-- Logs begin at Mon 2022-10-31 04:25:06 UTC, end at Mon 2022-10-31 07:01:49 UTC. -- Oct 31 04:55:27.815644 n-d-862355-5 systemd[1]: Starting Devstack devstack@keystone.service... Oct 31 04:55:27.822887 n-d-862355-5 devstack@keystone.service[81986]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 04:55:27 2022] *** Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: nodename: n-d-862355-5 Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: machine: x86_64 Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: clock source: unix Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: pcre jit disabled Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: detected number of CPU cores: 4 Oct 31 04:55:27.825064 n-d-862355-5 devstack@keystone.service[81986]: current working directory: / Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: detected binary path: /usr/bin/uwsgi-core Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: your processes number limit is 47680 Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: your memory page size is 4096 bytes Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: detected max file descriptor number: 2048 Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: lock engine: pthread robust mutexes Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: thunder lock: enabled Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 31 04:55:27.825622 n-d-862355-5 devstack@keystone.service[81986]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 04:55:27.866431 n-d-862355-5 devstack@keystone.service[81986]: Python main interpreter initialized at 0x55ada20ef9c0 Oct 31 04:55:27.866431 n-d-862355-5 devstack@keystone.service[81986]: python threads support enabled Oct 31 04:55:27.866431 n-d-862355-5 devstack@keystone.service[81986]: your server socket listen backlog is limited to 100 connections Oct 31 04:55:27.866431 n-d-862355-5 devstack@keystone.service[81986]: your mercy for graceful operations on workers is 90 seconds Oct 31 04:55:27.866816 n-d-862355-5 devstack@keystone.service[81986]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 04:55:27.866906 n-d-862355-5 devstack@keystone.service[81986]: *** Operational MODE: preforking *** Oct 31 04:55:27.867176 n-d-862355-5 devstack@keystone.service[81986]: *** uWSGI is running in multiple interpreter mode *** Oct 31 04:55:27.867176 n-d-862355-5 devstack@keystone.service[81986]: spawned uWSGI master process (pid: 81986) Oct 31 04:55:27.867382 n-d-862355-5 systemd[1]: Started Devstack devstack@keystone.service. Oct 31 04:55:27.868497 n-d-862355-5 devstack@keystone.service[81986]: spawned uWSGI worker 1 (pid: 81999, cores: 1) Oct 31 04:55:27.868497 n-d-862355-5 devstack@keystone.service[81986]: spawned uWSGI worker 2 (pid: 82000, cores: 1) Oct 31 04:55:27.868497 n-d-862355-5 devstack@keystone.service[81986]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 04:55:32.225296 n-d-862355-5 devstack@keystone.service[81999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 04:55:32.225296 n-d-862355-5 devstack@keystone.service[81999]: from cryptography.utils import int_from_bytes Oct 31 04:55:32.226136 n-d-862355-5 devstack@keystone.service[81999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 04:55:32.226136 n-d-862355-5 devstack@keystone.service[81999]: from cryptography.utils import int_from_bytes Oct 31 04:55:32.226365 n-d-862355-5 devstack@keystone.service[82000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 04:55:32.226365 n-d-862355-5 devstack@keystone.service[82000]: from cryptography.utils import int_from_bytes Oct 31 04:55:32.226365 n-d-862355-5 devstack@keystone.service[82000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 04:55:32.226365 n-d-862355-5 devstack@keystone.service[82000]: from cryptography.utils import int_from_bytes Oct 31 04:55:32.276088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 04:55:32.276270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 04:55:32.276354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 04:55:32.276446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 04:55:32.276521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] command line args: [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 04:55:32.276598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] command line args: [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 04:55:32.276735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 04:55:32.276877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 04:55:32.277513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ================================================================================ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 04:55:32.277707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] admin_token = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.277843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ================================================================================ {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 04:55:32.277949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] config_dir = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] admin_token = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] config_source = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] debug = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] config_dir = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.278970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] config_source = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] debug = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.279995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_config_append = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_dir = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_config_append = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.280970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_dir = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_file = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.281857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.282928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.283925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.284042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.284160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.286621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.286752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.286752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.286999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.286999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] publish_errors = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] publish_errors = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.287968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] standard_threads = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.288922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] standard_threads = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.289040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.289160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.289279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.289392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.289504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] use_journal = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] use_json = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] use_journal = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] use_stderr = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] use_json = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] use_syslog = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.290909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] use_stderr = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.291030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.291144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] use_syslog = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.291256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.291368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 04:55:32.291486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.291600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.291600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.291820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.291820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.292933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.293915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.294892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.295843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.296904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.297928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.298902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.299943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.300983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.301955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.302872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.303990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.304950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.305974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.306986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.307979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.308928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.309994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.310927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.311949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.312922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.313930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.314994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.315904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.external = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.external = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.316979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.password = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.password = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] auth.token = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.token = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.317898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.318958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.319976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.320892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.321922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.322995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.323116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.323229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.323349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.323462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.323583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.323696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.324336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.324336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.324552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.324664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.324786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.324900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.325921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.326943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.327977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.328908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.329907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.330932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.331959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.332070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.332182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.332556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.332675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.332675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.332887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.333925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.334998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.335912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.336938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.337977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.338921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.339034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.339146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.339265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.339452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.340519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.340640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.340754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.340867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.341932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.342924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.343931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.344954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.345902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.346974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.347890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.348923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.349950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] role.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] role.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] role.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] role.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.350919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.351927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.352071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.352442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.352559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.352672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.352784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.352897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.353961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.354894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.355932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.356960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.357888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.358939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.359973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.360994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.361994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.connection = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.362930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.363995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.364908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.365945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.366904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.367016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.367128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.367249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 04:55:32.367364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 04:55:32.367364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 04:55:32.394542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.394779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.395014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.396019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.396257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.396488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.405012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.413002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.435721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.435952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.436261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.436573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.490477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.492790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.541197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.541436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.543253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.543564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.611903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.612158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.612460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.612690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.612915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.613137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.641672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.641986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.642141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.642387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.642621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.642847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.643067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.686985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.687229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.687465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.687691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.687916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.688140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.702433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.702668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.702900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.703131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.703359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.703583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.703801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.716019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.729550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.729787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.730113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.730513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.730850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.731079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.731302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.739678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.742611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.742806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.743036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.743264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.743486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.743706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.743924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 04:55:32.748655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.748874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 04:55:32.749228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.749437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 04:55:32.749721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.749992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.750540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.750817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.754498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.754714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 04:55:32.755058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.755262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 04:55:32.755542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.755811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.756086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.756350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.760212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.760500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.760783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.761075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.766573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.766858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.767133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.767427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.768769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.771694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.771988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.772283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.772578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.772872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.773144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.773424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.773708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.774102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.774414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.774498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.774692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.777444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.777735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.778024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.778338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.778631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.778897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.779172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.779452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.779730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.780116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.780391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.797485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.798997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.799288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.802939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.804411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.804700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.805717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.806008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.806327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.810097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.810409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.810699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.813308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.813599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.817129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.817420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.817783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.818089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.818411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.818700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.818981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.819272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.819568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.819856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.821537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.821832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.822122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.822432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.822712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.822991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.823264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.823539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.835632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.835919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.839187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.840003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.840620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.843888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.843989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.844197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.847167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.847781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.851936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.854027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.854741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.856981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.857288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.857580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.857882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.858234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.858489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.859424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.863463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.863941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.864269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.865713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.866217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.867471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.874289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.874591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.874865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.875139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.882038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.883652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.885183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.885475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.889045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.889338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.889734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.890025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.890342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.892883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.893194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.893515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.894125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.901747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.902778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.903348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.903643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.903961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.904233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.904756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.908146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.910783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.912340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.912623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.915315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.915610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.916023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.916315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.916601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.919991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.922943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.925838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.927391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.927929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.928218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.928607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.928896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.929012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.929185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.929307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.929466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.929598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.929757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.936032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.937513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.940544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.940841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.941133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.941418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.945435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.948428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.949769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.950061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.950374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.952114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.953535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.955191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.955498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.955787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.958269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.958562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.958852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.959141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.959419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.959698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.959981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.960273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.960557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.960830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.961105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.961375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.961661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.961965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.962191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.963653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.967508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.967804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.968094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.968378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.976204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.976500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.976794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.984016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 04:55:32.984306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.984605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.984888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.985171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.985452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.985734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.986020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.986329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.986625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.986903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.987169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.987447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.987721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 04:55:32.996009 n-d-862355-5 devstack@keystone.service[81999]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ada20ef9c0 pid: 81999 (default app) Oct 31 04:55:32.999269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79a87-2185-4b4d-b93c-ecc00d3165c4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:32.999561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79a87-2185-4b4d-b93c-ecc00d3165c4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:32.999841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79a87-2185-4b4d-b93c-ecc00d3165c4 None None] PATH_INFO: `/v3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:33.005518 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Oct 31 04:55:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:33.021484 n-d-862355-5 devstack@keystone.service[82000]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ada20ef9c0 pid: 82000 (default app) Oct 31 04:55:39.739163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:39.739662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:39.739662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:39.740963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:55:39.749383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:39.749966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:39.749966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:39.821345 n-d-862355-5 devstack@keystone.service[82000]: INFO dbcounter [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] Registered counter for database keystone Oct 31 04:55:39.840649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 04:55:39.846729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writer thread running {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 04:55:40.025008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG passlib.handlers.bcrypt [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82000) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 04:55:40.025395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG passlib.handlers.bcrypt [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82000) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 04:55:40.083362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:40.084994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:40.215246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 04:55:40.661610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:40.731111 n-d-862355-5 devstack@keystone.service[81999]: INFO dbcounter [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] Registered counter for database keystone Oct 31 04:55:40.752743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG oslo_db.sqlalchemy.engines [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 04:55:40.758866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writer thread running {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 04:55:40.878104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5973dbd-43e1-48ee-b454-1e8daafec817 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:40.882395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:40.883030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:40.883317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:40.883595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:40.892590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:40.943619 n-d-862355-5 devstack@keystone.service[81999]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 04:55:40.943917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f938-9f9f-466d-865b-da9926c3c1f6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:40.954271 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 31 04:55:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 04:55:40.960240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:40.975099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a473f-ccdf-4894-ac60-692791961ebc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:40.979725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:40.980945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:40.981233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:40.981510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] PATH_INFO: `/v3/projects/f366121cda9844abacd920de806ce5fd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:40.983006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=f366121cda9844abacd920de806ce5fd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:41.035385 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 04:55:41.035737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e949c12-3f3a-46cf-9db8-2caaf65452c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:41.040277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 04:55:40 2022] GET /identity/v3/projects/f366121cda9844abacd920de806ce5fd => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:43.156268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea5a7-b1f9-4480-9406-f9016ef24170 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:43.156871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea5a7-b1f9-4480-9406-f9016ef24170 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:43.156871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea5a7-b1f9-4480-9406-f9016ef24170 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:43.160984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:43.166289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:43.166680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:43.166912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:43.187527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:43.189047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:43.196924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 04:55:43.467091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea5a7-b1f9-4480-9406-f9016ef24170 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:43.479322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea5a7-b1f9-4480-9406-f9016ef24170 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:43.483592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8a84-1eb7-4bc2-b458-ffa51a2caa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:43.484197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8a84-1eb7-4bc2-b458-ffa51a2caa07 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:43.484482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8a84-1eb7-4bc2-b458-ffa51a2caa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:43.484755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8a84-1eb7-4bc2-b458-ffa51a2caa07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:43.492310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8a84-1eb7-4bc2-b458-ffa51a2caa07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:43.494064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8a84-1eb7-4bc2-b458-ffa51a2caa07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:43.502946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 31 04:55:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 04:55:43.508257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:43.517873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5dd25-ea5c-4d00-90d7-98ace491fdd9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:43.522245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237bdc0-9d47-496e-83a9-b782598298a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:43.522873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237bdc0-9d47-496e-83a9-b782598298a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:43.523157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237bdc0-9d47-496e-83a9-b782598298a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:43.523436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237bdc0-9d47-496e-83a9-b782598298a7 admin admin] PATH_INFO: `/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:43.524751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237bdc0-9d47-496e-83a9-b782598298a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=f880513b9a944eaeb8e9a0b21dc38a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:43.526633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237bdc0-9d47-496e-83a9-b782598298a7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:43.528729 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Oct 31 04:55:43 2022] GET /identity/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:45.712307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae82b-5a6d-4369-917c-1cc36ba9d3f7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:45.712803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae82b-5a6d-4369-917c-1cc36ba9d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:45.712803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae82b-5a6d-4369-917c-1cc36ba9d3f7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:45.714112 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:45.719687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:45.720084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:45.720238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:45.738827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:45.740010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:45.780682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ffa51-19d8-4f90-8c75-ef569e6c50ae None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:45.781098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ffa51-19d8-4f90-8c75-ef569e6c50ae None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:45.781388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ffa51-19d8-4f90-8c75-ef569e6c50ae None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:45.782748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:55:45.787715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:45.788003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:45.788282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:45.821873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:55:45.831290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG passlib.handlers.bcrypt [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81999) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 04:55:45.831703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG passlib.handlers.bcrypt [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81999) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 04:55:45.880928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:45.882557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:45.981546 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:55:46.093658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.119326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:46.202126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac268-b31d-4831-9d92-3fbb198bdff0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.236804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.237378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.237656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.237924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.249222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:55:46.254094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:55:46.257926 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:55:46.259035 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:55:46.259996 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:55:46.265429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.350749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:46.361708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdbf42-86e4-4089-9e67-243c4949b11f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.364032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:46.370907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b97c6-b1a9-4e94-9df3-c7205f160a65 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.399339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.400214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.400589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.400867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.402093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.403561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.405344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.405964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.406281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.406563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.407230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:55:46.407538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.408920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.414704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.sql.core [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 04:55:46.414704 n-d-862355-5 devstack@keystone.service[81999]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 04:55:46.414704 n-d-862355-5 devstack@keystone.service[81999]: [parameters: {'id': '19df073d8b7b47eaa7f58fc82dd9512e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 04:55:46.414704 n-d-862355-5 devstack@keystone.service[81999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 04:55:46.421419 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:55:46.426971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:55:46.433987 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 04:55:46.434997 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application yield resource Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise self.value Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application session.commit() Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 04:55:46.436113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.flush() Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application compat.raise_( Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 04:55:46.437290 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 04:55:46.438506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:55:46.439460 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [parameters: {'id': '19df073d8b7b47eaa7f58fc82dd9512e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 04:55:46.440740 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:55:46.441785 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 9/16] 10.222.0.23 () {60 vars in 1137 bytes} [Mon Oct 31 04:55:46 2022] POST /identity/v3/domains => generated 190 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:55:46.442969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.529819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa3cfc-8009-4b15-8612-f54bdd9dd87a None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.540162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a62f7-5039-4cb0-aae1-452e5e457ab6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.565993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.566652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.566931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.567202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] PATH_INFO: `/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.568372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] RBAC: Authorizing `identity:get_user(user_id=f880513b9a944eaeb8e9a0b21dc38a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.569830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.571405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:55:46 2022] GET /identity/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:55:46.576827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.577460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.577689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.577969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.578275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.592958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:46.597081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.598571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:55:46.615338 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:55:46.616374 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:55:46.617646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:55:46.617646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:55:46.617646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:46.617646 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:55:46.622433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.646826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:46.681051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba003-0923-4a3a-bfe2-3b5195f43f92 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.716149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.716779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.717059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.717329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.718477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.719924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.721476 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:55:46.727098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:46.727556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aea62-b3d0-46eb-8cd3-c9ee43b64fba None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.761721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.762383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.762664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.762942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.763591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:55:46.763898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.765305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a160fa3-5fac-49f8-b51a-ab2a54ed9533 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.782998 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:55:46.809904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:46.830390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3b63a-182b-4b0a-9b8c-89462573c836 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:46.866997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4106b-6742-4930-9d08-4149f457592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:46.867685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4106b-6742-4930-9d08-4149f457592f None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:46.867988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4106b-6742-4930-9d08-4149f457592f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:46.868247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4106b-6742-4930-9d08-4149f457592f None admin] PATH_INFO: `/v3/domains/default/users/f880513b9a944eaeb8e9a0b21dc38a8c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:46.870291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4106b-6742-4930-9d08-4149f457592f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f880513b9a944eaeb8e9a0b21dc38a8c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:46.872329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4106b-6742-4930-9d08-4149f457592f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:46.989372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 10/21] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Oct 31 04:55:46 2022] PUT /identity/v3/domains/default/users/f880513b9a944eaeb8e9a0b21dc38a8c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 04:55:49.399150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cfde-2386-46dc-8999-c9980b0dd0f4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:49.400149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cfde-2386-46dc-8999-c9980b0dd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:49.400630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cfde-2386-46dc-8999-c9980b0dd0f4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:49.402741 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:49.408713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5964-fde6-474e-b1fc-d499d3a6c2a2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:49.409127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5964-fde6-474e-b1fc-d499d3a6c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:49.409296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5964-fde6-474e-b1fc-d499d3a6c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:49.434553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8e4b5964-fde6-474e-b1fc-d499d3a6c2a2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:49.436432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8e4b5964-fde6-474e-b1fc-d499d3a6c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:49.496331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880221-ed4b-40f2-9fd0-14899b2ee89c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:49.496625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880221-ed4b-40f2-9fd0-14899b2ee89c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:49.496910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880221-ed4b-40f2-9fd0-14899b2ee89c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:49.498577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 13/23] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:49.521522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985d48-ad7e-420e-96a1-f3517e519c79 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:49.521817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985d48-ad7e-420e-96a1-f3517e519c79 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:49.522099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985d48-ad7e-420e-96a1-f3517e519c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:49.540460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 11/24] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:49.556266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-18985d48-ad7e-420e-96a1-f3517e519c79 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:49.557485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18985d48-ad7e-420e-96a1-f3517e519c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:49.649299 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 14/25] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:49.860597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca349-b54c-4960-8331-b7a47d137f5b None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:49.861153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca349-b54c-4960-8331-b7a47d137f5b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:49.861603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca349-b54c-4960-8331-b7a47d137f5b None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:49.866271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 12/26] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:49.872753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:49.873121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:49.873476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:49.903593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:49.904806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:49.909176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:49.991836 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:50.038241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7877b-3cff-48e4-a51d-66d725b40e60 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.038820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7877b-3cff-48e4-a51d-66d725b40e60 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.039281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7877b-3cff-48e4-a51d-66d725b40e60 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.040859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 13/28] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:50.042702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.046659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.046948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.047481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.075615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:50.076835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:50.194372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:50.202526 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 14/29] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:55:50.211123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.213885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60035962-ae60-4432-bd1c-36fdfc67b23e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:50.302385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:50.303040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.303326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.303606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.319256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:50.322136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:50.324768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:55:50.353522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:55:50.354479 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:55:50.355955 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:55:50.355955 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:55:50.355955 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:55:50.357857 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 16/30] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:55:50.365784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.427016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588da2-8d7e-470d-8f3d-5de6e7166773 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:50.496119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:50.496692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.496978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.497257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.521196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:55:50.527060 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:55:50.528149 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:55:50.528911 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:55:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:55:50.534225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.582068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aec43-b865-4253-8a0d-2a9ea1b8cab6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:50.599002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:50.660722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:50.661848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.662436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.662949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.663930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:55:50.664426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:50.665725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52b570-8363-4d0b-96e3-8c972c00f6c0 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:50.666262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:50.685059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:50.686416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.704365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf0dd-c320-49b9-955f-05e4f729d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:50.704994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf0dd-c320-49b9-955f-05e4f729d6f4 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.705285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf0dd-c320-49b9-955f-05e4f729d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.705567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf0dd-c320-49b9-955f-05e4f729d6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.706292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf0dd-c320-49b9-955f-05e4f729d6f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:50.707820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf0dd-c320-49b9-955f-05e4f729d6f4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:50.726223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 16/33] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 04:55:50 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:55:50.727713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe66ba-93f4-4761-aa74-b0aee7b7e52d None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.728007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe66ba-93f4-4761-aa74-b0aee7b7e52d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.728290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe66ba-93f4-4761-aa74-b0aee7b7e52d None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.734194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 17/34] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:50.734194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe66ba-93f4-4761-aa74-b0aee7b7e52d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.753286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:50.822431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520966-e69c-44b3-8fa6-c53fa9f8473f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:50.867932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:50.868924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.869389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.869853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.870895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:55:50.871451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:50.873270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:50.877382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe66ba-93f4-4761-aa74-b0aee7b7e52d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:50.894621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 18/35] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:55:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:50.895917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:50.904841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:50.926548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1e928-6df4-4756-aa34-2347dacd664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:50.927187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e928-6df4-4756-aa34-2347dacd664f None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.927476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e928-6df4-4756-aa34-2347dacd664f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.927757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e928-6df4-4756-aa34-2347dacd664f None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.928764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1e928-6df4-4756-aa34-2347dacd664f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:50.930519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1e928-6df4-4756-aa34-2347dacd664f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:50.958207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 04:55:50 2022] POST /identity/v3/roles => generated 219 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:55:50.958207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:50.958207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:50.958207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:50.975609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:50.976901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:51.083515 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:51.084348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:51.093602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa602-cede-456e-890e-a2a1a59b3cf7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:51.135040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:51.161343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca0c65-c081-47e4-b40a-9d938932c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:51.161977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0c65-c081-47e4-b40a-9d938932c7a3 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.162302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0c65-c081-47e4-b40a-9d938932c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.162693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0c65-c081-47e4-b40a-9d938932c7a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.163376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca0c65-c081-47e4-b40a-9d938932c7a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:51.164965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca0c65-c081-47e4-b40a-9d938932c7a3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:51.248637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4498d-5c76-441f-a2ac-b23343cd76c3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:51.267110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:51.308420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:51.309497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.310037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.310514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] PATH_INFO: `/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.312017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] RBAC: Authorizing `identity:get_user(user_id=f880513b9a944eaeb8e9a0b21dc38a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:51.313748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:51.316017 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:55:51 2022] GET /identity/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:51.319166 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:55:50 2022] POST /identity/v3/projects => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:55:51.329035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:51.424369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751afb25-ddc5-42fb-b8a1-de6ce69fdb0b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.424690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751afb25-ddc5-42fb-b8a1-de6ce69fdb0b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.424919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751afb25-ddc5-42fb-b8a1-de6ce69fdb0b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.426501 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 20/40] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:55:51.435213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.435514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.435895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.462949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:51.465825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:51.468320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5500446-0956-485b-8442-82954ae15a54 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:51.511829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:51.513012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.513296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.513567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.514746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:51.516259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:51.517838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 21/41] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:51.518698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:51.544194 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:51.545318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:51.576439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:51.643690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df9257-8fd2-4521-8df7-66d5db9db025 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:51.657138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:51.665138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d27cba-a040-45da-bded-162005cba4d7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:51.681495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:51.681780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.682065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.682368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.683741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:51.685170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:51.701226 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 22/43] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 04:55:51 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:55:51.703827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:51.704466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.704758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.705037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.705796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.domain.id=default, user.id=f880513b9a944eaeb8e9a0b21dc38a8c) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:55:51.706111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:51.707774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:51.718139 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Oct 31 04:55:51 2022] GET /identity/v3/role_assignments?user.id=f880513b9a944eaeb8e9a0b21dc38a8c&scope.domain.id=default&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 530 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:51.815262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:51.932631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab59ae-b368-4385-a02f-10ee45f07ef8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:51.940496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:51.972574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c188700-03cd-4bcb-84a3-d90d73cee7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:51.973252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188700-03cd-4bcb-84a3-d90d73cee7e3 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:51.973529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188700-03cd-4bcb-84a3-d90d73cee7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:51.973804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188700-03cd-4bcb-84a3-d90d73cee7e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:51.974978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c188700-03cd-4bcb-84a3-d90d73cee7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:51.976421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c188700-03cd-4bcb-84a3-d90d73cee7e3 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:51.978248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:51.984823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:52.081735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22fdf-e206-408d-8c47-8ce633d38694 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:52.115528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766de0-8d4e-40cb-b219-e78340dea2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:52.116134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766de0-8d4e-40cb-b219-e78340dea2f0 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:52.116416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766de0-8d4e-40cb-b219-e78340dea2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:52.116691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766de0-8d4e-40cb-b219-e78340dea2f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:52.117347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766de0-8d4e-40cb-b219-e78340dea2f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:52.118808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766de0-8d4e-40cb-b219-e78340dea2f0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:52.144862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:55:51 2022] POST /identity/v3/projects => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:55:54.321971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92bb1-406a-4522-b871-6e4b7d72adb3 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:54.322456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92bb1-406a-4522-b871-6e4b7d72adb3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:54.322566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92bb1-406a-4522-b871-6e4b7d72adb3 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:54.324427 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:54.329655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:54.330039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:54.330266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:54.348414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:54.349593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:54.357334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:54.416198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:54.686535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92bb1-406a-4522-b871-6e4b7d72adb3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:54.785640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92bb1-406a-4522-b871-6e4b7d72adb3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:54.817835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089e71e-5b7d-4139-91f4-312391ae3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:54.818485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089e71e-5b7d-4139-91f4-312391ae3714 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:54.818776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089e71e-5b7d-4139-91f4-312391ae3714 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:54.819057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089e71e-5b7d-4139-91f4-312391ae3714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:54.820169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089e71e-5b7d-4139-91f4-312391ae3714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:54.821611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089e71e-5b7d-4139-91f4-312391ae3714 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:54.823171 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:54.829147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:54.928128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2d023-8b50-486c-8a00-eb7476c88977 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:54.960791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce7523-4ed2-477d-b816-d74f14fb9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:54.961352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7523-4ed2-477d-b816-d74f14fb9f08 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:54.961639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7523-4ed2-477d-b816-d74f14fb9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:54.961918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7523-4ed2-477d-b816-d74f14fb9f08 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:54.962612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce7523-4ed2-477d-b816-d74f14fb9f08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:54.964669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce7523-4ed2-477d-b816-d74f14fb9f08 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:54.978526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:54.989713 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Oct 31 04:55:54 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:55:57.104631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545317-3644-458f-83cd-f8ec4dcfeb61 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:57.105170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545317-3644-458f-83cd-f8ec4dcfeb61 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:57.105255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545317-3644-458f-83cd-f8ec4dcfeb61 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:57.106650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 26/51] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:55:57.112318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:57.112684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:57.112891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:57.131076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:55:57.132255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:55:57.197077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:55:57.466994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a545317-3644-458f-83cd-f8ec4dcfeb61 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:57.511470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:57.567776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a545317-3644-458f-83cd-f8ec4dcfeb61 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:57.600374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c11879-2607-40da-ac32-7229cda06465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:57.600997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11879-2607-40da-ac32-7229cda06465 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:57.601281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11879-2607-40da-ac32-7229cda06465 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:57.601560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11879-2607-40da-ac32-7229cda06465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:57.602957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c11879-2607-40da-ac32-7229cda06465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:57.604389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c11879-2607-40da-ac32-7229cda06465 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:57.606483 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:55:57.612082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:55:57.712356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b26d-5089-4268-ac65-f235abdf4fd7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:55:57.737010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:55:57.748923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246c1b6-5630-406a-a207-b59b842b58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:55:57.749545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246c1b6-5630-406a-a207-b59b842b58bf None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:55:57.749837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246c1b6-5630-406a-a207-b59b842b58bf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:55:57.750120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246c1b6-5630-406a-a207-b59b842b58bf None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:55:57.750816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246c1b6-5630-406a-a207-b59b842b58bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:55:57.752273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246c1b6-5630-406a-a207-b59b842b58bf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:55:57.883131 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 27/54] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:55:57 2022] POST /identity/v3/users => generated 275 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:01.156260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e5e5e-806d-439c-978f-b5e982bd5e53 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.156828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e5e5e-806d-439c-978f-b5e982bd5e53 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.156828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e5e5e-806d-439c-978f-b5e982bd5e53 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.158249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 28/55] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:01.160190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b5d9-dae4-4ffb-8db4-0a23d238b8bd None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.160998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b5d9-dae4-4ffb-8db4-0a23d238b8bd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.161495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b5d9-dae4-4ffb-8db4-0a23d238b8bd None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.163165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac47d39-658b-49b9-b571-cb8f8e54ad5f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.163446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac47d39-658b-49b9-b571-cb8f8e54ad5f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.163862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac47d39-658b-49b9-b571-cb8f8e54ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.163963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 28/56] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:01.168749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e8ab6-4627-4975-a761-b29e7e9b6976 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.169262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e8ab6-4627-4975-a761-b29e7e9b6976 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.169721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e8ab6-4627-4975-a761-b29e7e9b6976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.187521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fac47d39-658b-49b9-b571-cb8f8e54ad5f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:01.193545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fac47d39-658b-49b9-b571-cb8f8e54ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:01.200833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-397e8ab6-4627-4975-a761-b29e7e9b6976 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:01.202043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-397e8ab6-4627-4975-a761-b29e7e9b6976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:01.314930 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 29/57] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:01.316459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 29/58] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:01.525924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6ac3-f916-497d-99bc-38da775f7a3d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.526136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bab71-2798-44ca-ab8b-fd53e5de8444 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.526251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6ac3-f916-497d-99bc-38da775f7a3d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.526584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6ac3-f916-497d-99bc-38da775f7a3d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.527073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bab71-2798-44ca-ab8b-fd53e5de8444 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.527547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bab71-2798-44ca-ab8b-fd53e5de8444 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.528327 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 30/59] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:01.529458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 30/60] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:01.533341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.533638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.533927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.538042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.538380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.538665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.568146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:01.569351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:01.576758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:01.577939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:01.645695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:01.676866 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 31/61] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:01.677731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:01.692830 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:01.694201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:01.768358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:01.869151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9559b-3361-42fd-903f-cdabf0709ca0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:01.873338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360b3a0-8773-44d4-8a64-1f39abceb645 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:01.925538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:01.926242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.926536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.926817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.942863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:01.943535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:01.943818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:01.944096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:01.955462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:01.961948 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:01.962809 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:01.963564 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 32/63] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:01.975120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:01.977095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:01.983014 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:01.983849 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:01.986080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 32/64] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:56:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:01.990109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.029215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.078938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.081979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aa2b3-a506-4022-b396-0c4ba52b831c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.102776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239bc5-bd64-44f9-9591-f2328592a62f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.116931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.117555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.117842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.118120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.118904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:02.119288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.121224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.129330 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 33/65] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.130124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.142053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.142717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.142998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.143271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.153130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:02.157896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:02.159152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:02.159921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.237728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f008-54c0-4d60-a78e-e8dd9b710e8b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.251057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.265797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac358c8-bfb5-4433-93af-5fdee4ed88c8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.271124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.271748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.272034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.272312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.273286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:02.273286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.274705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c0b5-e239-4207-afc3-479b443bad8d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.282804 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 34/67] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.283967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f22c5-404b-4fe6-ba1d-1763326e10c1 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.284260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f22c5-404b-4fe6-ba1d-1763326e10c1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.284656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f22c5-404b-4fe6-ba1d-1763326e10c1 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.289894 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 35/68] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:02.289894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f22c5-404b-4fe6-ba1d-1763326e10c1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.305779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.306456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.306738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.307024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.317618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.318369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:02.323255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:02.324174 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:02.324916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:02.325536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.401021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f22c5-404b-4fe6-ba1d-1763326e10c1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.427690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef741-068c-40c8-84d0-74cf127ea09b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.434971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.435648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.435937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.436222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] PATH_INFO: `/v3/users/a7ec17a4307243f9949b663f6ed4bc17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.451869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ec17a4307243f9949b663f6ed4bc17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.453339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.454987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/users/a7ec17a4307243f9949b663f6ed4bc17 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.459858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.463079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.463695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.464576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.464849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.465511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:02.465825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.467247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b348ff-b244-44cc-92ec-b2837f7ab69b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.475451 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.476591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.476877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.477153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.494253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:02.495952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:02.503078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.541263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.560460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dabddb-883f-4836-b500-f15fe9fe94e7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.563100 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 36/72] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:02.563925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.598129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.599226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.599520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.599967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] PATH_INFO: `/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.601140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] RBAC: Authorizing `identity:get_user(user_id=f880513b9a944eaeb8e9a0b21dc38a8c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.602876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.604489 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.605272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.685651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd33346-2627-481d-937f-822f6dc6b733 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.715118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9abd6-2d13-4ba6-8bf7-3fcc2d9da900 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.723844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.724476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.724761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.725039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.725786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:02.726015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.727686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.736428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 37/74] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.741613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.747082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.753003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.753649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.753936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.754247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.755389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.756817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.763808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.763808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.782500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:02.856143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe669c-21e0-4633-9fa2-3c63146529fd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.868509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c15d0-536d-4939-a3b4-176ba6e292f8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:02.889652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.890324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.890608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.890886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] PATH_INFO: `/v3/users/a7ec17a4307243f9949b663f6ed4bc17` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.892043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ec17a4307243f9949b663f6ed4bc17)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.893517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.895140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/users/a7ec17a4307243f9949b663f6ed4bc17 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.895905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.904141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:02.904785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:02.905072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:02.905353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:02.906527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:02.907972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:02.909582 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 39/77] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:02.910332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:02.967501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.000275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.016852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361c20-bb62-47c2-b886-beee50e62084 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.052901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.053591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.053881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.054188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/a7ec17a4307243f9949b663f6ed4bc17/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.056249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] RBAC: Authorizing `identity:create_grant(project_id=3c557bf323204c77b7e0db2fbf1b6ad7, user_id=a7ec17a4307243f9949b663f6ed4bc17, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.057937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.073803 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:02 2022] PUT /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/a7ec17a4307243f9949b663f6ed4bc17/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:03.074717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.111031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a42f9-57d3-436d-8c41-3d79d764e659 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.152571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.153249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.153534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.153821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] PATH_INFO: `/v3/users/a7ec17a4307243f9949b663f6ed4bc17` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.155082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] RBAC: Authorizing `identity:get_user(user_id=a7ec17a4307243f9949b663f6ed4bc17)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.156601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.158317 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 39/79] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:02 2022] GET /identity/v3/users/a7ec17a4307243f9949b663f6ed4bc17 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:03.159111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.206203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78fac-6426-4747-bfb6-40066c5d8c4e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.244444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.245122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.245378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.245662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.246923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.248394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.250314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:03.251089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.268803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.291746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d41f-27a2-4933-ab3c-19acd8121dbc None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.326879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.327521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.327806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.328083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] PATH_INFO: `/v3/projects/17dd2d074116428c99601165f4eaf8cd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.329231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] RBAC: Authorizing `identity:get_project(project_id=17dd2d074116428c99601165f4eaf8cd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.330745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.337082 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:03 2022] GET /identity/v3/projects/17dd2d074116428c99601165f4eaf8cd => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:03.337082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.346932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.366552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810fd8-001b-4629-9a68-c2c8380166e6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.403313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.403995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.404286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.404573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/f880513b9a944eaeb8e9a0b21dc38a8c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.406596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c557bf323204c77b7e0db2fbf1b6ad7, user_id=f880513b9a944eaeb8e9a0b21dc38a8c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.408038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.423465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 42/82] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:03 2022] PUT /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/f880513b9a944eaeb8e9a0b21dc38a8c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:03.424330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.462691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2823c1-6da6-4d04-8e12-a2da9c55adfb None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.510208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.512983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.513584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.514038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.516325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.518597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.521617 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 41/83] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:03 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:03.522763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.540534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.576205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a89b3e-6d5e-4711-875a-c9a8fdcdece8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.618246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.619234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.619644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.619934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.620924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.622957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.642608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.651261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 43/84] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:03 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:03.653328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:03.673011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68ddd-d62f-4091-a7c1-40fe30f71f14 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.722631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb428f-d2ac-4fc9-8704-7ed89da102c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.723606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb428f-d2ac-4fc9-8704-7ed89da102c6 None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.724053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb428f-d2ac-4fc9-8704-7ed89da102c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.724472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb428f-d2ac-4fc9-8704-7ed89da102c6 None admin] PATH_INFO: `/v3/projects/17dd2d074116428c99601165f4eaf8cd/users/a7ec17a4307243f9949b663f6ed4bc17/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.726857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb428f-d2ac-4fc9-8704-7ed89da102c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=17dd2d074116428c99601165f4eaf8cd, user_id=a7ec17a4307243f9949b663f6ed4bc17, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.728988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb428f-d2ac-4fc9-8704-7ed89da102c6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.747076 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:03 2022] PUT /identity/v3/projects/17dd2d074116428c99601165f4eaf8cd/users/a7ec17a4307243f9949b663f6ed4bc17/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:03.786637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664e7ad-e7ee-4371-841a-78cde17d738f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:03.824621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:03.833163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68957-3bf4-41d2-9720-e132f46562d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:03.834329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68957-3bf4-41d2-9720-e132f46562d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:03.834890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68957-3bf4-41d2-9720-e132f46562d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:03.835432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68957-3bf4-41d2-9720-e132f46562d2 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/a7ec17a4307243f9949b663f6ed4bc17/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:03.838646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68957-3bf4-41d2-9720-e132f46562d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c557bf323204c77b7e0db2fbf1b6ad7, user_id=a7ec17a4307243f9949b663f6ed4bc17, role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:03.841137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68957-3bf4-41d2-9720-e132f46562d2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:03.870253 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 44/86] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:03 2022] PUT /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/a7ec17a4307243f9949b663f6ed4bc17/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:05.663213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d9b71-7038-47ef-9b27-958986063583 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:05.663700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d9b71-7038-47ef-9b27-958986063583 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:05.663700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d9b71-7038-47ef-9b27-958986063583 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:05.665081 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 43/87] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:05.679901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d0bcd-2cfc-43d9-ab55-9d83303c9773 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:05.680826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d0bcd-2cfc-43d9-ab55-9d83303c9773 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:05.681300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d0bcd-2cfc-43d9-ab55-9d83303c9773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:05.707139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6b9d0bcd-2cfc-43d9-ab55-9d83303c9773 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:05.708738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b9d0bcd-2cfc-43d9-ab55-9d83303c9773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:05.790356 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:06.330956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d9b71-7038-47ef-9b27-958986063583 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:06.389664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b771b-08b5-4660-86cf-8af830f4b8cf None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.390328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b771b-08b5-4660-86cf-8af830f4b8cf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.390798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b771b-08b5-4660-86cf-8af830f4b8cf None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.392332 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 46/89] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:06.408220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411fec-b24b-4f22-9dc5-3dd4a0a2b5a4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.408803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411fec-b24b-4f22-9dc5-3dd4a0a2b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.409366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411fec-b24b-4f22-9dc5-3dd4a0a2b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.439693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4d411fec-b24b-4f22-9dc5-3dd4a0a2b5a4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:06.441878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d411fec-b24b-4f22-9dc5-3dd4a0a2b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:06.528548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d9b71-7038-47ef-9b27-958986063583 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:06.554243 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 47/90] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:06.554243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb0476-4fef-4e1a-98b9-f9df709edf9d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.554243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb0476-4fef-4e1a-98b9-f9df709edf9d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.554243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb0476-4fef-4e1a-98b9-f9df709edf9d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.554574 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 48/91] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:06.561183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.561473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.561756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.599175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:06.600401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:06.608600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:06.609558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.610038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.610901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.622195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:06.632169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:06.638934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:06.639780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:06.640551 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:06.646811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:06.703765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:06.740576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 49/93] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:06.843748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db821dce-72fd-4252-b69d-25213c3a8d8e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:06.889564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:06.890201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.890490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.890767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.891436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:06.891740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:06.893119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c2b2-2f9d-4e5e-bc55-09996b9f111b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:06.905586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:06.911715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:06.983881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acbc6a-c2fc-47fc-951c-2c2985b94424 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.984179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acbc6a-c2fc-47fc-951c-2c2985b94424 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.984492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acbc6a-c2fc-47fc-951c-2c2985b94424 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:06.985844 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 46/95] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:06.991439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:06.991718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:06.991988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.023972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:07.025168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:07.096663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.115146 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 47/96] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:07.115996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.117290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cd33d-b175-4922-9501-9ccb62bdad4b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.188092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.188747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.189034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.189313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] PATH_INFO: `/v3/users/a7ec17a4307243f9949b663f6ed4bc17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.192706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ec17a4307243f9949b663f6ed4bc17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:07.194352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:07.196093 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 50/97] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:06 2022] GET /identity/v3/users/a7ec17a4307243f9949b663f6ed4bc17 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:07.201915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.226305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf265ac-369a-48b3-906f-2f8ab04fc446 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.264478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e5f79-7e5a-479a-b8b4-11ccee42ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.265482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e5f79-7e5a-479a-b8b4-11ccee42ff10 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.265908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e5f79-7e5a-479a-b8b4-11ccee42ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.266352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e5f79-7e5a-479a-b8b4-11ccee42ff10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.275061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.279634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e5f79-7e5a-479a-b8b4-11ccee42ff10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-2a5e5f79-7e5a-479a-b8b4-11ccee42ff10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:07.285780 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:07.286873 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:07.287805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:07.290273 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 48/98] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:07.291696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0407609-93f4-473e-86a8-d5c019f7a021 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.292800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0407609-93f4-473e-86a8-d5c019f7a021 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.293439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0407609-93f4-473e-86a8-d5c019f7a021 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.295065 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 49/99] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:07.296018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0407609-93f4-473e-86a8-d5c019f7a021 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.342862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a13714-f79b-4784-ac5c-0189ea54a898 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.357922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.379626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca5a49-b392-4a4e-a74c-03086901cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.380563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5a49-b392-4a4e-a74c-03086901cff8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.381047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5a49-b392-4a4e-a74c-03086901cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.381548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5a49-b392-4a4e-a74c-03086901cff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.432221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0407609-93f4-473e-86a8-d5c019f7a021 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.455534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca5a49-b392-4a4e-a74c-03086901cff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:07.457186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca5a49-b392-4a4e-a74c-03086901cff8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:07.486070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.487309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.488214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.488673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.501184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:07.506697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:07.507539 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 50/100] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:07.513697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.522726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.580348 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 04:56:07.581948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.582264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.582547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.601373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:07.602954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:07.619353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e257d0f-881f-4ac4-a948-aa865da3a522 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.628863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.657284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.658015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.658327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.658600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.659264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:07.659573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:07.661058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:07.673266 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:07.675508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.677566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 52/103] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:07.678435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.786558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.794315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607df8e-3d0f-4720-a571-b0127c23d241 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.798724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989a62-afd2-4c0a-845d-5e02438d0127 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.832480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.833301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.833652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.833996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.838612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:07.840077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:07.840543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:07.840991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:07.841941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:07.842445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:07.844072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:07.845739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:07.851367 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:07.852236 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:07.853266 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 52/104] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:07.853987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.856984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 53/105] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:07.858000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:07.898474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:07.967133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5beb2-338b-40f5-8d8d-20327ba72021 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:07.976115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911353ec-801f-443c-a88b-35fe6069605c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.001429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.002263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.002636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.003027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] PATH_INFO: `/v3/users/a7ec17a4307243f9949b663f6ed4bc17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.004358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ec17a4307243f9949b663f6ed4bc17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.005927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.007534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 54/106] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/users/a7ec17a4307243f9949b663f6ed4bc17 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.008297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.014851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.015501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.015798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.016081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.017226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.018732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.019622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.020674 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 53/107] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:07 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.021452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.110286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77476389-9395-4866-933a-798e4eb760b0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.116451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.120984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d4bdb-fa53-471f-965a-664e745b9916 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.143880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.144495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.144781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.145068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.145742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:08.146054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.147458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a870633-0e58-467d-aa5f-b39172f45a80 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.155456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 55/108] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.155678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.156312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.156568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27414ce-2816-497d-8213-58fd55be5532 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.156654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.156851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] PATH_INFO: `/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.156936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27414ce-2816-497d-8213-58fd55be5532 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.157125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27414ce-2816-497d-8213-58fd55be5532 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.157989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] RBAC: Authorizing `identity:get_user(user_id=f880513b9a944eaeb8e9a0b21dc38a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.158357 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 56/109] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:08.159057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27414ce-2816-497d-8213-58fd55be5532 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.163660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.165263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 54/110] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/users/f880513b9a944eaeb8e9a0b21dc38a8c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.166023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.231242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.264526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27414ce-2816-497d-8213-58fd55be5532 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.267812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6139d7-9ddf-40c2-8c1a-8bcf6e5842e0 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.300872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.301522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.301810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.302089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.302902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885b55c-c05e-429b-9138-abb9ded865be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.303524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b55c-c05e-429b-9138-abb9ded865be None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.303815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b55c-c05e-429b-9138-abb9ded865be None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.304094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b55c-c05e-429b-9138-abb9ded865be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.312309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:08.317558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:08.318549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:08.319283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 57/111] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:08.319917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.341720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.376383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885b55c-c05e-429b-9138-abb9ded865be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.377845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885b55c-c05e-429b-9138-abb9ded865be None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.420098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ec71-568c-482c-89d6-e1113e495036 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.447953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.455697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.456324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.456614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.456895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.457633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] RBAC: Adding query filter params (role.id=09d7d7b078e14ccfafcd918e3a06fe8a, scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7, user.id=a7ec17a4307243f9949b663f6ed4bc17) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:08.457948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.459440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.465257 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 58/112] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/role_assignments?user.id=a7ec17a4307243f9949b663f6ed4bc17&scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.466045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.475936 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 55/113] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:08.478844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.479207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.480126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.500406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:08.501618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:08.571273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.581053 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:08.581925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.608207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a385df-0bd7-46a0-9623-ba2564f03753 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.656563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.656854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.657943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.657943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] PATH_INFO: `/v3/users/a7ec17a4307243f9949b663f6ed4bc17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.658876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ec17a4307243f9949b663f6ed4bc17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.660416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.662069 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/users/a7ec17a4307243f9949b663f6ed4bc17 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.662937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.744638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.745493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df64170-2e89-46d7-ac50-ef18cc404160 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.784835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.785455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.785735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.786014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.797785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890d8c-2e77-41ad-8093-d4c022c68247 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.839758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:08.841103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:08.841399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:08.841685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:08.842400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:08.842715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.844098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.858475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 60/116] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:08.858475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:08.862496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:08.871864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:08.873369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:08.966332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1297a-4385-4c8a-bd17-1eba165f94a1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:08.990878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.002824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.002992 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 57/117] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:09.003505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.003710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.003812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.003960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] PATH_INFO: `/v3/projects/17dd2d074116428c99601165f4eaf8cd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.005118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] RBAC: Authorizing `identity:get_project(project_id=17dd2d074116428c99601165f4eaf8cd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.006605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.012475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 61/118] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:08 2022] GET /identity/v3/projects/17dd2d074116428c99601165f4eaf8cd => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.012475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.112492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.119112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17e35-52dd-45fb-8504-58d19c449cac None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.123120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78858a2-a60d-424c-a493-8532f6327a2d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.157297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.157916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.158238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.158515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.162288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.163316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.163801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.164277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] PATH_INFO: `/v3/users/16f7ebb7419c4d7cb26f85f9e0dd685b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.181227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] RBAC: Authorizing `identity:get_user(user_id=16f7ebb7419c4d7cb26f85f9e0dd685b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.182805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.184503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 62/119] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/users/16f7ebb7419c4d7cb26f85f9e0dd685b => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.185301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.232215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.233715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.249011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.304386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a89cf-b87c-41aa-9cfe-678b2932c774 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.340218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.340864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.341158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.341435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.342636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.343893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.345024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.346716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 63/120] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.347489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.352872 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 58/121] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:09.354461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.460861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d860d05-6d13-4e09-8c05-779a8277ba93 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.474362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b00cb-7d99-4e94-857f-a43926eb8531 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.484996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.505824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.506501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.506957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.507422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.509027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.512967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.518476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 64/122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.518476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.520216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.520963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.521243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.521521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.522284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] RBAC: Adding query filter params (role.id=09d7d7b078e14ccfafcd918e3a06fe8a, scope.project.id=17dd2d074116428c99601165f4eaf8cd, user.id=a7ec17a4307243f9949b663f6ed4bc17) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:09.522589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.524043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.533518 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 59/123] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/role_assignments?user.id=a7ec17a4307243f9949b663f6ed4bc17&scope.project.id=17dd2d074116428c99601165f4eaf8cd&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.534350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.635826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.668316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72face6d-d747-4f49-bfaf-bffe68d9d2cc None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.701249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3a65-6a1c-4a65-83f6-e70d75ebedca None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.708239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.708902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.709194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.709472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.710687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.712141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.713827 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 65/124] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.715241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.747942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.748350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.748747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.749494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.749687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.751327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.776857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.784946 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 60/125] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:56:09 2022] POST /identity/v3/projects => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:09.785753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.836584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd275-d986-482d-b1f9-18130c76ae07 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.875662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.876322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.876610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.876912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.878122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.879631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.881549 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 66/126] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.882133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:09.908994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec470-5104-4ab3-bd5f-ab2010867c6b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:09.925890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:09.953531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:09.954466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:09.954751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:09.955170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:09.955785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7, user.id=f880513b9a944eaeb8e9a0b21dc38a8c) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:09.956102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:09.957593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:09.965086 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 61/127] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/role_assignments?user.id=f880513b9a944eaeb8e9a0b21dc38a8c&scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:09.965916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:10.005234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cef28-f889-42c3-a7a6-b2e416da3893 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:10.035804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:10.050858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d57c36-0d6c-4ff9-9ccd-add6e1c85eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:10.052092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57c36-0d6c-4ff9-9ccd-add6e1c85eb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:10.052092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57c36-0d6c-4ff9-9ccd-add6e1c85eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:10.052092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57c36-0d6c-4ff9-9ccd-add6e1c85eb0 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/16f7ebb7419c4d7cb26f85f9e0dd685b/roles/fb4666cc4eef444aa2c3060cb67b2d3a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:10.055428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d57c36-0d6c-4ff9-9ccd-add6e1c85eb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c557bf323204c77b7e0db2fbf1b6ad7, user_id=16f7ebb7419c4d7cb26f85f9e0dd685b, role_id=fb4666cc4eef444aa2c3060cb67b2d3a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:10.056895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d57c36-0d6c-4ff9-9ccd-add6e1c85eb0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:10.078171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 67/128] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:09 2022] PUT /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/users/16f7ebb7419c4d7cb26f85f9e0dd685b/roles/fb4666cc4eef444aa2c3060cb67b2d3a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:10.112358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2ee6-6825-448c-927d-0eb771a2fbe7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:10.159101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:10.159664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:10.159949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:10.160225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:10.160981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] RBAC: Adding query filter params (role.id=0269db5298cf4fd9878693e71b3f2b89, scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7, user.id=a7ec17a4307243f9949b663f6ed4bc17) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:10.161295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:10.162859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97519426-cace-412b-9c5d-e23a819807f3 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:10.170905 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 62/129] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:09 2022] GET /identity/v3/role_assignments?user.id=a7ec17a4307243f9949b663f6ed4bc17&scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7&role.id=0269db5298cf4fd9878693e71b3f2b89 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:12.133478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77d4ba-cd67-4cf6-b49f-1b66c403b08b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.133990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77d4ba-cd67-4cf6-b49f-1b66c403b08b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.134115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77d4ba-cd67-4cf6-b49f-1b66c403b08b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.135511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 68/130] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:12.140986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39288a0d-5c1b-4f62-82c6-caf0d8e526fb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.141367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39288a0d-5c1b-4f62-82c6-caf0d8e526fb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.141542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39288a0d-5c1b-4f62-82c6-caf0d8e526fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.160644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-39288a0d-5c1b-4f62-82c6-caf0d8e526fb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:12.161896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-39288a0d-5c1b-4f62-82c6-caf0d8e526fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:12.199590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:12.232705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 63/131] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:12.278407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0ee02-f67a-4aa5-ab49-0ac75cd323a7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.278698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0ee02-f67a-4aa5-ab49-0ac75cd323a7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.278975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0ee02-f67a-4aa5-ab49-0ac75cd323a7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.280314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 69/132] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:12.285586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.285885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.286180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.304599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:12.305766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:12.372835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 64/133] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:12.500316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0ee02-f67a-4aa5-ab49-0ac75cd323a7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:12.598337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0ee02-f67a-4aa5-ab49-0ac75cd323a7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:12.631192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:12.631829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.632118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.632400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.633508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:12.634994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:12.637143 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 70/134] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:12.642793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:12.645292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:12.693639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:12.738882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:12.741803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c993-321d-405e-a3a7-f5ccb8a01b42 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:12.745772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55c4e-814b-40d7-b206-b4b4602d48bf None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:12.775313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:12.775932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.776813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.777381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.778054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:12.779547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:12.780206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:12.780851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.781140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.781421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.791455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:12.796641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:12.797491 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:12.798339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 71/135] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:12.803734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:12.809278 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 65/136] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:12 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:12.914524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed8e8-f8d5-4bc2-838c-73e5c12dbde4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:12.926239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:12.953070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:12.953706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:12.953988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:12.954307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:12.954993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:12.955299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:12.956704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:12.966895 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 72/137] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:12.972587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:13.075616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f461995-7bbb-43ea-a03e-50c2417adb6f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:13.112942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:13.113609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:13.113893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:13.114213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] PATH_INFO: `/v3/users/16f7ebb7419c4d7cb26f85f9e0dd685b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:13.115362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] RBAC: Authorizing `identity:get_user(user_id=16f7ebb7419c4d7cb26f85f9e0dd685b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:13.116828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:13.118852 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 66/138] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:12 2022] GET /identity/v3/users/16f7ebb7419c4d7cb26f85f9e0dd685b => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:13.125116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:13.231748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d607-3c29-4548-b558-e516ba7b7377 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:13.273920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:13.274618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:13.274908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:13.275196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:13.324560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:13.357165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:13.358590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:13.464718 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 73/139] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 04:56:13.471306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:13.499973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:13.581232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bece-225a-4da0-86e5-417ce90b4313 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:13.618267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94db942-cf6f-49ac-91a0-4219948931cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:13.619319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94db942-cf6f-49ac-91a0-4219948931cb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:13.619845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94db942-cf6f-49ac-91a0-4219948931cb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:13.620444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94db942-cf6f-49ac-91a0-4219948931cb None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:13.621821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94db942-cf6f-49ac-91a0-4219948931cb None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:13.623560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94db942-cf6f-49ac-91a0-4219948931cb None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:13.625733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 67/140] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:13 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:13.631782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:13.705693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:13.738484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d180dd-668f-4e68-828a-6a8d2d4ac765 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:13.773902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:13.774873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:13.775370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:13.775838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:13.777333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] RBAC: Adding query filter params (role.id=fb4666cc4eef444aa2c3060cb67b2d3a, scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7, user.id=16f7ebb7419c4d7cb26f85f9e0dd685b) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:13.777881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:13.779526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bac4ef-a4cd-47da-a35d-8b78337174a5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:13.786453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 74/141] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:13 2022] GET /identity/v3/role_assignments?user.id=16f7ebb7419c4d7cb26f85f9e0dd685b&scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7&role.id=fb4666cc4eef444aa2c3060cb67b2d3a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:15.079967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd987-4e26-4ba4-b16b-b0a467dee323 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.080525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd987-4e26-4ba4-b16b-b0a467dee323 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.080525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd987-4e26-4ba4-b16b-b0a467dee323 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.081873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 68/142] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:15.087633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f53c-f343-4d56-a98b-a192b42dbc5d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.088101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f53c-f343-4d56-a98b-a192b42dbc5d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.088181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f53c-f343-4d56-a98b-a192b42dbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.107380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ff01f53c-f343-4d56-a98b-a192b42dbc5d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:15.108590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ff01f53c-f343-4d56-a98b-a192b42dbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:15.179597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 75/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:15.251150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347903-6938-4000-b475-cd338aff3936 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.251438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347903-6938-4000-b475-cd338aff3936 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.251901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347903-6938-4000-b475-cd338aff3936 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.253318 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 69/144] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:15.261547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59886-72d8-487e-bc1b-d2bb5756b435 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.262122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59886-72d8-487e-bc1b-d2bb5756b435 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.262605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59886-72d8-487e-bc1b-d2bb5756b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.282279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-79c59886-72d8-487e-bc1b-d2bb5756b435 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:15.283500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-79c59886-72d8-487e-bc1b-d2bb5756b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:15.348383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:15.358188 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 76/145] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:15.375537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5611c-dac6-400d-9b17-0fac153fe2e2 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.375827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5611c-dac6-400d-9b17-0fac153fe2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.376104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5611c-dac6-400d-9b17-0fac153fe2e2 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.381275 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 70/146] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:15.382859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.383151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.383427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.402128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:15.403089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:15.449005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5611c-dac6-400d-9b17-0fac153fe2e2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.472211 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 77/147] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:15.544472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:15.554123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5611c-dac6-400d-9b17-0fac153fe2e2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:15.588089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:15.589793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.590086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.590392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.600815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:15.607065 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:15.607919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:15.608887 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 71/148] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:15.613985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.628951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.722066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eba2b-0b97-443e-8a2a-db7d5937a84f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:15.739822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6d0b-830e-444f-9fe4-bc3fe549a689 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:15.750175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:15.759005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:15.759623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.759901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.760171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.761484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:15.761867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:15.763282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:15.771403 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 78/149] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:15.772189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.775421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:15.776823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.777118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.777408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.787896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:15.793736 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:15.794686 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:15.795485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 72/150] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:15.796217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.811285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:15.875079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115773a-3455-4f1c-8659-4d2a0ca0b35d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:15.895879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12a89-d58c-461d-a782-6c5f51379138 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:15.908760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:15.909399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.909683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.909957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.911097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:15.912536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:15.914125 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 79/151] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:15.914912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.934126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:15.934796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:15.935079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:15.935354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] PATH_INFO: `/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:15.948974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] RBAC: Authorizing `identity:get_user(user_id=dcfaa3dda4ad4a9ea727c46bb9a20702)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:15.950465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:15.952220 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 73/152] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:15 2022] GET /identity/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:15.952899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:15.970634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:16.014863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890aba5-4aac-4763-9ed9-cb839feb2513 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.023049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:16.049241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.049853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.050138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.050440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.051112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:16.051420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.052794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.054236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aadaa1-dbcb-480e-a3f8-db6d6e4f17cb None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.060747 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 80/153] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:16.061532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:16.087605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.088218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.089007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.089410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.090055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.091565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.113108 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 74/154] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:15 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:16.118348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:16.181678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa499a-9eee-42a5-bb5d-d879cedca7a9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.201656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:16.223058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.223724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.224030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.224295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.225481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.226992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.229297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 81/155] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:16 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:16.235764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:16.236740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483796f-e171-416b-961f-a034050f03c6 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.267871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:16.279471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.280290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.280574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.281305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] PATH_INFO: `/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.282719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] RBAC: Authorizing `identity:get_user(user_id=dcfaa3dda4ad4a9ea727c46bb9a20702)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.284388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.286175 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 75/156] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:16 2022] GET /identity/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:16.293949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:16.372899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b502f-1165-4da9-9ce7-58208bc9d9b2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.412994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ba8ac-87a0-4fd0-8c9a-7ceceb447927 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.420290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.420983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.421266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.421562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/dcfaa3dda4ad4a9ea727c46bb9a20702/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.427092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b, user_id=dcfaa3dda4ad4a9ea727c46bb9a20702, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.428961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.447141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 82/157] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:16 2022] PUT /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/dcfaa3dda4ad4a9ea727c46bb9a20702/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 04:56:16.452980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13fac4-7cfa-46f1-9760-a32061fe338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.453696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13fac4-7cfa-46f1-9760-a32061fe338f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.453980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13fac4-7cfa-46f1-9760-a32061fe338f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.454409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13fac4-7cfa-46f1-9760-a32061fe338f None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.455617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13fac4-7cfa-46f1-9760-a32061fe338f None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.457114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13fac4-7cfa-46f1-9760-a32061fe338f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.459201 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 76/158] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:16 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:16.465410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:16.522900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:16.590620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62aaf-c329-4c0e-9542-3551fa688d50 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:16.632881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e921e-00bc-4608-913c-484a9e2ef418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:16.633554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e921e-00bc-4608-913c-484a9e2ef418 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:16.633832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e921e-00bc-4608-913c-484a9e2ef418 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:16.634110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e921e-00bc-4608-913c-484a9e2ef418 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/dcfaa3dda4ad4a9ea727c46bb9a20702/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:16.637269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e921e-00bc-4608-913c-484a9e2ef418 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b, user_id=dcfaa3dda4ad4a9ea727c46bb9a20702, role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:16.638776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e921e-00bc-4608-913c-484a9e2ef418 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:16.657618 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 83/159] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:16 2022] PUT /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/dcfaa3dda4ad4a9ea727c46bb9a20702/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:18.462076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e380b3-26eb-4186-b364-ce6e0389c8f9 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.462646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e380b3-26eb-4186-b364-ce6e0389c8f9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.462646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e380b3-26eb-4186-b364-ce6e0389c8f9 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.465492 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 77/160] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:18.470958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3814c-fb18-4046-a1a2-e750e19059e3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.471399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3814c-fb18-4046-a1a2-e750e19059e3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.471491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3814c-fb18-4046-a1a2-e750e19059e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.490478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dea3814c-fb18-4046-a1a2-e750e19059e3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:18.491668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dea3814c-fb18-4046-a1a2-e750e19059e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:18.542070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4604-2257-4c79-9332-3f9a4c2fdc7f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.542262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4604-2257-4c79-9332-3f9a4c2fdc7f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.542878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4604-2257-4c79-9332-3f9a4c2fdc7f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.543887 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 78/161] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:18.554179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b5d9-62a0-4035-bb0e-590bd9711fd1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.554179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b5d9-62a0-4035-bb0e-590bd9711fd1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.554179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b5d9-62a0-4035-bb0e-590bd9711fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.571291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c6c3b5d9-62a0-4035-bb0e-590bd9711fd1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:18.572913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6c3b5d9-62a0-4035-bb0e-590bd9711fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:18.573068 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 84/162] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:18.638740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:18.646232 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 79/163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:18.677724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145281-564b-4142-93b1-c61668e8b919 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.678298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145281-564b-4142-93b1-c61668e8b919 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.678716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145281-564b-4142-93b1-c61668e8b919 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.680202 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 85/164] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:18.685632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45115f-aba9-49d7-af09-c5bc22f93ba7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.686084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45115f-aba9-49d7-af09-c5bc22f93ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.686550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45115f-aba9-49d7-af09-c5bc22f93ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.706570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fa45115f-aba9-49d7-af09-c5bc22f93ba7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:18.708033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa45115f-aba9-49d7-af09-c5bc22f93ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:18.780916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 80/165] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:18.868140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145281-564b-4142-93b1-c61668e8b919 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:18.878452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14967146-5a45-4561-bb29-c9caef513e53 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.878795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14967146-5a45-4561-bb29-c9caef513e53 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.879077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14967146-5a45-4561-bb29-c9caef513e53 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.880607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 81/166] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:18.886798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:18.887161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:18.887362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:18.912176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:18.913368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:18.916496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:18.989828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145281-564b-4142-93b1-c61668e8b919 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.002873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 82/167] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:19.004153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.033037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.033730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.034017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.034319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.047137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:19.053026 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:19.054003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:19.055353 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 86/168] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:19.059122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.075058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.126352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180cd4-b301-43cd-ac1c-9e4f3afb94d3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.161339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.161976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.162181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.162281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.162540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.163836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.165401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.171603 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 83/169] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.171603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.174357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ea4f4-b994-4e1f-aab9-fd488e6befa7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.212055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.212706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.213280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.214300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.224821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:19.230092 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:19.231061 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:19.231853 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 87/170] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:19.233226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.279398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222a99-ee96-47c0-9ac6-10f24c371edb None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.300030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.313768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.314412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.314694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.314966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.315629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:19.315929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.317303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.325697 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 84/171] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.326736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.337622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f6781-a6c0-4052-950a-c89318663cf1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.372055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.372667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.372949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.373225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.373884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.375361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.406488 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 88/172] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:19 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:19.406488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.426197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.433221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44442-a369-4f0d-b26f-a380f88843f0 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.472613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.473407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.473688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.473968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.474714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:19.475099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.476446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.487294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 85/173] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.488002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.541442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.552297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09527-a571-4a0c-b046-175b884ea9ce None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.591944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.592468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.592754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.593028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.605999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:19.609151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492f659-99f2-4fa5-847d-6efcb8d9f6bf None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:19.611546 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:19.612441 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:19.613214 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 89/174] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:19.613849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.649636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.650329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.650615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.653941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] PATH_INFO: `/v3/users/5b63b8c4acd1413c9cc4c1c42cffd4fe` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.671178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] RBAC: Authorizing `identity:get_user(user_id=5b63b8c4acd1413c9cc4c1c42cffd4fe)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.672596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.674443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 86/175] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/users/5b63b8c4acd1413c9cc4c1c42cffd4fe => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.677962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.708541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.743537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca633-cea3-4bea-af44-1b4543f47d7f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.787047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.787667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.787953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.788231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] PATH_INFO: `/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.789369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] RBAC: Authorizing `identity:get_user(user_id=dcfaa3dda4ad4a9ea727c46bb9a20702)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.791602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.793198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 90/176] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.794188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.809124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b3479-2d2b-4be7-a2f8-98667486743d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.811503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:19.853111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.853728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.854004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.854908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.855601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:19.855909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.857292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.865904 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 87/177] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.866628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.923807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ca97-285b-4c0e-b27c-eb12ecc94871 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.964161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:19.964812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:19.965098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:19.965539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:19.966958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:19.968580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:19.974311 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 91/178] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:19.974742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305be6-dbf6-4aa4-97dc-ffae61a25629 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:19.975272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:19.988461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.013242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.013864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.014140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.014442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.047913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.088354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.091127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.094856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326406-ee39-4d0d-97cc-44ccf3f0c6ec None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:20.132605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.133256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.133649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.133937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] PATH_INFO: `/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.135229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] RBAC: Authorizing `identity:get_user(user_id=dcfaa3dda4ad4a9ea727c46bb9a20702)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.137259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.139174 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 92/179] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/users/dcfaa3dda4ad4a9ea727c46bb9a20702 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:20.139831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:20.197101 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 88/180] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:20.198510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:20.234295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.261700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c262d9e-eece-47f7-b4b6-ece1fbc667c8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:20.264880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.303236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.304199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.304489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.304771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/5b63b8c4acd1413c9cc4c1c42cffd4fe/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.305760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4f39-1656-4507-b6d5-815ddb7f53cb None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:20.306796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b, user_id=5b63b8c4acd1413c9cc4c1c42cffd4fe, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.309582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.328360 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 93/181] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:20 2022] PUT /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/5b63b8c4acd1413c9cc4c1c42cffd4fe/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:20.329199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:20.373809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.374512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.374798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.375067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.522004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.523628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.556427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4ee95-233b-47dc-b7b5-cb0c99b5235d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:20.603798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.604520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.604789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.605072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.606773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.608296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.610196 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 94/182] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:20 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:20.615880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:20.622245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.627294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.679849 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 89/183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:20.685657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:20.799081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1385c-45c7-4a84-a66b-c47068303148 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:20.807803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8b7f-ce10-4392-9a0c-7320de648c00 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:20.850897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.851544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.851828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.852105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.857334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.858853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.863731 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 90/184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:20 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:20.866454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:20.867785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:20.868642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:20.869135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:20.869602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:20.870614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b, user.id=dcfaa3dda4ad4a9ea727c46bb9a20702) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:20.871157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:20.872788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674db9b-49c4-4466-a399-849aaf543704 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:20.884902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 95/185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:20 2022] GET /identity/v3/role_assignments?user.id=dcfaa3dda4ad4a9ea727c46bb9a20702&scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:20.906619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:20.984740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa532d-b0c8-41f1-95cb-cf305d015179 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:21.022935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:21.023573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:21.023856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:21.024133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:21.024886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] RBAC: Adding query filter params (role.id=0269db5298cf4fd9878693e71b3f2b89, scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b, user.id=dcfaa3dda4ad4a9ea727c46bb9a20702) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:21.025198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:21.026917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9081-e41c-4531-adb2-3e3280fbbd2e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:21.034062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 91/186] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:20 2022] GET /identity/v3/role_assignments?user.id=dcfaa3dda4ad4a9ea727c46bb9a20702&scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b&role.id=0269db5298cf4fd9878693e71b3f2b89 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:21.772437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22cae2-9800-4228-bb53-a510ef223c46 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:21.772937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22cae2-9800-4228-bb53-a510ef223c46 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:21.773012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22cae2-9800-4228-bb53-a510ef223c46 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:21.774362 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 96/187] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:21.779789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2e07-b0ea-4acc-a2cb-c36d76e634e9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:21.780176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2e07-b0ea-4acc-a2cb-c36d76e634e9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:21.780347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2e07-b0ea-4acc-a2cb-c36d76e634e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:21.799211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ed4f2e07-b0ea-4acc-a2cb-c36d76e634e9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:21.800599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ed4f2e07-b0ea-4acc-a2cb-c36d76e634e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:21.872783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 92/188] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:21.959965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4b10-2cef-4597-a3cf-15b8d3562be9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:21.960602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4b10-2cef-4597-a3cf-15b8d3562be9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:21.961082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4b10-2cef-4597-a3cf-15b8d3562be9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:21.962690 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 97/189] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:21.968240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:21.968791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:21.969272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:21.988392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:21.989873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:22.011274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:22.060475 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 93/190] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:22.140749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4b10-2cef-4597-a3cf-15b8d3562be9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.210917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:22.249046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4b10-2cef-4597-a3cf-15b8d3562be9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.287849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:22.288871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.289846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.290127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.301611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:22.307114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:22.308581 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:22.309356 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 98/191] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:22.315957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.332388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.422037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1431362-61c8-41c2-9bcd-8b79efd79ef9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.439795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e491fa-54a3-4691-b43a-2dbee2593aeb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.458078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:22.458730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.459010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.459286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.459977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:22.460285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:22.461673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:22.467560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:22.471736 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 94/192] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:22.477085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:22.477222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.477977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.478303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.478578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.480918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:22.482391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:22.486180 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 99/193] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:22.489192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.499292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:22.590885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509c176-99e9-4482-bd85-1d6536228954 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.597499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed053-345f-4cd3-9339-969a8b84ce53 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.626727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:22.627474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.627756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.628146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] PATH_INFO: `/v3/users/ca3ed251b5c0428896f6129ddc89c67d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.632843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:22.633472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.633756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.634034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.634731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:22.636241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:22.641893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] RBAC: Authorizing `identity:get_user(user_id=ca3ed251b5c0428896f6129ddc89c67d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:22.643563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:22.645521 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 95/194] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:22 2022] GET /identity/v3/users/ca3ed251b5c0428896f6129ddc89c67d => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:22.651279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.666505 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 100/195] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:22 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:22.742472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:22.772514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e51444-a56b-42f8-b7b8-8237de24dc8c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.811229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c179c00-6f58-452f-b73d-bec9477eb0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:22.812013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c179c00-6f58-452f-b73d-bec9477eb0ff None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.812236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c179c00-6f58-452f-b73d-bec9477eb0ff None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.812519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c179c00-6f58-452f-b73d-bec9477eb0ff None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.813823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c179c00-6f58-452f-b73d-bec9477eb0ff None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:22.815411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c179c00-6f58-452f-b73d-bec9477eb0ff None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:22.817321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:22 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:22.824407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:22.856207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09a1e-9daa-4394-8176-de293c0da949 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.856481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09a1e-9daa-4394-8176-de293c0da949 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.856688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09a1e-9daa-4394-8176-de293c0da949 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.858041 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 97/197] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:22.864352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:22.864629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:22.864903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:22.884969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:22.887157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:22.901200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:22.961507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4958-46d8-4bce-82e5-f0208f0c4527 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:22.975846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 98/198] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:23.000090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:23.000773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:23.001064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:23.001346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/ca3ed251b5c0428896f6129ddc89c67d/roles/fb4666cc4eef444aa2c3060cb67b2d3a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:23.003401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b, user_id=ca3ed251b5c0428896f6129ddc89c67d, role_id=fb4666cc4eef444aa2c3060cb67b2d3a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:23.004874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:23.020125 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 101/199] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:22 2022] PUT /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/users/ca3ed251b5c0428896f6129ddc89c67d/roles/fb4666cc4eef444aa2c3060cb67b2d3a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:23.262002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:23.344915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:23.372544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3105d9-39f2-4cff-b6c2-350c4ea23a9a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:23.407632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:23.408277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:23.408555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:23.408875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:23.419745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:23.424589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:23.425453 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:23.426246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:23.430291 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 99/200] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:23.432040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:23.544454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172cf2-c880-47ae-b7ba-cf8e723dd14a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:23.558420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:23.584055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:23.585080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:23.585555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:23.586017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:23.586919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:23.587412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:23.589683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:23.598854 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 102/201] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:23.608805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:23.712125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac41d-d594-4c15-a0ad-c39cee8a01c4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:23.748587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:23.749237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:23.749520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:23.749799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] PATH_INFO: `/v3/users/5b63b8c4acd1413c9cc4c1c42cffd4fe` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:23.750989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=5b63b8c4acd1413c9cc4c1c42cffd4fe)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:23.752448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:23.754053 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 100/202] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:23 2022] GET /identity/v3/users/5b63b8c4acd1413c9cc4c1c42cffd4fe => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:23.759737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:23.869039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d5c02-0ad8-43b7-a5b8-f34c99defd40 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:23.907873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:23.908755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:23.909240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:23.909681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:23.954684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:23.981798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:23.983536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:24.083007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 103/203] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:24.089046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:24.094771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:24.197553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c74a1-735e-4fe1-bbc0-22fb10dc6aa1 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:24.236245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed1c2-8e59-4486-9986-392c06d74c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:24.236951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed1c2-8e59-4486-9986-392c06d74c49 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:24.237236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed1c2-8e59-4486-9986-392c06d74c49 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:24.237510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed1c2-8e59-4486-9986-392c06d74c49 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:24.238661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed1c2-8e59-4486-9986-392c06d74c49 None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:24.240124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed1c2-8e59-4486-9986-392c06d74c49 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:24.242062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 101/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:24 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:24.248652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:24.328076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:24.355957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2df1f-78a8-4429-a944-4092961a77ec None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:24.391633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:24.392252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:24.392587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:24.392869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:24.393602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] RBAC: Adding query filter params (role.id=09d7d7b078e14ccfafcd918e3a06fe8a, scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b, user.id=5b63b8c4acd1413c9cc4c1c42cffd4fe) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:24.393913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:24.395371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a80c23-2578-463d-be26-f2e5b71b14cc None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:24.402628 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 104/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:24 2022] GET /identity/v3/role_assignments?user.id=5b63b8c4acd1413c9cc4c1c42cffd4fe&scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:25.068992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466173d-9034-46e0-b360-01b1da7235c0 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.069403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466173d-9034-46e0-b360-01b1da7235c0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.069674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466173d-9034-46e0-b360-01b1da7235c0 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.071291 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 102/206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:25.077069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68ca7-115f-4bd3-b245-48a8a686b8b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.077564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68ca7-115f-4bd3-b245-48a8a686b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.077632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68ca7-115f-4bd3-b245-48a8a686b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.096446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-56b68ca7-115f-4bd3-b245-48a8a686b8b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:25.097641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-56b68ca7-115f-4bd3-b245-48a8a686b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:25.169669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 105/207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:25.179600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd584c-ef5f-4d96-8196-2cc006378261 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.180038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd584c-ef5f-4d96-8196-2cc006378261 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.180154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd584c-ef5f-4d96-8196-2cc006378261 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.181660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 103/208] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:25.187103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.187394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.187671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.206049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:25.207250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:25.260124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bfd80-9622-49e6-b208-9c347c08cc6e None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.260500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bfd80-9622-49e6-b208-9c347c08cc6e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.260770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bfd80-9622-49e6-b208-9c347c08cc6e None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.262326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 104/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:25.267615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.267901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.268182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.279442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:25.285992 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:25.287378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:25.288586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:25.357570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:25.368413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 105/211] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:25.439117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:25.539125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125332d-f805-4380-909a-f9f265ce58ae None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:25.560122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:25.574200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:25.574846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.575125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.575396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.576480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:25.577924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:25.579651 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 107/212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:25.584697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:25.655731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:25.665277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de22952-bfa6-4456-86ea-b42e1e871d93 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:25.690723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c826f-8a5e-4bdb-bcbd-78de627ed538 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:25.699776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:25.700796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.701079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.701364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.711278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:25.716226 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:25.717296 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 106/213] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:25.722923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:25.726685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:25.727305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.727587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.728115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.728772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:25.730787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:25.754246 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 108/214] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:25 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:56:25.754246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:25.796705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:25.850784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc0af-c58b-4471-9395-8e4f02e78003 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:25.868912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e749-53fb-4948-b3a2-775c919cdfd3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:25.894593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:25.895255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.895536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.895841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.896158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:25.910601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:25.911150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:25.911433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:25.911716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:25.912397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:25.912560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:25.912711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:25.914119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:25.917726 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:25.918631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:25.919428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 107/215] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:25.923703 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 109/216] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:25.924996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:25.929421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:26.050244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762bce4-9ebb-4935-b1ba-8c141df25d21 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.059514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ae7cf-b2b7-42b3-b750-f48a945665c4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.086642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:26.101916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.103059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.103341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.103620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] PATH_INFO: `/v3/users/ae80f57dd0714a3086db184bfc46c9fa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.111477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.111477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.111477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.111477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.111846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:26.111846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.111846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.119222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] RBAC: Authorizing `identity:get_user(user_id=ae80f57dd0714a3086db184bfc46c9fa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.120775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.121215 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 108/217] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:26.122951 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 110/218] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:25 2022] GET /identity/v3/users/ae80f57dd0714a3086db184bfc46c9fa => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:26.126650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:26.128049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:26.180187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:26.238191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758a24-c618-4cb1-a142-688d17b9ed87 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.247577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74ef6a-f27e-4b57-8bd0-39492b0f02ad None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.274807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.275455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.275986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.276742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] PATH_INFO: `/v3/users/ca3ed251b5c0428896f6129ddc89c67d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.277658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] RBAC: Authorizing `identity:get_user(user_id=ca3ed251b5c0428896f6129ddc89c67d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.279246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.280979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 109/219] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:26 2022] GET /identity/v3/users/ca3ed251b5c0428896f6129ddc89c67d => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:26.286408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:26.295032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.295778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.296203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.296593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.297405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] RBAC: Adding query filter params (role.id=09d7d7b078e14ccfafcd918e3a06fe8a, user.id=ae80f57dd0714a3086db184bfc46c9fa, scope.system=all) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:26.297785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.299495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.305492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 111/220] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 04:56:26 2022] GET /identity/v3/role_assignments?user.id=ae80f57dd0714a3086db184bfc46c9fa&scope.system=all&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:26.342311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:26.399349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e4a6-dcce-402e-9460-f123d3314ede None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.438814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.439365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.439690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.439978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.514743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.516230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.566256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:26.619274 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 110/221] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 04:56:26.627459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:26.735500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5f7f-f645-4ef3-91a8-49213d8a55e4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.743690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:26.772566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f326b-cb0e-467d-b1e4-06c9c794fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.773256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f326b-cb0e-467d-b1e4-06c9c794fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.773543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f326b-cb0e-467d-b1e4-06c9c794fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.773821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f326b-cb0e-467d-b1e4-06c9c794fdf2 None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.774986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f326b-cb0e-467d-b1e4-06c9c794fdf2 None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.776478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f326b-cb0e-467d-b1e4-06c9c794fdf2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.778297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 112/222] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:26 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:26.783995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:26.895621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ea21-46a9-49b4-bdbf-950a8b1254be None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:26.930719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:26.931328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:26.931606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:26.931880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:26.932754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] RBAC: Adding query filter params (role.id=fb4666cc4eef444aa2c3060cb67b2d3a, scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b, user.id=ca3ed251b5c0428896f6129ddc89c67d) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:26.933121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:26.934639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9a505-8e80-459f-8d87-d8e19fc47e88 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:26.940634 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 111/223] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:56:26 2022] GET /identity/v3/role_assignments?user.id=ca3ed251b5c0428896f6129ddc89c67d&scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b&role.id=fb4666cc4eef444aa2c3060cb67b2d3a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:28.147246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8ff7f-edb0-45c9-ac25-24860165c7b7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.147759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8ff7f-edb0-45c9-ac25-24860165c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.147834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8ff7f-edb0-45c9-ac25-24860165c7b7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.149271 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 113/224] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:28.155177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ee36-2049-4565-8153-17b3ddc0ac2c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.155600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ee36-2049-4565-8153-17b3ddc0ac2c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.155769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ee36-2049-4565-8153-17b3ddc0ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.164742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944ddd-7ce3-44cf-a44c-eea4be7db260 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.165025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944ddd-7ce3-44cf-a44c-eea4be7db260 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.165303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944ddd-7ce3-44cf-a44c-eea4be7db260 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.167976 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 114/225] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:28.172820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b083f-9808-4052-8803-49f4acda3165 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.173105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b083f-9808-4052-8803-49f4acda3165 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.173381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b083f-9808-4052-8803-49f4acda3165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.175854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0509ee36-2049-4565-8153-17b3ddc0ac2c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:28.177039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0509ee36-2049-4565-8153-17b3ddc0ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:28.188282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:28.192764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4a7b083f-9808-4052-8803-49f4acda3165 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:28.193972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a7b083f-9808-4052-8803-49f4acda3165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:28.264431 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 112/226] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:28.266109 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 115/227] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:28.493611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd1c50-67f6-49f4-b041-b8a31703d826 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.493930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd1c50-67f6-49f4-b041-b8a31703d826 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.494103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd1c50-67f6-49f4-b041-b8a31703d826 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.495723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 113/228] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:28.500541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.500828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.501100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.519906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:28.521075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:28.537911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd1c50-67f6-49f4-b041-b8a31703d826 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:28.587257 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 116/229] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:28.588102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:28.624984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:28.657183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd1c50-67f6-49f4-b041-b8a31703d826 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:28.694941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:28.695269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837ca5b-c297-435c-aa26-dc004fd8a68b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:28.695578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.695855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.696125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.697224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:28.699759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:28.702192 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 114/230] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:28.706720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:28.722060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:28.738680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:28.739325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.739606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.739879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.751911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:28.756626 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:28.757499 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:28.758312 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:28.764100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:28.817961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05072e-aabd-4c1d-971a-0dffbbc1b1e5 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:28.854708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:28.855306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.855582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.855852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] PATH_INFO: `/v3/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.856481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:28.857918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:28.863356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:28.871997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16a11-d38c-4418-89b8-4ea6c921bed9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:28.874692 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 115/232] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Oct 31 04:56:28 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:56:28.875487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:28.925924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:28.926585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:28.926859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:28.927394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:28.927821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:28.928126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:28.929541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:28.944297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:28.946079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:28.955533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:28.993407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a0da-db57-452e-9f28-9eba6e93eb63 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:29.031341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:29.032001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:29.032281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:29.032554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:29.045261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:29.050625 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:29.051498 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:29.052317 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 116/234] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:29.060410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:29.079706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db534-b153-41e4-9382-5838a22f5fba None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:29.120881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:29.121647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:29.121930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:29.122239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] PATH_INFO: `/v3/users/7cc3867c960841e08469960a9d274bec` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:29.138111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] RBAC: Authorizing `identity:get_user(user_id=7cc3867c960841e08469960a9d274bec)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:29.139592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:29.141386 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 119/235] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:28 2022] GET /identity/v3/users/7cc3867c960841e08469960a9d274bec => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:29.146912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:29.163398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:29.175177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0bd9-0929-4de9-bcad-3eca74968b43 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:29.206509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:29.214006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:29.214668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:29.214953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:29.215229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:29.215898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:29.216204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:29.217604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:29.226922 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 117/236] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:29.232598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:29.258918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce202b-3b27-480a-9ea8-95919de53516 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:29.298048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:29.298808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:29.299094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:29.299496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:29.300233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] RBAC: Adding query filter params (role.id=fb4666cc4eef444aa2c3060cb67b2d3a, user.id=7cc3867c960841e08469960a9d274bec, scope.system=all) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:29.300546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:29.302116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:29.308588 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 120/237] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 04:56:29 2022] GET /identity/v3/role_assignments?user.id=7cc3867c960841e08469960a9d274bec&scope.system=all&role.id=fb4666cc4eef444aa2c3060cb67b2d3a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:29.355874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a84212-f3bf-42a6-a784-7721f1bcfe7b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:29.398764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222d70d-4f04-40c8-860b-95a69540ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:29.400143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d70d-4f04-40c8-860b-95a69540ba13 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:29.400819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d70d-4f04-40c8-860b-95a69540ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:29.401505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d70d-4f04-40c8-860b-95a69540ba13 None admin] PATH_INFO: `/v3/users/ae80f57dd0714a3086db184bfc46c9fa` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:29.403655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222d70d-4f04-40c8-860b-95a69540ba13 None admin] RBAC: Authorizing `identity:get_user(user_id=ae80f57dd0714a3086db184bfc46c9fa)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:29.406402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222d70d-4f04-40c8-860b-95a69540ba13 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:29.409328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 118/238] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:29 2022] GET /identity/v3/users/ae80f57dd0714a3086db184bfc46c9fa => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:29.415462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:29.503609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:29.527428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bc86c-2ec1-4fe5-a2fa-dbcc188c9ba7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:29.563527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a8d0c-5ef8-47b4-bea7-c80b62aa141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:29.564151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a8d0c-5ef8-47b4-bea7-c80b62aa141f None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:29.564432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a8d0c-5ef8-47b4-bea7-c80b62aa141f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:29.564704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a8d0c-5ef8-47b4-bea7-c80b62aa141f None admin] PATH_INFO: `/v3/system/users/ae80f57dd0714a3086db184bfc46c9fa/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:29.566116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a8d0c-5ef8-47b4-bea7-c80b62aa141f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ae80f57dd0714a3086db184bfc46c9fa, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:29.567505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a8d0c-5ef8-47b4-bea7-c80b62aa141f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:29.582180 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 121/239] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Oct 31 04:56:29 2022] PUT /identity/v3/system/users/ae80f57dd0714a3086db184bfc46c9fa/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:31.085322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c0db-08df-497b-9356-1125f0004a39 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.085839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c0db-08df-497b-9356-1125f0004a39 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.085839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c0db-08df-497b-9356-1125f0004a39 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.087392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 119/240] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:31.093313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750c79-1fb8-4837-9303-504413e1391c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.093693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750c79-1fb8-4837-9303-504413e1391c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.093873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750c79-1fb8-4837-9303-504413e1391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.112065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-37750c79-1fb8-4837-9303-504413e1391c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:31.113249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-37750c79-1fb8-4837-9303-504413e1391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:31.183502 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 122/241] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:31.453234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8c0db-08df-497b-9356-1125f0004a39 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:31.518207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:31.521553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed1c02-84a6-4e8b-b38c-a280bc882236 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.521876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed1c02-84a6-4e8b-b38c-a280bc882236 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.522115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed1c02-84a6-4e8b-b38c-a280bc882236 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.523492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 123/242] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:31.530034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a4c0-25a3-4ae7-9a8b-af168d5ff933 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.530443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a4c0-25a3-4ae7-9a8b-af168d5ff933 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.530728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a4c0-25a3-4ae7-9a8b-af168d5ff933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.549078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2b60a4c0-25a3-4ae7-9a8b-af168d5ff933 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:31.550312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b60a4c0-25a3-4ae7-9a8b-af168d5ff933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:31.565700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8c0db-08df-497b-9356-1125f0004a39 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:31.603515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:31.604335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.604617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.604891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.605995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:31.607477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:31.609207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 120/243] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:31.614899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:31.623800 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 124/244] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:31.728463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acd113-ed49-42fd-8afa-b14172962566 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:31.754377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6580481-4985-4677-be69-91ada1934c50 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.754665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6580481-4985-4677-be69-91ada1934c50 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.754943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6580481-4985-4677-be69-91ada1934c50 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.756414 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 125/245] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:31.760895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:31.762347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.762607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.762886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.768017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:31.768798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:31.769231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:31.769349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:31.769508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] PATH_INFO: `/v3/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:31.770188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:31.771816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:31.783791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:31.784996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:31.790489 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 121/246] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Oct 31 04:56:31 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:56:31.862966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:31.897406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.008711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b534ab2-5a25-438f-89ea-45936e96a1c6 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.042468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.043379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.043860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.044302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.055020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:32.062227 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:32.063079 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:32.063843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:32.066109 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 122/248] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:32.072032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.138636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.187030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41bc1-d3df-499d-bb68-3d45bb566971 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.215777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:32.231487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:32.237791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.238874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.239326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.239889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.240723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:32.241330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:32.243590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:32.256186 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 127/249] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:32.264434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.286062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19bc26-b64e-4122-a464-6e1c9764c707 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.336450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efd64-7863-43c9-830d-93bce334184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.337392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efd64-7863-43c9-830d-93bce334184d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.337683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efd64-7863-43c9-830d-93bce334184d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.337959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efd64-7863-43c9-830d-93bce334184d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.353378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efd64-7863-43c9-830d-93bce334184d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-152efd64-7863-43c9-830d-93bce334184d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:32.361307 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:32.362293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:32.363254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 123/250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:32.370177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efd64-7863-43c9-830d-93bce334184d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.405278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8614f3-8ad6-4ae1-acbd-e6d504e61b12 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.445123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.445893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.446201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.446484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] PATH_INFO: `/v3/users/7cc3867c960841e08469960a9d274bec` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.447726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] RBAC: Authorizing `identity:get_user(user_id=7cc3867c960841e08469960a9d274bec)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:32.449381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:32.451381 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 128/251] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:32 2022] GET /identity/v3/users/7cc3867c960841e08469960a9d274bec => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:32.456859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.511610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efd64-7863-43c9-830d-93bce334184d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.528519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:32.549947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:32.568986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.569616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.569897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.570199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.570879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:32.571183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:32.572577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:32.585651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 124/252] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:32.591949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.597220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689212-fe67-4bae-b1d1-43c6a42b4f74 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.634703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.635527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.635817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.636093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] PATH_INFO: `/v3/system/users/7cc3867c960841e08469960a9d274bec/roles/fb4666cc4eef444aa2c3060cb67b2d3a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.637579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7cc3867c960841e08469960a9d274bec, role_id=fb4666cc4eef444aa2c3060cb67b2d3a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:32.639006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:32.649831 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 129/253] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Oct 31 04:56:32 2022] PUT /identity/v3/system/users/7cc3867c960841e08469960a9d274bec/roles/fb4666cc4eef444aa2c3060cb67b2d3a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:32.713071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fa23-d675-4435-8884-b2f7fcb5f395 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.762172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde5af-3bf1-4a87-918d-4a81260139a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.762172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde5af-3bf1-4a87-918d-4a81260139a1 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.762172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde5af-3bf1-4a87-918d-4a81260139a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.762172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde5af-3bf1-4a87-918d-4a81260139a1 None admin] PATH_INFO: `/v3/users/ae80f57dd0714a3086db184bfc46c9fa` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.766907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde5af-3bf1-4a87-918d-4a81260139a1 None admin] RBAC: Authorizing `identity:get_user(user_id=ae80f57dd0714a3086db184bfc46c9fa)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:32.770570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde5af-3bf1-4a87-918d-4a81260139a1 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:32.772393 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 125/254] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:32 2022] GET /identity/v3/users/ae80f57dd0714a3086db184bfc46c9fa => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:32.787296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:32.923732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2232-d94f-4851-afdd-7cd473087639 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:32.957000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:32.972268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:32.973184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:32.973668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:32.974172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:32.974920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] RBAC: Adding query filter params (role.id=09d7d7b078e14ccfafcd918e3a06fe8a, user.id=ae80f57dd0714a3086db184bfc46c9fa, scope.system=all) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:32.975247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:32.976709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baebde-78e0-408b-ae24-1a32fd03a610 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:32.996324 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 130/255] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 04:56:32 2022] GET /identity/v3/role_assignments?user.id=ae80f57dd0714a3086db184bfc46c9fa&scope.system=all&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:34.379229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8980b9-0c0a-4618-a734-f182459b53df None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.379753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8980b9-0c0a-4618-a734-f182459b53df None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.379753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8980b9-0c0a-4618-a734-f182459b53df None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.381244 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 126/256] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:34.387314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685963-b0c3-4245-a25e-5128251d4203 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.388161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685963-b0c3-4245-a25e-5128251d4203 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.388660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685963-b0c3-4245-a25e-5128251d4203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.409887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c5685963-b0c3-4245-a25e-5128251d4203 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:34.411462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5685963-b0c3-4245-a25e-5128251d4203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:34.483006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 131/257] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 04:56:34.722415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c1fd-ff54-40c9-aba5-a3d673a54da4 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.722599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c1fd-ff54-40c9-aba5-a3d673a54da4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.722878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30c1fd-ff54-40c9-aba5-a3d673a54da4 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.724359 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 127/258] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:34.730552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.731145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.731626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.760145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:34.761711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:34.769785 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 132/259] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 04:56:34.805107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30c1fd-ff54-40c9-aba5-a3d673a54da4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:34.819565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30c1fd-ff54-40c9-aba5-a3d673a54da4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:34.824480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:34.825383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.825869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.826369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.837953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:34.843794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:34.844674 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:34.845471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:34.847797 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 128/260] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:56:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:34.854210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:34.866891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4ae9-6e78-43da-973e-439431aa605d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:34.872728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:34.873613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.874115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.874618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.875567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:34.876077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:34.878045 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 04:56:34.878045 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 04:56:34.878045 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 04:56:34.879346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:34.889558 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 133/261] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:56:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:34.895517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:34.909540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d301396-2a93-4bcd-af83-be59cda29a14 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:34.914472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:34.915372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.915925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.916512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.924955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:34.927126 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 04:56:34.927126 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 04:56:34.927126 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 04:56:34.928784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:34.930742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 129/262] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 04:56:34 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:34.937341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:34.948820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0301b1-3f31-4cca-83af-c803df3cb0cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:34.953634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:34.954608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.955200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.955674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.957093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:34.959593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:34.961785 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 134/263] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 04:56:34 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:34.967771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:34.979090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b379a75-a620-42e2-8ede-6a617517b34f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:34.984104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:34.985092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:34.985595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:34.986083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/groups/2c2842beca38499b859b801436702f7d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:34.988298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c557bf323204c77b7e0db2fbf1b6ad7, group_id=2c2842beca38499b859b801436702f7d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:34.989599 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 04:56:34.989599 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 04:56:34.989599 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 04:56:34.992049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6a491-defe-40e8-a94e-047e8277c7f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:35.014928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 130/264] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 04:56:34 2022] PUT /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/groups/2c2842beca38499b859b801436702f7d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:35.301150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.311835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0e96-a691-4272-bebf-55c51d22ad67 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.356260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e02e0-5fac-4893-bb7a-029ea5d2df4d None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.356557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e02e0-5fac-4893-bb7a-029ea5d2df4d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.356818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e02e0-5fac-4893-bb7a-029ea5d2df4d None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.358186 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 131/265] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:35.363369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.363654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.363933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.403772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:35.404985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:35.413080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.413743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.414023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.418399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.435118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:35.437003 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 132/266] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:35.441725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:35.442620 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:35.443394 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:35.445399 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 135/267] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 04:56:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:35.450637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.458472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:35.464045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8a11-a281-4c30-8f28-a1ccf72dc514 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.479991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.481092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.481789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.482067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.482778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:35.483081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:35.484092 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 04:56:35.484092 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 04:56:35.484092 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 04:56:35.485002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:35.494058 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 133/268] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 04:56:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:35.500139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.515999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b6dba-5231-4b57-b5c2-b008d6e7ddd0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.527691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.528348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.528629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.528901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.530024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:35.531068 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 04:56:35.531068 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 04:56:35.531068 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 04:56:35.532290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:35.534038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 136/269] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 04:56:35 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:35.539914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.551287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27918-eb3e-4cfe-8e3f-c616aa1892af admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.562087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.563419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.564267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.564850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.570351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:35.573427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:35.575759 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 134/270] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 04:56:35 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:35.581798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.595244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b394-d3a7-4921-8ac7-1487e93b38bd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.603489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.604280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.604555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.604822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/groups/2c2842beca38499b859b801436702f7d/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.607049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c557bf323204c77b7e0db2fbf1b6ad7, group_id=2c2842beca38499b859b801436702f7d, role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:35.608074 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 04:56:35.608074 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 04:56:35.608074 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 04:56:35.610030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:35.638128 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 137/271] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 04:56:35 2022] PUT /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7/groups/2c2842beca38499b859b801436702f7d/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:35.831193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.842679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d06533-ed9b-432d-b23d-c8e867cb92ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.919471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.920130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.920410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.920688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.937877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:35.942921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:35.943813 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:35.944594 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 135/272] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:35.950778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:35.972671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bcc45-1358-42f6-a593-8506cce1acb0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:35.991952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:35.992596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:35.992880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:35.993156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:35.993849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:35.994177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:35.996071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:36.014078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 138/273] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:36.020196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:36.031449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb41ca-801b-409f-acba-c588b4ca9e0b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:36.044676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:36.045327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:36.045608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:36.045879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:36.050821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:36.052773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:36.054429 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 136/274] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 04:56:36 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:36.060357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:36.076116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7b255-d1c9-4463-bf6c-bbcac589012a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:36.082040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce18e-a5dd-4936-a1d8-19960af143a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:36.082653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce18e-a5dd-4936-a1d8-19960af143a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:36.082935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce18e-a5dd-4936-a1d8-19960af143a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:36.083209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce18e-a5dd-4936-a1d8-19960af143a3 admin admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:36.086846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce18e-a5dd-4936-a1d8-19960af143a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:36.089326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce18e-a5dd-4936-a1d8-19960af143a3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:36.090864 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 139/275] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 04:56:36 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:36.096469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:36.107953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feefea-0b41-42d5-9e37-d4dbc6b37ab1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:36.118364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590b8d-5770-4207-b1db-7b750ec05dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:36.119032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590b8d-5770-4207-b1db-7b750ec05dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:36.119313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590b8d-5770-4207-b1db-7b750ec05dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:36.119704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590b8d-5770-4207-b1db-7b750ec05dd3 admin admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/groups/2c2842beca38499b859b801436702f7d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:36.127635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9590b8d-5770-4207-b1db-7b750ec05dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b, group_id=2c2842beca38499b859b801436702f7d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:36.130359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9590b8d-5770-4207-b1db-7b750ec05dd3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:36.164335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 137/276] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 04:56:36 2022] PUT /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/groups/2c2842beca38499b859b801436702f7d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:36.614660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6121-bdaa-481b-a9eb-0ab7be3748c8 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:36.615371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6121-bdaa-481b-a9eb-0ab7be3748c8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:36.615371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6121-bdaa-481b-a9eb-0ab7be3748c8 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:36.616747 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 140/277] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:36.622473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca8ed-10d9-4583-99bf-0a9dd2004d96 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:36.622982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca8ed-10d9-4583-99bf-0a9dd2004d96 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:36.623131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca8ed-10d9-4583-99bf-0a9dd2004d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:36.651295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-189ca8ed-10d9-4583-99bf-0a9dd2004d96 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:36.652508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-189ca8ed-10d9-4583-99bf-0a9dd2004d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:36.729513 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 138/278] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:37.028436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6121-bdaa-481b-a9eb-0ab7be3748c8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.052855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:37.061410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275524a-2729-4b06-9c1a-e226b84cb4a4 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.061688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275524a-2729-4b06-9c1a-e226b84cb4a4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.061961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275524a-2729-4b06-9c1a-e226b84cb4a4 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.063349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 139/279] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:37.068691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.068972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.069241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.103265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:37.104652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:37.170293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:37.193201 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 140/280] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 04:56:37.216719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6121-bdaa-481b-a9eb-0ab7be3748c8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.252559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.253431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.253879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.254328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.270841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:37.276584 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:37.277630 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 04:56:37.278674 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:37.280860 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 141/281] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:37.292203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.397585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bd65a-790a-4258-a1f3-cb81823b244e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.433717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.434608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.435027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.435533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.436400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:37.436836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.438373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.448111 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 141/282] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:37.454379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.549385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:37.572051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67c40c-7245-41ab-8ddc-66aebe7743b2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.613967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.614876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.615722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.616160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] PATH_INFO: `/v3/users/7cc3867c960841e08469960a9d274bec` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.618109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] RBAC: Authorizing `identity:get_user(user_id=7cc3867c960841e08469960a9d274bec)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.619854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.621664 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 142/283] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/users/7cc3867c960841e08469960a9d274bec => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:37.627567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.646374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.663149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f260a-a505-40d3-97e8-4c70214cf699 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.671659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a203a8-7a49-485f-9999-2c40e436bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.672311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a203a8-7a49-485f-9999-2c40e436bead admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.672706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a203a8-7a49-485f-9999-2c40e436bead admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.672877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a203a8-7a49-485f-9999-2c40e436bead admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.695530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a203a8-7a49-485f-9999-2c40e436bead admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b4a203a8-7a49-485f-9999-2c40e436bead admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:37.702432 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:37.703341 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:37.704100 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:37.707244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 143/284] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:37.708704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1532-6fde-46f8-94c7-8a1f19b0f0ec None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.709182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1532-6fde-46f8-94c7-8a1f19b0f0ec None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.709644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1532-6fde-46f8-94c7-8a1f19b0f0ec None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.711728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:37.712450 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 144/285] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:37.713636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1532-6fde-46f8-94c7-8a1f19b0f0ec None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.739323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1532-6fde-46f8-94c7-8a1f19b0f0ec None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.752081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.752710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.752992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.753262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.753941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:37.754271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.755886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47cf3b-8206-4f41-9fa9-0ebde4a0d8b8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.771347 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 145/286] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:37.772607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.772893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.773169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.800469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12125adf-a401-4ec5-b25f-1774a2c13f06 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.809141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:37.810360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:37.830566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 146/287] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 04:56:37.831486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.846624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaa473-df0a-438b-b378-f15139c0b23e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.848520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.849146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.849488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.849807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.850629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] RBAC: Adding query filter params (role.id=fb4666cc4eef444aa2c3060cb67b2d3a, user.id=7cc3867c960841e08469960a9d274bec, scope.system=all) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:37.851081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.852765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.859681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.860338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.860630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.860891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.862009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.863958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.865521 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 147/288] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:37.873872 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 142/289] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/role_assignments?user.id=7cc3867c960841e08469960a9d274bec&scope.system=all&role.id=fb4666cc4eef444aa2c3060cb67b2d3a => generated 510 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:37.874882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.890046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b1772-cf30-4724-89d5-9677f5587cbe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.904024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.904689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.904971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.905249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.906423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.908483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.914255 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 148/290] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 04:56:37 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:37.916232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:37.939824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8188657-262b-4518-9b63-b19fdfd12190 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:37.946853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:37.948260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:37.948813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:37.949098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/groups/2c2842beca38499b859b801436702f7d/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:37.951490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b, group_id=2c2842beca38499b859b801436702f7d, role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:37.954455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:37.983326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 04:56:37 2022] PUT /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b/groups/2c2842beca38499b859b801436702f7d/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:38.219670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:38.232342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4bc63-d8b0-4715-935a-3fb428557ab1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:38.304798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:38.305500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.305785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.306055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.323337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:38.328278 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:38.329123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:38.329939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 149/292] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:38.335316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:38.350854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f69d6-4af6-46b4-9185-7d50fb1ad627 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:38.356689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:38.357313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.357593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.357867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.358648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:38.358954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:38.360683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:38.374979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 144/293] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:38.380658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:38.395416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58fdb-f447-486b-94b9-f8a56361d800 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:38.400742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:38.401800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.402096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.402402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] PATH_INFO: `/v3/groups/b2c1eef7942745e19850f5a1641e9c21` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.410464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] RBAC: Authorizing `identity:get_group(group_id=b2c1eef7942745e19850f5a1641e9c21)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:38.412577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:38.414484 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 150/294] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 04:56:38 2022] GET /identity/v3/groups/b2c1eef7942745e19850f5a1641e9c21 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:38.420879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:38.432211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea488ae-a2c2-47ce-ad36-ad264681e7c9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:38.439110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb2413-0764-4044-8508-d6b564cb83e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:38.439839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2413-0764-4044-8508-d6b564cb83e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.440176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2413-0764-4044-8508-d6b564cb83e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.440504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2413-0764-4044-8508-d6b564cb83e1 admin admin] PATH_INFO: `/v3/projects/f366121cda9844abacd920de806ce5fd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.441746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb2413-0764-4044-8508-d6b564cb83e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f366121cda9844abacd920de806ce5fd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:38.443728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb2413-0764-4044-8508-d6b564cb83e1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:38.445726 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 145/295] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 04:56:38 2022] GET /identity/v3/projects/f366121cda9844abacd920de806ce5fd => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:38.452143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:38.463006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee85be7-2db6-4ef8-82e2-7bb2f62cea70 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:38.469625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03524e-58ff-439c-a0ed-f8eeaf924a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:38.470445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03524e-58ff-439c-a0ed-f8eeaf924a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.470834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03524e-58ff-439c-a0ed-f8eeaf924a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.471118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03524e-58ff-439c-a0ed-f8eeaf924a6e admin admin] PATH_INFO: `/v3/projects/f366121cda9844abacd920de806ce5fd/groups/b2c1eef7942745e19850f5a1641e9c21/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.473150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03524e-58ff-439c-a0ed-f8eeaf924a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f366121cda9844abacd920de806ce5fd, group_id=b2c1eef7942745e19850f5a1641e9c21, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:38.476078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03524e-58ff-439c-a0ed-f8eeaf924a6e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:38.497911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 04:56:38 2022] PUT /identity/v3/projects/f366121cda9844abacd920de806ce5fd/groups/b2c1eef7942745e19850f5a1641e9c21/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:38.599435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90416e-83b7-450f-9cfd-6d970beec205 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.599780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90416e-83b7-450f-9cfd-6d970beec205 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.600108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90416e-83b7-450f-9cfd-6d970beec205 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.601603 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 146/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:38.607914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd9b05-79dd-4e2e-a00d-89e2a722f6d0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:38.608251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd9b05-79dd-4e2e-a00d-89e2a722f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:38.608534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd9b05-79dd-4e2e-a00d-89e2a722f6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:38.633362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-47cd9b05-79dd-4e2e-a00d-89e2a722f6d0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:38.634677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-47cd9b05-79dd-4e2e-a00d-89e2a722f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:38.678172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:38.735638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 152/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:39.196148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90416e-83b7-450f-9cfd-6d970beec205 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:39.300379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:39.324720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a9d33-18d5-470c-81a8-f43762ac8a21 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.325056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a9d33-18d5-470c-81a8-f43762ac8a21 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.325273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a9d33-18d5-470c-81a8-f43762ac8a21 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:39.326881 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 153/299] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:56:39.330519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90416e-83b7-450f-9cfd-6d970beec205 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:39.333059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e9b7-535f-49f5-8454-597d4ee59103 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.333632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e9b7-535f-49f5-8454-597d4ee59103 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.334110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e9b7-535f-49f5-8454-597d4ee59103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:39.360235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f842e9b7-535f-49f5-8454-597d4ee59103 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:39.362494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f842e9b7-535f-49f5-8454-597d4ee59103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:39.394981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:39.395638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.395916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.396189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] PATH_INFO: `/v3/roles/member` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:39.422282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:39.433550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:39.434536 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:39.435337 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:39.440739 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 147/300] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:39.443744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:39.475737 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 154/301] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:39.476926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3297-445f-4beb-91b3-3136a154459a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.477214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3297-445f-4beb-91b3-3136a154459a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.477487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3297-445f-4beb-91b3-3136a154459a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:39.479814 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 155/302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:39.487578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.487862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.488136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:39.522450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:39.525376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:39.635254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121805e-a456-4fbe-9639-b471f7054acd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:39.670265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 156/303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:39.690669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:39.691282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.691556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.691825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:39.692491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:39.692794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:39.694300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:39.707434 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 148/304] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:39.714220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:39.750804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:39.850604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feedf6-56d6-4b31-a178-73b1d6375c94 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:39.874665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:39.878897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:39.918239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:39.918866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:39.919143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:39.919652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.055558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfa025-fed4-4365-a1f5-baf6c9f0054a None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.077877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:40.079670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:40.111036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.112063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.112539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.113057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.117848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.133733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:40.142613 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:40.143505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:40.144295 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:40.145622 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 149/305] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:40.152481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.246619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.248450 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 157/306] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:40.249521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.301805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a9524-33ad-41db-a2b5-466d1fb0eefb None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.342913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.343452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.346197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.346197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.346197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:40.346197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:40.346485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:40.355426 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 150/307] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:40.356254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.372141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721fb4-2713-4679-b977-ff950ccde564 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.399493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.414586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.415635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.416125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.417149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.429593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:40.435367 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:40.436275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 04:56:40.437134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:40.439422 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 158/308] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:40.440400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.476562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4fd34-85c0-4c7e-9f57-431d526fb9ba None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.511520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.513865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.515128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.515418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.515691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.517203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:40.518699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:40.524988 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 151/309] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:40.524988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.567099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8c4b4-33ca-4c0a-9355-d217b8292250 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.617550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.618580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.619061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.619633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.658026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae967e-f17d-44a8-be4c-68ee948ecfb7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.681282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.706239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.706864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.707144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.707418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.708101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] RBAC: Adding query filter params (name=member) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:40.708666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:40.709426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:40.710048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:40.711348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:40.723134 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 152/310] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:40.723709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.802589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.852304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 159/311] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:40.854480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.858718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a3de-1c83-41ea-91a6-7f921d696e34 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:40.900346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:40.901446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:40.901782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:40.902117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:40.903270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:40.904710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:40.906700 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 153/312] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:40.907335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:40.964252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:40.988427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea3e3e-4c54-4793-9152-b81bd66559a4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.026890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fd65-2bd1-43ce-9be3-287c696c51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.027682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fd65-2bd1-43ce-9be3-287c696c51dc None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.028067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fd65-2bd1-43ce-9be3-287c696c51dc None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.028449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fd65-2bd1-43ce-9be3-287c696c51dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.036709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c987-8df8-491c-9d72-2fbfc1f708dc None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.064689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:41.078303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.079339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.079832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.080325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] PATH_INFO: `/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.081614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] RBAC: Authorizing `identity:get_project(project_id=3c557bf323204c77b7e0db2fbf1b6ad7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.083563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.085742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 154/313] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/projects/3c557bf323204c77b7e0db2fbf1b6ad7 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:41.086750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.104597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fd65-2bd1-43ce-9be3-287c696c51dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.107379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fd65-2bd1-43ce-9be3-287c696c51dc None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.233274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d2c8-69b5-4cb5-928a-360a3fe6a45e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.235458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:41.255341 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 160/314] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:41.262888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d6b6-a493-4732-8b5b-47406658d7c8 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.263787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d6b6-a493-4732-8b5b-47406658d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.264071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d6b6-a493-4732-8b5b-47406658d7c8 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.265958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 161/315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:41.266262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d6b6-a493-4732-8b5b-47406658d7c8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.282084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.283066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.283424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.283686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.284370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] RBAC: Adding query filter params (group.id=2c2842beca38499b859b801436702f7d, role.id=09d7d7b078e14ccfafcd918e3a06fe8a, scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:41.284694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.286196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a445535-a7b0-404d-9abd-6dc9070350bc None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.293843 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 155/316] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/role_assignments?group.id=2c2842beca38499b859b801436702f7d&scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:41.295423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2fef-47fd-4c42-aa65-aa4c5e4298bb None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.295423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2fef-47fd-4c42-aa65-aa4c5e4298bb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.295692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2fef-47fd-4c42-aa65-aa4c5e4298bb None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.296954 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 156/317] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:41.304202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2fef-47fd-4c42-aa65-aa4c5e4298bb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.384703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:41.405207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d6b6-a493-4732-8b5b-47406658d7c8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.448651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2fef-47fd-4c42-aa65-aa4c5e4298bb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.455136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf29bf4-bd46-4874-9518-9fb0ed4c05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.455916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf29bf4-bd46-4874-9518-9fb0ed4c05b3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.456805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf29bf4-bd46-4874-9518-9fb0ed4c05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.457175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf29bf4-bd46-4874-9518-9fb0ed4c05b3 None admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.458425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf29bf4-bd46-4874-9518-9fb0ed4c05b3 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.460337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf29bf4-bd46-4874-9518-9fb0ed4c05b3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.462747 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 162/318] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:41.464017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.464308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.464589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.488084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:41.489386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:41.501498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27019546-3711-4fad-b928-832fd159284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.502165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27019546-3711-4fad-b928-832fd159284a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.502458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27019546-3711-4fad-b928-832fd159284a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.502738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27019546-3711-4fad-b928-832fd159284a None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.504293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27019546-3711-4fad-b928-832fd159284a None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.505756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27019546-3711-4fad-b928-832fd159284a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.507537 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 157/319] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:41.508685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.508964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.509243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.533529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:41.534761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:41.548260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:41.570162 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 163/320] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:41.571029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.623605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 158/321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:41.624484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.693541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:41.701268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b755cb-0956-4aef-b741-f30381e95b16 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.747216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.747864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.748213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.748557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.749615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] RBAC: Adding query filter params (group.id=2c2842beca38499b859b801436702f7d, role.id=0269db5298cf4fd9878693e71b3f2b89, scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:41.750735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.752213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.756824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b0fc7-4300-482a-962f-4ae102688858 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:41.761063 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 164/322] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/role_assignments?group.id=2c2842beca38499b859b801436702f7d&scope.project.id=3c557bf323204c77b7e0db2fbf1b6ad7&role.id=0269db5298cf4fd9878693e71b3f2b89 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:41.801857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:41.802568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:41.802852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:41.803129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:41.804281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:41.805761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:41.808339 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 159/323] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:41.815398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.869981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:41.872185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:41.949008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0a7d-0c7c-4a2e-9acc-4a393fc6517e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.002297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.002975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.003262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.004977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.004977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] RBAC: Adding query filter params (group.id=2c2842beca38499b859b801436702f7d, role.id=09d7d7b078e14ccfafcd918e3a06fe8a, scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:42.004977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.006022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.014963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 165/324] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/role_assignments?group.id=2c2842beca38499b859b801436702f7d&scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b&role.id=09d7d7b078e14ccfafcd918e3a06fe8a => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:42.015818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.028664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3977db-5a58-413a-8fd8-3b82dacd8680 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.073021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.090684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.091347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.091632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.091910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.106779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:42.113388 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:42.114630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:42.115428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 160/325] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:42.123187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.154011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a856e-9a3b-436d-8c61-9a446437afad None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.164419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.205224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.206079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.206543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.206889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.223601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:42.228677 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:42.230242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:42.231037 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 166/326] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:42.237282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.280733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa211a7-4d44-4214-a9c7-374a211a56c1 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.328063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.328681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.331034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.331034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.331034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:42.331034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.331720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.341563 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 161/327] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:42.347424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.368258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5054c3-ff42-47eb-9696-a1cb9ea860da None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.401161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.411862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.412494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.412790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.413123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.413812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:42.414119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.415517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.427420 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 167/328] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:42.433129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.465463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887fb80-b609-45dc-a8cf-b27713e7daa7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.467238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.510929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.511638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.511923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.512200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.553684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead4fc8-96d6-4812-910f-5b465a70351e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.594527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.596186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.598125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.598780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.599066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.599344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.652258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.679723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.681195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.716121 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 162/329] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:42.716651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.721775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.791588 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 168/330] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 04:56:42.797261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.825623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf867e3-6a8c-49d7-8e50-37f2708b1f8f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.859229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.859852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.860128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.860394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] PATH_INFO: `/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.861492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] RBAC: Authorizing `identity:get_project(project_id=42c6d6cd9b944dd98ce1d5c75a8df34b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.862953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.864591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 163/331] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/projects/42c6d6cd9b944dd98ce1d5c75a8df34b => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:42.870631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.884837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.893559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095601-f57d-452b-b5ff-8b3c9b88dbd6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:42.922227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:42.928595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:42.929223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:42.929500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:42.929766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] PATH_INFO: `/v3/projects/f366121cda9844abacd920de806ce5fd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:42.930895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f366121cda9844abacd920de806ce5fd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:42.932844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:42.934495 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 169/332] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/projects/f366121cda9844abacd920de806ce5fd => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:42.939844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:42.972781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56433be1-793e-43f1-b634-4e434be0530e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:43.007415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:43.008048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:43.008334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:43.008611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] PATH_INFO: `/v3/groups/2c2842beca38499b859b801436702f7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:43.009720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] RBAC: Authorizing `identity:get_group(group_id=2c2842beca38499b859b801436702f7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:43.011361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:43.013102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 164/333] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/groups/2c2842beca38499b859b801436702f7d => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:43.018680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:43.039299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca53d-3a2a-4f13-9ae8-1f02ba9e08f2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:43.072393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:43.073768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:43.074052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:43.074355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] PATH_INFO: `/v3/groups/b2c1eef7942745e19850f5a1641e9c21` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:43.075457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] RBAC: Authorizing `identity:get_group(group_id=b2c1eef7942745e19850f5a1641e9c21)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:43.076933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:43.078474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 170/334] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 04:56:42 2022] GET /identity/v3/groups/b2c1eef7942745e19850f5a1641e9c21 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:43.084149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:43.097988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:43.119018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d8da2-14e4-4b1a-8781-c0063d99a922 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:43.148138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:43.154211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:43.154817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:43.155094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:43.155363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:43.156083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] RBAC: Adding query filter params (group.id=2c2842beca38499b859b801436702f7d, role.id=0269db5298cf4fd9878693e71b3f2b89, scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:43.156387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:43.157798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede00da-5456-49f9-80d7-3266e74d4e22 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:43.163641 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 165/335] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 04:56:43 2022] GET /identity/v3/role_assignments?group.id=2c2842beca38499b859b801436702f7d&scope.project.id=42c6d6cd9b944dd98ce1d5c75a8df34b&role.id=0269db5298cf4fd9878693e71b3f2b89 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:43.185991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676ba30-9a20-48a1-8985-a78302457562 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:43.223370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:43.224010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:43.224292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:43.224566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:43.225391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] RBAC: Adding query filter params (group.id=b2c1eef7942745e19850f5a1641e9c21, role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=f366121cda9844abacd920de806ce5fd) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:43.225706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:43.227177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b1bf-1429-4164-9191-3d825fbed7ac None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:43.234753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 171/336] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 04:56:43 2022] GET /identity/v3/role_assignments?group.id=b2c1eef7942745e19850f5a1641e9c21&scope.project.id=f366121cda9844abacd920de806ce5fd&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:45.791018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219860-beff-4fc6-85db-83b333cf82bb None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:45.792334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219860-beff-4fc6-85db-83b333cf82bb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:45.792334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219860-beff-4fc6-85db-83b333cf82bb None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:45.793831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 166/337] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:45.799082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053b2b-8dab-4e92-a238-283a8ca313a1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:45.799895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053b2b-8dab-4e92-a238-283a8ca313a1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:45.800454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20053b2b-8dab-4e92-a238-283a8ca313a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:45.838614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-20053b2b-8dab-4e92-a238-283a8ca313a1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:45.840211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20053b2b-8dab-4e92-a238-283a8ca313a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:45.935963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 172/338] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:46.049061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9db36-65ad-4e5d-a041-d9488d356675 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.049572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9db36-65ad-4e5d-a041-d9488d356675 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.050010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9db36-65ad-4e5d-a041-d9488d356675 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.051767 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 167/339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:46.058390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69aa4-a00e-4972-8452-c43879626fda None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.058924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69aa4-a00e-4972-8452-c43879626fda None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.059385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69aa4-a00e-4972-8452-c43879626fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.086390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-60e69aa4-a00e-4972-8452-c43879626fda None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:46.087893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60e69aa4-a00e-4972-8452-c43879626fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:46.168181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:46.184885 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:46.247020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62771d-627d-429e-b2e0-131523ffeaa9 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.247666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62771d-627d-429e-b2e0-131523ffeaa9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.248146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62771d-627d-429e-b2e0-131523ffeaa9 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.249944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 168/341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:46.255245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.255538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.255822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.278976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:46.280215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:46.379112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62771d-627d-429e-b2e0-131523ffeaa9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:46.385805 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 174/342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:46.494904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62771d-627d-429e-b2e0-131523ffeaa9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:46.542306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:46.543361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.543846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.544321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.559774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:46.561570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:46.571098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:46.582271 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:46.583230 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:46.584105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:46.584105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:46.584105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:46.585842 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 169/343] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:46.589359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:46.592417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:46.750574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcb92-763a-422f-ad38-0c197f00e795 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:46.800461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdecb12-77aa-456c-bfc8-8567b0c0c608 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:46.814568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:46.815198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.815921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.816365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.817647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:46.818384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:46.820597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:46.823988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:46.840445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:46.841086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:46.841368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:46.841760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:46.845741 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 170/344] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:46.846877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:46.853464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:46.855296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:46.871889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:46.872836 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:46.873707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:46.873707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:46.873707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:46.875882 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 175/345] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:46.876844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:46.922339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:46.970555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13105d4-6834-402e-81d0-0d941872056d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:46.987096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f410de-6ce1-4f6d-9ce2-0f58ff97b9a4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:47.005250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:47.005821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.006286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.006719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.017722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:47.019847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:47.023926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7db009-4206-4f23-a4ce-a96311b5fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:47.024538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7db009-4206-4f23-a4ce-a96311b5fb27 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.024824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7db009-4206-4f23-a4ce-a96311b5fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.025099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7db009-4206-4f23-a4ce-a96311b5fb27 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.025793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7db009-4206-4f23-a4ce-a96311b5fb27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:47.027398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7db009-4206-4f23-a4ce-a96311b5fb27 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:47.035514 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:47.036506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:47.037362 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:47.037362 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:47.037362 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:47.038435 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 171/346] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:47.039682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:47.062172 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 176/347] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:46 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:47.062172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a936e-83af-4d42-b9ae-52e881289b03 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.062172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a936e-83af-4d42-b9ae-52e881289b03 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.062172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a936e-83af-4d42-b9ae-52e881289b03 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.062172 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 177/348] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:47.062172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a936e-83af-4d42-b9ae-52e881289b03 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:47.099119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:47.191655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a936e-83af-4d42-b9ae-52e881289b03 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:47.196455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483be41-3a3c-43fb-ace0-7d0b20e4feff None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:47.210069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:47.243711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:47.245056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.245661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.245925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.246632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:47.247100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:47.248654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0b7f-0b2d-4e9e-8522-e6b91ee5318b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:47.250051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:47.251394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.252490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.252915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.253804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:47.254117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:47.255596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:47.273968 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 178/349] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:47.273968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.273968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.273968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.281540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 172/350] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:47.282498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:47.296441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:47.297276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:47.374076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 179/351] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:47.374941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:47.399713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:47.422671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2739ed-f15c-4ce3-9d08-d234879b4edf None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:47.472349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:47.473359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.474371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.474884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.475999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:47.479676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:47.487045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6749a-8299-48df-a46a-10287c91edf5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:47.510620 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 173/352] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:47 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:47.529738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f05087-aeb1-499b-9d91-bea464153c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:47.530435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f05087-aeb1-499b-9d91-bea464153c37 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.530773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f05087-aeb1-499b-9d91-bea464153c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.531055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f05087-aeb1-499b-9d91-bea464153c37 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.531724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f05087-aeb1-499b-9d91-bea464153c37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:47.533238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f05087-aeb1-499b-9d91-bea464153c37 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:47.566985 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 180/353] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:47 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:47.826224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:47.826948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032273-d0c4-484c-bc6d-1f4d988ea19a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.827315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032273-d0c4-484c-bc6d-1f4d988ea19a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.827508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032273-d0c4-484c-bc6d-1f4d988ea19a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.829106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 181/354] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:47.834534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:47.834824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:47.835106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:47.854537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:47.855804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:47.860124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:47.939413 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 182/355] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:47.989869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a1827-938e-40b8-a6d5-1325b5b109a4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:48.044134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:48.044788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:48.045068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:48.045343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:48.061861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:48.063414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:48.086805 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:48.087746 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:48.088713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:48.088713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:48.088713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:48.088713 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 174/356] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:48.094650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:48.098236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:48.250852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896acb1-b784-414b-a780-c7a4c3c0ab2f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:48.287842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:48.306115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:48.308303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:48.308785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:48.309261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:48.310174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:48.310743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:48.312293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:48.325707 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 183/357] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:48.331572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:48.403008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:48.447139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90cadc-1e99-4114-a1c1-e41972b8d0c6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:48.484774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:48.487125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:48.488006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:48.488476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:48.488954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:48.489814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:48.491681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:48.518547 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 184/358] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:48 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:48.546827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917b964-7ab4-47e0-b212-5b647eb08b79 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:48.609498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:48.610138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:48.610450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:48.610726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:48.611424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:48.612817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:48.631862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.sql.core [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 04:56:48.631862 n-d-862355-5 devstack@keystone.service[82000]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 04:56:48.631862 n-d-862355-5 devstack@keystone.service[82000]: [parameters: {'id': '1e99e96360cf41139b43764f5bf56c9e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 04:56:48.631862 n-d-862355-5 devstack@keystone.service[82000]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82000) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 04:56:48.648047 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return ref.to_dict() Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:56:48.648995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application yield resource Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise self.value Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application session.commit() Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 04:56:48.649917 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.flush() Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application compat.raise_( Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 04:56:48.650856 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:56:48.651718 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:56:48.652505 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [parameters: {'id': '1e99e96360cf41139b43764f5bf56c9e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:48.655191 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 04:56:48.661989 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:48.663735 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 175/359] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 04:56:48 2022] POST /identity/v3/roles => generated 144 bytes in 362 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:48.665011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:48.790186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977fc4-cad4-4a5f-96d1-248282018ee1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:48.812142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:48.827608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62dc3-a42e-4da9-8ba8-b030c7b837aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:48.828417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62dc3-a42e-4da9-8ba8-b030c7b837aa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:48.828811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62dc3-a42e-4da9-8ba8-b030c7b837aa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:48.829199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62dc3-a42e-4da9-8ba8-b030c7b837aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:48.841764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a62dc3-a42e-4da9-8ba8-b030c7b837aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-52a62dc3-a42e-4da9-8ba8-b030c7b837aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:48.846767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:48.847684 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:48.848545 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 185/360] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:56:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:48.855111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:48.966544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad1ac9-2082-43b3-b561-0de34caab587 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:49.007130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:49.007750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:49.008075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:49.008352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:49.009020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:49.009320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:49.011322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7676-383d-4216-84cb-2a691f5d502a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:49.019921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 176/361] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:49.680731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01671-c4ec-4605-b2a7-e572d2407a25 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:49.681098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01671-c4ec-4605-b2a7-e572d2407a25 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:49.681207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01671-c4ec-4605-b2a7-e572d2407a25 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:49.682933 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 186/362] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:49.688386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3ca31-e4f1-4d04-98f7-88356323b2cf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:49.688679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3ca31-e4f1-4d04-98f7-88356323b2cf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:49.688956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3ca31-e4f1-4d04-98f7-88356323b2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:49.695435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:49.710064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-40f3ca31-e4f1-4d04-98f7-88356323b2cf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:49.711318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-40f3ca31-e4f1-4d04-98f7-88356323b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:49.801587 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 177/363] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:50.052476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1c2b5-31ac-493e-bfcb-0a43cfdc8132 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.052983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1c2b5-31ac-493e-bfcb-0a43cfdc8132 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.053058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1c2b5-31ac-493e-bfcb-0a43cfdc8132 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.054647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 187/364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:50.060234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.060658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.060831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.082534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:50.083721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:50.138556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1c2b5-31ac-493e-bfcb-0a43cfdc8132 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:50.207591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 178/365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:50.272189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1c2b5-31ac-493e-bfcb-0a43cfdc8132 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:50.329420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c0f36-067c-40ae-9e72-3f41dfc046db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:50.329996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c0f36-067c-40ae-9e72-3f41dfc046db None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.330307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c0f36-067c-40ae-9e72-3f41dfc046db None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.330589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c0f36-067c-40ae-9e72-3f41dfc046db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.352352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c0f36-067c-40ae-9e72-3f41dfc046db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0c0c0f36-067c-40ae-9e72-3f41dfc046db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:50.359319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:50.360319 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:50.362023 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 188/366] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:50.366368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:50.436060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:50.467913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0629-d497-42c5-871e-ff73c795dd24 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.468274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0629-d497-42c5-871e-ff73c795dd24 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.468562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0629-d497-42c5-871e-ff73c795dd24 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.470235 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 189/367] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:50.476216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.476507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.476781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.482554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3231218-f029-445e-9aac-d52e86a124c0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:50.517740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:50.518969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:50.545105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:50.545754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.546035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.546368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.547066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:50.547374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:50.548809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:50.558742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 179/368] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:50.559731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:50.560688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:50.597476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 190/369] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:50.598631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:50.707372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c528c-35d2-4517-8afc-a5cbf76b1920 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:50.707729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625db2aa-31fb-4683-8324-5b30f844de89 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:50.745790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:50.746538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.746824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.747101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.757791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:50.759281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:50.763158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:50.776539 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:50.778732 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:50.780793 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:50.780793 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:50.780793 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:50.780793 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 191/370] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:50.783571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:50.789257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:50.789907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:50.796821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:50.797101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:50.816549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:50.824136 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:50.826205 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:50.828225 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:50.831484 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 180/371] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:50.832565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:50.838468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:50.956772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa86314-7224-4d09-9819-f348173c9f98 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:50.982528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349164e-9cda-4bcb-adc3-9d4507d1bf78 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.003031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.003657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.003944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.004223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.004879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:51.005186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.007326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.022581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.023502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.023608 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 192/372] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:51.024162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.024390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.024928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.026206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:51.026733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.028329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.037970 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 181/373] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:51.039344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.095969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.136542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.157576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ac5e9-b858-4349-a6d0-9b1d18cd8d25 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.169736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247105b-f6d4-466d-ab56-c98f530a388b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.195343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.196312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.196812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.197298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.209491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:51.211763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.212419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.212704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.213032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:51.216197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:51.217107 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:51.217917 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:51.222241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.222659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.225121 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 193/374] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:51.226156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:51.238335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:51.239462 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:56:51.240576 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:51.242772 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 182/375] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:51.248161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.362566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04a766-0a97-4141-972e-2965d8f18be1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.389045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6427e-960b-4f63-961a-5b5d59711a0b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.398253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.408443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.410266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.410785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.411528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.426980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.428755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.430226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.430889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.431177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.431454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.431678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.433143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:51.433466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.434976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.444764 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 183/376] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:51.450036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:51.450961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:51.451822 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:51.451822 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:51.451822 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:51.451981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.454939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 194/377] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:51.455678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.569123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3fcc4-4800-4a94-9e84-360d3382181e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.571727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a89d-d6ef-4ba1-88d2-ed4cbae17840 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.605968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.606610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.606895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.607171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.607901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:51.608010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.608212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.608616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.608898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.609174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.609681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e494c-31c0-4144-be15-0547398bd46a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.620320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.621766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:51.637865 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:51.638981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:51.646989 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:51.646989 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:51.646989 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:51.646989 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 195/378] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:51.646989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.649925 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 184/379] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:51.651851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc15e5f-f4ed-456d-952e-6468fc8fd568 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.652138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc15e5f-f4ed-456d-952e-6468fc8fd568 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.652417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc15e5f-f4ed-456d-952e-6468fc8fd568 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.653636 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 185/380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:51.658320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc15e5f-f4ed-456d-952e-6468fc8fd568 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.687759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.701329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.760734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71ae3-adfd-466a-aeb4-c0c64d7c9fd2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.766806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc15e5f-f4ed-456d-952e-6468fc8fd568 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.798409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.799225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.799610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.800006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.800827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:51.801344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.802909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.806025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.806771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.807092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.807966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.808640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:51.808945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.810395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc7b00-98d1-4998-be3f-56229ec98840 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:51.818282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 196/381] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:51.819621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.826776 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 186/382] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:51.828328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.828810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.829251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.850300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:51.851583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:51.926524 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 187/383] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:51.927373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:51.942005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411967f6-7275-4192-94f7-5a19ccc8c83a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:51.944755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.950621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:51.978515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:51.979665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:51.980062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:51.980342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:51.990813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:51.992261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:52.007416 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.008346 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:52.009166 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:52.009166 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:52.009166 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:52.009166 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 197/384] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.009386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.036172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4d82-f339-4a30-8660-3386a063ba89 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.070596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.071164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.071443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.071714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] PATH_INFO: `/v3/users/glance` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.078849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.080325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-71bbf871-ae38-4fef-ae40-10b0e38f514d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:52.094655 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.095608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 188/385] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.096935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74142-50eb-43ee-a124-e0de03aaad5c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.097528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74142-50eb-43ee-a124-e0de03aaad5c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.097528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74142-50eb-43ee-a124-e0de03aaad5c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.098795 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 189/386] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:52.099304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74142-50eb-43ee-a124-e0de03aaad5c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.123464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241e06d-5f29-4cc2-b91c-bd528adf06e5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.161825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.163206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.163645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.163924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.171786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.173233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.186033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:52.186425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.187300 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 198/387] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.188280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.213127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.214733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74142-50eb-43ee-a124-e0de03aaad5c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.248831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.249435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.249713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.249996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.250659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:52.250958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.252334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ae9a-4db9-41b2-9c20-2da8f4462291 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.266013 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 190/388] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:52.267236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.267519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.267789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.285517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:52.286748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:52.296090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd2e4-5e0b-4abc-800b-a664b32da39c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.330615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.331162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.331445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.331719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.332456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:52.332786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.334223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.353389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 191/389] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:52.355055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.378175 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 199/390] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:52.378175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.425325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.456727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.462860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90da47-1468-4c05-a552-b02ec98c67a4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.483763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358b413-dc5d-42ff-ba76-39c01c5c4618 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.497362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.497982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.498300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.498574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.499307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:52.499611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.501124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.518271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 192/391] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:52.519067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.524426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.525078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.525365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.526398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.537553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:52.542858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.543768 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:52.544556 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 200/392] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.545201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.629508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cc7bc-368a-4c9b-b8e2-87366f88800e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.652751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b720-39e8-46ab-bec4-256d25984be7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.653085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.663909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.664548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.664834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.665115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.672067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.673513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.684802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.685423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:56:52.685516 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.686355 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:52.687233 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:52.687691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.687691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.687808 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 193/393] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.687808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.693496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.702669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.704116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:52.718916 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.719825 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:52.720681 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:52.720681 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:52.720681 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:52.720681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 201/394] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.721074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.795357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56308f6-a54f-4e60-ae7c-e2f3901ba683 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.822968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b0db-f3df-45b6-8fc1-7cd4196420b8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.827831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.828461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.828746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.829027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.839909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.841372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:52.856134 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:52.857250 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:52.858452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:52.858452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:52.858452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:52.858452 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 194/395] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:52.858452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.859419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.860038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.860321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.860710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:52.861481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:52.862028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:52.863424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:52.871658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 202/396] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:52.872445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:52.897266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.925367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:52.962838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f54e04-1794-484a-b998-b80fa79f2f4f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.975235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e008a8-0cea-4b68-9e9d-089679fac8ba None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:52.997075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:52.997733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:52.998013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:52.998315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.008379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487278-8905-405d-8745-a58d489c596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.008508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.008987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487278-8905-405d-8745-a58d489c596b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.009271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487278-8905-405d-8745-a58d489c596b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.009548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487278-8905-405d-8745-a58d489c596b None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.009953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.010415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487278-8905-405d-8745-a58d489c596b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:53.010728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487278-8905-405d-8745-a58d489c596b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.012128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487278-8905-405d-8745-a58d489c596b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:53.023794 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:53.024818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:53.027203 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:53.027203 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:53.027203 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:53.027203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 195/397] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:53.027203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.033418 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 203/398] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:53.034204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487278-8905-405d-8745-a58d489c596b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.113964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.126075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a736-5575-4e70-993b-5d79091773b4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.131341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487278-8905-405d-8745-a58d489c596b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.142411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.159954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.160501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.160782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.161056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.161693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:53.161997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.163415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.165796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.166779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.166921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.167197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.167836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:53.168142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.169511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.175404 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 196/399] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:53.176189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.185304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 204/400] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:53.186121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.275184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423272c2-c27d-42ba-8a25-82e02724dfdb None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.286768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02eb1-5058-4740-a827-a584f4b37277 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.313408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.314048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.314357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.314632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.321984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.322751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.323033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.323308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.323951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:53.324255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.324703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.325624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.326140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.334329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.338372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 205/401] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:53.339143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:53.341039 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:53.341914 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:53.347376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:53.347376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:53.347376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:53.347376 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 197/402] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:53.347376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.375734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.443182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2463-a0fd-450f-898f-bd8008d3a217 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.443667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25594c53-a07d-4b53-b378-8234461a0fbb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.476671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.476848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.477327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.477423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.477608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.477698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.477879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.477976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/c82a0f508316483c92cc7872c1be0ad0/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.485308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.486807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.492438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=c82a0f508316483c92cc7872c1be0ad0, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.493878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:56:53.497934 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:53.499624 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 198/403] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:53.500815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.508888 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 206/404] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:53 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/c82a0f508316483c92cc7872c1be0ad0/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:53.509478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.569507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.615537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5cfa-5443-48b7-b478-a00fed63bc1b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.621128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.651445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8f72b-b912-4839-acc8-5da39aacda0c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.656034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.656856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.657141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.657416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.664812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.666390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:56:53.678266 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:53.679179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:53.680057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 199/405] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:53.680522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.694249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.694813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.695096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.695373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.696030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.698127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.720994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 207/406] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:56:53 2022] POST /identity/v3/users => generated 247 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:56:53.727284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.803718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8272e00-06cd-4494-b794-07c8816cc4a4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.828155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.846432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.847422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.847935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.848429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.849313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:53.849823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.851620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.866117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 200/407] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:53.872263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.877550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed319c-5c26-4aec-a22a-171a2b2b3ac8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:53.921161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:53.921786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:53.922071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:53.922380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:53.923080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:53.923393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:53.924832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:53.928925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:53.941002 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 208/408] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:53.941847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:53.995424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435d7e-204e-4c62-8a56-3aa8caf0c64a None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.042740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.043766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.044229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.044957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.046408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:54.047048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.049050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.065963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f4a0b-70a5-4286-86df-f178ab4cea65 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.075236 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 201/409] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:54.076316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:54.109671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.110521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.110871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.111254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.118992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.121928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.133375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:54.134534 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:54.135773 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:54.136656 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 209/410] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:54.137865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:54.217451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:54.219919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4706b-e4d2-4184-b835-e72956c303b0 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.271674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.271899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9f551-df49-4da6-91a5-48aa95542198 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.272632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.273007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.273482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/d1a59dbd84f94e99ad696d60c25082c9/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.298173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=d1a59dbd84f94e99ad696d60c25082c9, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.298173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.310325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.311139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.311495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.311847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/b46b252d8cc1405896f3f9b22531c08a/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.312729 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 202/411] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:54 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/d1a59dbd84f94e99ad696d60c25082c9/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:54.313725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:54.351608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=b46b252d8cc1405896f3f9b22531c08a, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.355110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.401440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 210/412] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:54 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/b46b252d8cc1405896f3f9b22531c08a/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:54.458831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:54.471713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a98b0-ebc7-4e13-8d21-eea310284390 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.512581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.513217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.513501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.513779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.514618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:54.514932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.516424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.537577 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 203/413] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Oct 31 04:56:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:54.543480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:54.663588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e600f-96da-4193-971d-eb2164657023 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.672168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:54.707179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.707880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.708170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.708448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.720634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.722113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:54.742083 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:54.743041 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:54.743977 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:54.743977 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:54.743977 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:54.743977 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 211/414] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:54.749236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:54.893506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d5fa2-8df3-4097-b5b4-4a9f73a6f87d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:54.934113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:54.934755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:54.935041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:54.935317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:54.935967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:54.936272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:54.937646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:54.955774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 204/415] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:54.964014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:55.109096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb120f3-43a6-4b1b-8d96-d7cf4cbe9db6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:55.163024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:55.163588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:55.163869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:55.164145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:55.175480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:55.176935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:56:55.195488 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:55.196358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:55.197214 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:55.199501 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 212/416] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:55.205745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:55.223890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:55.313848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a13a-5dd7-41ab-ba50-58cb92331420 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:55.348459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:55.349082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:55.349367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:55.349699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:55.350425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:55.350731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:55.352161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626eb5f-b258-4525-b43d-221579cb5bb2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:55.365032 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 205/417] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:55.371094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:55.396987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:55.505423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08235-d666-45fc-a33f-e7254abba8d6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:55.554758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d4386-eff9-475e-ade4-97aa3548ae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:55.555421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d4386-eff9-475e-ade4-97aa3548ae06 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:55.555702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d4386-eff9-475e-ade4-97aa3548ae06 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:55.555977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d4386-eff9-475e-ade4-97aa3548ae06 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/0a0be2f91dce4a62aa9d25e95a45925c/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:55.575969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d4386-eff9-475e-ade4-97aa3548ae06 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=0a0be2f91dce4a62aa9d25e95a45925c, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:55.577415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d4386-eff9-475e-ade4-97aa3548ae06 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:55.601447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 213/418] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:56:55 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/0a0be2f91dce4a62aa9d25e95a45925c/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:56:55.941808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7aca2-dd7e-412b-b9bf-52378b435d93 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:55.942221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7aca2-dd7e-412b-b9bf-52378b435d93 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:55.942401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7aca2-dd7e-412b-b9bf-52378b435d93 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:55.944007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 206/419] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:55.949830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205aa5c-cbf2-4d43-bbda-cc2688f071b7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:55.950120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205aa5c-cbf2-4d43-bbda-cc2688f071b7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:55.950431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205aa5c-cbf2-4d43-bbda-cc2688f071b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:55.974414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d205aa5c-cbf2-4d43-bbda-cc2688f071b7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:55.975607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d205aa5c-cbf2-4d43-bbda-cc2688f071b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:56.056082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:56.063518 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 214/420] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:56:56.330780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2099-a4f3-4279-a9b3-3ba0fb66c0b6 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.331673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2099-a4f3-4279-a9b3-3ba0fb66c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.332125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2099-a4f3-4279-a9b3-3ba0fb66c0b6 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:56.333907 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 207/421] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:56.339594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.339881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.340156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:56.359101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:56.360277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:56.440506 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 215/422] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:56.499339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf2099-a4f3-4279-a9b3-3ba0fb66c0b6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:56.585005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:56.629036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf2099-a4f3-4279-a9b3-3ba0fb66c0b6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:56.679080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:56.679715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.679993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.680265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:56.692708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:56.697638 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:56.698595 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:56.699920 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 208/423] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:56.707322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:56.752811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:56.898893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7372-7e87-4a7b-b8cc-e0e848efc978 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:56.915120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bbf15-ba8d-4cfc-8c0c-711877cb785c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:56.927389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:56.936208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:56.936843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.937463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.937934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:56.939007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:56.939528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:56.941227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21dd0e-5feb-49a1-a48f-808a599ffb00 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:56.949811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:56.951700 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 216/424] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:56.953244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95414d9-6b56-4058-ab37-d64acc3d664e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.953724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95414d9-6b56-4058-ab37-d64acc3d664e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.954249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95414d9-6b56-4058-ab37-d64acc3d664e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:56.956708 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 217/425] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:56.957783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95414d9-6b56-4058-ab37-d64acc3d664e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:56.959497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a57566-3713-4120-8e8e-2055e7d25f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:56.960434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a57566-3713-4120-8e8e-2055e7d25f41 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.960719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a57566-3713-4120-8e8e-2055e7d25f41 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.960990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a57566-3713-4120-8e8e-2055e7d25f41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:56.973816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a57566-3713-4120-8e8e-2055e7d25f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-d6a57566-3713-4120-8e8e-2055e7d25f41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:56.979643 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:56.980541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:56.981314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:56.985506 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 209/426] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:56.986972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:56.987158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:56.987437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.007469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:57.008692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:57.070168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95414d9-6b56-4058-ab37-d64acc3d664e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.086306 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 210/427] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:57.087310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.111053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.112095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.112573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.113041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.124832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.126812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:57.142609 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:57.143507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:57.144327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:57.144327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:57.144327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:57.146377 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 218/428] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:57.151710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.215127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9818e3-3182-449a-a8db-26d0cef53242 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.223598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:57.251051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:57.303916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b763c-f7b0-46cd-953a-407404eeb83e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.313243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.313921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.314236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.314511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.315185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:57.315485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.316870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.340005 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 211/429] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:57.340005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.364656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.365605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.366181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.366472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.367138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:57.367593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.370249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a6ce0-e9f6-421a-b4a4-fb8a2311e31f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.386307 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 219/430] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:56:57.387564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16236b41-e6a2-47f9-9b49-fbfe226c6639 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.387901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16236b41-e6a2-47f9-9b49-fbfe226c6639 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.388179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16236b41-e6a2-47f9-9b49-fbfe226c6639 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.389607 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 220/431] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:57.392115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16236b41-e6a2-47f9-9b49-fbfe226c6639 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.453682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc797-d6c4-4b2b-98d9-c2dd84e99bb5 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.490393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.491025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.491306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.491567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.502433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16236b41-e6a2-47f9-9b49-fbfe226c6639 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.503934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:57.505116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.506909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-2f2c21b4-6631-46d5-8155-47f4cb0dbb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:57.522419 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:57.523356 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:57.524204 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:57.524204 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:57.524204 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:57.529048 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 212/432] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:56:57.530344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.530863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.531145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.540006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.540634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.540911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.541315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.550558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.552013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.553475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:57.554887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:57.564672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:57.565566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:56:57.566502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:57.570496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 221/433] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:57.571127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.585807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:57.632279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 213/434] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:57.633014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.696101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fffea-4e47-48ee-8c81-2c36480ea3e3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.738465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.739664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.740155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.741064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.756105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:57.760436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129452be-cf27-4204-8b60-600b2f95fc95 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:57.764257 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:57.765138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:57.765928 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:57.769034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 222/435] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:57.770591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.799429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:57.803310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.804564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.805342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.805923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.806909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:57.807438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.809724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.824906 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 214/436] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:57.826376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.859412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:57.887215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f412a-ce81-4d47-87f8-f4b704617e09 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.928886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.929513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.929793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.930066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.930825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:57.931133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.933335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:57.951029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 223/437] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:57.952108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6658aca-487d-434f-aff5-faf7001e6505 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:57.955895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:57.987822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:57.988437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:57.988773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:57.988989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:57.989650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:57.989953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:57.991352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.004782 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 215/438] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:58.004782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.051785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.073857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca755ad-7952-4e2f-9b86-c141a152e3bd None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.093787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.111260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.111903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.112180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.112452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.114001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4f01-5ceb-4a6b-b500-ce5d39cf1f35 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.120048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.121484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:58.132981 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:58.133891 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 224/439] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:56:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:58.134973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.156131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.156901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.157189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.157467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.169045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:58.174713 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:58.175575 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:58.176380 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 216/440] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:58.177036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.250320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f87e1d-34b3-4d15-9dbd-d03a0e98b061 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.286709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db0c6-ea2e-415c-bce4-8115604e0d9b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.289661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.290314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.290602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.290879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.302539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.328643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.329285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.329567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.329844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.340601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.342042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.344682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:58.358127 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:58.359069 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:58.359904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:58.359904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.359904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:58.359904 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 217/441] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:58.360123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.376955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.378454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.470719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e5fb-420b-40a3-8064-4f902bf6696e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.494740 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 225/442] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:58.494740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.506944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.507362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.507643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.507927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.508644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:58.508952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.510938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.528654 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 218/443] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:58.529469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.538998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.583785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.597941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596634-012a-46cb-aea0-bbb0b7e74d24 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.628141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505fc4-5b18-4987-89f3-55c04f55a831 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.631282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.631893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.632176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.632450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.633115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:58.633421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.635431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.643404 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 226/444] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:58.644186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.663375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.663990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.664278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.664550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.665188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:58.665791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.667443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ed6f2-55d2-4938-9e5a-d8dec5f32b6f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.680365 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 219/445] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:58.681532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6f45-3b59-4008-bc54-44f68164c732 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.682400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6f45-3b59-4008-bc54-44f68164c732 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.682657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6f45-3b59-4008-bc54-44f68164c732 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.686658 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 220/446] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:56:58.686658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6f45-3b59-4008-bc54-44f68164c732 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.746416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb692055-0b4c-4c84-b5b2-e6e219d96426 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.747927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.781090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.781715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.781993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.782294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.786803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6f45-3b59-4008-bc54-44f68164c732 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.793347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.794833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.801262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:58.809138 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:58.810039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:58.811123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:58.811123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.811123 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:58.811123 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 227/447] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:58.811123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.826472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.827109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.827393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.827669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.838496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.839940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:58.854596 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:58.855633 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:58.856474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:58.856474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.856474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:58.856474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 221/448] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:58.856474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:58.914357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ace8f-9278-483a-b6d3-b44fa1ecab77 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.947018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.947769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.948050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.948318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.954381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73eaec-63fc-4fdc-a9f2-672477286bd2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:58.959350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.960779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-546f5f46-19a7-4a95-8895-1f74cf95dbbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:56:58.975272 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:58.976330 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 228/449] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.982169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.988193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:58.988823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:58.989101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:58.989394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:58.990724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:58.997088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:56:58.997596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:58.998319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:56:58.999072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:59.010267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:59.011335 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 222/450] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:59.017141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.039652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.066619 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 229/451] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:56:59.067455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.115833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed7058-e9ae-4f4f-a28b-e94a414361b3 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.151620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.152383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.152767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.153145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.154008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:59.154435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.155906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.165095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323fc5-366f-4b32-b8fb-7b10a6aa05e8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.169507 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 223/452] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:59.174578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.202551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.203158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.203438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.203711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.204354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:59.204657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.206018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.208467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.223326 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 230/453] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:59.223326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.280992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.297528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bef595-11d9-417f-be9e-5296ab94017e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.334136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.334780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.335069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.335334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.335974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:59.336274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.337725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.337878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446307-dc72-4762-894d-130d07a65ad8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.348930 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 224/454] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:59.349721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.374087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.374723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.375001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.375273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.375998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:59.376305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.377719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.394576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 231/455] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:59.395380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.449880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2b78-ae6e-4eab-a310-6c9729c2a7d4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.450409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.483023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.483652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.483952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.484222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.490649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.492077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.495664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30ae9e-5bd8-4803-9c72-05a2fce6f396 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:56:59.503336 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:59.504263 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:59.505105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 225/456] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:59.505552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.514022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.533813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.534485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.534765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.535044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.542046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.543522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:56:59.554412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:59.555223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:59.556078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 232/457] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:59.557083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.609945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411bc9a-511a-4a45-9c51-ab3fe71acb87 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.644353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.644984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.645265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.645543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.656008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:56:59.658126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97891ed-3c51-45f2-8375-fefb7420d0aa None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:56:59.661199 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:59.662299 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 226/458] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:59.663231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.674812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.695763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.696403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.696682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.696964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.704058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.705487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:56:59.717570 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:56:59.718572 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 233/459] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:56:59.719796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.734043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.768906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009d81e-cd49-4592-93d4-2da0aaa570b6 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.803836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.804492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.804719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.804993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.820781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866730e3-ecc0-4b7e-8938-35be691cfdf0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.854434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:56:59.855038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:56:59.855318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:56:59.855591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:56:59.856284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:56:59.856592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.858004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.869752 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 234/460] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:56:59.870657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:56:59.871293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:56:59.872744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:56:59.905606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.937219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:56:59.972384 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 227/461] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:56:59.977107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97250313-92b4-45dd-a8ba-598962701e2e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:56:59.977200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.010503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.011115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.011398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.011675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.012372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:00.012678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.014099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.026079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 235/462] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:00.026079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.071228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9797e-bedf-4d59-acd9-86f08cd0088d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.106358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.106956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.107235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.107504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.108155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:00.108480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.109854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.117623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 228/463] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:00.118170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.120290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.125509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e576b9-f187-44be-afc0-0288595be90b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.148222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.159994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.160610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.160927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.161206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.161939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:00.162308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.163728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.181319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 236/464] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:00.182013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.220713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e0e31-88fe-4960-b36d-019eb2736bd6 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.253983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.254627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.254912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.255188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.255903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=c82a0f508316483c92cc7872c1be0ad0) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:00.256209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.257640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.264147 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 229/465] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/role_assignments?user.id=c82a0f508316483c92cc7872c1be0ad0&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:00.271190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.289607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273baef9-ca28-46e0-a869-c864cf2f9aab None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.331667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.332362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.332645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.332928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.345418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.347066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:00.365675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:00.366885 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:00.367699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:00.367699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:00.367699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:00.367699 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 237/466] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:00.367918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.372101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.390057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.402656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fad2d-5a25-4204-acae-4f2c0d46b013 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.441115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.441818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.442099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.442430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/d29fb54e4c484f94a012b821cdb5ae64/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.459786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=d29fb54e4c484f94a012b821cdb5ae64, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.461606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.476592 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 230/467] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:00 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/d29fb54e4c484f94a012b821cdb5ae64/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:57:00.477412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.481225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032d62-5699-48fd-adde-5e7cccff50fe None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.522127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.522819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.524347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.524347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.544564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.546941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:00.567661 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:00.568636 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:00.569654 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:00.569654 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:00.569654 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:00.569654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 238/468] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:00.571209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.616579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758099-c69f-41ba-9434-b9b45649b48b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.643239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.658297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.659015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.659363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.659651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.674183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.710925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888d372-76e1-4f4a-bc07-a88622639503 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.746347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.747929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.757395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.758351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.758658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.758940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.759605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:00.766184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.766184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.774862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 239/469] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:00.775782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.882186 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 231/470] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:57:00.883880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:00.895502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c293d-1378-488b-b8d3-96367209573d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:00.915915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.940937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:00.941837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:00.942871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:00.943360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:00.944212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:00.944715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:00.948508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:00.949774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:00.966833 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 240/471] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:00.968022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.017240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec487-e514-4983-bf34-d948f8c48c48 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.054732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.055373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.055653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.055929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.064096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.065839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:01.077751 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:01.078774 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 232/472] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:01.079897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.110638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f764b9-d1ea-4b21-9b76-79d3d9b33fad None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.147334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.147893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.148178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.148456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.160628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.162184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:01.177403 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:01.178557 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:01.179742 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:01.179742 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:01.179742 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:01.179742 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 241/473] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:01.179742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.205404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004421b2-67ae-4d88-a4bf-5b5e13118017 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.207317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:01.212688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:01.245152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.246048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.246477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.246850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.255310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.256953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:01.273121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:01.274106 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:01.275009 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 233/474] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:01.282327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.307708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28696d71-bf48-46c6-bfbb-47f3696dd48c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.357932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.358960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.359360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.360149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.361216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:01.361626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.363449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.380560 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 242/475] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:01.381854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.408068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ddc81-db39-4be4-95eb-33e24be44537 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.454164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.454789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.455072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.455349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.456536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:01.456850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.458536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.475546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 234/476] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:01.476525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.503601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:01.510219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:01.517701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ab53-53d3-45a5-a354-ee6166f3a596 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.553745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.554543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.554930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.555306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.556145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:01.556614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.558235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.581123 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 243/477] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:01.582160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.594642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c25ed-9e0b-4737-bb68-e955b7958d76 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.633574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.634354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.634641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.635461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.636348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=d1a59dbd84f94e99ad696d60c25082c9) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:01.636715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.638341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.645268 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 235/478] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/role_assignments?user.id=d1a59dbd84f94e99ad696d60c25082c9&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:01.646268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.693563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f903-48e7-44e0-9c03-daafc631c2d7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.731612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.732259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.732545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.732820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.740367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.741858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.749867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:01.756046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:01.757226 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:01.758497 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 244/479] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:01.764041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:01.773226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:01.776120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb90e-7204-402f-b779-1b3044a4d4be None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.818293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.819423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.819905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.820378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.877618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4be8-27e4-4edd-adf4-d2ee271dd062 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:01.902892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.904946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.915292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:01.915944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:01.916419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:01.916715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:01.917515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:01.917834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:01.920000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:01.933569 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 245/480] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:01.939340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:02.010851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:02.018496 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 236/481] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:57:02.019045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:02.022833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:02.049100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eccf7a-d326-4167-bc10-18fd57c97fac None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:02.084979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:02.085758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.086165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.086550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.087390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=b46b252d8cc1405896f3f9b22531c08a) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:02.087765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:02.089812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:02.096129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 246/482] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:01 2022] GET /identity/v3/role_assignments?user.id=b46b252d8cc1405896f3f9b22531c08a&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:02.133858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fb43b-50d3-4d98-a032-eaa338d5a665 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:02.172427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:02.173074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.173354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.173625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.185682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:02.187202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:02.204281 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:02.205314 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:02.206183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:02.206183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:02.206183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:02.210013 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 237/483] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:02.211464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:02.355990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fcab7-22d2-410f-8525-03dc20c664b7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:02.387966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:02.394444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:02.395278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.395565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.395845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.396497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:02.396805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:02.398193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:02.412303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 247/484] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:02.418858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:02.466567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:02.534018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae69a0-ee18-4a56-b238-7c2aba412379 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:02.577834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:02.578787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.579250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.579723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.587415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:02.589848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:02.608724 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:02.609699 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:02.610566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:02.612293 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 238/485] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:02.618291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:02.747918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336f0ab-c4da-441c-8f17-3dcb6a536d4d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:02.802481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:02.803223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.803506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.803832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.804611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:02.804922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:02.806417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889accb3-ad69-4541-9250-7f0c302ab418 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:02.830337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 248/486] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:02.835234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:02.913817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64311-c88d-47bb-aa5b-519552d835e7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.914137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64311-c88d-47bb-aa5b-519552d835e7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.914407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64311-c88d-47bb-aa5b-519552d835e7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.917905 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 249/487] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:02.921956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc58c80-c27a-4efb-8513-41e3fc193cd4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:02.922282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc58c80-c27a-4efb-8513-41e3fc193cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:02.922588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc58c80-c27a-4efb-8513-41e3fc193cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:02.941840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cfc58c80-c27a-4efb-8513-41e3fc193cd4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:02.943131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cfc58c80-c27a-4efb-8513-41e3fc193cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:02.954172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:02.958506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e72b9-9758-4db6-bb42-54b1a2691df2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:03.019736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:03.020766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:03.021297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:03.021782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:03.022776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=0a0be2f91dce4a62aa9d25e95a45925c) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:03.023292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:03.024967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df31c9-2e5e-4f9c-94f2-5a68843fcbd6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:03.033586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:03.039120 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 239/488] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:02 2022] GET /identity/v3/role_assignments?user.id=0a0be2f91dce4a62aa9d25e95a45925c&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:03.073354 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 250/489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 04:57:03.145951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d478d-d4ad-4619-8c14-7842f8d42bdf None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:03.146593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d478d-d4ad-4619-8c14-7842f8d42bdf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:03.147071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d478d-d4ad-4619-8c14-7842f8d42bdf None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:03.148870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 240/490] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:03.155343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:03.155649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:03.155898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:03.179543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:03.180789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:03.280403 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 251/491] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:03.383894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d478d-d4ad-4619-8c14-7842f8d42bdf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:03.498241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d478d-d4ad-4619-8c14-7842f8d42bdf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:03.533091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:03.533724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:03.534220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:03.534495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:03.547118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:03.552474 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:03.553344 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:03.554115 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 241/492] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:03.559894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:03.636846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:03.664939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:03.747783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ad191-357d-41d4-9537-4996234fe261 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:03.779028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:03.818062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d380da-c682-4601-8614-c90f40bb9c85 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:03.820154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:03.820843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:03.821126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:03.821401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:03.822078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:03.822895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:03.824483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:03.842063 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 252/493] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:03.847727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:03.867851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:03.869724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:03.870375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:03.870557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:03.893212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:03.898885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:03.900267 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:03.901473 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 242/494] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:03.908436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.043072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5491c4-12ac-4d76-b958-30c36f583a0e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.062503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:04.091583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851000c-acfe-4533-9481-d13c95e198f8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.113606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.114542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.114825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.115096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.136795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.138281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.163497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.164144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.164425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.164703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.165402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:04.165706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.167252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:04.175133 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:04.176119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:04.177143 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:04.177143 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:04.177143 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:04.177721 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 253/495] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:04.186997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.197884 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 243/496] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:57:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:04.203358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.243224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:04.347375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264ec1-da2e-4006-978a-feb8d9907019 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.357934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fe6e-902f-4ef0-8177-bb3dd227fdde None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.386867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.387979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.388510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.388975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.389999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:04.390628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.392366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b021a92-7b93-4794-aa61-d67396bdc00c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.399981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.401496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.401792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.402070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.410227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 254/497] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:04.411868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2ccd-8e8c-47e3-a89f-fab52f11a8c3 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.412460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2ccd-8e8c-47e3-a89f-fab52f11a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.412937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2ccd-8e8c-47e3-a89f-fab52f11a8c3 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.414396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.415013 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 255/498] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:04.416697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.418236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a2ccd-8e8c-47e3-a89f-fab52f11a8c3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.424338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-835cbaec-75de-48ab-846d-965a5723e0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:04.440915 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:04.441904 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:04.442921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:04.442921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:04.442921 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:04.442921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 244/499] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:04.443639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.443979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.444252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.467125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:04.468701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:04.537729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:04.542669 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 245/500] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:04.544197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.575868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a2ccd-8e8c-47e3-a89f-fab52f11a8c3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.650707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.651798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.652357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.652877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.671562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.672602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597558a1-59b9-4dcd-a9f5-74f698f12aae None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.673793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:04.694817 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:04.695786 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:04.697778 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:04.706363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:04.708113 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 256/501] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:04.712225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.713224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.713630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.713913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.714594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:04.714810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.714921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.716394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.730781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 246/502] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:04.736548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.877186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe39e89-8d8b-49d4-8c94-357f34b3df03 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.877752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992225-afaf-4ded-98b7-8fc12596c76c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:04.913629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.913826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:04.914251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.914529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.914630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.914802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.915056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.915593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.917172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:04.917575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.919135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.923720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:04.925155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-053009a3-fb34-4a09-a476-2e2485618723 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:04.936895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:04.937929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:04.938906 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 247/503] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:04.939474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea878f5-4571-4da6-893d-c1bc7ac32599 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:04.940058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea878f5-4571-4da6-893d-c1bc7ac32599 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:04.940058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea878f5-4571-4da6-893d-c1bc7ac32599 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:04.940410 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 257/504] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:04.941433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.944405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 248/505] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:04.944521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:04.947036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea878f5-4571-4da6-893d-c1bc7ac32599 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:04.997184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.052081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff67c9-4b34-4b49-a07a-d379c9edb4c5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.055257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea878f5-4571-4da6-893d-c1bc7ac32599 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.086673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.087354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.087608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.088403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.090736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.091350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.091633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.091911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.092635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:05.092944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.094398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.099524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.100988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.117101 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 249/506] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:05.117101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-aec53fbf-ff77-4784-bce7-87edddefeb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:05.117353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:05.118718 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 258/507] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.119774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.140797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:05.142129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:05.195990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.218576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 259/508] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:05.219797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.237425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89863e4-04cf-4d1f-b4cb-c6cd8ee05d6a None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.240366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.294918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.295565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.295849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.296123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.309465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.310956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:05.327048 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:05.327992 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:05.328874 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:05.328874 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:05.328874 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:05.328874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 250/509] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:05.329513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.362318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8260f63-65b0-49dc-a1a8-5284bbf97981 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.399390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.400013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.400673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.401001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.456212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9bddd-387a-4791-8132-28fb36937958 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.460488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.481646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.483704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.496171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.497131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.497587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.498067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.499050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:05.499602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.501454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.515296 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 251/510] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:05.516725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.536542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.602295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 260/511] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 04:57:05.603165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.630314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793bc3-8bb5-4552-b834-968fd25cc18f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.667312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.667951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.668233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.668509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.669172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:05.669483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.670960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.684722 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 252/512] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:05.685621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.702993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.723211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf533-e1ff-471e-abb8-39ca166553f8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.761673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.762586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.763044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.763461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.764196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.765838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.767080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:05.778912 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:05.780122 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:05.781163 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:05.783207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 261/513] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:05.788703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.791864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4f6b-b409-4272-b1d2-40369914498f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.827048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.827662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.827945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.828222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.828898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.830366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.850981 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 253/514] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:57:05 2022] POST /identity/v3/users => generated 254 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:05.851839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:05.912664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6de2f-daa3-4dad-9fb1-d0ad42b3b804 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.951579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:05.952229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:05.952576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:05.952857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:05.964615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:05.966117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:05.970260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8eda-86eb-419c-af12-2810f91d64f4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:05.975586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:05.984929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:05.985951 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:05.986866 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:05.986866 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:05.986866 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:05.986866 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 262/515] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:05.986866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.009058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:06.016209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.016922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.017590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.018026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.026662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.028244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-dcfb020b-f85e-4eb1-ae64-738f3a839fd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:06.045306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:06.046424 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 254/516] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbccff-ad91-433e-82ec-436c3fc2467a None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.053146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbccff-ad91-433e-82ec-436c3fc2467a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.053845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbccff-ad91-433e-82ec-436c3fc2467a None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.053845 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 255/517] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:06.053845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbccff-ad91-433e-82ec-436c3fc2467a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.109717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7d21-e0dc-4d03-97d7-98d1a5648a54 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.147149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.147883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.148236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.148639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.149401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:06.149710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.151277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.155614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbccff-ad91-433e-82ec-436c3fc2467a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.160645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 263/518] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 04:57:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:06.161521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.190788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.191493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.191846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.192193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.192917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:06.193293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.194758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfdfc0-dcf6-4c1c-9347-a3cae61b055a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.211352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 256/519] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:06.211352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.211352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.211352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.228018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:06.230410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:06.235057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:06.283275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:06.287770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abbbbb-becc-4ff9-ad0d-a3ab1b53f697 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.310344 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 257/520] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:06.310344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.337148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.338900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.339393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.340155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.341507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:06.342323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.344223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.361333 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 264/521] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:06.362569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.438265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bea50-b211-40fc-a8f8-1a210a7bfa1a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.478577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4845-eb44-42ed-aaac-8effa50e2f39 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.485055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.485696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.485970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.486265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.486895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:06.487189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.488547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.502185 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 258/522] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:06.502185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.523254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:06.552215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.552875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.553157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.553432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.568671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.570169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:06.595969 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:06.596950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:06.597870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 265/523] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:06.598401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.604995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:06.670288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25765623-7ad0-4ad1-b415-481adede9acf None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.718924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.720118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.720118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.720118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/c82a0f508316483c92cc7872c1be0ad0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.722845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=c82a0f508316483c92cc7872c1be0ad0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.725573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.739603 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 259/524] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:06 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/c82a0f508316483c92cc7872c1be0ad0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:57:06.747072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.777792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb046-d236-4217-bb75-8b44a6c7e8bf None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:06.825263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:06.826394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:06.826929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:06.827458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] PATH_INFO: `/v3/services/network` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:06.828373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:06.830004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:06.842291 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:06.843400 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:06.844339 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:06.848066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 266/525] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:06.855446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:06.919923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:06.987228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8269-ec6e-433f-b5a0-200473184117 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:07.023855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e054-50c4-49be-bafc-7b0af43f1fe7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:07.032978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:07.034425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:07.035285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:07.035664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:07.036064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:07.037624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] RBAC: Adding query filter params (name=network) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:07.038137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:07.040413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:07.047972 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 267/526] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:07.055997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:07.074956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:07.076193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:07.077163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:07.077663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:07.078843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:07.079601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:07.081653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:07.100846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 260/527] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:07.108180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:07.188116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7b97-e171-471f-96f0-a504e8b9a916 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:07.221721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:07.246183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f728c7-2fdb-422b-9a74-303665047b3d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:07.272539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:07.273160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:07.273440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:07.273813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:07.274629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] RBAC: Adding query filter params (type=network) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:07.274884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:07.276778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd630a9-ccef-41f8-a71b-ee6be387d573 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:07.291642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:07.292363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:07.292712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:07.293060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:07.293865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=d29fb54e4c484f94a012b821cdb5ae64) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:07.294275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:07.295845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8085-ba18-4ea9-bca9-2b0b69df6b62 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:07.296476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 268/528] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:07.310350 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 261/529] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:07 2022] GET /identity/v3/role_assignments?user.id=d29fb54e4c484f94a012b821cdb5ae64&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:08.416746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ee7b-8da2-4812-b0a6-29e34504ef9c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:08.417770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ee7b-8da2-4812-b0a6-29e34504ef9c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:08.418292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ee7b-8da2-4812-b0a6-29e34504ef9c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:08.420100 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 269/530] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:08.425210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2d251-fef9-416a-9ff3-bcce4535a9b8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:08.425648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2d251-fef9-416a-9ff3-bcce4535a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:08.425829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2d251-fef9-416a-9ff3-bcce4535a9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:08.447693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9fe2d251-fef9-416a-9ff3-bcce4535a9b8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:08.448907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9fe2d251-fef9-416a-9ff3-bcce4535a9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:08.475270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:08.540843 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 262/531] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:08.901463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ee7b-8da2-4812-b0a6-29e34504ef9c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:08.929912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c836b7-faa5-443a-ab25-f2c540e962bd None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:08.930546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c836b7-faa5-443a-ab25-f2c540e962bd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:08.931013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c836b7-faa5-443a-ab25-f2c540e962bd None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:08.932824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 263/532] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:57:08.938027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:08.938348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:08.938621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:08.971144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:08.972360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:09.019802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ee7b-8da2-4812-b0a6-29e34504ef9c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:09.057171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:09.057902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.058211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.058492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.069635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:09.075867 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:09.076759 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:09.077566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 270/533] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:09.082178 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 264/534] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:09.092334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:09.136767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:09.206346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a492eb-46d8-44ed-8c60-eb3c43660d57 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:09.243477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:09.244240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.244573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.244852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.245523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:09.245830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:09.247244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83794e-fd8f-432a-83c2-0c3703bba594 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:09.256096 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 271/535] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:09.263276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:09.408772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:09.418754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bc80-3bcf-4739-8a33-46b40fcfc09d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:09.468404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889491f9-1cd0-4cb5-8f52-5117294f7557 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.468977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889491f9-1cd0-4cb5-8f52-5117294f7557 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.468977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889491f9-1cd0-4cb5-8f52-5117294f7557 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.474167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:09.474167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.474167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.474900 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 272/536] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:09.475030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.475167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889491f9-1cd0-4cb5-8f52-5117294f7557 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:09.485913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:09.487811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-fbe1099b-4468-4e4c-a762-c26a008b6639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:09.503942 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:09.505818 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 265/537] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.507673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.532547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:09.533738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:09.590138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:09.597114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889491f9-1cd0-4cb5-8f52-5117294f7557 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:09.620975 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 266/538] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:09.621660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:09.655607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:09.656533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.657089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.657532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.658385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:09.661146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:09.695654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 273/539] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:09 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:09.744584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:09.777783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf2e3f-5014-4370-9600-6dbc89dbeef4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:09.826657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:09.827289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:09.827569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:09.827839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:09.828494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:09.828793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:09.830189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:09.847710 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 267/540] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:09.853848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.007699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc3337-8812-43d6-b3f9-efe393891c6e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.049971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.050814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.051312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.051601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.060888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.063246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:10.080270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:10.081255 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:10.082198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 274/541] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:57:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:10.088294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.090195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.117425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:10.232525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904606ad-57d7-4417-91cf-ebce54f5cf4d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.258288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df747363-09fe-41bb-8c6b-2cf656aab5a2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.283758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.284495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.284884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.285263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.286120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:10.286565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.288110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128415b-8877-4c9f-b96d-efd069e7660b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:10.302438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:10.310756 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 275/542] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:10.311981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858848-6b7a-49db-936f-e47ca12e2461 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.312445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858848-6b7a-49db-936f-e47ca12e2461 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.312815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858848-6b7a-49db-936f-e47ca12e2461 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.313906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67772-3cb0-409a-862a-5edd1a202fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.314735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67772-3cb0-409a-862a-5edd1a202fa5 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.315170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67772-3cb0-409a-862a-5edd1a202fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.315770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67772-3cb0-409a-862a-5edd1a202fa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.318540 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 276/543] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:10.319688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858848-6b7a-49db-936f-e47ca12e2461 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.330640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67772-3cb0-409a-862a-5edd1a202fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-6bf67772-3cb0-409a-862a-5edd1a202fa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:10.339955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:10.341145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:10.342189 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:10.350154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 268/544] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:10.352114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.352544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.353216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.378523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:10.380392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:10.424611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:10.456694 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 269/545] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:10.457910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.467217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858848-6b7a-49db-936f-e47ca12e2461 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.508013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.509062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.509062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.509062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.521153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.522772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f23e8ca2-df86-48bd-8ccc-077727d0923e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:10.540517 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:10.542571 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:10.543482 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:10.543482 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:10.543482 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:10.543482 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 277/546] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:10.543975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaad4b0-117d-4af3-9fc3-a2a98132659b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.544262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaad4b0-117d-4af3-9fc3-a2a98132659b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.544534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaad4b0-117d-4af3-9fc3-a2a98132659b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.546205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 278/547] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:10.549552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaad4b0-117d-4af3-9fc3-a2a98132659b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.598203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0399e4-255c-432c-b631-f23eea4cfdac None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.642527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:10.656941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.657986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.658300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.658580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.659557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:10.659863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.661542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d31ab-f620-4ad0-ba03-3fa12fff6b21 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:10.674509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 270/548] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:10.678498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.678794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.679071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.687995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaad4b0-117d-4af3-9fc3-a2a98132659b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.701566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:10.703461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:10.719470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:10.732564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.733193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.733478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.733753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.734474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:10.737393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.737393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:10.754264 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 279/549] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:10.755129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.792838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 271/550] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 04:57:10.794021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.873905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0c4a-a4d0-4e33-93e5-96768a38e56a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.913723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.914748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.915239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.916212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.929847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.930437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4193c-9f4d-4525-b594-e1d44969251d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:10.932756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:10.944048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:10.952736 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:10.953788 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:10.954741 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:10.954741 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:10.954741 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:10.954741 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 280/551] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:10.954741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:10.987522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:10.988142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:10.988422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:10.988698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:10.989358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:10.990775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.017738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.020839 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 272/552] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:10 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:11.021512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.095953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d10e46-6303-4d4d-8546-35f06b7216d8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.164678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.167057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.167570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.168323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.169756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c17c4-317f-46bc-8bdf-c42a098df3bd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.180787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.182388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:11.194565 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:11.195558 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:11.196410 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 281/553] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:11.198009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.220589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.221649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.222626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.222626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.223344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:11.223731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.225243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.239887 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 273/554] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:11.240885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.274700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.329427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.339922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1656-3742-4edd-850a-f49f5a7f2f54 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.373121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e07c-9222-4239-bf55-cde47a56803c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.378513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.379260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.379642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.380017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.391603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:11.396735 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:11.397805 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:11.398647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:11.399263 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 282/555] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:11.399701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.422459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.423163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.423446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.423724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.425017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:11.425333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.427499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.442609 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 274/556] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:11.443444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.518556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7a0a-c1e1-4c43-a0af-b176b688c9d3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.554832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.555477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.555813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.556318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.563006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd66984-7b70-4608-b3bd-0c93497b5bae None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.564395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.566340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.566456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:11.579331 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:11.580298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:11.581219 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:11.585178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 283/557] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:11.586009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.604479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.605811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.606310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.607533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.608090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.608957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:11.609510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.611506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.622781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 275/558] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:11.623912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.696584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c7435-bebc-4f6a-9f00-218df5f080f9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.736886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.737576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.737860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.738139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/dac7255e7a4c40ff8be7f90f56aa6f38/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.744731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81dd9d-cc0a-4069-80c1-b01b6dae5105 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.755496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=dac7255e7a4c40ff8be7f90f56aa6f38, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.757427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.773490 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 284/559] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:11 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/dac7255e7a4c40ff8be7f90f56aa6f38/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:57:11.774632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.796014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.796704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.796982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.797260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.798187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:11.802569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.804091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.840571 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 276/560] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:11.846135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:11.854296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.870333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:11.898472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e503f-dc93-4956-9634-5768f16f61f4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:11.939166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:11.939876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:11.940170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:11.940491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:11.953126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:11.954630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:11.971692 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:11.972698 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:11.973583 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:11.973583 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:11.973583 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:11.973583 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 285/561] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:11.981746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.096813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efa4d-8483-4e2e-8d03-b47667281162 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.100659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcd7fe-dbf1-4b36-a6ce-73d4b1e3fe6f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.116914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:12.137498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.138238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.138526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.138807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.139666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:12.139974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.140979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c2033-42d5-47ae-9694-2a4763797739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.141479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.142194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2033-42d5-47ae-9694-2a4763797739 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.142655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2033-42d5-47ae-9694-2a4763797739 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.143193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2033-42d5-47ae-9694-2a4763797739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.154877 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 286/562] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:12.161617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.248535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c2033-42d5-47ae-9694-2a4763797739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.250454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c2033-42d5-47ae-9694-2a4763797739 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.264497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:12.333919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f9e59-2369-4999-9ae5-225dd45c1ee8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.374506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.375478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.375944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.376395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.384007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.385778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:12.398496 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:12.399483 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:57:12.401002 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:12.401543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 277/563] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:57:12.402544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1bb5-f379-4a52-ae8f-f6550cafa037 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.402900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1bb5-f379-4a52-ae8f-f6550cafa037 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.403245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1bb5-f379-4a52-ae8f-f6550cafa037 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.412517 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 278/565] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:12.412517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1bb5-f379-4a52-ae8f-f6550cafa037 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.412835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 287/565] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:12.413918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.463585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:12.524236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1bb5-f379-4a52-ae8f-f6550cafa037 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.546545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:12.546852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9fd48-f11c-42a5-9dc9-e37f6a0f4ab0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.571526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.572732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.573218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.573737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.584736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.586503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.586614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.587326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.588191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.588477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.589308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:12.589622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.591583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-bf3a4714-5834-4663-8266-eb80a75ee3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:12.609373 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:12.610885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:12.611790 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:12.611790 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:12.611790 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:12.611790 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 279/566] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:12.612011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.612442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.612539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.618213 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 288/567] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:12.619736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.633172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:12.634397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:12.727163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:12.734178 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 280/568] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:12.734178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.744324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e440512-b2ab-45e6-a33a-95101bb10f6c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.825173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.826268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.826761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.827287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.828147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:12.828811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.830416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.832392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:12.846549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362e0e-6ea0-4631-ba4f-03747f91e25c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:12.856652 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 289/569] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:12.861740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:12.886976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:12.888095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:12.888669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:12.889090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:12.902376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:12.904073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:12.922043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:12.923243 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:12.924175 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:12.924175 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:12.924175 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:12.926200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 281/570] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:12.935109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.001450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14159-215e-4963-ade4-0e1e15ab4111 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.038021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.038727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.039012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.039290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.046398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.047879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:13.059747 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:13.060769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:13.061678 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 290/571] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:13.066372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.110512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.142739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d6c3-6817-4883-a94e-57348072a3b8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.189407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.190345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.190634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.190916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.191938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:13.192257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.194436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.207436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.215820 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 282/572] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:13.215820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.221495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88666571-9065-4399-b071-ceb8c1dff63c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.273414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.274245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.274635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.275003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.276785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:13.277202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.279196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.294813 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 291/573] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:13.295972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.364292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d423c8-2382-48a2-bc0a-b32e109d86d2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.384465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.407153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.408210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.408641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.409078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.409839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.410471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8df61-3d51-4fc7-a8d8-515a9ad9e85f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.411581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:13.424192 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:13.425440 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:13.426443 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:13.428669 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 283/574] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:13.429740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.454729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.455393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.455680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.455955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.464054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.465571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:13.477360 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:13.479113 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:13.480071 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:13.483804 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 292/575] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:13.484667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.507788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.553331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dbfec-7047-4fcd-ac26-14a34db6fdbd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.590478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d018-31a3-4880-a38b-def9622b838d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.590979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.591546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.591826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.592101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.592830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=c82a0f508316483c92cc7872c1be0ad0) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:13.593140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.594615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.600518 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 284/576] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/role_assignments?user.id=c82a0f508316483c92cc7872c1be0ad0&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:13.601296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.628512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.629620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.630204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.630770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.631509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:13.631901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.633390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ef17-4814-491b-99dd-2531569d8b64 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.636839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.641280 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 293/577] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:13.643037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4d767-efb4-487f-95aa-c21a9b42838f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.643871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4d767-efb4-487f-95aa-c21a9b42838f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.644613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4d767-efb4-487f-95aa-c21a9b42838f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.650273 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 294/578] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:13.650273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4d767-efb4-487f-95aa-c21a9b42838f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.748314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08b38-f0b1-40af-a964-bf7e25dc6d9c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.774633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4d767-efb4-487f-95aa-c21a9b42838f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:13.784294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.795071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.795706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.795982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.796234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.796940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:13.797248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.798841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c39d35-e9b1-4b1b-9afd-433891a07b2b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.814870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 285/579] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:13.815881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.821008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.821321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.824277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:13.824905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:13.825192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:13.825470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:13.826116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:13.826473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:13.827841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:13.834576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 295/580] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:13.835675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.841831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:13.843098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:13.914662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:13.936313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 286/581] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:13.941254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:13.973493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914674-7786-4117-9953-dc44e42e015e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.037564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.038265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.038557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.038830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/d29fb54e4c484f94a012b821cdb5ae64/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.042218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=d29fb54e4c484f94a012b821cdb5ae64, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.043665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:14.066196 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 296/582] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:13 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/d29fb54e4c484f94a012b821cdb5ae64/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:57:14.109269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb121ef-3878-4ff6-8a6c-524517af6c1a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.138367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:14.162716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.163441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.163794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.164146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.164936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] RBAC: Adding query filter params (interface=public, service_id=a14a1e550eaf4c248030a09350d6fcf2, region_id=RegionOne) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:14.165319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.167323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:14.180792 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 287/583] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:13 2022] GET /identity/v3/endpoints?service_id=a14a1e550eaf4c248030a09350d6fcf2&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:14.187024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:14.283114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:14.310930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614498-2b8b-4e70-aa8f-dab42a402699 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.342686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:14.350900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a571c-550b-4aa2-a4b6-fce461dacc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.351664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a571c-550b-4aa2-a4b6-fce461dacc5c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.352127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a571c-550b-4aa2-a4b6-fce461dacc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.352508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a571c-550b-4aa2-a4b6-fce461dacc5c None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.354295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a571c-550b-4aa2-a4b6-fce461dacc5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.356059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a571c-550b-4aa2-a4b6-fce461dacc5c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:14.361812 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 297/584] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:14 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:14.414530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a400b9-4feb-42bb-8dc9-54cfa1b07e89 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.414892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a400b9-4feb-42bb-8dc9-54cfa1b07e89 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.415101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a400b9-4feb-42bb-8dc9-54cfa1b07e89 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.417241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 298/585] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:14.423931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.424282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.424518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.427794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70affeb5-f25c-4a83-96d7-4c35ecb1f825 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.446415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:14.448232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:14.468425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.469092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.469445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.469726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] PATH_INFO: `/v3/services/network` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.470356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.471780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:14.482866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:14.483990 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:14.484965 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 288/586] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:14 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:14.490124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:14.546529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:14.577838 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 299/587] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:14.611398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a17f-0534-4ed4-9d40-7fae84ff3382 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.651542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.652156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.652442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.652714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.653397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:14.653702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.655142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:14.660177 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 289/588] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:14.665479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:14.775621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323692a-e97a-4da4-99eb-6b893090736c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.794170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:14.812585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.813262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.813547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.813821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.814493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] RBAC: Adding query filter params (type=network) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:14.814798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.816249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:14.821600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 300/589] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:14.827238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:14.942212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:14.945112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc42fb-c4f7-46f1-8ba9-f7eda133c5c2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:14.959631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:14.989709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:14.990363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:14.990644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:14.990917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:14.991954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] RBAC: Adding query filter params (interface=public, service_id=a09341832fda469d8721da3d65d58e09, region_id=RegionOne) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:14.992550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:14.994211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:15.000939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 290/590] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:14 2022] GET /identity/v3/endpoints?service_id=a09341832fda469d8721da3d65d58e09&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:15.011231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:15.110193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80564-704a-4412-9209-020dab9c16ad None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:15.129383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41612-f7f3-4564-aa9e-e1d6a684688b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:15.157612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:15.158630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:15.159080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:15.159493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:15.166838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:15.167468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:15.167746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:15.168019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:15.168950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:15.170514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:15.172828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:15.176359 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 291/591] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:15 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:15.178008 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:15.179238 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:57:15.180263 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:15.191159 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 301/592] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:15.193811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:15.278629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:15.386994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819348bf-8800-4caa-8c2e-94165b80bebd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:15.440453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:15.441077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:15.441364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:15.441643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:15.442342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:15.442651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:15.444087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:15.455659 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 292/593] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:15.461344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:15.540054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:15.617986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe1cec-a9eb-4be9-a89c-5fd800d3388c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:15.666853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:15.667520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:15.667797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:15.667973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:15.682913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:15.684359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:15.705591 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:15.706647 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:15.708151 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:15.708151 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:15.708151 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:15.708151 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 302/594] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:15.712201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:15.851031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:15.855545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa19d3-264b-48fb-8530-7b64a25bc04a None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:15.909293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:15.909914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:15.910219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:15.910497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:15.911153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:15.911460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:15.912836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:15.929509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 293/595] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:15.934867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:16.060490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:16.068581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a708-f71b-460e-b733-9ac9757db7f6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:16.120313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:16.120970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:16.121255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:16.121529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:16.132309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:16.133770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:16.148192 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:16.151203 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:16.153535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 303/596] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:57:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:16.158808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:16.343106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab1be-becc-41d5-928d-ec14c00a5a70 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:16.393377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:16.394056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:16.394372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:16.394648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:16.395389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:16.395699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:16.397134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffa198-cb2c-440e-85d6-749d4f702296 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:16.423392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 294/597] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 04:57:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:16.428705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:16.445208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270414-fa69-40b5-b46c-e2c0bf0222c7 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:16.445517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270414-fa69-40b5-b46c-e2c0bf0222c7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:16.445768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270414-fa69-40b5-b46c-e2c0bf0222c7 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:16.447913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 295/598] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:16.452965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:16.453253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:16.453533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:16.471522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:16.472714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:16.487917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:16.584132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 296/599] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:16.614372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b5fd9-cba1-42fc-ac10-af62b1240b46 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:16.654218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:16.654852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:16.655141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:16.655419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:16.682605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:16.737355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:16.738848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:16.873304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 304/600] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:57:16.879137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:16.945182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.010217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.049811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cc0a9-a5e6-45a4-84fd-0cb6399edacc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.071464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213f31-0539-4d0c-8a5a-946ef7bd914f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.097585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.098280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.098562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.098835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.111903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.113513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.120293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.121222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.122184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.122661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.123493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.123599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.125816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f601cb8c-11d8-4184-86e0-e99596de1614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:17.131667 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:17.132598 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:17.133466 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:17.133466 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:17.133466 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:17.133466 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 297/601] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4a4b8bed-06aa-45d9-a01c-e0118bc79568 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:17.137873 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:17.138845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:17.139725 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:17.140452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538b98-5575-40fb-96b3-0a23a80e0fa6 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.140452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538b98-5575-40fb-96b3-0a23a80e0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.140452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538b98-5575-40fb-96b3-0a23a80e0fa6 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.140452 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 298/602] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:17.142227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538b98-5575-40fb-96b3-0a23a80e0fa6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.142405 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 305/603] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 04:57:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:17.146322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.146712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.147088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.166427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:17.167748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:17.238935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 306/604] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:17.239991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.265819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538b98-5575-40fb-96b3-0a23a80e0fa6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.312635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.313665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.314098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.314984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.316049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:17.316518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.317336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.318386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697685a-0853-4d05-b95a-5790442d970d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.335285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 299/605] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:17.336744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a219dc-b864-45a3-8145-85403e9bb2da None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.337174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a219dc-b864-45a3-8145-85403e9bb2da None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.337674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a219dc-b864-45a3-8145-85403e9bb2da None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.340669 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 300/606] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:17.346006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a219dc-b864-45a3-8145-85403e9bb2da None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.381877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cdd4b-4c92-4b63-bf11-e6c98515e486 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.421103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.421896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.422320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.422692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.423480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:17.423882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.425393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ea01-9128-4975-bc8e-fe0bc1db4ce0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.425807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.432080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 307/607] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:17.433652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.434057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.434481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.455764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:17.457192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:17.477180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a219dc-b864-45a3-8145-85403e9bb2da None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.518956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.520022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.520307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.520586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.527862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.529345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.534462 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 308/608] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:17.541912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:17.542214 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:17.543072 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:17.544023 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 301/609] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:17.544520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.608921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.656218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f18ea-fc93-4139-b798-36fdbf8406e8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.678814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89504c19-e9aa-4ca1-9154-30cfeb217c74 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.684555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.702509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.703244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.703528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.703803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.717580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:17.723247 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:17.724303 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:17.725132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 302/610] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:17.725844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.736372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.737088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.737485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.737885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.738662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:17.739069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.740583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.746702 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 309/611] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:17.747680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.861374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21265a8-7bcb-43c0-9f21-f0913a5c5529 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.879112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5cc4d-d601-4d5c-81b9-6ec6895bba2d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:17.889549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:17.901776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.902429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.902709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.902985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.903696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:17.904004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.905474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.920253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 303/612] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:17.923024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:17.923660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.923945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.924221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.924997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:17.925283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:17.925955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.926723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766b11d-f3f8-4800-9d6d-b33a393c5773 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:17.938514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 310/613] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:17.939803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062542d-5800-4158-88e9-4577a0072126 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:17.940362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062542d-5800-4158-88e9-4577a0072126 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:17.940362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062542d-5800-4158-88e9-4577a0072126 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:17.945635 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 311/614] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:17.945635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062542d-5800-4158-88e9-4577a0072126 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:17.979007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.046842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad041955-c14b-423c-a208-63026ec945fe None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.054500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062542d-5800-4158-88e9-4577a0072126 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.083479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.084121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.084403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.084675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.085256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.086673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.091615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.092286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.092579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.092853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.093726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=dac7255e7a4c40ff8be7f90f56aa6f38) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:18.094066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.095585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b961c-3888-492e-ab69-e32e6dd15987 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:18.096423 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:18.097368 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:18.098376 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 304/615] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:18.099618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.114557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 312/616] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:17 2022] GET /identity/v3/role_assignments?user.id=dac7255e7a4c40ff8be7f90f56aa6f38&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:18.114557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.114557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.114557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.130862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:18.132182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:18.167908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.226378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe865-8faf-4b6e-b1ed-4bacbc671761 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.229284 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 313/617] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:18.229639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.231691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.266441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.267091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.267369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.267641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.280119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.281667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:18.300087 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:18.301323 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:18.302464 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:18.302464 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:18.302464 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:18.303800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 305/618] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:18.310018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.421029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446055a-44fd-40bd-8fad-897e1bbbae50 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.425201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98e73e-643c-4f86-8646-a97495ce2f3e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.465110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.466001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.466475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.466897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.467759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:18.468211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.469727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.474615 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 314/619] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:18.480994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.482120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.482742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.483021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.483291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.483941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:18.484242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.485769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.500085 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 306/620] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:18.505478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.512446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.526093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.592140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f4984-9086-4e66-aa60-0e171c41409e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.617146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39147-6de0-4181-9059-8423de9db03a None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.628519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.629462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.629949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.630477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.631334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:18.631860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.633435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.639872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 315/621] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:18.640947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.655129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.656255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.656730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.657328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.666554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.668191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:18.681034 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:18.682286 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 04:57:18.683238 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:18.686988 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 307/622] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:18.687905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.744039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.754996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324ae7-9b82-43ce-aec7-bfac87536653 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.776777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:18.795862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.796909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.797419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.797892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.798803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.800487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.802683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96a17f-2620-4d4a-8a39-937bb39e8d8f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:18.810408 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:18.811419 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 04:57:18.812275 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:18.815072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 316/623] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:18.816069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.845864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:18.846601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:18.846805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:18.847056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:18.847727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:18.849217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:18.875900 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 308/624] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:18.876842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:18.939755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01100f4-2255-40b3-972e-aaeb586458b2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.008529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:19.009083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:19.009364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:19.009839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:19.010777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:19.011088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:19.012583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:19.024613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46132-b461-410f-a7e9-ff6da25617e7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.051785 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 317/625] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:19.058790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:19.078227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:19.092663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:19.103253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:19.104559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:19.105084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:19.105552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:19.106408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] RBAC: Adding query filter params (name=network) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:19.106884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:19.109183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:19.115919 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 309/626] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:19.120920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:19.221403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dcac0-70e2-4b88-82aa-2f3d8f1d4b3c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.256129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24087c4b-5982-45b2-85ea-1455e410c909 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.271373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:19.272018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:19.272717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:19.272998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:19.305538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:19.306245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:19.307132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:19.307424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:19.308040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:19.308342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:19.309937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:19.315914 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 310/627] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:19.321439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:19.367989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:19.370288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:19.384029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:19.400508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:19.483671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091a19d-8710-407f-8fa3-c96abe3ae9a4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.550915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:19.551446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:19.551726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:19.551990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:19.552652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:19.558658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:19.571201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 318/628] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:57:19.575127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:19.601914 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 311/629] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:19 2022] POST /identity/v3/endpoints => generated 337 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:19.708397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e744ca-cabd-4828-868a-9082a6264c2d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.719260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:19.765397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:19.766199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:19.766418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:19.766696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:19.783477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:19.786239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:19.810316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:19.811407 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:19.812306 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:19.812306 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:19.812306 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:19.812306 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 319/630] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:19.817286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:19.955527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7651fd5-d00d-4591-8760-bdf1ab152cc6 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:19.977627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:19.999941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:20.000564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.000841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.001111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.001754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:20.002054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:20.003450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421558c1-d661-4954-9de2-40bff343f3b2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:20.018400 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 312/631] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:20.024440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:20.151479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900434-1bb8-45fe-9429-53341d567384 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:20.191896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:20.192536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.192816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.193098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.200563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:20.201780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab1b9-787a-4095-9f4e-3953eeb06081 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.202267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:20.202348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab1b9-787a-4095-9f4e-3953eeb06081 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.202348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab1b9-787a-4095-9f4e-3953eeb06081 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.203942 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 313/632] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:20.209443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.209730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.210006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:20.215358 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:20.216213 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:20.217084 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:20.218107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 320/633] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:20.223737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:20.235424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:20.236607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:20.254482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:20.327425 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 314/634] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:20.346509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc0ff7-8608-4f87-a7d0-65f1f475b782 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:20.381841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:20.382489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.382770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.383044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.383741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:20.384050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:20.385984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:20.398690 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 321/635] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:20.404782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:20.509252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d9cd5-ec29-403e-91c2-214ed30684c2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:20.516932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:20.545210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:20.545821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.546098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.546410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.547184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=d29fb54e4c484f94a012b821cdb5ae64) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:20.547780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:20.549209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b46e-e174-4bfb-9111-6f26e53b812a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:20.555353 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 315/636] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:20 2022] GET /identity/v3/role_assignments?user.id=d29fb54e4c484f94a012b821cdb5ae64&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:20.604648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:20.691593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:20.718632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308a9e-afaf-4eda-9912-c5b1a2666950 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:20.756344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395249e2-ea79-4f4f-b692-ad0d9a2ef198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:20.756982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395249e2-ea79-4f4f-b692-ad0d9a2ef198 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.757263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395249e2-ea79-4f4f-b692-ad0d9a2ef198 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.757537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395249e2-ea79-4f4f-b692-ad0d9a2ef198 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.758243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395249e2-ea79-4f4f-b692-ad0d9a2ef198 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:20.759925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395249e2-ea79-4f4f-b692-ad0d9a2ef198 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:20.782250 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 322/637] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:20 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:20.901395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869f2b0-e6c4-4f24-9c83-1f6992f03f2e None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.902115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869f2b0-e6c4-4f24-9c83-1f6992f03f2e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.902625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869f2b0-e6c4-4f24-9c83-1f6992f03f2e None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.904568 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 316/638] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:20.910602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:20.910895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:20.911162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:20.935518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:20.936730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:21.021335 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 323/639] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:20 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:21.300054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869f2b0-e6c4-4f24-9c83-1f6992f03f2e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:21.415055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869f2b0-e6c4-4f24-9c83-1f6992f03f2e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:21.451120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc26c98-4329-480f-ac00-83b132940dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:21.451757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc26c98-4329-480f-ac00-83b132940dd8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:21.452085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc26c98-4329-480f-ac00-83b132940dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:21.452362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc26c98-4329-480f-ac00-83b132940dd8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:21.463460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc26c98-4329-480f-ac00-83b132940dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9bc26c98-4329-480f-ac00-83b132940dd8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:21.468179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:21.469074 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:21.469919 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 317/640] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:57:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:21.476909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:21.484916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64e07-c6ee-4724-871b-c48629a77eef None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:21.485195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64e07-c6ee-4724-871b-c48629a77eef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:21.485482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64e07-c6ee-4724-871b-c48629a77eef None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:21.487704 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 318/641] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:21.492687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:21.492972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:21.493251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:21.512167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:21.513364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:21.543486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:21.553517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:21.602660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9690b-f087-4e2b-9dfe-1bcdf9b244ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:21.614294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 319/642] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:21 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:21.648389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:21.649008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:21.649292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:21.649623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:21.650761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:21.650761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:21.652129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:21.660818 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 324/643] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 04:57:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:21.667243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:21.769242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d599c-ef03-4625-9475-a14a6da7c207 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:21.807442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:21.808512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:21.809066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:21.809538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:21.820313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:21.821999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:21.836729 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:21.837730 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:21.838631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:21.838631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:21.838631 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:21.840667 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 320/644] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:21.847220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:21.907041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:21.927175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:21.968999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c77c7-985e-469e-821a-37dcc1a7c1db None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:21.994968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:22.007907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.008773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.009253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.009722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.010549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:22.011060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.012773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.026637 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 325/645] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:22.029968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dbdfc-21bc-4fcd-8616-50d09697bcb7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.031750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.072306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.072863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.073140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.073412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.073998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.075436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:22.088183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:22.089394 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:22.090689 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 321/646] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:22.095114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.152741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f05a-298d-4796-917e-ded01a3906fb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.180907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:22.201148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.201795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.202076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.202391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.210121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7586af-e678-4d54-972d-f818e698b349 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.211210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.213467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:22.229097 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:22.230194 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:22.231187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 326/647] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:22.235736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.260316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.261647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.262721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.263215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.264127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:22.264638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.266263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.274292 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 322/648] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:22.282195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.301788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:22.366912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a8dac-b810-4990-9e4b-0dcd22a0ae2e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.412570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e7a57-7d02-4849-91ca-ea857598917e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.413220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.414279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.414728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.416544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.417442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:22.417896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.419507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.446522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 327/649] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:22.449332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.454934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.455763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.456190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.456609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.457397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:22.458390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.460371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.474435 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 323/650] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:22.570696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0e795-141f-48c3-9e82-2c43e9ce4416 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.573162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:22.612470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.613116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.613394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.613669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.626874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.628415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:22.645112 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:22.646129 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:22.647741 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:22.647741 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:22.647741 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:22.647741 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 328/651] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:22.653221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.657321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:22.774018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2237-0dff-42af-bdc0-742f8904fc2e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.811788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:22.812405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.812684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.812960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.813602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:22.813909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:22.815312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ce2b6-b79d-4069-a60c-c037d6c253a7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:22.829197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 324/652] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:22.835022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:22.848448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239ddb-e00c-41f3-8c8d-2a8380476ea3 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.848742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239ddb-e00c-41f3-8c8d-2a8380476ea3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.849005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239ddb-e00c-41f3-8c8d-2a8380476ea3 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.850628 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 325/653] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:57:22.856515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:22.856799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:22.857072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:22.878174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:22.879299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:22.947021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:22.957965 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 326/654] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:22.958133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10367252-649e-4422-9fca-ebe39318e028 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:22.999754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.000652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.000917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.001186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.009737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.012100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f03a4eee-af5b-4841-9533-e1ec91ac7856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:23.026689 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:23.027650 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.028826 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 329/655] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:23.034115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.124589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827985c-c400-443b-b2b3-a9dac3bc11b5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.124880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827985c-c400-443b-b2b3-a9dac3bc11b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.125163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827985c-c400-443b-b2b3-a9dac3bc11b5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.126787 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 330/656] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:23.131768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.131991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.132269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.145971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad1ad8-e99a-4a08-bb19-1d619c98ab8f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.151351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:23.152755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:23.163207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:23.191843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.193267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.193545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.193900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.194631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:23.194936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.196362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.214038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 327/657] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:23.219833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.236597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 331/658] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:23.239072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.295638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:23.347130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40eae7-6918-4f4b-98b1-e44ddd6b6cd8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.373486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc0ba-8382-42e7-af68-c4e88c93185b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.385828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.386730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.387155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.387573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/dac7255e7a4c40ff8be7f90f56aa6f38/roles/1e7512e9a3884346ab707d652a04b135` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.390027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=dac7255e7a4c40ff8be7f90f56aa6f38, role_id=1e7512e9a3884346ab707d652a04b135)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.391641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.418176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 328/659] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:23 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/dac7255e7a4c40ff8be7f90f56aa6f38/roles/1e7512e9a3884346ab707d652a04b135 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 04:57:23.423781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.424541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.424871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.425236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.425845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.427383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:23.438522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:23.439577 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.440411 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 332/660] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:23.446389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.515332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.533409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:23.584121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087559b-4bb8-410b-a6f4-f63026f3f894 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.600869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:23.627316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.627932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.628211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.628483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.629636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:23.629636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.630801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.636194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 329/661] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:23.642377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.664332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c4cab-05a6-4dd9-adb4-5fc22d1b066d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.699917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.700922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.701394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.701851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.702643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.704126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:23.714038 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:23.715025 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:23.715909 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 333/662] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:23.722896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.770013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da38c82-ab2a-403d-abee-f2271b48881e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.807929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.808802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.809205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.809602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.810346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:23.810746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.812352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.817925 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 330/663] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:23.819641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:23.858688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36eff4-204f-4086-a781-cdb1b428fe4f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:23.900887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:23.901783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:23.902247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:23.902669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:23.903474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:23.903956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:23.905524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:23.911568 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 334/664] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:23.918359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:23.971100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:24.033107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdc5a-1776-4e13-b712-ad577c4548a4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:24.068080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:24.068984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:24.069412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:24.069855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:24.070735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:24.071186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:24.073333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:24.078722 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 331/665] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:24.085435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:24.196333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198141-30ae-49d8-ba77-09e6e9620fde None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:24.234418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:24.235287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:24.235720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:24.236141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:24.237020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] RBAC: Adding query filter params (interface=public, service_id=c41b641ad32243ff860f00e36a5163ad, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:24.237479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:24.239020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7bd9f-dc67-4337-ba00-782222e128e9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:24.243970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:24.248151 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 335/666] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:24 2022] GET /identity/v3/endpoints?service_id=c41b641ad32243ff860f00e36a5163ad&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:24.254325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:24.366095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd616-4fec-490a-9b8b-ae01cb71e8a5 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:24.374023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:24.406289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d99061-02d1-4213-974b-9db0e3a7f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:24.407150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99061-02d1-4213-974b-9db0e3a7f80c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:24.407599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99061-02d1-4213-974b-9db0e3a7f80c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:24.408013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99061-02d1-4213-974b-9db0e3a7f80c None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:24.408753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d99061-02d1-4213-974b-9db0e3a7f80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:24.410279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d99061-02d1-4213-974b-9db0e3a7f80c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:24.422526 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 332/667] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:24 2022] GET /identity/v3/services => generated 1029 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 04:57:24.811043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52484b6-73fa-411a-b7c0-6d0e58351e7d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:24.811741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52484b6-73fa-411a-b7c0-6d0e58351e7d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:24.812232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52484b6-73fa-411a-b7c0-6d0e58351e7d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:24.814029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 336/668] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:24.819046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42bff-4515-453a-9ecc-d5dc78991d62 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:24.819330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42bff-4515-453a-9ecc-d5dc78991d62 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:24.819606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42bff-4515-453a-9ecc-d5dc78991d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:24.838283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-10a42bff-4515-453a-9ecc-d5dc78991d62 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:24.839457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-10a42bff-4515-453a-9ecc-d5dc78991d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:24.909662 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 333/669] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:25.179473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52484b6-73fa-411a-b7c0-6d0e58351e7d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:25.294186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52484b6-73fa-411a-b7c0-6d0e58351e7d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:25.328337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7ca8-72e4-4581-8f7c-7bdc5e2c9b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:25.328956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7ca8-72e4-4581-8f7c-7bdc5e2c9b95 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:25.329289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7ca8-72e4-4581-8f7c-7bdc5e2c9b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:25.329571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7ca8-72e4-4581-8f7c-7bdc5e2c9b95 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:25.330279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac7ca8-72e4-4581-8f7c-7bdc5e2c9b95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:25.331919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac7ca8-72e4-4581-8f7c-7bdc5e2c9b95 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:25.349308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 337/670] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:25 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:25.690505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a60b-15d9-4e6a-a609-4808c3220143 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:25.691544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a60b-15d9-4e6a-a609-4808c3220143 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:25.692030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a60b-15d9-4e6a-a609-4808c3220143 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:25.693852 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 334/671] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:25.700495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5f43-227d-4ac3-bbd6-f7c69878868e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:25.701053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5f43-227d-4ac3-bbd6-f7c69878868e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:25.701570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5f43-227d-4ac3-bbd6-f7c69878868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:25.720793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0bbe5f43-227d-4ac3-bbd6-f7c69878868e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:25.722336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0bbe5f43-227d-4ac3-bbd6-f7c69878868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:25.780171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:25.798995 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 338/672] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:26.073286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a60b-15d9-4e6a-a609-4808c3220143 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:26.074396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210f57-91d1-46bf-8d30-3e2ccba1e238 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.074902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210f57-91d1-46bf-8d30-3e2ccba1e238 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.075387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0210f57-91d1-46bf-8d30-3e2ccba1e238 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.077171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 339/673] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:26.083643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.084245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.084852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.106295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:26.108278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:26.187745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:26.194476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a60b-15d9-4e6a-a609-4808c3220143 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:26.200562 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 340/674] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:26.235511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:26.236513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.237015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.237496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.249226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:26.254952 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:26.255994 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:26.256885 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:26.266098 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 335/675] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:57:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:26.272439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:26.383445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8146-10a4-4d2a-959e-67dfcb4ea55d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:26.402290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:26.422563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:26.423495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.424037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.424514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.425374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:26.425875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:26.427487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:26.436458 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 341/676] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 04:57:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:26.442442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:26.541415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:26.549810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e668c8-a5be-47a5-aad0-6f4e93d9bc3b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:26.585537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:26.586835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.586835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.586835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.598662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:26.600156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:26.617246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:26.618311 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:26.619822 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:26.619822 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:26.619822 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:26.619822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 336/677] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:26.626055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:26.642393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:26.675485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be8ca-ef04-4038-abe6-1c8aa5edf59d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:26.714354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b13dc-3209-4b97-a70a-0487f464614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:26.715359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b13dc-3209-4b97-a70a-0487f464614d None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.715937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b13dc-3209-4b97-a70a-0487f464614d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.716488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b13dc-3209-4b97-a70a-0487f464614d None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.717421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b13dc-3209-4b97-a70a-0487f464614d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:26.719007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b13dc-3209-4b97-a70a-0487f464614d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:26.732997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8d3a4-4cc1-45b5-be41-768cdf6ea842 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:26.734810 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 342/678] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:26 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:57:26.735874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c03c-8e51-453d-9314-f702e0583dd0 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.736163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c03c-8e51-453d-9314-f702e0583dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.736440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c03c-8e51-453d-9314-f702e0583dd0 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.737831 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 343/679] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:26.744449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.744828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.745108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.766617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:26.767910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:26.802782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:26.803949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:26.805218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:26.805839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:26.807265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:26.808658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:26.809227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:26.811532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:26.831850 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 337/680] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:26.838935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:26.862581 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 344/681] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:26.930725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:26.963263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ddcee-5379-4dea-a7e0-4acff92381db None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.000408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.001345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.001768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.002209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.010448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.012064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:27.024112 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:27.025566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 04:57:27.026930 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:27.029037 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 338/682] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:57:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:27.034955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.146369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5cb60-e63a-4e06-9671-af5f35c92ed2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.155779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.184166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.184714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.185000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.185278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.186178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:27.186481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.187921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.211268 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 345/683] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:27.212620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.241893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:27.283114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075473-e9ba-4de8-bb9a-814d31aaea54 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.316832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:27.319139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.320080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.320368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.320647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.321709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.324535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:27.336487 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:27.338056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:27.344361 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 339/684] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:27.345191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.350118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3050-7f31-458e-89e2-de56f58a389f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.388465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f26d4-ed7f-4c1e-afc9-f7c2fdc8fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.389086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f26d4-ed7f-4c1e-afc9-f7c2fdc8fc90 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.389368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f26d4-ed7f-4c1e-afc9-f7c2fdc8fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.389645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f26d4-ed7f-4c1e-afc9-f7c2fdc8fc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.457154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73b3fd-2531-4672-983f-1b5e6011d3cd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.468895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f26d4-ed7f-4c1e-afc9-f7c2fdc8fc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.470508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f26d4-ed7f-4c1e-afc9-f7c2fdc8fc90 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.495653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.496661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.497142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.497627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.498504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:27.499021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.499602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:27.500992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.511738 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 340/685] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:27.512946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.573516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:27.585027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 346/686] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:57:27.587097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be52e-6176-448f-852a-5cd0bdf65056 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.587737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be52e-6176-448f-852a-5cd0bdf65056 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.588363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be52e-6176-448f-852a-5cd0bdf65056 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.590266 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 347/687] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:27.592118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087be52e-6176-448f-852a-5cd0bdf65056 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.624919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c880-c0dd-4038-bbb9-44e3553333d4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.660363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.660974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.661255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.661524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.662167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:27.662470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.663834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d614-db42-4064-9f93-33da30dc5296 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.674069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 341/688] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:27.675358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.675648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.675927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.696941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:27.698225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:27.709801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087be52e-6176-448f-852a-5cd0bdf65056 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.738282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:27.750035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.750840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.751404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.751688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.762843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.764278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.774621 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 342/689] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:27.774621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:27.782593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:27.783592 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:27.784510 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:27.784510 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:27.784510 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:27.784510 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 348/690] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:27.789178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.853396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:27.909317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e29590-467b-4f5f-9863-0448a79d6642 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.922307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f216c02-6978-4e37-acc4-d4902f1e092c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:27.944148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.944844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.945232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.945577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.946338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:27.946712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.948666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:27.961011 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 349/691] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:27.966358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:27.969507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:27.971247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:27.971718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:27.972174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:27.973047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:27.974706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.003350 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 343/692] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:28.014070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:28.082393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.090336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff4a3-d138-4038-9e47-2fa783a88624 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.136816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.137432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.137717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.138003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.145788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.147239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:28.160693 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:28.161651 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:28.162593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 350/693] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:28.167877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.223546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16bc9a-3253-498d-a0b4-cd7aa1c1c964 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.234321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:28.270387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.271146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.271428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.271701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.272290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.273655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:28.283647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:28.284689 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:28.285520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:28.289930 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 344/694] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:28.291588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.293875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:28.306293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca2cc2-24d6-4aef-9591-e0eb7f73e305 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.343918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.344874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.345388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.345952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.346972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:28.347536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.349193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.365038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 351/695] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:28.371318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.402170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416fd4f-f098-4698-bef0-ede848300750 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.439591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.440219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.440499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.440772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.441531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:28.441800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.443200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.453509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 345/696] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:28.454776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.485521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142fd1-4af2-4acf-8269-34357e2abfd6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.491885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:28.526504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.527695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.528301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.528775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.529706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] RBAC: Adding query filter params (role.id=1e7512e9a3884346ab707d652a04b135, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=dac7255e7a4c40ff8be7f90f56aa6f38) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:28.530243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.532108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.546505 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 352/697] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/role_assignments?user.id=dac7255e7a4c40ff8be7f90f56aa6f38&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=1e7512e9a3884346ab707d652a04b135 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:28.565492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1045-2ffe-49fd-a1e1-838dc9acd5ca None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.607037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.607673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.607953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.608228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.608875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:28.609179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.610602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.621785 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 346/698] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:28.623244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.645309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:28.745042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700e4d-f772-41d6-ab27-f58518b16272 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.780803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.781430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.781712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.781992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.782733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] RBAC: Adding query filter params (interface=public, service_id=dee9b4ad87764abb8638d4dc86482fb4, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:28.783040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.784404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f1b42-f538-4e69-902c-ea108fd20488 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.794212 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 353/699] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/endpoints?service_id=dee9b4ad87764abb8638d4dc86482fb4&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:28.796666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:28.902282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823746-8ecc-4d02-b3c6-d5397a8005a0 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:28.904244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:28.943795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656bdc2-9e31-48a5-b1d2-84d6a0aaff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:28.944416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656bdc2-9e31-48a5-b1d2-84d6a0aaff70 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:28.944695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656bdc2-9e31-48a5-b1d2-84d6a0aaff70 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:28.944969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656bdc2-9e31-48a5-b1d2-84d6a0aaff70 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:28.945580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656bdc2-9e31-48a5-b1d2-84d6a0aaff70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:28.947884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656bdc2-9e31-48a5-b1d2-84d6a0aaff70 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:28.958275 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 347/700] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:28 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 04:57:29.037163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358b00c-429b-46f7-9f64-204ec08906b5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:29.037507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358b00c-429b-46f7-9f64-204ec08906b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:29.037736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358b00c-429b-46f7-9f64-204ec08906b5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:29.039473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 354/701] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:29.045734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:29.046027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:29.046314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:29.070806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:29.072143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:29.148962 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 348/702] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:29.423417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358b00c-429b-46f7-9f64-204ec08906b5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:29.517401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:29.538629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358b00c-429b-46f7-9f64-204ec08906b5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:29.577650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:29.578252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:29.578531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:29.578803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:29.579388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:29.580835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:29.590811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:29.591830 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:29.592719 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 355/703] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:29.598449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:29.697351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b962b7-cdc9-43d9-bdbe-72ccc9a5a94e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:29.699037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:29.733797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:29.734440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:29.734782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:29.735060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:29.735728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:29.736045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:29.737413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:29.746274 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 349/704] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:29.749132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:29.863888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f1c83-3a20-4d6a-a40b-84fbb43ebbc5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:29.902003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:29.902749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:29.903029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:29.903299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:29.903936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:29.904238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:29.905593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:29.911174 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 356/705] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:29.917102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:30.028953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb028f8a-59ba-4587-a73c-212bb78367e5 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:30.065230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:30.066211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.066704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.067158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.068035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] RBAC: Adding query filter params (interface=public, service_id=f82dfd90454849439277b500eb974863, region_id=RegionOne) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:30.068524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:30.070115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af44a8-6e41-44ea-9972-774b70247856 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:30.075823 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 350/706] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:29 2022] GET /identity/v3/endpoints?service_id=f82dfd90454849439277b500eb974863&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:30.081412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:30.093731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:30.186886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94261921-aa16-4e2a-8ca7-e3dec6fd5090 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:30.225903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb444f4-f313-45c4-8f36-af294ddaecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:30.226566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb444f4-f313-45c4-8f36-af294ddaecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.226845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb444f4-f313-45c4-8f36-af294ddaecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.227117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb444f4-f313-45c4-8f36-af294ddaecc3 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.227735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb444f4-f313-45c4-8f36-af294ddaecc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:30.230795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb444f4-f313-45c4-8f36-af294ddaecc3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:30.237951 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 357/707] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:30 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 04:57:30.345904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab2605-f589-4bc5-a643-104ff8b0079a None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.346580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab2605-f589-4bc5-a643-104ff8b0079a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.347094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab2605-f589-4bc5-a643-104ff8b0079a None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.348986 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 351/708] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:30.356298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.356615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.356845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.378300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:30.379510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:30.455257 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 358/709] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:30.729621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab2605-f589-4bc5-a643-104ff8b0079a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:30.753790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:30.843908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab2605-f589-4bc5-a643-104ff8b0079a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:30.879567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:30.880207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.880488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.880759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.881340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:30.882733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-68cbba6b-0f0e-4d23-88fc-2aa23f714595 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:30.892357 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:30.893349 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:30.894197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 352/710] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:30.900635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:30.909448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:30.917786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74cb75-1940-4591-822d-83336a2a9ebf None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.918312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74cb75-1940-4591-822d-83336a2a9ebf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.918645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74cb75-1940-4591-822d-83336a2a9ebf None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.920510 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 353/711] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:30.925677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:30.925963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:30.927240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:30.946546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:30.948349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:31.023906 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 354/712] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:31.024651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e82501-6dd1-4c34-9c01-38ffe86eb321 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:31.061884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:31.062526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.062807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.063076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.063711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:31.064015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:31.065369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3982a-065f-4ae1-a681-29817693863b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:31.074468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 359/713] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:31.077105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:31.093634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:31.195816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb52d8d-2b4c-4665-929c-09a424b09d46 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:31.235128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:31.235749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.236028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.236300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.236934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] RBAC: Adding query filter params (type=compute) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:31.237232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:31.238642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cc9dc-1fd5-43fb-91db-f4f0a0d077da None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:31.243617 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 355/714] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:31.294120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75204b-a747-473b-a5c1-2e46ab1461b2 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.294443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75204b-a747-473b-a5c1-2e46ab1461b2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.294724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75204b-a747-473b-a5c1-2e46ab1461b2 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.296334 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 360/715] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:31.301973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.302298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.302573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.303042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75204b-a747-473b-a5c1-2e46ab1461b2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:31.322801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:31.324122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:31.386817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:31.422774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 356/716] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:31.438830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75204b-a747-473b-a5c1-2e46ab1461b2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:31.477753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:31.479716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.479716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.480008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] PATH_INFO: `/v3/services/image` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.480536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:31.481892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:31.491929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:31.492946 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:31.494117 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:31.498195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 361/717] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 31 04:57:31 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:31.499600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:31.515294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:31.613603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6b701-6992-4e05-be93-67f2b7d30d3a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:31.651047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:31.651961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.652419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.652869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.653673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] RBAC: Adding query filter params (name=image) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:31.654207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:31.655752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:31.666246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 357/718] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:31.668081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:31.690868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:31.765755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:31.777048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab51b4-c09b-4e3e-ab64-3c0ede19b76f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:31.797715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636f09-38a7-475f-9cbf-75e3da46fb23 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:31.809736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:31.816375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:31.817275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.817745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.818196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.819415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:31.820188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:31.822622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:31.828135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 362/719] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:31.841375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:31.842461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:31.843031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:31.843498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:31.844509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:31.846133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:31.858499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:31.859555 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 04:57:31.860374 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:31.863321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 358/720] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:31.869984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:31.984634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf23715-4528-4b8c-a308-2de631c131a5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:32.023504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:32.024508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:32.024791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:32.025584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:32.026321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:32.026636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:32.027996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:32.033203 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 363/721] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:32.038659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:32.148869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcc005-e92c-498f-b2bd-db7d6e176844 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:32.184884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:32.185894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:32.186407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:32.186888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:32.187720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:32.188286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:32.189936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcf208-d8b3-4789-b8ad-b7fd97c525fe None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:32.192369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:32.200665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 359/722] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 04:57:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:32.202298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:32.274229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:32.322521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de739a-43e4-46e8-bf74-f3a17761e451 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:32.358594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a059b-76be-4ab9-8684-0302e50ad674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:32.359213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a059b-76be-4ab9-8684-0302e50ad674 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:32.359497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a059b-76be-4ab9-8684-0302e50ad674 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:32.359774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a059b-76be-4ab9-8684-0302e50ad674 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:32.360468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a059b-76be-4ab9-8684-0302e50ad674 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:32.361874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a059b-76be-4ab9-8684-0302e50ad674 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:32.386140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 364/723] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:32.557221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74ea0-ed51-4405-b281-f29efbc72799 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:32.557531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74ea0-ed51-4405-b281-f29efbc72799 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:32.557771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74ea0-ed51-4405-b281-f29efbc72799 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:32.559421 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 360/724] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:32.564833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:32.565612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:32.566038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:32.586228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:32.588212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:32.668638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 365/725] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:32.945657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74ea0-ed51-4405-b281-f29efbc72799 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:33.053444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74ea0-ed51-4405-b281-f29efbc72799 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:33.088595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:33.089286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:33.089569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:33.089890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:33.090520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:33.091941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:33.101194 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:33.102212 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:33.103971 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 361/726] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:33.111534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:33.157710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:33.220436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757c7f-77f7-4860-b670-5b80c24c2ef6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:33.257368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:33.258378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:33.258888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:33.259526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:33.260510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:33.261101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:33.262776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:33.270902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 366/727] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:33.277420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:33.386551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:33.424548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae34a28-78aa-42eb-bee2-59998d98f0c2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:33.461749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:33.463271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:33.463637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:33.464015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:33.464751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:33.465204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:33.466729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536281d-6251-4820-a986-19e4ef97e57d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:33.472069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 362/728] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:33.477796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:33.600095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8931f-c5ea-4e66-b202-2d62c7aa3ade None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:33.608605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:33.622053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223079c-f076-4a25-845a-8c79e3392ce3 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:33.622385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223079c-f076-4a25-845a-8c79e3392ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:33.624080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223079c-f076-4a25-845a-8c79e3392ce3 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:33.625393 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 363/729] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:33.630815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f200-d0f7-4519-9912-1f17c51a1fdc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:33.631212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f200-d0f7-4519-9912-1f17c51a1fdc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:33.631586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f200-d0f7-4519-9912-1f17c51a1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:33.642066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:33.642905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:33.645278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:33.646535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:33.647456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:33.650067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:33.656552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-edf3f200-d0f7-4519-9912-1f17c51a1fdc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:33.659799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-edf3f200-d0f7-4519-9912-1f17c51a1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:33.690036 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 367/730] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:33.788025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 364/731] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:34.067560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:34.177751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984903b-efee-497b-9037-b50cad76bfe5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:34.183820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727602-9d4e-4599-a5a1-694aa01f550f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:34.184288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727602-9d4e-4599-a5a1-694aa01f550f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:34.184391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727602-9d4e-4599-a5a1-694aa01f550f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:34.185976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 365/732] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:57:34.191360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b0b4-c28f-45d8-b0a1-f24f1d100e44 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:34.191600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b0b4-c28f-45d8-b0a1-f24f1d100e44 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:34.191834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b0b4-c28f-45d8-b0a1-f24f1d100e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:34.210667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6127b0b4-c28f-45d8-b0a1-f24f1d100e44 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:34.212067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6127b0b4-c28f-45d8-b0a1-f24f1d100e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:34.217901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:34.218823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:34.219308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:34.219807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:34.220795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:34.222257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:34.245638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 368/733] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:34 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:34.284938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:34.315426 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 366/734] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:34.592100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:34.620215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:34.702721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7d464-6af3-499c-a419-acd36e83d263 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:34.744139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0061cce-1b29-4e55-81a6-5703b4083667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:34.744793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061cce-1b29-4e55-81a6-5703b4083667 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:34.745079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061cce-1b29-4e55-81a6-5703b4083667 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:34.745357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061cce-1b29-4e55-81a6-5703b4083667 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:34.746056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0061cce-1b29-4e55-81a6-5703b4083667 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:34.747491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0061cce-1b29-4e55-81a6-5703b4083667 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:34.765430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 369/735] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:34 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:34.846025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881b478-2e74-4ef2-90a5-e41f359cc9fc None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:34.846356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881b478-2e74-4ef2-90a5-e41f359cc9fc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:34.846586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881b478-2e74-4ef2-90a5-e41f359cc9fc None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:34.848263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 367/736] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:34.854691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:34.854995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:34.855251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:34.875297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:34.876575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:34.961008 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 370/737] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:35.241663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881b478-2e74-4ef2-90a5-e41f359cc9fc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:35.348549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881b478-2e74-4ef2-90a5-e41f359cc9fc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:35.384803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:35.385422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:35.385706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:35.385985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:35.386685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:35.388124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:35.390776 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.server.flask.common [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 04:57:35.409338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.sql.core [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 04:57:35.409338 n-d-862355-5 devstack@keystone.service[82000]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 04:57:35.409338 n-d-862355-5 devstack@keystone.service[82000]: [parameters: {'id': '1ec76807b3fb456ab3a906fd5c8f80a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 04:57:35.409338 n-d-862355-5 devstack@keystone.service[82000]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82000) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ec76807b3fb456ab3a906fd5c8f80a1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ec76807b3fb456ab3a906fd5c8f80a1. Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:57:35.417980 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 04:57:35.419860 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application yield resource Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise self.value Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application session.commit() Oct 31 04:57:35.421342 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.flush() Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application compat.raise_( Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 04:57:35.422597 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 04:57:35.430687 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:57:35.433621 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [parameters: {'id': '1ec76807b3fb456ab3a906fd5c8f80a1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:35.435759 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:35.437738 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ec76807b3fb456ab3a906fd5c8f80a1. Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:35.439923 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 368/738] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Oct 31 04:57:35 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:35.441222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:35.446246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:35.533022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eddbe-d9d2-4f1e-b91f-1951535dd47d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:35.569065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:35.569720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:35.570007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:35.570311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:35.577674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:35.579166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-77a53421-0f73-44b7-9bae-6985745a3c71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:35.591507 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:35.593670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:35.595821 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 371/739] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:35.601660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:35.643953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:35.715353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd5a5-2584-4207-9baa-fc80dda2bd66 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:35.752211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:35.752832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:35.753156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:35.753439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:35.754110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:35.754485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:35.756156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5fbf4-465b-49b7-9bad-94a190d2acbf None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:35.780937 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 369/740] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:36.030676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272e1c-02a8-4aa8-b999-8d9353fc9cba None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.031180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272e1c-02a8-4aa8-b999-8d9353fc9cba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.031280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272e1c-02a8-4aa8-b999-8d9353fc9cba None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.032709 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 372/741] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:36.038276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85f31-e15d-401f-a585-fe26f594d19e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.038795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85f31-e15d-401f-a585-fe26f594d19e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.039311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85f31-e15d-401f-a585-fe26f594d19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.059302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d1e85f31-e15d-401f-a585-fe26f594d19e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:36.061159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d1e85f31-e15d-401f-a585-fe26f594d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:36.134948 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 370/742] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:36.416725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272e1c-02a8-4aa8-b999-8d9353fc9cba None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:36.486624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:36.502037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e0b7-f912-4cdc-8235-f25dcc06889f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.502558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e0b7-f912-4cdc-8235-f25dcc06889f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.502647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e0b7-f912-4cdc-8235-f25dcc06889f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.504265 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 371/743] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:36.509387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.509673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.509946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.530519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:36.530917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272e1c-02a8-4aa8-b999-8d9353fc9cba None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:36.531755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:36.557788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:36.573184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:36.573899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.574394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.574678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.576123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:36.577511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:36.589458 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:36.590495 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:36.591321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 373/744] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:36.598934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:36.618295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 372/745] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:36.710130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71c2f8-7cc3-4d20-aee5-93edc48113a1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:36.741423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:36.747646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:36.748593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.749101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.749612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.750466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:36.750966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:36.752528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:36.758222 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 374/746] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:36.764688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:36.874503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b8fb0-d531-4826-894b-dbee37533bf7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:36.910272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:36.910894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:36.911174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:36.911445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:36.912075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:36.912378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:36.913746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:36.920060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 373/747] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:36.925738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:36.927328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:36.955325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.047542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4acd4-4aff-4156-8b40-1cecfd3ca19d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.059523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4345-0ea6-441d-bd7b-dbcfa6553990 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.084663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.085370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.085656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.085934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.086543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.088467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ebe0a311-ae1a-4842-ba6a-efae74e53067 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:37.097803 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:37.098859 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:37.099756 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 374/748] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:37.101060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac62dd8-ed69-47e8-8263-dce7cc2edff7 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.101060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac62dd8-ed69-47e8-8263-dce7cc2edff7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.101220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac62dd8-ed69-47e8-8263-dce7cc2edff7 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.104805 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 375/749] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:37.105941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac62dd8-ed69-47e8-8263-dce7cc2edff7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.106974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.107600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.107883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.108157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.109071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] RBAC: Adding query filter params (interface=admin, service_id=f82dfd90454849439277b500eb974863, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:37.109225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.110625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c242d85-6d3d-45de-b59d-f7eff8baf4b0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.118195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 375/750] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Oct 31 04:57:36 2022] GET /identity/v3/endpoints?service_id=f82dfd90454849439277b500eb974863&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:37.118195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.118195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.118195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.137829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:37.140061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:37.203265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.205203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.218412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 376/751] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:37.219319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.223322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac62dd8-ed69-47e8-8263-dce7cc2edff7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.265690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.266456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.266795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.267076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.267711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:37.268014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.269502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.279918 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 376/752] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:37.281189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.327664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9550d6-220b-4918-b98b-4ee38df5317b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.363687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.364303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.364581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.364852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.365455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.366848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.382621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 377/753] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 04:57:37.393128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80f564-7486-4ddc-b3e6-3dc9b70da106 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.432510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.433202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.433487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.433763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.434582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:37.434886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.436311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.447997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 377/754] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:37.449430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.503564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.516051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.525615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.574265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71bb1-93d4-4389-9992-24263f6cf989 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.624547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.625318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.625604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.626036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.626791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] RBAC: Adding query filter params (interface=public, service_id=890ed787e3c7409bb88d47e28a1e02da, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:37.627272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.629230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.637201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 378/755] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/endpoints?service_id=890ed787e3c7409bb88d47e28a1e02da&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:37.642869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.645111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790e50-ae2a-4b95-afa0-a129b4120055 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.681309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.682917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.682917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.682917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.683126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.684441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:37.693824 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:37.694870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:37.695706 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 378/756] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:37.701490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:37.777257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b15eba-54b9-41df-8340-0176716b9a90 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.799747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.814541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:37.818441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.819404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.819878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.820368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.821170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.824132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.829450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2abe4-68b1-4cea-811b-4e4464eb26f4 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:37.836981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 379/757] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services => generated 1957 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 04:57:37.868492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:37.869970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:37.869970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:37.870206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:37.870850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:37.871147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:37.872539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:37.878539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 379/758] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:37.884885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:38.004662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4bede-e420-4657-829f-f4d731e525b8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:38.047085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:38.047717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.047997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.048270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.048915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:38.049220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:38.050643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5dbc5-829c-4619-9f51-2874a1b398c5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:38.055996 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 380/759] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:38.062049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:38.123670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839d3b-f8e9-4f4d-bf1c-f5e81f6e5f23 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.124188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839d3b-f8e9-4f4d-bf1c-f5e81f6e5f23 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.124263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839d3b-f8e9-4f4d-bf1c-f5e81f6e5f23 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.125820 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 381/760] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:38.130984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.131274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.131554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.158553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:38.160999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:38.177170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e553e2-b39c-4144-ac1b-2f7a82c330a9 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:38.213947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:38.214594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.214875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.215150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.215853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] RBAC: Adding query filter params (interface=public, service_id=7d50600f84ce47ecb5781e1309d4f976, region_id=RegionOne) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:38.216158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:38.218123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:38.223415 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 380/761] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:57:38 2022] GET /identity/v3/endpoints?service_id=7d50600f84ce47ecb5781e1309d4f976&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:38.226964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:38.235681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:38.241201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:38.272941 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 382/762] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:38 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:38.362498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf5c4-025c-4d66-9f77-54bae6515999 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:38.399546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:38.401188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.401188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.401470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.402141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:38.403519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:38.410510 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 381/763] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:57:38 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 04:57:38.560475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:38.669687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc694507-d8b3-40b3-9b22-c1bb565a2660 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:38.705909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:38.706553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.706837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.707112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.707761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:38.709182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:38.711814 n-d-862355-5 devstack@keystone.service[81999]: WARNING keystone.server.flask.common [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 04:57:38.725670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.sql.core [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 04:57:38.725670 n-d-862355-5 devstack@keystone.service[81999]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 04:57:38.725670 n-d-862355-5 devstack@keystone.service[81999]: [parameters: {'user_id': '9853727a04f44511aebb19759111da93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 04:57:38.725670 n-d-862355-5 devstack@keystone.service[81999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Oct 31 04:57:38.734412 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:57:38.735327 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application yield resource Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise self.value Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application session.commit() Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 04:57:38.736304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.flush() Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application compat.raise_( Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 04:57:38.737162 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:57:38.738036 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:57:38.740628 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [parameters: {'user_id': '9853727a04f44511aebb19759111da93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:38.742625 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 31 04:57:38.745169 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:38.751907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 383/764] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 04:57:38 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:38.754920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:38.832263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:38.867655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57065f-e8fa-4141-8644-fbadfe24d4df None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:38.902115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:38.902833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:38.903184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:38.903459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:38.911174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:38.912625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-0335aefc-416e-4e0e-b7f7-ac343740f4df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:38.924531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:38.925452 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:38.926433 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 382/765] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:38.933658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:38.977331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:39.042028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06b0a1-1998-429b-be08-d8f155dda6a5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:39.077427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:39.078042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:39.078353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:39.078625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:39.079326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:39.079632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:39.081243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b236fb-2ff7-411e-adda-b89cd8dc87c0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:39.121205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 384/766] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 04:57:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:39.683474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab535b-76d4-4850-9f9e-d65542999e43 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:39.683858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab535b-76d4-4850-9f9e-d65542999e43 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:39.684039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab535b-76d4-4850-9f9e-d65542999e43 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:39.685407 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 383/767] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:39.690933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c76f1-2a5e-466a-9751-4cfa701a5f87 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:39.691365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c76f1-2a5e-466a-9751-4cfa701a5f87 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:39.691550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c76f1-2a5e-466a-9751-4cfa701a5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:39.710373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-288c76f1-2a5e-466a-9751-4cfa701a5f87 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:39.711889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-288c76f1-2a5e-466a-9751-4cfa701a5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:39.779421 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 385/768] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:40.048557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab535b-76d4-4850-9f9e-d65542999e43 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.111918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf29d-20c0-4f11-b33f-159e9659f831 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.112202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf29d-20c0-4f11-b33f-159e9659f831 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.112477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf29d-20c0-4f11-b33f-159e9659f831 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.113814 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 386/769] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:40.119348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.119643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.119923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.138682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:40.139875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:40.157975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab535b-76d4-4850-9f9e-d65542999e43 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.161358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:40.187236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:40.195326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.195969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.196252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.196529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.198007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.199321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:40.208273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:40.214395 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:40.215260 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 384/770] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 04:57:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:40.217123 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 387/771] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:40.217428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.324903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bb9f9-872a-41e6-9a03-ae10fba73416 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.359773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.360385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.360714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.360996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.361623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:40.361925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.363317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.373486 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 385/772] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:40.374740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.473719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2566476-6f67-4fa3-a303-8b9a7f9ad5dc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.486465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.511566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.512191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.512477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.512755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.513434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:40.513741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.515172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.520153 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 388/773] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 04:57:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:40.526811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.551631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:40.552878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:40.603515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420030f-4036-4fd0-89c0-c47e6aade870 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.641321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.641700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127d04-6e85-4500-b557-b23ca1d65f56 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.641955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.642264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.642536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.643115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.644466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:40.653895 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:40.655096 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:40.656102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 386/774] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:40.660797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.683768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869691e6-2af9-4401-bacd-d5d999d4ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.684616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869691e6-2af9-4401-bacd-d5d999d4ccd2 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.685044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869691e6-2af9-4401-bacd-d5d999d4ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.685492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869691e6-2af9-4401-bacd-d5d999d4ccd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.686192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869691e6-2af9-4401-bacd-d5d999d4ccd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.687557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869691e6-2af9-4401-bacd-d5d999d4ccd2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 389/775] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db460-0d4e-4c51-b16c-00b7e29899ee None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db460-0d4e-4c51-b16c-00b7e29899ee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db460-0d4e-4c51-b16c-00b7e29899ee None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 390/776] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.714176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.715203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.741048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:40.742330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:40.787030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094669a2-938c-4318-9590-0fe62ea4d615 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.811292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:40.824585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 391/777] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:40 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:40.828871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.829782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.830281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.830736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.831563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:40.832084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.833839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.840853 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 387/778] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:40.846476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:40.857384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:40.954248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06ed5a-6737-4a1c-9cf9-2056ad61b62c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:40.988834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:40.989450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:40.989730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:40.990002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:40.990665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:40.990971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:40.992323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:40.997375 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 392/779] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 04:57:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:41.005813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:41.110827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017daaa2-3bd0-4a52-8574-cd65ea8b3338 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:41.112778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:41.147478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:41.148097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:41.148382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:41.148658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:41.149324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:41.150835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:41.181684 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 388/780] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 04:57:41.197896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:41.236256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34f5e-2ffa-44b5-ad50-acea4b5fb84e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:41.288509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:41.289173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:41.289460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:41.289743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:41.291017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:41.292738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:41.302423 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:41.303480 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:41.307703 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 393/781] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 31 04:57:41 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:41.311767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:41.358689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:41.426018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235d42-794f-4e63-a140-5e39d069ac73 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:41.461347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:41.462274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:41.462755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:41.463326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:41.464106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] RBAC: Adding query filter params (name=image) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:41.464602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:41.466122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:41.471378 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 389/782] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:41.477214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:41.581768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14fda-7961-46d9-8ad8-423dae2698f7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:41.610731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:41.617661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af855215-9669-4658-bd8b-08045068c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:41.618331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af855215-9669-4658-bd8b-08045068c895 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:41.619152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af855215-9669-4658-bd8b-08045068c895 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:41.619433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af855215-9669-4658-bd8b-08045068c895 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:41.620084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af855215-9669-4658-bd8b-08045068c895 None admin] RBAC: Adding query filter params (type=image) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:41.620391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af855215-9669-4658-bd8b-08045068c895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:41.621822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af855215-9669-4658-bd8b-08045068c895 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:41.627698 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 394/783] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:41.633394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:41.736894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234a6c-3c95-4493-b05f-1f17219a3bfa None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:41.740004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:41.773047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905635-5f0e-4d8e-bc29-a484e5a643a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:41.773658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905635-5f0e-4d8e-bc29-a484e5a643a0 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:41.773937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905635-5f0e-4d8e-bc29-a484e5a643a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:41.774239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905635-5f0e-4d8e-bc29-a484e5a643a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:41.774951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a905635-5f0e-4d8e-bc29-a484e5a643a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:41.776385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a905635-5f0e-4d8e-bc29-a484e5a643a0 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:41.799384 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 390/784] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:57:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:42.905646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926a70-1f5b-47a3-818b-4bd02e5c086f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:42.906381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926a70-1f5b-47a3-818b-4bd02e5c086f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:42.906381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926a70-1f5b-47a3-818b-4bd02e5c086f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:42.907585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 395/785] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:42.912718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:42.913109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:42.913268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:42.931826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:42.933003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:43.004501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 391/786] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:43.272019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8926a70-1f5b-47a3-818b-4bd02e5c086f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:43.381995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8926a70-1f5b-47a3-818b-4bd02e5c086f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:43.416863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1d076-9f88-4d7b-b464-6aecac1db9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:43.417500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1d076-9f88-4d7b-b464-6aecac1db9ad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:43.417781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1d076-9f88-4d7b-b464-6aecac1db9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:43.418056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1d076-9f88-4d7b-b464-6aecac1db9ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:43.419204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1d076-9f88-4d7b-b464-6aecac1db9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:43.420645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1d076-9f88-4d7b-b464-6aecac1db9ad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:43.426192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 396/787] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:43.427937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:43.466464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd18d60-6be3-4805-8d40-5e655297a65a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:43.467084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd18d60-6be3-4805-8d40-5e655297a65a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:43.467581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd18d60-6be3-4805-8d40-5e655297a65a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:43.470028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 397/788] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:43.474875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:43.475642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:43.476139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:43.501796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:43.504452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:43.521018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:43.537832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72974-79d4-4518-ab57-1ea66b388a86 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:43.567314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:43.574875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1f65d-5602-4a6b-9e94-12aeae42ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:43.575498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f65d-5602-4a6b-9e94-12aeae42ba2c None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:43.575777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f65d-5602-4a6b-9e94-12aeae42ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:43.576051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f65d-5602-4a6b-9e94-12aeae42ba2c None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:43.576705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1f65d-5602-4a6b-9e94-12aeae42ba2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:43.578130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1f65d-5602-4a6b-9e94-12aeae42ba2c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:43.580105 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 398/789] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:43.618184 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 392/790] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:57:43 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:43.848451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:43.957646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cfe0b-9751-4719-b917-6d5c1613d049 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:43.993223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:43.993891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:43.994191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:43.994467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.004636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:44.005059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598029-108b-4979-ae46-507c37f6cbb0 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.005481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598029-108b-4979-ae46-507c37f6cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.005654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598029-108b-4979-ae46-507c37f6cbb0 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.007133 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 393/791] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:44.009424 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:44.010549 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:44.011378 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:44.013699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.014058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.014433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.015445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 399/792] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:57:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:44.016279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.033143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:44.034470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:44.072994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:44.107908 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 394/793] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:44.125539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa363de-d417-407c-a109-836430e9a879 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.162762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.163709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.164196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.164620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.165509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:44.166063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.167640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.176744 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 400/794] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:44.183065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.252406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:44.289165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675f52-8360-40e3-9cee-ffb5a312198e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.325195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.325838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.326121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.326427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.337188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.339537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:44.354843 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:44.355792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:44.361717 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:44.361717 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:44.361717 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.361717 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 395/795] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:44.361970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.378053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.472247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f09a-ccdb-45e5-bf73-77adff9f088f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.487164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97d0d-c515-4038-a86c-79e090adbea8 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.488054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:44.509614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:44.510831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.511685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.512009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.512288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.512998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:44.513306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.514973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.526428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.527041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.527316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.531958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.532092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 401/796] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:44.532182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.532182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.532974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.538709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.sql.core [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 04:57:44.538709 n-d-862355-5 devstack@keystone.service[82000]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 04:57:44.538709 n-d-862355-5 devstack@keystone.service[82000]: [parameters: {'id': 'fc031a38cb4640f0b3fc3a33b70cca9e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 04:57:44.538709 n-d-862355-5 devstack@keystone.service[82000]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82000) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:57:44.547623 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 04:57:44.548548 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application yield resource Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise self.value Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application session.commit() Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 04:57:44.549471 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.flush() Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application compat.raise_( Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 04:57:44.550393 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 04:57:44.551290 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 04:57:44.552067 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [parameters: {'id': 'fc031a38cb4640f0b3fc3a33b70cca9e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 04:57:44.552984 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:44.553749 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.554685 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 396/797] 10.222.0.23 () {60 vars in 1137 bytes} [Mon Oct 31 04:57:44 2022] POST /identity/v3/domains => generated 190 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:44.555395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.653083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca1d5-f4ad-4078-9539-ad9f5783f90e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.661540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf5a34-8229-403c-8356-fdcb26e53ed2 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.688168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.688809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.689093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.689372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.696368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.696957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.697597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.697881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.697979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.698180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.708912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:44.709874 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:44.710796 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:44.711743 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:44.712806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.712877 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 402/798] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:44.717207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:44.730027 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:44.731150 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:44.734531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:44.734531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:44.734531 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:44.734531 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 397/799] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:44.737912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.753195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:44.776550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:44.826708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dd915-a73e-45e1-8861-fbb256e87913 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.849137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ffe3-8220-4560-b474-258f2461223c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:44.863443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.864066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.864353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.864633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.865466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:44.865778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.867220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.886007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 403/800] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:44.892494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:44.893772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:44.894525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:44.894799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:44.895073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:44.895725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:44.896031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:44.897416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:44.911364 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 398/801] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:44.993193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:45.005472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6530e7-a24f-4c6b-8e87-0c6290b9284b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:45.042999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:45.043670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.043954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.044230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.055614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:45.057993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:45.073961 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:45.075014 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:45.076537 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:45.076537 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:45.076537 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:45.076537 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 404/802] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:45.083524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:45.186558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:45.192677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0d69-b7b9-4054-b6eb-e0ca5f0d537d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:45.228422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:45.229311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.229590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.229863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.230543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:45.230847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:45.232222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:45.244239 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 399/803] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:45.250084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:45.349664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59e6c-053f-4e88-9d54-c016b735511a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:45.383942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:45.384635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.384916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.385201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.391888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:45.393336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:45.405057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:45.406135 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:45.407080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 405/804] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:45.412263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:45.511936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85728b-73a1-46a4-8528-55d21c8aa223 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:45.545377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:45.545982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.546290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.546565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.547250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:45.547554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:45.548982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c384c-aadc-4c13-8f8a-b3d79f81991b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:45.560931 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 400/805] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:45.567007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:45.570785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:45.666290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44e65a-132e-4ce6-b984-1e09c2d55c3c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:45.699410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a33f31-baec-40c2-b35b-9dc2b2d4ae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:45.700094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a33f31-baec-40c2-b35b-9dc2b2d4ae1f None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.700382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a33f31-baec-40c2-b35b-9dc2b2d4ae1f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.700658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a33f31-baec-40c2-b35b-9dc2b2d4ae1f None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/c82a0f508316483c92cc7872c1be0ad0/roles/1e7512e9a3884346ab707d652a04b135` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.702888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a33f31-baec-40c2-b35b-9dc2b2d4ae1f None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=c82a0f508316483c92cc7872c1be0ad0, role_id=1e7512e9a3884346ab707d652a04b135)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:45.704370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a33f31-baec-40c2-b35b-9dc2b2d4ae1f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:45.718508 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 406/806] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:45 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/c82a0f508316483c92cc7872c1be0ad0/roles/1e7512e9a3884346ab707d652a04b135 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:57:45.832574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500833b6-c801-4e35-82cd-007674dc453d None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.832857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500833b6-c801-4e35-82cd-007674dc453d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.833134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500833b6-c801-4e35-82cd-007674dc453d None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.834543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 401/807] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:45.841403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:45.841694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:45.841973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:45.861370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:45.862660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:45.927136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:45.936669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 407/808] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:46.208206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500833b6-c801-4e35-82cd-007674dc453d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:46.226644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:46.314958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500833b6-c801-4e35-82cd-007674dc453d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:46.348211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43de756-be06-4dd6-894d-7e039cc56a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:46.348841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43de756-be06-4dd6-894d-7e039cc56a1a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:46.349120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43de756-be06-4dd6-894d-7e039cc56a1a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:46.349394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43de756-be06-4dd6-894d-7e039cc56a1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:46.350539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43de756-be06-4dd6-894d-7e039cc56a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:46.351967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43de756-be06-4dd6-894d-7e039cc56a1a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:46.354533 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 402/809] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:46.360244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:46.571405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efcec9-d638-4131-b329-ec18545ee9c5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:46.607213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80739a6-c8ae-4d73-acb5-4513b74bd082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:46.607834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80739a6-c8ae-4d73-acb5-4513b74bd082 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:46.608119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80739a6-c8ae-4d73-acb5-4513b74bd082 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:46.608395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80739a6-c8ae-4d73-acb5-4513b74bd082 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:46.609050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80739a6-c8ae-4d73-acb5-4513b74bd082 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:46.610501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80739a6-c8ae-4d73-acb5-4513b74bd082 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:46.642177 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 408/810] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:57:46 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:47.848816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b418f7-c026-42bf-8292-bb9eea520b67 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:47.849361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b418f7-c026-42bf-8292-bb9eea520b67 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:47.849460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b418f7-c026-42bf-8292-bb9eea520b67 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:47.850859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 403/811] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:47.857148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:47.857556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:47.857838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:47.875661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:47.876844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:47.924762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:47.947250 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 409/812] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:48.215994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b418f7-c026-42bf-8292-bb9eea520b67 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:48.303676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:48.320592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b418f7-c026-42bf-8292-bb9eea520b67 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:48.355164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:48.355791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.356066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.356335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.366188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:48.371023 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:48.372183 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:48.373472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 404/813] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 04:57:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:48.378049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:48.474477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bdfc-495c-4f77-8c21-a9620d858273 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:48.507701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:48.508320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.508602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.508876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.510093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:48.510428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:48.511788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:48.519471 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 410/814] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 04:57:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:48.525353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:48.621182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d03527-f71d-4002-af3d-e38194b47ebc None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:48.654310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:48.654933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.655209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.655476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.665098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:48.667609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:48.670059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-b4fa3195-5874-437b-bbec-2b303c7b48d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:48.682731 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:48.683827 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:48.684712 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:48.684712 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:48.684712 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:48.685376 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 405/815] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:48.689840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:48.736501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:48.794111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae05e-f14e-40a1-993c-29636668cf88 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:48.811814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ca4e-7440-46e9-97d8-678ed32a2ad7 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.812092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ca4e-7440-46e9-97d8-678ed32a2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.812366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ca4e-7440-46e9-97d8-678ed32a2ad7 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.813702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 406/816] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:57:48.818629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57609d44-9bff-4c93-b058-487226078627 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.818913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57609d44-9bff-4c93-b058-487226078627 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.819185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57609d44-9bff-4c93-b058-487226078627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.828055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:48.828667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.828948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.829220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.829863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:48.830185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:48.831528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:48.838168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-57609d44-9bff-4c93-b058-487226078627 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:48.839464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57609d44-9bff-4c93-b058-487226078627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:48.843987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 411/817] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:48.849464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:48.908579 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 407/818] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 04:57:48.947951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f3018-cb14-4200-8710-f03c4c78c669 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:48.949442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:48.982705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:48.983333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:48.983618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:48.983894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:48.990731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:48.992103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:57:49.004737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:49.010596 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:49.011585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 412/819] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 04:57:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:49.012190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57609d44-9bff-4c93-b058-487226078627 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.112871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57609d44-9bff-4c93-b058-487226078627 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.137535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.146476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.147084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.147367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.147642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.148364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:49.148667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.150630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.167682 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 408/820] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:49.173375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.186565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.276513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7985c1c-45a0-416b-86b7-32bea2174dc5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.285575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d868-02c3-4d3f-9848-76ee87bfec5b None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.312831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.313444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.313725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.313998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.321553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.322315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.322596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.322869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.332767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:49.337979 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:49.339171 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:49.340400 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 409/821] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:49.344976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.346000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.384619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.386058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.391682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.444350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d824ac0-ef64-45ab-9ce4-a28063dd2a18 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.478510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.479361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.479644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.479917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.480579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:49.480879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.482263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.484547 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 413/822] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:57:49.490291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.495347 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 410/823] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:49.496318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.549173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.588612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2c1a-14df-499c-b842-380745836807 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.598168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc236e8-9248-4fa7-94be-4f182b3c1945 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.605268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.622665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.623297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.623579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.623851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.632786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.633410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.633647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.633752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.633948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] PATH_INFO: `/v3/users/905d5b5ed9b34616971dd7c836e1b6b4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.635899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.647866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] RBAC: Authorizing `identity:get_user(user_id=905d5b5ed9b34616971dd7c836e1b6b4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.649297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:57:49.650057 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:49.651003 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:57:49.652316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:57:49.652316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:57:49.652316 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:49.652316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 414/825] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:49.652565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 411/825] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/users/905d5b5ed9b34616971dd7c836e1b6b4 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:49.656633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.660998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.754723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1cc0-2eb6-4c3c-814c-c24e86c2855c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.760321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167abbb-dc82-4b23-a047-dc3163378d22 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.768430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.789946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.791141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.791592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.791871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] PATH_INFO: `/v3/projects/e55adec1e6f04634b6f72321c1e67e65` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.792981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] RBAC: Authorizing `identity:get_project(project_id=e55adec1e6f04634b6f72321c1e67e65)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.794424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.795768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.796028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 415/826] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/projects/e55adec1e6f04634b6f72321c1e67e65 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:49.798541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.798815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.799082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.799763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:49.800012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.801359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.801893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.813143 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 412/827] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:57:49.818521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:49.844882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:49.901828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3b07-7b94-4c14-8aa0-6f66678acae5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.921142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8709f-e978-4a0f-bce6-74521212f1b9 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:49.937780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.938485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.938765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.939040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] PATH_INFO: `/v3/projects/e55adec1e6f04634b6f72321c1e67e65/users/905d5b5ed9b34616971dd7c836e1b6b4/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.940959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] RBAC: Authorizing `identity:create_grant(project_id=e55adec1e6f04634b6f72321c1e67e65, user_id=905d5b5ed9b34616971dd7c836e1b6b4, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.942562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.956304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 416/828] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:49 2022] PUT /identity/v3/projects/e55adec1e6f04634b6f72321c1e67e65/users/905d5b5ed9b34616971dd7c836e1b6b4/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 04:57:49.958745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:49.959389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:49.959666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:49.959936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:49.968102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:49.969705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:57:49.983056 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:49.984273 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:57:49.985364 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:57:49.986323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 413/829] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 04:57:49.990271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:50.038490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:50.098965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0b71-b6a8-46f4-b0c8-d1c427aa0c8e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:50.134749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:50.135024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:50.135299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:50.135567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:50.136256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:50.136560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:50.137962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2603a-51ff-4840-abac-f088cb7b31dd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:50.149826 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 417/830] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:50.155940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:50.241498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:50.257949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a29136-762b-4f76-b583-177991ff18be None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:50.294265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:50.294871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:50.295148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:50.295418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:50.296143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] RBAC: Adding query filter params (role.id=1e7512e9a3884346ab707d652a04b135, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=c82a0f508316483c92cc7872c1be0ad0) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:50.296449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:50.297903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d38082-b638-4336-85e0-d2e12e2e54dc None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:50.303950 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 414/831] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:50 2022] GET /identity/v3/role_assignments?user.id=c82a0f508316483c92cc7872c1be0ad0&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=1e7512e9a3884346ab707d652a04b135 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:52.110844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c729f-8be8-439a-ad33-85cc7cf43fc4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:52.111401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c729f-8be8-439a-ad33-85cc7cf43fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:52.111401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c729f-8be8-439a-ad33-85cc7cf43fc4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:52.112728 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 418/832] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:52.117895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:52.118337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:52.118962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:52.137212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:52.138417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:52.202593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 415/833] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:52.474584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c729f-8be8-439a-ad33-85cc7cf43fc4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:52.573958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c729f-8be8-439a-ad33-85cc7cf43fc4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:52.575447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:52.608206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:52.608826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:52.609107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:52.609379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:52.619463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:57:52.624145 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:57:52.625197 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:57:52.626256 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 419/834] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:57:52.631152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:52.706961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:52.729355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f983-e960-44d9-91ad-d4433f892871 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:52.762989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:52.763579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:52.763855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:52.764125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:52.764774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:52.765076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:52.766457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:52.774054 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 416/835] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:52.780190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:52.877633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8fe85-fa95-48bb-9f3c-6203518e0745 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:52.912725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:52.913346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:52.913631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:52.913904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] PATH_INFO: `/v3/users/905d5b5ed9b34616971dd7c836e1b6b4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:52.915043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] RBAC: Authorizing `identity:get_user(user_id=905d5b5ed9b34616971dd7c836e1b6b4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:52.916620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:52.918183 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 420/836] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:57:52 2022] GET /identity/v3/users/905d5b5ed9b34616971dd7c836e1b6b4 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:52.923841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:53.021083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca609c3-bfd9-452e-b1b7-5e039a9cf473 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:53.053110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:53.053701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:53.053982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:53.054285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:53.065412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:53.123078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:53.124664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:53.218607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 417/837] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:57:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:57:53.224481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:53.255163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:53.324055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68729c-942a-4975-88f9-00494d2618e0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:53.357060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eede44-b5af-4b26-a4b5-58b4f45339fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:53.357692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eede44-b5af-4b26-a4b5-58b4f45339fa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:53.357976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eede44-b5af-4b26-a4b5-58b4f45339fa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:53.358284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eede44-b5af-4b26-a4b5-58b4f45339fa None admin] PATH_INFO: `/v3/projects/e55adec1e6f04634b6f72321c1e67e65` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:53.359395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eede44-b5af-4b26-a4b5-58b4f45339fa None admin] RBAC: Authorizing `identity:get_project(project_id=e55adec1e6f04634b6f72321c1e67e65)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:53.360814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eede44-b5af-4b26-a4b5-58b4f45339fa None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:53.362448 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 421/838] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:57:53 2022] GET /identity/v3/projects/e55adec1e6f04634b6f72321c1e67e65 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:53.369063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:53.409000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:53.465888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c9d1-66d1-4e26-a2e3-4cf2481cd03c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:53.499155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:53.499745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:53.500021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:53.500293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:53.501003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=e55adec1e6f04634b6f72321c1e67e65, user.id=905d5b5ed9b34616971dd7c836e1b6b4) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:57:53.501306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:53.502769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a5b7-8c5c-47c8-b802-47e43cbd261b None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:53.508363 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 418/839] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:57:53 2022] GET /identity/v3/role_assignments?user.id=905d5b5ed9b34616971dd7c836e1b6b4&scope.project.id=e55adec1e6f04634b6f72321c1e67e65&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:55.641692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce4410-dd2e-4241-ae46-49dde1099067 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:55.642220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce4410-dd2e-4241-ae46-49dde1099067 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:55.642220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce4410-dd2e-4241-ae46-49dde1099067 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:55.643519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 422/840] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:55.648760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:55.649128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:55.649302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:55.668495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:55.669678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:55.735253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 419/841] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:56.016250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce4410-dd2e-4241-ae46-49dde1099067 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:56.111028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:56.115667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce4410-dd2e-4241-ae46-49dde1099067 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:56.148953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939662-3c57-4d8a-8ae0-53bddebed9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:56.149594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939662-3c57-4d8a-8ae0-53bddebed9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:56.150519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939662-3c57-4d8a-8ae0-53bddebed9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:56.150796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939662-3c57-4d8a-8ae0-53bddebed9a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:56.151904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac939662-3c57-4d8a-8ae0-53bddebed9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:56.153306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac939662-3c57-4d8a-8ae0-53bddebed9a1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:56.154848 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 423/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:57:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:56.160459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:56.192946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:56.258239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d97f-f572-498a-878f-8ab410e6b24c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:56.293081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acba6b-a915-4392-aae8-98be53eee620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:56.293683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acba6b-a915-4392-aae8-98be53eee620 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:56.293959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acba6b-a915-4392-aae8-98be53eee620 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:56.294260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acba6b-a915-4392-aae8-98be53eee620 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:56.294907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acba6b-a915-4392-aae8-98be53eee620 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:56.296323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acba6b-a915-4392-aae8-98be53eee620 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:56.317330 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 420/843] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:57:56 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:57:58.499340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733a1e-e7ac-4d41-aabc-97bc1a6c72c9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:58.499853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733a1e-e7ac-4d41-aabc-97bc1a6c72c9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:58.499939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733a1e-e7ac-4d41-aabc-97bc1a6c72c9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:58.501234 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 424/844] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:57:58.506597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:58.506983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:58.507143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:58.526956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:57:58.528127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:57:58.592649 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 421/845] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:57:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:57:58.866880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733a1e-e7ac-4d41-aabc-97bc1a6c72c9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:58.967366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733a1e-e7ac-4d41-aabc-97bc1a6c72c9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:59.000626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:59.001258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:59.001541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:59.001816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] PATH_INFO: `/v3/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:59.003217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] RBAC: Authorizing `identity:get_role(role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:59.004577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:59.005866 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 425/846] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:57:58 2022] GET /identity/v3/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:59.012790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:59.034070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:59.111922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e504ad-70f7-4b6a-86b7-0ee6e0a3ee2c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:59.145456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:59.146026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:59.146338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:59.146613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] PATH_INFO: `/v3/users/34615609b6704ace8e7e7de6e337a61a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:59.159813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] RBAC: Authorizing `identity:get_user(user_id=34615609b6704ace8e7e7de6e337a61a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:59.161250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:59.162872 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 422/847] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:57:59 2022] GET /identity/v3/users/34615609b6704ace8e7e7de6e337a61a => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:59.168686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:59.202311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:59.266678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd37dc-b9aa-403a-9bb7-66639025670a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:59.300507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a27d6-51c3-4857-a4fc-f9ecc38f683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:59.301140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a27d6-51c3-4857-a4fc-f9ecc38f683b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:59.301422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a27d6-51c3-4857-a4fc-f9ecc38f683b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:59.301697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a27d6-51c3-4857-a4fc-f9ecc38f683b None admin] PATH_INFO: `/v3/projects/e55adec1e6f04634b6f72321c1e67e65` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:59.302829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a27d6-51c3-4857-a4fc-f9ecc38f683b None admin] RBAC: Authorizing `identity:get_project(project_id=e55adec1e6f04634b6f72321c1e67e65)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:59.304252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a27d6-51c3-4857-a4fc-f9ecc38f683b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:59.305873 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 426/848] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:57:59 2022] GET /identity/v3/projects/e55adec1e6f04634b6f72321c1e67e65 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:57:59.311797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:57:59.388476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:57:59.409982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f799b8-dde6-4f97-afa3-54807aa22241 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:57:59.443059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606904-e5a0-4807-a124-5f75076ed4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:57:59.443707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606904-e5a0-4807-a124-5f75076ed4c7 None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:57:59.443989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606904-e5a0-4807-a124-5f75076ed4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:57:59.444264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606904-e5a0-4807-a124-5f75076ed4c7 None admin] PATH_INFO: `/v3/projects/e55adec1e6f04634b6f72321c1e67e65/users/34615609b6704ace8e7e7de6e337a61a/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:57:59.446946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606904-e5a0-4807-a124-5f75076ed4c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e55adec1e6f04634b6f72321c1e67e65, user_id=34615609b6704ace8e7e7de6e337a61a, role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:57:59.448383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606904-e5a0-4807-a124-5f75076ed4c7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:57:59.460944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 423/849] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:57:59 2022] PUT /identity/v3/projects/e55adec1e6f04634b6f72321c1e67e65/users/34615609b6704ace8e7e7de6e337a61a/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:58:01.594230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c6ce-4d18-44d7-85fe-18a21c8ece58 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:01.594750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c6ce-4d18-44d7-85fe-18a21c8ece58 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:01.594750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c6ce-4d18-44d7-85fe-18a21c8ece58 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:01.596033 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 427/850] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:01.601172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:01.601541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:01.601722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:01.620317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:01.621496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:01.685492 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 424/851] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:01.957503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c6ce-4d18-44d7-85fe-18a21c8ece58 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:02.061400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c6ce-4d18-44d7-85fe-18a21c8ece58 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:02.062883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:02.095694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:02.096310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:02.096586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:02.096854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] PATH_INFO: `/v3/roles/0269db5298cf4fd9878693e71b3f2b89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:02.098237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] RBAC: Authorizing `identity:get_role(role_id=0269db5298cf4fd9878693e71b3f2b89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:02.099579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:02.100850 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 428/852] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:58:01 2022] GET /identity/v3/roles/0269db5298cf4fd9878693e71b3f2b89 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:02.107204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:02.170795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:02.203478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6efa-fdb4-49b0-a837-6a667ff1114b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:02.237041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:02.237605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:02.237886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:02.238179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] PATH_INFO: `/v3/users/34615609b6704ace8e7e7de6e337a61a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:02.239293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] RBAC: Authorizing `identity:get_user(user_id=34615609b6704ace8e7e7de6e337a61a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:02.240721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:02.242300 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 425/853] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:58:02 2022] GET /identity/v3/users/34615609b6704ace8e7e7de6e337a61a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:02.248726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:02.345947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce303b-c922-44d0-bc1d-4bcb67be480d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:02.380149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:02.380751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:02.381033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:02.381307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:02.418395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:02.445654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:02.447607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:02.543161 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 429/854] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:58:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:58:02.549166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:02.645087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3f7e9-8c2c-44b0-b274-15332750276d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:02.676856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923347c-487f-425f-b5c6-8a4e4230adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:02.677466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923347c-487f-425f-b5c6-8a4e4230adf5 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:02.677741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923347c-487f-425f-b5c6-8a4e4230adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:02.678011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923347c-487f-425f-b5c6-8a4e4230adf5 None admin] PATH_INFO: `/v3/projects/e55adec1e6f04634b6f72321c1e67e65` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:02.679129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923347c-487f-425f-b5c6-8a4e4230adf5 None admin] RBAC: Authorizing `identity:get_project(project_id=e55adec1e6f04634b6f72321c1e67e65)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:02.680544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923347c-487f-425f-b5c6-8a4e4230adf5 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:02.682707 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 426/855] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:58:02 2022] GET /identity/v3/projects/e55adec1e6f04634b6f72321c1e67e65 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:02.688901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:02.756033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:02.786375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391404f-413a-4f25-a1d3-2a6f28730714 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:02.819509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:02.820058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:02.820340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:02.820614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:02.821332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] RBAC: Adding query filter params (role.id=0269db5298cf4fd9878693e71b3f2b89, scope.project.id=e55adec1e6f04634b6f72321c1e67e65, user.id=34615609b6704ace8e7e7de6e337a61a) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:02.822399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:02.823819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec1ff-8d88-4460-8e40-85aaba1a72ed None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:02.829343 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 430/856] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:58:02 2022] GET /identity/v3/role_assignments?user.id=34615609b6704ace8e7e7de6e337a61a&scope.project.id=e55adec1e6f04634b6f72321c1e67e65&role.id=0269db5298cf4fd9878693e71b3f2b89 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:04.950385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da492-586e-4b63-bd3f-c95dcd82c03f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:04.950946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da492-586e-4b63-bd3f-c95dcd82c03f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:04.950946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4da492-586e-4b63-bd3f-c95dcd82c03f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:04.952287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 427/857] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:04.957389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:04.957757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:04.957937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:04.975496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:04.976655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:05.041129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 431/858] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:05.309874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4da492-586e-4b63-bd3f-c95dcd82c03f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:05.313785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:05.410406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4da492-586e-4b63-bd3f-c95dcd82c03f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:05.442103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46764ee5-97d0-48d7-8ae0-164a0d0946b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:05.442746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764ee5-97d0-48d7-8ae0-164a0d0946b9 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:05.443024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764ee5-97d0-48d7-8ae0-164a0d0946b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:05.443293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764ee5-97d0-48d7-8ae0-164a0d0946b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:05.444386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46764ee5-97d0-48d7-8ae0-164a0d0946b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:05.445799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46764ee5-97d0-48d7-8ae0-164a0d0946b9 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:05.448182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 428/859] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:58:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:05.453957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:05.514269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:05.552020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0121e3-6e35-44d6-a352-bf4f65c3a6c1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:05.584600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6e515-cf35-4323-8f93-d5a260ac564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:05.585194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e515-cf35-4323-8f93-d5a260ac564e None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:05.585471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e515-cf35-4323-8f93-d5a260ac564e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:05.585740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e515-cf35-4323-8f93-d5a260ac564e None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:05.586406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e515-cf35-4323-8f93-d5a260ac564e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:05.588537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e515-cf35-4323-8f93-d5a260ac564e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:05.614523 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 432/860] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:58:05 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:58:07.798135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a1037-e3bb-475e-a22f-e89c4b072377 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:07.798669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a1037-e3bb-475e-a22f-e89c4b072377 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:07.798761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a1037-e3bb-475e-a22f-e89c4b072377 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:07.800055 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 429/861] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:07.805367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:07.805776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:07.805926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:07.825004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:07.826212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:07.891053 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 433/862] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:08.163491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a1037-e3bb-475e-a22f-e89c4b072377 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:08.234102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:08.264387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a1037-e3bb-475e-a22f-e89c4b072377 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:08.298470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3946865-5341-4ea8-bc56-c60501fd8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:08.299098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3946865-5341-4ea8-bc56-c60501fd8369 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:08.299376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3946865-5341-4ea8-bc56-c60501fd8369 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:08.299645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3946865-5341-4ea8-bc56-c60501fd8369 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:08.300745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3946865-5341-4ea8-bc56-c60501fd8369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:08.302268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3946865-5341-4ea8-bc56-c60501fd8369 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:08.303825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 430/863] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:58:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:08.310098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:08.355959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:08.408345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00c74-1039-4175-9c87-63e7f4818862 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:08.440758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c431ddd-09ef-4b10-8529-464968554baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:08.441294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c431ddd-09ef-4b10-8529-464968554baf None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:08.441576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c431ddd-09ef-4b10-8529-464968554baf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:08.441851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c431ddd-09ef-4b10-8529-464968554baf None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:08.442541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c431ddd-09ef-4b10-8529-464968554baf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:08.443953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c431ddd-09ef-4b10-8529-464968554baf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:08.463911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 434/864] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:58:08 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:58:10.662530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428df4-4a45-459f-ac6d-88e41f53a5e7 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:10.663023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428df4-4a45-459f-ac6d-88e41f53a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:10.663023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428df4-4a45-459f-ac6d-88e41f53a5e7 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:10.664338 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 431/865] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:10.670568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:10.670984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:10.671115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:10.689739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:10.690946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:10.755911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 435/866] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:11.038961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428df4-4a45-459f-ac6d-88e41f53a5e7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:11.139107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428df4-4a45-459f-ac6d-88e41f53a5e7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:11.172019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:11.172636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:11.172918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:11.173192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:11.180722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:11.184770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:58:11.189840 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:58:11.190995 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:58:11.195020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 432/867] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:58:11.197559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:11.227026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:11.296478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145ced3-d9ce-4356-a55b-b4c8476916b0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:11.329464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:11.330066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:11.330370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:11.330643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:11.331303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:11.331603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:11.332953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:11.340751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 436/868] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:11.346532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:11.444012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efaf2-71b7-481c-9c8c-3271e00a1b85 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:11.477735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:11.478449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:11.478734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:11.479009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] PATH_INFO: `/v3/users/6dd6f5d683464e8a90b402d9d61a758c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:11.491721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] RBAC: Authorizing `identity:get_user(user_id=6dd6f5d683464e8a90b402d9d61a758c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:11.493666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:11.495269 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 433/869] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:58:11 2022] GET /identity/v3/users/6dd6f5d683464e8a90b402d9d61a758c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:11.500917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:11.591560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:11.598492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e17d-c57c-41a8-a28b-adbc37058e4b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:11.630930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde346d1-cb11-498d-ac77-4e7c6654939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:11.631547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde346d1-cb11-498d-ac77-4e7c6654939c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:11.631824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde346d1-cb11-498d-ac77-4e7c6654939c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:11.632095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde346d1-cb11-498d-ac77-4e7c6654939c None admin] PATH_INFO: `/v3/projects/2d69aa1e8a6b4ba6ac375da77acffa54` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:11.633193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde346d1-cb11-498d-ac77-4e7c6654939c None admin] RBAC: Authorizing `identity:get_project(project_id=2d69aa1e8a6b4ba6ac375da77acffa54)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:11.635274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde346d1-cb11-498d-ac77-4e7c6654939c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:11.636851 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 437/870] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:58:11 2022] GET /identity/v3/projects/2d69aa1e8a6b4ba6ac375da77acffa54 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:11.642756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:11.700032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:11.750220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacdd07-a98a-4c4d-99f2-33bc79098d56 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:11.783384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9496cd-9743-4fb2-8bb4-65a10e866d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:11.784033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9496cd-9743-4fb2-8bb4-65a10e866d01 None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:11.784314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9496cd-9743-4fb2-8bb4-65a10e866d01 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:11.784590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9496cd-9743-4fb2-8bb4-65a10e866d01 None admin] PATH_INFO: `/v3/projects/2d69aa1e8a6b4ba6ac375da77acffa54/users/6dd6f5d683464e8a90b402d9d61a758c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:11.786505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9496cd-9743-4fb2-8bb4-65a10e866d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d69aa1e8a6b4ba6ac375da77acffa54, user_id=6dd6f5d683464e8a90b402d9d61a758c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:11.787933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9496cd-9743-4fb2-8bb4-65a10e866d01 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:11.799968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 434/871] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:58:11 2022] PUT /identity/v3/projects/2d69aa1e8a6b4ba6ac375da77acffa54/users/6dd6f5d683464e8a90b402d9d61a758c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:58:13.969822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5a98-ef23-480a-b7b4-173393eb7efb None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:13.970378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5a98-ef23-480a-b7b4-173393eb7efb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:13.970495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5a98-ef23-480a-b7b4-173393eb7efb None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:13.971750 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 438/872] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:13.976899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:13.977297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:13.977452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:13.996063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:13.997250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:14.063386 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 435/873] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:14.333930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5a98-ef23-480a-b7b4-173393eb7efb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:14.432270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5a98-ef23-480a-b7b4-173393eb7efb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:14.463712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:14.464325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:14.464601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:14.464873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:14.474849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:58:14.480375 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:58:14.481476 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:58:14.482699 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 439/874] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:58:14.487342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:14.534819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:14.583768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d0e96-cc11-463f-8ba0-dd3378cb8372 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:14.616369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:14.616961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:14.617234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:14.617503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:14.618683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:14.619128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:14.620639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:14.628262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 436/875] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:14.634930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:14.658565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:14.731632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45689e-81d0-43a1-8976-78db5dc3457f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:14.763495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:14.764108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:14.764387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:14.764660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] PATH_INFO: `/v3/users/6dd6f5d683464e8a90b402d9d61a758c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:14.765751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] RBAC: Authorizing `identity:get_user(user_id=6dd6f5d683464e8a90b402d9d61a758c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:14.767194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:14.768709 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 440/876] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:58:14 2022] GET /identity/v3/users/6dd6f5d683464e8a90b402d9d61a758c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:14.774972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:14.872345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dda56-7a8f-4c7b-adca-2637f84b6eea None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:14.882011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:14.906681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:14.907314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:14.907593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:14.907865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:14.972701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:14.974141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:15.068766 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 437/877] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:58:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:58:15.075578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:15.162450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:15.172340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3eb9c-6af8-4a7b-927b-fb53854a0c6a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:15.204574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd0f9-fdc9-4431-bfaa-a253b0412c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:15.205191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd0f9-fdc9-4431-bfaa-a253b0412c4d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:15.205471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd0f9-fdc9-4431-bfaa-a253b0412c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:15.205743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd0f9-fdc9-4431-bfaa-a253b0412c4d None admin] PATH_INFO: `/v3/projects/2d69aa1e8a6b4ba6ac375da77acffa54` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:15.206893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd0f9-fdc9-4431-bfaa-a253b0412c4d None admin] RBAC: Authorizing `identity:get_project(project_id=2d69aa1e8a6b4ba6ac375da77acffa54)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:15.208298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd0f9-fdc9-4431-bfaa-a253b0412c4d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:15.209870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 441/878] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:58:15 2022] GET /identity/v3/projects/2d69aa1e8a6b4ba6ac375da77acffa54 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:15.216147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:15.227958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:15.316498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c89bf-d8e4-4a72-bf71-ee3313ec45c1 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:15.349982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:15.350604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:15.350880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:15.351150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:15.351860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=2d69aa1e8a6b4ba6ac375da77acffa54, user.id=6dd6f5d683464e8a90b402d9d61a758c) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:15.352164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:15.354914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a9db7-8f93-4b12-a8c7-816aedbae697 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:15.360726 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 438/879] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:58:15 2022] GET /identity/v3/role_assignments?user.id=6dd6f5d683464e8a90b402d9d61a758c&scope.project.id=2d69aa1e8a6b4ba6ac375da77acffa54&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:17.552647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723bdb3-499c-4391-ad50-100b3a964579 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:17.553186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723bdb3-499c-4391-ad50-100b3a964579 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:17.553186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723bdb3-499c-4391-ad50-100b3a964579 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:17.554468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 442/880] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:17.560184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7511-fcfb-4637-b631-caeb7bbf314b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:17.560573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7511-fcfb-4637-b631-caeb7bbf314b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:17.560733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7511-fcfb-4637-b631-caeb7bbf314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:17.578646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-78cf7511-fcfb-4637-b631-caeb7bbf314b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:17.579813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-78cf7511-fcfb-4637-b631-caeb7bbf314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:17.644682 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 439/881] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:17.923664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723bdb3-499c-4391-ad50-100b3a964579 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:18.023375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723bdb3-499c-4391-ad50-100b3a964579 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:18.056643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd108e-340a-4066-9266-fb4c94b0f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:18.057243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd108e-340a-4066-9266-fb4c94b0f800 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:18.057523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd108e-340a-4066-9266-fb4c94b0f800 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:18.057796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd108e-340a-4066-9266-fb4c94b0f800 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:18.058494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd108e-340a-4066-9266-fb4c94b0f800 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:18.059837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd108e-340a-4066-9266-fb4c94b0f800 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:18.076073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 443/882] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Oct 31 04:58:17 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:58:20.231483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd6391-ae9b-4132-ae23-047ff67b5cef None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:20.232033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd6391-ae9b-4132-ae23-047ff67b5cef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:20.232033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd6391-ae9b-4132-ae23-047ff67b5cef None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:20.233400 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 440/883] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:20.238661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:20.239100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:20.239220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:20.257465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:20.258928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:20.272032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:20.326681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 444/884] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:20.593310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd6391-ae9b-4132-ae23-047ff67b5cef None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:20.597133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:20.691593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd6391-ae9b-4132-ae23-047ff67b5cef None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:20.724677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72784c3-3100-4e27-bbcb-34e25fe49c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:20.725290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72784c3-3100-4e27-bbcb-34e25fe49c97 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:20.725564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72784c3-3100-4e27-bbcb-34e25fe49c97 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:20.725836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72784c3-3100-4e27-bbcb-34e25fe49c97 None admin] PATH_INFO: `/v3/domains/0bf60027197f4f938484428c4b4e4938` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:20.736215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72784c3-3100-4e27-bbcb-34e25fe49c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0bf60027197f4f938484428c4b4e4938)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:20.737654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72784c3-3100-4e27-bbcb-34e25fe49c97 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:20.739222 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 441/885] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Oct 31 04:58:20 2022] GET /identity/v3/domains/0bf60027197f4f938484428c4b4e4938 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:20.745457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:20.842481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad68a4a-f146-498a-96cc-56a0f7aa1548 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:20.876569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c972-6e7e-4699-b07e-f67b7ca0007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:20.877154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c972-6e7e-4699-b07e-f67b7ca0007f None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:20.877439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c972-6e7e-4699-b07e-f67b7ca0007f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:20.877713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c972-6e7e-4699-b07e-f67b7ca0007f None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:20.878403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5c972-6e7e-4699-b07e-f67b7ca0007f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:20.879823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5c972-6e7e-4699-b07e-f67b7ca0007f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:20.903717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:20.910445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 445/886] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:58:20 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:58:23.049093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71e72-1c89-4c95-8d94-0504a435476b None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:23.049658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71e72-1c89-4c95-8d94-0504a435476b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:23.049658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71e72-1c89-4c95-8d94-0504a435476b None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:23.051006 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 442/887] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:23.056809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:23.057255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:23.057352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:23.075697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:23.076881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:23.141919 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 446/888] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:23.411634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71e72-1c89-4c95-8d94-0504a435476b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:23.474247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:23.512661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71e72-1c89-4c95-8d94-0504a435476b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:23.544284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15accc4-69a3-44ee-addd-f286459b1902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:23.544907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15accc4-69a3-44ee-addd-f286459b1902 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:23.545186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15accc4-69a3-44ee-addd-f286459b1902 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:23.545462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15accc4-69a3-44ee-addd-f286459b1902 None admin] PATH_INFO: `/v3/domains/0bf60027197f4f938484428c4b4e4938` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:23.546589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15accc4-69a3-44ee-addd-f286459b1902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0bf60027197f4f938484428c4b4e4938)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:23.548014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15accc4-69a3-44ee-addd-f286459b1902 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:23.549559 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 443/889] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Oct 31 04:58:23 2022] GET /identity/v3/domains/0bf60027197f4f938484428c4b4e4938 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:23.555225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:23.651154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414054e-cd3b-4a5b-ab2f-3eed97344979 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:23.679163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:23.685215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9f60-0ade-4324-b325-029570e5a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:23.685824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9f60-0ade-4324-b325-029570e5a501 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:23.686108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9f60-0ade-4324-b325-029570e5a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:23.686417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9f60-0ade-4324-b325-029570e5a501 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:23.687070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd9f60-0ade-4324-b325-029570e5a501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:23.688498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd9f60-0ade-4324-b325-029570e5a501 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:23.709713 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 447/890] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:58:23 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:58:25.874008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642694-a6f8-456c-abbf-55cc875ef572 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:25.874603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642694-a6f8-456c-abbf-55cc875ef572 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:25.874603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642694-a6f8-456c-abbf-55cc875ef572 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:25.875929 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 444/891] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:25.881197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:25.881587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:25.881762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:25.900617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:25.901829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:25.967009 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 448/892] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:26.234951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642694-a6f8-456c-abbf-55cc875ef572 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:26.333967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642694-a6f8-456c-abbf-55cc875ef572 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:26.362508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:26.367522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:26.368751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:26.369031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:26.369311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:26.379713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:58:26.385084 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:58:26.386275 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:58:26.387532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 445/893] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:58:26.392254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:26.487819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be1df-7453-479c-a75b-202c30cd2f3f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:26.504633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:26.522518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:26.523118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:26.523400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:26.523675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:26.524946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:26.525406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:26.526814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:26.534605 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 449/894] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:26.540887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:26.636028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944deb06-2fbe-4d8a-9129-ae6248b99ad9 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:26.668179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:26.668786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:26.669061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:26.669333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] PATH_INFO: `/v3/users/a0ecbf07018545dabf2b4c059c827fd5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:26.682328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] RBAC: Authorizing `identity:get_user(user_id=a0ecbf07018545dabf2b4c059c827fd5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:26.683749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:26.685301 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 446/895] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:58:26 2022] GET /identity/v3/users/a0ecbf07018545dabf2b4c059c827fd5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:26.690947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:26.788008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c045d-9b71-4bd9-add5-a2d02a548358 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:26.820304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62171152-e011-443a-af22-7ed89f18dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:26.820926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171152-e011-443a-af22-7ed89f18dc95 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:26.821354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171152-e011-443a-af22-7ed89f18dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:26.821980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171152-e011-443a-af22-7ed89f18dc95 None admin] PATH_INFO: `/v3/projects/e03f6947dfb540b3bdbe12037aa9ddbe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:26.822824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171152-e011-443a-af22-7ed89f18dc95 None admin] RBAC: Authorizing `identity:get_project(project_id=e03f6947dfb540b3bdbe12037aa9ddbe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:26.824245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171152-e011-443a-af22-7ed89f18dc95 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:26.825831 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 450/896] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:58:26 2022] GET /identity/v3/projects/e03f6947dfb540b3bdbe12037aa9ddbe => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:26.831615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:26.881549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:26.930058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7757eb8-5a3b-4531-8e6d-de649183e795 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:26.963534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bd3f5-5261-4959-bcdb-d07e7c400efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:26.964177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd3f5-5261-4959-bcdb-d07e7c400efa None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:26.964461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd3f5-5261-4959-bcdb-d07e7c400efa None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:26.964738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd3f5-5261-4959-bcdb-d07e7c400efa None admin] PATH_INFO: `/v3/projects/e03f6947dfb540b3bdbe12037aa9ddbe/users/a0ecbf07018545dabf2b4c059c827fd5/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:26.966661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bd3f5-5261-4959-bcdb-d07e7c400efa None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f6947dfb540b3bdbe12037aa9ddbe, user_id=a0ecbf07018545dabf2b4c059c827fd5, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:26.968092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bd3f5-5261-4959-bcdb-d07e7c400efa None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:26.981185 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 447/897] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:58:26 2022] PUT /identity/v3/projects/e03f6947dfb540b3bdbe12037aa9ddbe/users/a0ecbf07018545dabf2b4c059c827fd5/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:58:29.108931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37258f65-0958-4b11-a904-2b87fb699c99 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:29.109446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37258f65-0958-4b11-a904-2b87fb699c99 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:29.109550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37258f65-0958-4b11-a904-2b87fb699c99 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:29.110840 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 451/898] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:58:29.116073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:29.116491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:29.116621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:29.135110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:58:29.136266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:58:29.200223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 448/899] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:58:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:58:29.466879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37258f65-0958-4b11-a904-2b87fb699c99 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:29.514628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:29.567851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37258f65-0958-4b11-a904-2b87fb699c99 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:29.599844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:29.600464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:29.600746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:29.601019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:29.611517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:58:29.616210 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:58:29.617294 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:58:29.618894 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 452/900] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:58:29.624102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:29.664031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:29.720461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca675-7094-404c-a76c-9bf4afdaeaf5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:29.753070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:29.753665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:29.753941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:29.754238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:29.754902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:29.755203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:29.756574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:29.764305 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 449/901] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:29.770090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:29.867033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21873528-8c71-4099-8cda-7e5dcca08a6e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:29.873608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:29.900898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:29.901528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:29.901810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:29.902085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] PATH_INFO: `/v3/users/a0ecbf07018545dabf2b4c059c827fd5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:29.903225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=a0ecbf07018545dabf2b4c059c827fd5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:29.904673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:29.906412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 453/902] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 04:58:29 2022] GET /identity/v3/users/a0ecbf07018545dabf2b4c059c827fd5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:29.911885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:30.009607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e219e2-b52e-43c2-9b72-bd8d47e2d89c None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:30.011122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:30.043829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:30.044432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:30.044713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:30.044990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:30.110072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:30.111538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:30.205650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 450/903] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:58:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:58:30.212443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:30.310949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81776-b59f-4c5a-9daa-b0114a238eb5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:30.343586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170cd05-48a9-47fb-88c4-0ba1420471be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:30.344210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cd05-48a9-47fb-88c4-0ba1420471be None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:30.344494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cd05-48a9-47fb-88c4-0ba1420471be None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:30.344768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170cd05-48a9-47fb-88c4-0ba1420471be None admin] PATH_INFO: `/v3/projects/e03f6947dfb540b3bdbe12037aa9ddbe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:30.345878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170cd05-48a9-47fb-88c4-0ba1420471be None admin] RBAC: Authorizing `identity:get_project(project_id=e03f6947dfb540b3bdbe12037aa9ddbe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:30.347332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170cd05-48a9-47fb-88c4-0ba1420471be None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:30.348928 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 454/904] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 04:58:30 2022] GET /identity/v3/projects/e03f6947dfb540b3bdbe12037aa9ddbe => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:30.356268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:58:30.358425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:30.452426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b2c99-b9d6-4a24-a548-7874e35ef6f6 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:58:30.485962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:58:30.486585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:58:30.486866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:58:30.487136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:58:30.487844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=e03f6947dfb540b3bdbe12037aa9ddbe, user.id=a0ecbf07018545dabf2b4c059c827fd5) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:58:30.488148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:58:30.489561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f8ff-9387-4efe-b951-dd2bf2bdc46a None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:58:30.495293 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 451/905] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:58:30 2022] GET /identity/v3/role_assignments?user.id=a0ecbf07018545dabf2b4c059c827fd5&scope.project.id=e03f6947dfb540b3bdbe12037aa9ddbe&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:58:40.339533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=79 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:58:40.492610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=67 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:26.216837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93060c-2a2d-447c-80b4-4c3c60885acc None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:26.217478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93060c-2a2d-447c-80b4-4c3c60885acc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:26.217478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93060c-2a2d-447c-80b4-4c3c60885acc None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:26.218931 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 455/906] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:26.229256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:26.229256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:26.229256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:26.251003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:26.252307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:26.342201 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 452/907] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:26.621300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93060c-2a2d-447c-80b4-4c3c60885acc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:26.760191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93060c-2a2d-447c-80b4-4c3c60885acc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:26.810952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:26.811570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:26.811965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:26.812158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:26.825934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:26.827539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:26.845001 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:26.846245 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:26.851348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:26.851348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:26.851348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:26.851348 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 456/908] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:26.853078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:26.990301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167e49d-d241-4957-baad-d68d6b85273a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:27.170898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:27.178030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:27.178793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:27.179083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:27.179840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:27.182192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:27.182192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:27.182636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc07fb6-9125-4c81-8d25-1fbe39e84840 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:27.204655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 453/909] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:27.204865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:27.274777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:27.332153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3b22-c141-4881-bb6c-6b520f2b8dc4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:27.371429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2b581-3125-4956-9e83-28f0e10890ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:27.372064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2b581-3125-4956-9e83-28f0e10890ed None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:27.372373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2b581-3125-4956-9e83-28f0e10890ed None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:27.372616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2b581-3125-4956-9e83-28f0e10890ed None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:27.373728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2b581-3125-4956-9e83-28f0e10890ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:27.375250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2b581-3125-4956-9e83-28f0e10890ed None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:27.400807 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 457/910] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 04:59:27 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:59:29.860660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f4e9-9133-4901-ad54-45d12831ff35 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:29.861195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f4e9-9133-4901-ad54-45d12831ff35 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:29.861195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f4e9-9133-4901-ad54-45d12831ff35 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:29.863344 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 454/911] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:29.869553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:29.870022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:29.870307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:29.892662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:29.893958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:29.977632 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 458/912] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:30.275758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f4e9-9133-4901-ad54-45d12831ff35 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:30.410257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f4e9-9133-4901-ad54-45d12831ff35 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:30.459983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:30.460751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:30.461125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:30.462019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:30.474541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:59:30.480589 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:30.486866 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:30.487720 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 455/913] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:30.489914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:30.540463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:30.630814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab697a8-e43c-4990-9d10-e80e6e706085 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:30.678079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:30.678826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:30.679112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:30.679400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:30.680092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:30.680496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:30.681930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:30.697606 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 459/914] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:30.704607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:30.766618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:30.826230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4515979-418f-4e09-b7e5-5fe450efbd72 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:30.868606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:30.869573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:30.869802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:30.870235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:30.882216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:30.884093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:30.900040 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:30.901262 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:30.902430 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:30.902430 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:30.902430 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:30.903240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 456/915] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:30.910343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:31.035166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:31.038569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e7437-7a61-4202-b72d-1a3aa1d379f2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:31.083884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:31.084430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:31.084706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:31.084982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:31.085654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:31.085960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:31.087859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:31.100465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 460/916] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:31.106684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:31.219870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9df6-d797-4039-ac0d-e30c1a63a764 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:31.221523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:31.257736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:31.258582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:31.258927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:31.259268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:31.267234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:31.268738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:59:31.282251 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:31.283660 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:31.284609 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 457/917] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:31.289197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:31.407754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9dbd-1b2b-4e51-925a-d9ae90f64f36 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:31.449564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:31.450315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:31.450608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:31.450929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:31.451660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:31.451946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:31.453388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:31.479716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 461/918] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 04:59:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:59:31.479922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:31.597495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299dbc2-1488-4029-9559-b7dfb8b63c46 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:31.637689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:31.638407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:31.640487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:31.640731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:31.652847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:31.654442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:31.674606 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:31.675776 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:31.676658 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:31.676658 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:31.676658 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:31.676658 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 458/919] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:31.681813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:31.705340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:31.796044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf588-25f3-45be-86e2-73e3d707675f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:31.840329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:31.840937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:31.841216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:31.841486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:31.842134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:31.842498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:31.843900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:31.863099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 462/920] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:59:31.864479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:31.882684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:31.977014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd794-dbe3-4b9f-bab5-3472f6e6f6f1 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:32.012284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:32.013019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:32.013369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:32.013711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:32.020737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:32.022303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:59:32.034315 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:32.035481 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:32.036558 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:32.042789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 459/921] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:32.043865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:32.140373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:32.163723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560c7f-d6fd-4dc4-a7ec-11f425f97873 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:32.200818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:32.201507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:32.201856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:32.202228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:32.203022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:32.203380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:32.204852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a720574-4cbe-4e35-953e-4566d501ee64 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:32.218758 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 463/922] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:32.224536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:32.321980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:32.353851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1f39-e9cb-4b74-9039-1b03f7605118 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:32.394995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2e63e-d541-4cc9-8794-5887575f3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:32.396086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2e63e-d541-4cc9-8794-5887575f3e5d None admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:32.396510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2e63e-d541-4cc9-8794-5887575f3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:32.397021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2e63e-d541-4cc9-8794-5887575f3e5d None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/02161ca0b0614648b54e7047d767328d/roles/35d9df6b062548afab8e524ea5e1eb53` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:32.418029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2e63e-d541-4cc9-8794-5887575f3e5d None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=02161ca0b0614648b54e7047d767328d, role_id=35d9df6b062548afab8e524ea5e1eb53)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:32.419653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2e63e-d541-4cc9-8794-5887575f3e5d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:32.434619 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 460/923] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:59:32 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/02161ca0b0614648b54e7047d767328d/roles/35d9df6b062548afab8e524ea5e1eb53 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:59:34.619703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b982c4-dcbb-4178-b5a1-806ebc7da896 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:34.620212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b982c4-dcbb-4178-b5a1-806ebc7da896 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:34.620212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b982c4-dcbb-4178-b5a1-806ebc7da896 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:34.621479 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 464/924] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:34.626908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90368b0-5346-4743-84d0-28803ad225db None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:34.627346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90368b0-5346-4743-84d0-28803ad225db None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:34.627465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90368b0-5346-4743-84d0-28803ad225db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:34.646779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f90368b0-5346-4743-84d0-28803ad225db None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:34.648137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f90368b0-5346-4743-84d0-28803ad225db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:34.721834 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 461/925] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:34.996779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b982c4-dcbb-4178-b5a1-806ebc7da896 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:35.104385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b982c4-dcbb-4178-b5a1-806ebc7da896 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:35.142487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:35.143139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:35.143422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:35.143700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:35.150898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:35.155243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:59:35.160304 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:35.161556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:35.162545 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 465/926] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 04:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:35.169125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90368b0-5346-4743-84d0-28803ad225db None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:35.228080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:35.276193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90368b0-5346-4743-84d0-28803ad225db None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:35.314736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:35.315389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:35.315702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:35.316009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:35.316743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] RBAC: Adding query filter params (name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:35.317040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:35.318457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:35.327809 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 462/927] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 04:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:35.334214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:35.443396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccaa97-833c-4b41-9309-469e094f7662 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:35.477980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:35.478646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:35.478925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:35.479197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:35.489987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:35.491455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:35.506588 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:35.507767 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:35.509301 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:35.509301 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:35.509301 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:35.509301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 466/928] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:35.515192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:35.620723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58ac6-31dc-4090-8a5e-f63f2530615e None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:35.637079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:35.657203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:35.657874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:35.658277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:35.658593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:35.659378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:35.659720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:35.661337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:35.674450 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 463/929] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:59:35.681006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:35.737110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:35.797573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9480-b723-4ec0-ba94-c1293b0ad631 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:35.835477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:35.836132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:35.836412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:35.836684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:35.845318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:35.846961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:59:35.860512 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:35.861737 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:35.862943 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:35.866900 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 467/930] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:35.868641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:35.979204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3bb0-7d82-4ee7-b1c1-7302441a9de7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:36.014721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:36.015445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:36.015774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:36.016119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:36.016906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:36.017198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:36.018676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:36.037706 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 464/931] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 04:59:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:36.045118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:36.158798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63370-d980-43da-ba8b-0aca1d3abcad None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:36.173513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:36.202433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:36.203230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:36.203598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:36.203964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:36.287285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:36.288747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:36.398633 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 468/932] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:59:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:59:36.404341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:36.442684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:36.517925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409c71-4893-4180-9490-ac315c9fedae None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:36.552512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:36.553101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:36.553368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:36.553643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:36.564337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:36.565775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:36.581807 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:36.583104 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:36.584285 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:36.584285 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:36.584285 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:36.584626 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 465/933] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:36.589385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:36.601572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:36.699882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3e8d-57ce-4330-a9bd-a1b6d1bb4284 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:36.738777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:36.739473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:36.739790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:36.740110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:36.740869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:36.741230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:36.742991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:36.755024 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 469/934] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:36.761526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:36.859785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:36.876360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6d936-60df-4689-8aa8-d19a7ab6adfd None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:36.917326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:36.918045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:36.918459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:36.918715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:36.926700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:36.928364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:59:36.941969 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:36.942955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:36.943899 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 466/935] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:36.949672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:37.024090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:37.059923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f44d-00f7-4715-8712-52782c514126 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:37.097262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:37.097951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:37.098272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:37.098557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:37.099259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:37.099571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:37.101000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977536e-b0ac-43f7-bb3f-89e1ce4f2dfb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:37.114598 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 470/936] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:37.121488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:37.244556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee12f-7f60-4b08-8998-e5e7f6b3243d None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:37.280708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:37.281308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:37.281619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:37.281853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:37.282711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] RBAC: Adding query filter params (role.id=35d9df6b062548afab8e524ea5e1eb53, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=02161ca0b0614648b54e7047d767328d) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:37.283131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:37.284687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a132a-cf93-4614-8a31-0b1f29c3a401 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:37.293540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 467/937] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:59:37 2022] GET /identity/v3/role_assignments?user.id=02161ca0b0614648b54e7047d767328d&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=35d9df6b062548afab8e524ea5e1eb53 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:39.618829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d4e7-4f49-4531-9fae-75b408c39967 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:39.619355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d4e7-4f49-4531-9fae-75b408c39967 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:39.619355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d4e7-4f49-4531-9fae-75b408c39967 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:39.620644 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 471/938] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:39.626014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:39.626445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:39.626606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:39.645909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:39.647213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:39.650861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:39.723454 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 468/939] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:39.998914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d4e7-4f49-4531-9fae-75b408c39967 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:40.102928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d4e7-4f49-4531-9fae-75b408c39967 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:40.132797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:40.139497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:40.140243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:40.140559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:40.140915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:40.152672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:59:40.158492 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:40.159653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:40.160707 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 472/940] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:40.167238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:40.281059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b40b4a-01dc-47c3-9e9c-22b37a14203f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:40.321712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:40.322365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:40.322643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:40.322916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:40.323580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:40.323883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:40.325259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:40.333797 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 469/941] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:59:40.340441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:40.448624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111e522-a84e-4351-80bb-4933fe509029 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:40.484182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:40.484824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:40.485129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:40.485376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:40.496135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:40.497656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:40.516237 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:40.517352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:40.518464 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:40.518464 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:40.518464 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:40.518464 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 473/942] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:40.523208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:40.526785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:40.632298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f409c-a078-4d4e-8a16-eb1298f526a7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:40.670694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:40.671311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:40.671589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:40.671892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:40.672642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:40.672980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:40.674676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:40.687908 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 470/943] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:59:40.694275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:40.744071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:40.817313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c7b12-92c7-4ae4-a36f-902f076d6086 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:40.854172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:40.854835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:40.855160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:40.855392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:40.863974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:40.865548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:59:40.878364 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:40.879540 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:40.880641 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 474/944] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:40.886763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:40.963261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:41.011120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8487d-fa6b-4edb-a9d8-9776b92eca98 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:41.045658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:41.046297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:41.046580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:41.046850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:41.047573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:41.047875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:41.049306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:41.067416 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 471/945] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 04:59:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:41.073916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:41.187961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918529c7-6be9-4440-9cce-dc5867911273 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:41.189515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:41.224039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:41.224676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:41.224982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:41.225259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:41.237562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:41.239057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:41.254442 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:41.260298 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:41.261425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:41.261425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:41.261425 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:41.261425 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 475/946] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:41.262858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:41.370798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839852b-2885-47fb-848e-45635cffbf72 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:41.392564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:41.409112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:41.409805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:41.410243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:41.410640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:41.411405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:41.411719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:41.413640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:41.429068 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 472/947] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:41.436232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:41.568688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418ab0-9da6-49ef-ab63-6bdaa47fc506 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:41.606458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:41.607103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:41.607387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:41.607660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:41.614471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:41.615928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:59:41.627371 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:41.633156 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:41.635114 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 476/948] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:41.635823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:41.741569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001fa7-6aa8-4446-8209-25a8c8b134c7 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:41.778401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:41.779014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:41.779294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:41.779562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:41.780286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:41.780590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:41.782093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6a896-66fc-483f-8a05-56e68991f381 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:41.794919 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 473/949] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:41.802639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:41.823088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:41.919391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d436cc-942f-48c8-8127-41251b349e68 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:41.959098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329d5ec-98ec-4b73-bc22-cc2d6fb40e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:41.959837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d5ec-98ec-4b73-bc22-cc2d6fb40e34 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:41.960162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d5ec-98ec-4b73-bc22-cc2d6fb40e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:41.960472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d5ec-98ec-4b73-bc22-cc2d6fb40e34 None admin] PATH_INFO: `/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/02161ca0b0614648b54e7047d767328d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:41.962857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329d5ec-98ec-4b73-bc22-cc2d6fb40e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user_id=02161ca0b0614648b54e7047d767328d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:41.964320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329d5ec-98ec-4b73-bc22-cc2d6fb40e34 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:41.978736 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 477/950] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 04:59:41 2022] PUT /identity/v3/projects/0792e9c5f1dd4b8da9ed5e65fd5b1bfa/users/02161ca0b0614648b54e7047d767328d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 04:59:44.328307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044944-5e70-4e4f-94ba-b2df304d8113 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:44.328839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044944-5e70-4e4f-94ba-b2df304d8113 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:44.328839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044944-5e70-4e4f-94ba-b2df304d8113 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:44.330361 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 474/951] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:44.335522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:44.336079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:44.336173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:44.358415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:44.360763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:44.454014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 478/952] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:44.739700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044944-5e70-4e4f-94ba-b2df304d8113 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:44.784959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:44.846800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044944-5e70-4e4f-94ba-b2df304d8113 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:44.882632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:44.883818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:44.884112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:44.884382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:44.894723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 04:59:44.899927 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:44.901032 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:44.902334 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 475/953] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 04:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:44.907683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:44.911282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:45.024822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde28e8-eb1e-43a6-9734-5ce13b64d5c1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:45.060741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:45.061362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:45.061646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:45.061920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:45.062633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:45.062941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:45.064302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:45.073041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 479/954] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 04:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:45.078946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:45.183500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:45.186695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6a7ed-a54c-45a3-8e62-fdf3572eb4a9 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:45.227833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:45.228474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:45.228746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:45.229021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:45.240042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:45.241521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:45.257026 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:45.258011 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:45.259024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:45.259024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:45.259024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:45.263107 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 476/955] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:45.264054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:45.336734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:45.376095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01561a0-2769-4393-8f2c-e8d49b80da6c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:45.416512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:45.417260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:45.417583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:45.418033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:45.418857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:45.419194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:45.420939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:45.435003 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 480/956] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:45.441608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:45.554724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b21d-0d41-423a-b2cd-9a1e646a7d9f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:45.590782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:45.591423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:45.591707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:45.591982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:45.599604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:45.601522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 04:59:45.615037 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:45.621901 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:45.623130 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 477/957] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:45.623856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:45.739438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441df37-56ba-46eb-9e7d-114933b2aa31 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:45.769571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:45.779064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:45.779685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:45.779969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:45.780246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:45.780981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:45.781291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:45.782774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:45.800661 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 481/958] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 04:59:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 04:59:45.807969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:45.824884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:45.923240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2c0ca-8932-4e58-ba95-95bd41e1d332 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:45.967795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:45.968556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:45.968944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:45.969424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:46.049946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:46.051423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:46.066832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:46.159472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 478/959] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 04:59:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 04:59:46.165893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:46.273366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac1ffc-be8e-4094-ad5e-f9fe3ade7056 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:46.312593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:46.313245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:46.313524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:46.313793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:46.325197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:46.327225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 04:59:46.343080 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:46.345470 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 04:59:46.346762 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 04:59:46.346762 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 04:59:46.346762 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:46.346762 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 482/960] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 04:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:46.350593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:46.459792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67666c-b7d9-497e-b3ab-763f94bd4685 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:46.474823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:46.498215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:46.498869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:46.499144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:46.499452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:46.500177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:46.500493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:46.501926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:46.515853 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 479/961] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 04:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:46.522005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:46.561137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:46.632828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae07a3-72ae-44c6-bca1-ede07e6c3d70 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:46.669875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:46.670570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:46.670852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:46.671127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:46.678920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:46.681314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 04:59:46.693728 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:46.694754 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 04:59:46.695646 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 483/962] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 04:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:46.701243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:46.808146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b9dc7-dc2b-46ba-898a-683805c3890f None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:46.844701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:46.845330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:46.845613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:46.845888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:46.846627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:46.846938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:46.848390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b63e3-925e-40ad-b25f-f17760f4e080 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:46.862597 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 480/963] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 04:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:46.869908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:46.976116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:46.983883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c33f-05d5-491c-b2ba-5862463f77a4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:47.020642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:47.021245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:47.021522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:47.021792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:47.022620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] RBAC: Adding query filter params (role.id=14e4a1b541b244baaac32fd3e27cd6d1, scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa, user.id=02161ca0b0614648b54e7047d767328d) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:47.022927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:47.025084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71373e5b-5a0c-438b-a8ab-797187597f50 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:47.030849 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 484/964] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 04:59:46 2022] GET /identity/v3/role_assignments?user.id=02161ca0b0614648b54e7047d767328d&scope.project.id=0792e9c5f1dd4b8da9ed5e65fd5b1bfa&role.id=14e4a1b541b244baaac32fd3e27cd6d1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:49.220895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31bf51-0df2-44ee-b130-214458117b78 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:49.221527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31bf51-0df2-44ee-b130-214458117b78 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:49.221527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31bf51-0df2-44ee-b130-214458117b78 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:49.222809 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 481/965] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:49.228674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:49.229118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:49.229216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:49.248126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:49.249314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:49.314375 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 485/966] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:49.581610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31bf51-0df2-44ee-b130-214458117b78 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:49.612223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:49.680723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31bf51-0df2-44ee-b130-214458117b78 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:49.713829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:49.714467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:49.714745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:49.715016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:49.715593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:49.716953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:49.725431 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:49.726670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:49.728152 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 482/967] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:59:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:49.732764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:49.820219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:49.830924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8a16-7b66-4b85-9774-c36f6de996ab None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:49.863866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:49.864405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:49.864681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:49.864950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:49.865570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:49.865870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:49.867241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b193d-cefd-4fe9-8bd1-c5294473ee29 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:49.872798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 486/968] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 04:59:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:49.878427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:49.981934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:49.987911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5401a18-034b-4510-b7a8-4e21dc676795 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:50.019817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:50.020419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:50.020698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:50.020969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:50.021589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:50.021889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:50.023284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4ec63-74c6-4b44-889e-55e6d3c012e8 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:50.028117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 483/969] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 04:59:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:52.159161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476d7e8-67ec-4519-b4aa-514fbedb455f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:52.159730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476d7e8-67ec-4519-b4aa-514fbedb455f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:52.159730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476d7e8-67ec-4519-b4aa-514fbedb455f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:52.161029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 487/970] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:52.166647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405280-8490-4ee0-9372-c30cd00f92a4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:52.167060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405280-8490-4ee0-9372-c30cd00f92a4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:52.167184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405280-8490-4ee0-9372-c30cd00f92a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:52.185138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-78405280-8490-4ee0-9372-c30cd00f92a4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:52.186348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-78405280-8490-4ee0-9372-c30cd00f92a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:52.250100 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 484/971] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:52.517949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476d7e8-67ec-4519-b4aa-514fbedb455f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:52.616066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476d7e8-67ec-4519-b4aa-514fbedb455f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:52.648924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfae7c-81d1-4358-9205-4483ec496746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:52.649512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfae7c-81d1-4358-9205-4483ec496746 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:52.649794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfae7c-81d1-4358-9205-4483ec496746 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:52.650070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfae7c-81d1-4358-9205-4483ec496746 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:52.650750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfae7c-81d1-4358-9205-4483ec496746 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:52.652105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfae7c-81d1-4358-9205-4483ec496746 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:52.666551 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 488/972] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 04:59:52 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 04:59:54.837075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed975-2b2d-46c9-ba24-b5b97d2b427b None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:54.837616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed975-2b2d-46c9-ba24-b5b97d2b427b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:54.837616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed975-2b2d-46c9-ba24-b5b97d2b427b None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:54.838993 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 485/973] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 04:59:54.844810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:54.845215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:54.845367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:54.863571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:54.864753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:54.873845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:54.942844 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 489/974] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:55.213631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed975-2b2d-46c9-ba24-b5b97d2b427b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:55.302955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:55.314073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed975-2b2d-46c9-ba24-b5b97d2b427b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:55.346977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:55.347592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:55.347866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:55.348131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:55.348698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:55.350128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:55.359387 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:55.360520 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:55.361541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 486/975] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:59:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:55.366468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:55.463469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bce2-cce7-48b6-9413-ece9d7b47a72 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:55.496484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:55.497016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:55.497295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:55.497565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:55.498208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:55.498509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:55.499850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:55.504724 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 490/976] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 04:59:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:55.511375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:55.607464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b342-b157-4d9b-b685-703c8d1e9220 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:55.639713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:55.640301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:55.640577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:55.640846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:55.641528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] RBAC: Adding query filter params (interface=public, service_id=e29e391a0e364a039e0caf206e9e3a8f, region_id=RegionOne) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:55.641835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:55.643211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8494a-c436-45fe-b7ef-18f585708d96 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:55.647986 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 487/977] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 04:59:55 2022] GET /identity/v3/endpoints?service_id=e29e391a0e364a039e0caf206e9e3a8f&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:55.654552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:55.658230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:55.752779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f721b-ea6d-4722-8d27-54d030094bcc None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:55.785515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf1be-e51d-4a33-b3bd-77308c8b01df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:55.786115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf1be-e51d-4a33-b3bd-77308c8b01df None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:55.786435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf1be-e51d-4a33-b3bd-77308c8b01df None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:55.786712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf1be-e51d-4a33-b3bd-77308c8b01df None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:55.787318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf1be-e51d-4a33-b3bd-77308c8b01df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:55.788658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf1be-e51d-4a33-b3bd-77308c8b01df None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:55.795468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 491/978] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 04:59:55 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 04:59:57.940740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3a7b-dc84-48ef-91f5-62ff11dff899 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:57.941346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3a7b-dc84-48ef-91f5-62ff11dff899 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:57.941346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3a7b-dc84-48ef-91f5-62ff11dff899 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:57.942840 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 488/979] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 04:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 04:59:57.949150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:57.949615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:57.949811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:57.971463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 04:59:57.972774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 04:59:58.035326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:58.040907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 492/980] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 04:59:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 04:59:58.311312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3a7b-dc84-48ef-91f5-62ff11dff899 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:58.330532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:58.413091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3a7b-dc84-48ef-91f5-62ff11dff899 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:58.445249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:58.446666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:58.446951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:58.447227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:58.447807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:58.449165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 04:59:58.458584 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 04:59:58.459732 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 04:59:58.460594 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 489/981] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 04:59:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 04:59:58.466605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:58.562185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f653b-2d90-478f-9692-edd219c0a03e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:58.595379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:58.595977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:58.596259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:58.596535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:58.597161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 04:59:58.597465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:58.598844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28047a-6076-404b-839e-61d05cbc395c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:58.604250 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 493/982] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 04:59:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 04:59:58.610226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 04:59:58.688805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 04:59:58.706965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a5247-8df2-4be8-87f7-d72d2f0ed904 None admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 04:59:58.739919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfa354-5ff2-464e-acc5-11cefabb74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 04:59:58.740519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa354-5ff2-464e-acc5-11cefabb74e6 None admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 04:59:58.740800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa354-5ff2-464e-acc5-11cefabb74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 04:59:58.741073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfa354-5ff2-464e-acc5-11cefabb74e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 04:59:58.741734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfa354-5ff2-464e-acc5-11cefabb74e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 04:59:58.743674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfa354-5ff2-464e-acc5-11cefabb74e6 None admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 04:59:58.762248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 490/983] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 04:59:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:00:08.601121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=69 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:00:08.757852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:03.343756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a52c74-1182-462d-9bfd-2f5bcd7cf95a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:03.344198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a52c74-1182-462d-9bfd-2f5bcd7cf95a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:03.344275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a52c74-1182-462d-9bfd-2f5bcd7cf95a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:03.346514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 494/984] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:03.351822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb679-03b2-478d-896d-3131c059774c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:03.352253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb679-03b2-478d-896d-3131c059774c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:03.352253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb679-03b2-478d-896d-3131c059774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:03.464319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-229fb679-03b2-478d-896d-3131c059774c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:03.466929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-229fb679-03b2-478d-896d-3131c059774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:03.638253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 491/985] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:03.933499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7000-5fa0-481c-93af-02acbdaf8327 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:03.933897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7000-5fa0-481c-93af-02acbdaf8327 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:03.934300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7000-5fa0-481c-93af-02acbdaf8327 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:03.935804 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 495/986] 10.222.0.23 () {54 vars in 965 bytes} [Mon Oct 31 05:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:03.942488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bf9cd-3396-400a-aba2-9222531bfe7d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:03.942862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bf9cd-3396-400a-aba2-9222531bfe7d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:03.943216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bf9cd-3396-400a-aba2-9222531bfe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:04.035351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4b3bf9cd-3396-400a-aba2-9222531bfe7d None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:04.036579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b3bf9cd-3396-400a-aba2-9222531bfe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:04.060251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:04.124286 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 492/987] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Oct 31 05:01:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:04.133922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7000-5fa0-481c-93af-02acbdaf8327 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:04.135787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7e6f7000-5fa0-481c-93af-02acbdaf8327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:04.253013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7000-5fa0-481c-93af-02acbdaf8327 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:04.340882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:04.341491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:04.341770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:04.342036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:04.343642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:04.410307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:04.475476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:04.478185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa29a7-283b-40b1-86de-242fe04a3d53 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:04.500254 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 496/988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:06.999101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e36f10-002e-44e1-be65-80a6567aafb1 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:06.999696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e36f10-002e-44e1-be65-80a6567aafb1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:06.999696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e36f10-002e-44e1-be65-80a6567aafb1 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:07.000926 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 493/989] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:07.006136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9ab8-6764-4a7f-abce-cb65cd0ad3bc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:07.006558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9ab8-6764-4a7f-abce-cb65cd0ad3bc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:07.006714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9ab8-6764-4a7f-abce-cb65cd0ad3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:07.088385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-306f9ab8-6764-4a7f-abce-cb65cd0ad3bc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:07.089577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-306f9ab8-6764-4a7f-abce-cb65cd0ad3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:07.185593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 497/990] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:07.472489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e36f10-002e-44e1-be65-80a6567aafb1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:07.474051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b1e36f10-002e-44e1-be65-80a6567aafb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:07.581301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e36f10-002e-44e1-be65-80a6567aafb1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:07.654166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:07.656675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:07.657384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:07.657750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:07.658041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:07.660398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:07.770377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:07.771816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78be65-2e0b-4b15-a0cb-076d6fa9a19a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:07.791830 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 494/991] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:10.263877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec4908-3c46-474e-b001-643c4f3838db None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:10.264425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec4908-3c46-474e-b001-643c4f3838db None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:10.264425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec4908-3c46-474e-b001-643c4f3838db None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:10.265751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 498/992] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:10.270920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd03-0174-45fe-ad10-0e11aeea4958 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:10.271312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd03-0174-45fe-ad10-0e11aeea4958 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:10.271476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5fd03-0174-45fe-ad10-0e11aeea4958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:10.338201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-84a5fd03-0174-45fe-ad10-0e11aeea4958 None None] MFA Rules not processed for user `a7ec17a4307243f9949b663f6ed4bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:10.339448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-84a5fd03-0174-45fe-ad10-0e11aeea4958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:10.391543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:10.435913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 495/993] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:10.722108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec4908-3c46-474e-b001-643c4f3838db None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:10.723660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebec4908-3c46-474e-b001-643c4f3838db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:10.736369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:10.830269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec4908-3c46-474e-b001-643c4f3838db None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:10.903792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:10.904396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:10.904676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:10.904946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:10.906574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:10.970185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:11.016638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:11.018176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396a279-f776-4325-9afa-848aab5b60a1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:11.036198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 499/994] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:13.717106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08d60-a0ad-4f20-bdeb-b8d50b1d83fd None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:13.717610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08d60-a0ad-4f20-bdeb-b8d50b1d83fd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:13.717610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08d60-a0ad-4f20-bdeb-b8d50b1d83fd None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:13.718952 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 496/995] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:13.724020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d656037-57c9-4a0f-b80d-a69a25aaa1d6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:13.724417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d656037-57c9-4a0f-b80d-a69a25aaa1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:13.724578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d656037-57c9-4a0f-b80d-a69a25aaa1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:13.790917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4d656037-57c9-4a0f-b80d-a69a25aaa1d6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:13.792122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d656037-57c9-4a0f-b80d-a69a25aaa1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:13.885975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 500/996] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:14.175467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc08d60-a0ad-4f20-bdeb-b8d50b1d83fd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:14.177004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ccc08d60-a0ad-4f20-bdeb-b8d50b1d83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:14.278694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc08d60-a0ad-4f20-bdeb-b8d50b1d83fd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:14.350201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:14.350798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:14.351591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:14.352060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:14.353651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:14.360667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:14.460355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:14.462288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9478a-1915-4360-8b96-bec062c84cb9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:14.479615 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 497/997] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:17.395377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d420d-b7ec-4bcf-bbe5-cb80c98f2127 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:17.395900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d420d-b7ec-4bcf-bbe5-cb80c98f2127 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:17.395900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d420d-b7ec-4bcf-bbe5-cb80c98f2127 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:17.397259 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 501/998] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:17.403043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c620fa-6f47-45c7-bb54-7b7d7e139374 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:17.403453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c620fa-6f47-45c7-bb54-7b7d7e139374 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:17.403585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c620fa-6f47-45c7-bb54-7b7d7e139374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:17.476931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d0c620fa-6f47-45c7-bb54-7b7d7e139374 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:17.478288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d0c620fa-6f47-45c7-bb54-7b7d7e139374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:17.541675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:17.585200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 498/999] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:17.885985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c90163-7b3c-417d-a532-b0777ff2b0d9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:17.886310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c90163-7b3c-417d-a532-b0777ff2b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:17.886586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c90163-7b3c-417d-a532-b0777ff2b0d9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:17.887930 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 502/1000] 10.222.0.23 () {54 vars in 965 bytes} [Mon Oct 31 05:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:17.893885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92baeda-bd84-4806-9b8f-b87658618de0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:17.894194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92baeda-bd84-4806-9b8f-b87658618de0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:17.894471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92baeda-bd84-4806-9b8f-b87658618de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:17.970058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c92baeda-bd84-4806-9b8f-b87658618de0 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:17.971308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c92baeda-bd84-4806-9b8f-b87658618de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:18.047711 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 499/1001] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Oct 31 05:01:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:18.057948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c90163-7b3c-417d-a532-b0777ff2b0d9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:18.059473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0c90163-7b3c-417d-a532-b0777ff2b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:18.079461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:18.165053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c90163-7b3c-417d-a532-b0777ff2b0d9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:18.239649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:18.240263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:18.240543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:18.240816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:18.243130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:18.317991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:18.356645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:18.358629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63d748-2e70-4a21-915b-34e65325ce3a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:18.377327 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 503/1002] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:20.830689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17813-064e-4ebc-9bbb-85371f28ba29 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:20.831203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17813-064e-4ebc-9bbb-85371f28ba29 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:20.831203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17813-064e-4ebc-9bbb-85371f28ba29 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:20.832474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 500/1003] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:20.838627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3feab-ff36-4dfb-a4f4-e796273baaa3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:20.839039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3feab-ff36-4dfb-a4f4-e796273baaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:20.839189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3feab-ff36-4dfb-a4f4-e796273baaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:20.907313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cde3feab-ff36-4dfb-a4f4-e796273baaa3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:20.908839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cde3feab-ff36-4dfb-a4f4-e796273baaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:21.014051 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 504/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:21.303118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17813-064e-4ebc-9bbb-85371f28ba29 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:21.305244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-47d17813-064e-4ebc-9bbb-85371f28ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:21.368642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:21.413484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17813-064e-4ebc-9bbb-85371f28ba29 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:21.487975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:21.488588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:21.488870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:21.489144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:21.490769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:21.599856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:21.603217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:21.605182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249bd64-bf9e-4588-b17e-a583ea97c221 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:21.625149 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 501/1005] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:23.862675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bdf41-d91e-4480-9834-7ae1140d5a2a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:23.863195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bdf41-d91e-4480-9834-7ae1140d5a2a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:23.863291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bdf41-d91e-4480-9834-7ae1140d5a2a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:23.864749 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 505/1006] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:23.870353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c03cc-0166-4883-9e9d-3883b4fff151 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:23.870852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c03cc-0166-4883-9e9d-3883b4fff151 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:23.870973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c03cc-0166-4883-9e9d-3883b4fff151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:23.941477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ab9c03cc-0166-4883-9e9d-3883b4fff151 None None] MFA Rules not processed for user `a7ec17a4307243f9949b663f6ed4bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:23.942733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab9c03cc-0166-4883-9e9d-3883b4fff151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:24.044182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 502/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:24.323860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bdf41-d91e-4480-9834-7ae1140d5a2a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:24.325412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f5bdf41-d91e-4480-9834-7ae1140d5a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:24.356731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:24.434345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bdf41-d91e-4480-9834-7ae1140d5a2a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:24.512581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:24.513202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:24.513483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:24.513758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:24.515399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:24.601684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:24.639223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:24.640703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9356a-f2a8-4f20-bfc7-64a71b07aa25 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:24.660743 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 506/1008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:27.047984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a13252-c862-44c3-8a1d-4231d948775c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:27.048519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a13252-c862-44c3-8a1d-4231d948775c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:27.048519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a13252-c862-44c3-8a1d-4231d948775c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:27.049884 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 503/1009] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:27.055797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5e556-acb1-42d1-a8f3-f13ace4df3b3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:27.056228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5e556-acb1-42d1-a8f3-f13ace4df3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:27.056330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5e556-acb1-42d1-a8f3-f13ace4df3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:27.120754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-93b5e556-acb1-42d1-a8f3-f13ace4df3b3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:27.121944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93b5e556-acb1-42d1-a8f3-f13ace4df3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:27.215692 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 507/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:27.496902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a13252-c862-44c3-8a1d-4231d948775c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:27.498497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6a13252-c862-44c3-8a1d-4231d948775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:27.570777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:27.606045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a13252-c862-44c3-8a1d-4231d948775c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:27.679940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:27.680557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:27.680835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:27.681108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:27.682733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:27.792512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:27.793946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ec5e7-6593-4913-8446-b11ffa6bfc4c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:27.803654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:27.812511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 504/1011] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:30.044518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f507e-7572-4835-8f76-ac5c982d0323 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:30.045049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f507e-7572-4835-8f76-ac5c982d0323 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:30.045049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f507e-7572-4835-8f76-ac5c982d0323 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:30.046456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 508/1012] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:30.051708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3232f1-d2cb-40a0-98b4-80653e960b68 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:30.052121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3232f1-d2cb-40a0-98b4-80653e960b68 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:30.052262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3232f1-d2cb-40a0-98b4-80653e960b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:30.124766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5e3232f1-d2cb-40a0-98b4-80653e960b68 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:30.125967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e3232f1-d2cb-40a0-98b4-80653e960b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:30.222000 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 505/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:30.512144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f507e-7572-4835-8f76-ac5c982d0323 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:30.513655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a07f507e-7572-4835-8f76-ac5c982d0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:30.552731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:30.617371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f507e-7572-4835-8f76-ac5c982d0323 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:30.690051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:30.690689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:30.690983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:30.691255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:30.692846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:30.776748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:30.802660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:30.804731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74b0a0-ad3f-4520-9040-2d5dc2d44e62 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:30.822928 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 509/1014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:33.284276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf9d3-5ef2-46f1-b507-5404f4ec6cad None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:33.284824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf9d3-5ef2-46f1-b507-5404f4ec6cad None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:33.284824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf9d3-5ef2-46f1-b507-5404f4ec6cad None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:33.287703 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 506/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:33.293232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1f48c-3816-453c-8bdf-8b702852956c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:33.293620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1f48c-3816-453c-8bdf-8b702852956c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:33.293776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1f48c-3816-453c-8bdf-8b702852956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:33.359302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4dc1f48c-3816-453c-8bdf-8b702852956c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:33.360508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4dc1f48c-3816-453c-8bdf-8b702852956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:33.457070 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 510/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:33.741163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bf9d3-5ef2-46f1-b507-5404f4ec6cad None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:33.742724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fc6bf9d3-5ef2-46f1-b507-5404f4ec6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:33.818489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:33.846069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bf9d3-5ef2-46f1-b507-5404f4ec6cad None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:33.919839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:33.920375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:33.920649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:33.920917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:33.922511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:34.031126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:34.032556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39f386-754a-420b-9209-13711d25c10d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:34.050718 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 507/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:38.511778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e29d8-26bb-489e-aed0-d99ad8163392 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:38.512311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e29d8-26bb-489e-aed0-d99ad8163392 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:38.512311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e29d8-26bb-489e-aed0-d99ad8163392 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:38.513599 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 511/1018] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:38.519106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2c14-df70-4d00-b71b-1fc9dd3265c4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:38.519488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2c14-df70-4d00-b71b-1fc9dd3265c4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:38.519735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2c14-df70-4d00-b71b-1fc9dd3265c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:38.526026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:38.587781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d64b2c14-df70-4d00-b71b-1fc9dd3265c4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:38.589089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d64b2c14-df70-4d00-b71b-1fc9dd3265c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:38.683967 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 508/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:38.972890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e29d8-26bb-489e-aed0-d99ad8163392 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:38.974447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c23e29d8-26bb-489e-aed0-d99ad8163392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:39.024328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:39.079917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e29d8-26bb-489e-aed0-d99ad8163392 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:39.154949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:39.155561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:39.155842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:39.156132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:39.157687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:39.255256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:39.273167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:39.275210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b25a-bdcf-4357-84a0-9d75b38bccd2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:39.298306 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 512/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:42.112682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f36988-1f4b-4538-af56-1e64a9ae9c02 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:42.113238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f36988-1f4b-4538-af56-1e64a9ae9c02 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:42.113238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f36988-1f4b-4538-af56-1e64a9ae9c02 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:42.114623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 509/1021] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:42.120502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183210e-d68f-478b-800e-2c4653671afb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:42.120917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183210e-d68f-478b-800e-2c4653671afb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:42.121122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183210e-d68f-478b-800e-2c4653671afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:42.187341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a183210e-d68f-478b-800e-2c4653671afb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:42.188545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a183210e-d68f-478b-800e-2c4653671afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:42.287807 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 513/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:42.570672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f36988-1f4b-4538-af56-1e64a9ae9c02 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:42.573157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-96f36988-1f4b-4538-af56-1e64a9ae9c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:42.667422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:42.684706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f36988-1f4b-4538-af56-1e64a9ae9c02 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:42.758375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:42.759062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:42.759335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:42.759630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:42.761220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:42.873161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:42.874656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469df5-fa72-434a-9357-deb53dbecdaf service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:42.893042 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 510/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:47.024481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec331da-d168-4215-a9cd-ad548adcad81 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:47.024963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec331da-d168-4215-a9cd-ad548adcad81 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:47.025041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec331da-d168-4215-a9cd-ad548adcad81 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:47.030600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 514/1024] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:01:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:47.031880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee1ce-4b11-48d2-a72c-964b5f4c46de None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:47.032330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee1ce-4b11-48d2-a72c-964b5f4c46de None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:47.032494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee1ce-4b11-48d2-a72c-964b5f4c46de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:47.048742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:47.109363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-891ee1ce-4b11-48d2-a72c-964b5f4c46de None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:47.110730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-891ee1ce-4b11-48d2-a72c-964b5f4c46de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:47.223501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 511/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:01:47.508069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec331da-d168-4215-a9cd-ad548adcad81 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:01:47.510169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ec331da-d168-4215-a9cd-ad548adcad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:47.567852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:47.613047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec331da-d168-4215-a9cd-ad548adcad81 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:01:47.685487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:01:47.686122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:47.686425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:47.686697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:47.688303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:47.799391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:47.802777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:01:47.804719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17034b67-8c00-4da7-877e-9f036686dee5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:01:47.824114 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 515/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:01:52.818720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd841212-a031-4bec-bdd4-3bf5c5010662 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:52.819221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd841212-a031-4bec-bdd4-3bf5c5010662 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:52.819315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd841212-a031-4bec-bdd4-3bf5c5010662 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:52.821162 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 512/1027] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:52.826756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff085e3-1b09-4bea-83a9-5e8243d66e6c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:52.827207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff085e3-1b09-4bea-83a9-5e8243d66e6c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:52.827292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff085e3-1b09-4bea-83a9-5e8243d66e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:52.975837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9ff085e3-1b09-4bea-83a9-5e8243d66e6c None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:52.977302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ff085e3-1b09-4bea-83a9-5e8243d66e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:53.103995 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 516/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:01:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:57.221478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=59 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:57.292316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c532-a08f-4f08-8efe-be9002336243 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:57.295256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c532-a08f-4f08-8efe-be9002336243 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:57.295625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c532-a08f-4f08-8efe-be9002336243 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:57.297200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 513/1029] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:01:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:57.302439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa67f49-68d1-4805-81a9-d8d3dd92990f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:57.302835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa67f49-68d1-4805-81a9-d8d3dd92990f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:57.303056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa67f49-68d1-4805-81a9-d8d3dd92990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:57.361554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:57.387428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-baa67f49-68d1-4805-81a9-d8d3dd92990f None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:57.388731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-baa67f49-68d1-4805-81a9-d8d3dd92990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:57.512080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 517/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:01:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:01:58.927858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995b224-b244-42fa-8c45-64ea397ed457 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:58.928386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995b224-b244-42fa-8c45-64ea397ed457 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:58.928386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995b224-b244-42fa-8c45-64ea397ed457 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:58.930019 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 514/1031] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:01:58.935587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca0f8-96c7-4c2d-b273-d5b5996fb485 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:01:58.935952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca0f8-96c7-4c2d-b273-d5b5996fb485 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:01:58.936688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca0f8-96c7-4c2d-b273-d5b5996fb485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:01:59.018427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-032ca0f8-96c7-4c2d-b273-d5b5996fb485 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:01:59.019627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-032ca0f8-96c7-4c2d-b273-d5b5996fb485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:01:59.067644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:01:59.139066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 518/1032] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:01:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:02.533236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e7643-6c74-4862-9273-715a512a7b15 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:02.534133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e7643-6c74-4862-9273-715a512a7b15 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:02.534431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e7643-6c74-4862-9273-715a512a7b15 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:02.535887 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 515/1033] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:02.544240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bbd8a-8e9c-42a1-a189-2a76d041a57f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:02.545151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bbd8a-8e9c-42a1-a189-2a76d041a57f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:02.545603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bbd8a-8e9c-42a1-a189-2a76d041a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:02.620183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-173bbd8a-8e9c-42a1-a189-2a76d041a57f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:02.621386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-173bbd8a-8e9c-42a1-a189-2a76d041a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:02.730262 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 519/1034] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:03.033618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517e2bb-5a72-4b00-9bcc-25d02edf0510 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:03.034313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517e2bb-5a72-4b00-9bcc-25d02edf0510 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:03.034811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517e2bb-5a72-4b00-9bcc-25d02edf0510 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:03.041072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 516/1035] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 05:02:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:03.050372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66a6f-1ba0-4d4f-b557-99597d602aca None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:03.050661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66a6f-1ba0-4d4f-b557-99597d602aca None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:03.050987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66a6f-1ba0-4d4f-b557-99597d602aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:03.078471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:03.149925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-daf66a6f-1ba0-4d4f-b557-99597d602aca None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:03.151292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-daf66a6f-1ba0-4d4f-b557-99597d602aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:03.282421 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 520/1036] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 05:02:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:03.294008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517e2bb-5a72-4b00-9bcc-25d02edf0510 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:03.295698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6517e2bb-5a72-4b00-9bcc-25d02edf0510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:03.452236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517e2bb-5a72-4b00-9bcc-25d02edf0510 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:03.529839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:03.578831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:03.579446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:03.579727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:03.580041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:03.581893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:03.684510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:03.686114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a1139-388f-40d6-9f4d-3daadcebe7d7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:03.706047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 517/1037] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:02:06.141259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7602-d506-4130-8d95-3913d98ef416 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:06.141727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7602-d506-4130-8d95-3913d98ef416 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:06.141824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7602-d506-4130-8d95-3913d98ef416 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:06.143369 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 521/1038] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:06.148697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c36e-5e38-45ac-8319-e6b33fc550ca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:06.149765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c36e-5e38-45ac-8319-e6b33fc550ca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:06.149924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c36e-5e38-45ac-8319-e6b33fc550ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:06.223513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b103c36e-5e38-45ac-8319-e6b33fc550ca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:06.224853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b103c36e-5e38-45ac-8319-e6b33fc550ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:06.273365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:06.345579 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 518/1039] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:06.636396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b7602-d506-4130-8d95-3913d98ef416 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:06.637903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f2b7602-d506-4130-8d95-3913d98ef416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:06.722469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:06.821748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b7602-d506-4130-8d95-3913d98ef416 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:06.956601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:06.958216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:06.958216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:06.958216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:06.959370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:06.984715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:07.056874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:07.058505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294872-efd2-44f1-9dfe-37ffa229d68c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:07.078050 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 522/1040] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:09.589492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c306-623a-4586-bd66-203ab66ba448 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:09.590020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c306-623a-4586-bd66-203ab66ba448 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:09.590020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c306-623a-4586-bd66-203ab66ba448 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:09.594266 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 519/1041] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:09.596879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7de0-026e-44dc-a7b0-70ae0ef29ec8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:09.597285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7de0-026e-44dc-a7b0-70ae0ef29ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:09.597430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7de0-026e-44dc-a7b0-70ae0ef29ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:09.682009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-04ac7de0-026e-44dc-a7b0-70ae0ef29ec8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:09.684012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-04ac7de0-026e-44dc-a7b0-70ae0ef29ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:09.810612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:09.813005 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 523/1042] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:10.133192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2540e3-07b9-48bc-a318-6c23e6da6768 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:10.134236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2540e3-07b9-48bc-a318-6c23e6da6768 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:10.134721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2540e3-07b9-48bc-a318-6c23e6da6768 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:10.136229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 520/1043] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 05:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:10.142836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4b77-a06e-462b-9a69-7308d09cd84b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:10.142836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4b77-a06e-462b-9a69-7308d09cd84b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:10.143110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4b77-a06e-462b-9a69-7308d09cd84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:10.242097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-502c4b77-a06e-462b-9a69-7308d09cd84b None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:10.244030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-502c4b77-a06e-462b-9a69-7308d09cd84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:10.408452 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 524/1044] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:10.416255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2540e3-07b9-48bc-a318-6c23e6da6768 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:10.418012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac2540e3-07b9-48bc-a318-6c23e6da6768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:10.631040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2540e3-07b9-48bc-a318-6c23e6da6768 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:10.667131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:10.784525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:10.784525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:10.785739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:10.786027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:10.787692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:10.911607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:10.913346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33041543-fd34-41b6-a449-0a3c80c996af service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:10.937565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 521/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:02:13.385135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1cae-b029-42b5-b413-d221858254f3 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:13.385730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1cae-b029-42b5-b413-d221858254f3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:13.385730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1cae-b029-42b5-b413-d221858254f3 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:13.390762 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 525/1046] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:13.392508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e5ed-5cc3-465f-8157-c718602c5b3f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:13.392958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e5ed-5cc3-465f-8157-c718602c5b3f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:13.393043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e5ed-5cc3-465f-8157-c718602c5b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:13.433391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:13.496163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4097e5ed-5cc3-465f-8157-c718602c5b3f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:13.498877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4097e5ed-5cc3-465f-8157-c718602c5b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:13.648182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 522/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:13.951095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f1cae-b029-42b5-b413-d221858254f3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:13.953722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-811f1cae-b029-42b5-b413-d221858254f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:14.030062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:14.177888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f1cae-b029-42b5-b413-d221858254f3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:14.305204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:14.305992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:14.306319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:14.306603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:14.308287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:14.319877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:14.406373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:14.407973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3110742-0c99-433d-bdec-9dfc2ad8a2e9 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:14.428111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 526/1048] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:14.695647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf36f2-3889-4ffe-b9ff-91e147d879dc None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:14.696944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf36f2-3889-4ffe-b9ff-91e147d879dc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:14.696944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf36f2-3889-4ffe-b9ff-91e147d879dc None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:14.698127 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 523/1049] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:14.703742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2525e3-6372-4e5f-b246-7bccc74884a7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:14.704133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2525e3-6372-4e5f-b246-7bccc74884a7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:14.704597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2525e3-6372-4e5f-b246-7bccc74884a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:14.780007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0d2525e3-6372-4e5f-b246-7bccc74884a7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:14.781236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0d2525e3-6372-4e5f-b246-7bccc74884a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:14.866876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:14.889989 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 527/1050] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:02:15.193497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be322cf-36cb-45c9-b85d-390097f222a4 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:15.193920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be322cf-36cb-45c9-b85d-390097f222a4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:15.194350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be322cf-36cb-45c9-b85d-390097f222a4 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:15.196486 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 524/1051] 10.222.0.23 () {54 vars in 963 bytes} [Mon Oct 31 05:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:15.201738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2af28-40ba-4d7f-8540-befb3ed11b1b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:15.202039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2af28-40ba-4d7f-8540-befb3ed11b1b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:15.202367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2af28-40ba-4d7f-8540-befb3ed11b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:15.291899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-06a2af28-40ba-4d7f-8540-befb3ed11b1b None None] MFA Rules not processed for user `b46b252d8cc1405896f3f9b22531c08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:15.293220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-06a2af28-40ba-4d7f-8540-befb3ed11b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:15.377902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 528/1052] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 31 05:02:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:15.386010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be322cf-36cb-45c9-b85d-390097f222a4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:15.387629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5be322cf-36cb-45c9-b85d-390097f222a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:15.500993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be322cf-36cb-45c9-b85d-390097f222a4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:15.504965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:15.580216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:15.580739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:15.581022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:15.581298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:15.582942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:15.702689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:15.704280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71e6d4-6410-4587-b11e-1b3f2cafa579 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:15.732302 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 525/1053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:16.823805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817270e3-0fa0-4191-8804-f29e534be689 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:16.824306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817270e3-0fa0-4191-8804-f29e534be689 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:16.824306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817270e3-0fa0-4191-8804-f29e534be689 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:16.825780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 529/1054] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:02:16.831115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12434e65-8dfb-4406-99d1-3def74dfefc1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:16.831548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12434e65-8dfb-4406-99d1-3def74dfefc1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:16.831673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12434e65-8dfb-4406-99d1-3def74dfefc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:16.877332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:16.903053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-12434e65-8dfb-4406-99d1-3def74dfefc1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:16.904299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-12434e65-8dfb-4406-99d1-3def74dfefc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:17.005002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 526/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:17.301515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817270e3-0fa0-4191-8804-f29e534be689 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:17.302988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-817270e3-0fa0-4191-8804-f29e534be689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:17.395570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:17.478816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817270e3-0fa0-4191-8804-f29e534be689 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:17.607618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:17.608238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:17.608522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:17.608805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:17.610728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:17.658296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:17.725270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:17.726931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cb1c3-4c2f-456d-b02f-7ac35de3c87a service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:17.749903 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 530/1056] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:20.063272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a4a6-0f3e-4d49-b40e-f80089ceab05 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:20.064324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a4a6-0f3e-4d49-b40e-f80089ceab05 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:20.064813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a4a6-0f3e-4d49-b40e-f80089ceab05 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:20.066652 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 527/1057] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:20.073010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd01d8-caf8-4bb0-88ef-138cb39279b5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:20.073866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd01d8-caf8-4bb0-88ef-138cb39279b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:20.074388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd01d8-caf8-4bb0-88ef-138cb39279b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:20.149906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-facd01d8-caf8-4bb0-88ef-138cb39279b5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:20.152806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-facd01d8-caf8-4bb0-88ef-138cb39279b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:20.286176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 531/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:20.568175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a4a6-0f3e-4d49-b40e-f80089ceab05 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:20.569970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6223a4a6-0f3e-4d49-b40e-f80089ceab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:20.685603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:20.731353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a4a6-0f3e-4d49-b40e-f80089ceab05 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:20.851602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:20.852901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:20.853183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:20.853458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:20.855114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:20.937682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:20.955206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:20.956932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd7d00-619c-478b-aef4-4b54267d2c43 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:20.976591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 528/1059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:23.238283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458543d-ef2c-43c4-8b87-0d4e3d70d799 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:23.238846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458543d-ef2c-43c4-8b87-0d4e3d70d799 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:23.238846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458543d-ef2c-43c4-8b87-0d4e3d70d799 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:23.240133 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 532/1060] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:23.245727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583727e-80e3-4ae5-bfc7-8043dc99f9a8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:23.247728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583727e-80e3-4ae5-bfc7-8043dc99f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:23.247728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583727e-80e3-4ae5-bfc7-8043dc99f9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:23.327475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4583727e-80e3-4ae5-bfc7-8043dc99f9a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:23.329041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4583727e-80e3-4ae5-bfc7-8043dc99f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:23.444656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 529/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:23.733097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458543d-ef2c-43c4-8b87-0d4e3d70d799 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:23.734933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1458543d-ef2c-43c4-8b87-0d4e3d70d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:23.771642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:23.951771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458543d-ef2c-43c4-8b87-0d4e3d70d799 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:24.045291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:24.074003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:24.074799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:24.075235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:24.075591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:24.077681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:24.183511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:24.185575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea02f2-f0c5-47ec-86a0-35f855d54913 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:24.209251 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 533/1062] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:26.905843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0296-b9e9-4eef-a59f-589868084be2 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:26.906384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0296-b9e9-4eef-a59f-589868084be2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:26.906384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0296-b9e9-4eef-a59f-589868084be2 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:26.907833 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 530/1063] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:26.913360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e586-769a-4595-a24d-7ef3c4914366 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:26.913773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e586-769a-4595-a24d-7ef3c4914366 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:26.913915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e586-769a-4595-a24d-7ef3c4914366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:26.983490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5ec9e586-769a-4595-a24d-7ef3c4914366 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:26.984965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5ec9e586-769a-4595-a24d-7ef3c4914366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:27.052172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:27.101157 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 534/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:27.402074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd0296-b9e9-4eef-a59f-589868084be2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:27.403662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8ffd0296-b9e9-4eef-a59f-589868084be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:27.471563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:27.572796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd0296-b9e9-4eef-a59f-589868084be2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:27.699639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:27.700284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:27.700574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:27.700845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:27.702559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:27.717337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:27.801234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:27.802871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c1a43-a629-46f6-8997-49beb04f99e7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:27.822405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 531/1065] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:30.240694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c92bc-d3f7-4e9e-bf2f-1a46be41f563 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:30.241287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c92bc-d3f7-4e9e-bf2f-1a46be41f563 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:30.241287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c92bc-d3f7-4e9e-bf2f-1a46be41f563 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:30.243161 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 535/1066] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:02:30.248719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ce2f-84bd-4876-9a69-585e9130334f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:30.249155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ce2f-84bd-4876-9a69-585e9130334f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:30.249256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ce2f-84bd-4876-9a69-585e9130334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:30.322834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f108ce2f-84bd-4876-9a69-585e9130334f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:30.324072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f108ce2f-84bd-4876-9a69-585e9130334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:30.415431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:30.426913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 532/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:30.719639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c92bc-d3f7-4e9e-bf2f-1a46be41f563 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:30.721158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-114c92bc-d3f7-4e9e-bf2f-1a46be41f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:30.870306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c92bc-d3f7-4e9e-bf2f-1a46be41f563 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:30.909560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:30.989025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:30.989558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:30.989841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:30.990115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:30.991793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:31.086853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:31.088460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807811dc-d919-4513-84dc-64eab0f52e86 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:31.106801 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 536/1068] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:31.620313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbd7f9-5c30-4cee-b150-7be92dccc08f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:31.620873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbd7f9-5c30-4cee-b150-7be92dccc08f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:31.620873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbd7f9-5c30-4cee-b150-7be92dccc08f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:31.622312 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 533/1069] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:31.627555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e3293-f6d9-4e5e-a09e-6c5f548ec474 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:31.628007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e3293-f6d9-4e5e-a09e-6c5f548ec474 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:31.628101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e3293-f6d9-4e5e-a09e-6c5f548ec474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:31.682580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:31.697270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-358e3293-f6d9-4e5e-a09e-6c5f548ec474 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:31.698524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-358e3293-f6d9-4e5e-a09e-6c5f548ec474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:31.797772 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 537/1070] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:32.099967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fce4be-a8b3-47b5-a1cb-b683ecdc0798 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:32.100361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fce4be-a8b3-47b5-a1cb-b683ecdc0798 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:32.100641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fce4be-a8b3-47b5-a1cb-b683ecdc0798 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:32.102841 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 534/1071] 10.222.0.23 () {54 vars in 962 bytes} [Mon Oct 31 05:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:32.108470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200d01-06e6-4efb-be33-085ed2603475 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:32.108845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200d01-06e6-4efb-be33-085ed2603475 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:32.109187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200d01-06e6-4efb-be33-085ed2603475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:32.188726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a200d01-06e6-4efb-be33-085ed2603475 None None] MFA Rules not processed for user `d1a59dbd84f94e99ad696d60c25082c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:32.190036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a200d01-06e6-4efb-be33-085ed2603475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:32.254925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:32.269659 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 538/1072] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 31 05:02:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:32.277944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fce4be-a8b3-47b5-a1cb-b683ecdc0798 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:32.279494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6fce4be-a8b3-47b5-a1cb-b683ecdc0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:32.389092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fce4be-a8b3-47b5-a1cb-b683ecdc0798 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:32.464285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:32.464943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:32.465232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:32.465819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:32.467435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:32.510638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:32.583713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:32.585141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef2baf-1cab-4da8-ad0f-62f8243fc4c5 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:32.604384 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 535/1073] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:33.315231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd8fc-d5a3-4510-a4e2-fe9ddf66686d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:33.315706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd8fc-d5a3-4510-a4e2-fe9ddf66686d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:33.315816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd8fc-d5a3-4510-a4e2-fe9ddf66686d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:33.317120 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 539/1074] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:33.323165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f9ba-7e84-4b8d-b635-a4daa4c125bc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:33.323637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f9ba-7e84-4b8d-b635-a4daa4c125bc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:33.323804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f9ba-7e84-4b8d-b635-a4daa4c125bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:33.377711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7082a-5ebc-41b3-9b20-744d36895ca9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:33.378023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7082a-5ebc-41b3-9b20-744d36895ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:33.378328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7082a-5ebc-41b3-9b20-744d36895ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:33.395927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a852f9ba-7e84-4b8d-b635-a4daa4c125bc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:33.397137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a852f9ba-7e84-4b8d-b635-a4daa4c125bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:33.447119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b2c7082a-5ebc-41b3-9b20-744d36895ca9 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:33.448469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b2c7082a-5ebc-41b3-9b20-744d36895ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:33.499401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:33.502352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 536/1075] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:33.537531 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 540/1076] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:02:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:02:33.589978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69593-20a8-4d2f-9fa7-e93aee19cbdc None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:33.590612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69593-20a8-4d2f-9fa7-e93aee19cbdc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:33.590898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69593-20a8-4d2f-9fa7-e93aee19cbdc None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:33.592268 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 537/1077] 10.222.0.23 () {54 vars in 943 bytes} [Mon Oct 31 05:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:33.598559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:33.599022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:33.599422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:33.676397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] MFA Rules not processed for user `d29fb54e4c484f94a012b821cdb5ae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:33.677582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:33.698899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:33.787728 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 541/1078] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Oct 31 05:02:33 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:33.794635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69593-20a8-4d2f-9fa7-e93aee19cbdc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:33.796288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-93a69593-20a8-4d2f-9fa7-e93aee19cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:33.797328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:33.807642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb88a22-c38d-4962-8a66-e8d320a8935c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:33.915586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:33.916486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:33.916821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:33.917049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:33.918689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:33.947074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69593-20a8-4d2f-9fa7-e93aee19cbdc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:33.948180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:34.005551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:34.007300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6102ed-cecf-42fd-88ad-15c666f4f349 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:34.016097 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 542/1079] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:02:34.023346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:34.067199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:34.067816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:34.068099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:34.068363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:34.069972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:34.186370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:34.187993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772cc97-e912-458b-bb53-40191c50f660 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:34.207455 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 538/1080] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:36.494525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36d02-4139-4c6d-bb14-7a9dbfdcaf6b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:36.495049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36d02-4139-4c6d-bb14-7a9dbfdcaf6b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:36.495049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36d02-4139-4c6d-bb14-7a9dbfdcaf6b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:36.496576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 543/1081] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:36.501769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0379-4f35-4d5d-a6b0-603d05d4ee6e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:36.502205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0379-4f35-4d5d-a6b0-603d05d4ee6e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:36.502366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0379-4f35-4d5d-a6b0-603d05d4ee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:36.575781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-510a0379-4f35-4d5d-a6b0-603d05d4ee6e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:36.576948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-510a0379-4f35-4d5d-a6b0-603d05d4ee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:36.619264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:36.703010 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 539/1082] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:02:36.993858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36d02-4139-4c6d-bb14-7a9dbfdcaf6b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:36.995550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67f36d02-4139-4c6d-bb14-7a9dbfdcaf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:37.166029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36d02-4139-4c6d-bb14-7a9dbfdcaf6b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:37.189996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:37.305407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:37.306310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:37.306595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:37.306873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:37.308460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:37.406693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:37.408305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58822dfa-a7eb-431c-a1c0-3266544638f2 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:37.427891 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 544/1083] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:39.647962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de723-81b3-40ff-bdcd-91c170ecd8c1 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:39.648500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de723-81b3-40ff-bdcd-91c170ecd8c1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:39.648500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de723-81b3-40ff-bdcd-91c170ecd8c1 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:39.649902 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 540/1084] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:39.655241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c589313-ec9a-464d-a777-6aacca5738ac None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:39.655657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c589313-ec9a-464d-a777-6aacca5738ac None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:39.655797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c589313-ec9a-464d-a777-6aacca5738ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:39.691052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:39.730005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5c589313-ec9a-464d-a777-6aacca5738ac None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:39.731384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c589313-ec9a-464d-a777-6aacca5738ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:39.840751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 545/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:40.136844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de723-81b3-40ff-bdcd-91c170ecd8c1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:02:40.137367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3f0de723-81b3-40ff-bdcd-91c170ecd8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:40.312675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de723-81b3-40ff-bdcd-91c170ecd8c1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:02:40.337290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:40.447109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:02:40.448025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:40.448304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:40.448575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:40.450275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:40.552007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:02:40.553612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4baf1ac-9d6d-4ed4-a4a4-65ac62ed4912 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:02:40.576317 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 541/1086] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:02:49.839223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=54 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:50.573907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:57.687939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b2b8-826c-43a9-8c22-f0f1b5dedf3a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:57.688458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b2b8-826c-43a9-8c22-f0f1b5dedf3a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:57.688458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b2b8-826c-43a9-8c22-f0f1b5dedf3a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:57.689755 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 546/1087] 10.222.0.23 () {54 vars in 918 bytes} [Mon Oct 31 05:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:57.695678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15ff7-c519-4b31-8e17-03eef3586ce2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:57.696124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15ff7-c519-4b31-8e17-03eef3586ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:57.696235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15ff7-c519-4b31-8e17-03eef3586ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:57.774830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-69b15ff7-c519-4b31-8e17-03eef3586ce2 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:57.776048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-69b15ff7-c519-4b31-8e17-03eef3586ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:57.884367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 542/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 31 05:02:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:02:57.899092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df3ab-186d-41b0-9b4e-4707ea4322da None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:57.899379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df3ab-186d-41b0-9b4e-4707ea4322da None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:57.899655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df3ab-186d-41b0-9b4e-4707ea4322da None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:57.901080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 547/1089] 10.222.0.23 () {54 vars in 918 bytes} [Mon Oct 31 05:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:02:57.905692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30482b1-6fa3-4b05-baf7-d4134267dceb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:02:57.905975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30482b1-6fa3-4b05-baf7-d4134267dceb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:02:57.906294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30482b1-6fa3-4b05-baf7-d4134267dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:02:57.978415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:02:57.981580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f30482b1-6fa3-4b05-baf7-d4134267dceb None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:02:57.983394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f30482b1-6fa3-4b05-baf7-d4134267dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:02:58.100176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 543/1090] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 31 05:02:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:00.706905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8899702-bd1e-4264-9f0b-498b24958aa7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:00.707482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8899702-bd1e-4264-9f0b-498b24958aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:00.707482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8899702-bd1e-4264-9f0b-498b24958aa7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:00.708780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 548/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:00.714619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a364319-9bab-4c9d-89e5-37d1bcc4506d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:00.715071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a364319-9bab-4c9d-89e5-37d1bcc4506d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:00.715181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a364319-9bab-4c9d-89e5-37d1bcc4506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:00.782082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1a364319-9bab-4c9d-89e5-37d1bcc4506d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:00.783317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1a364319-9bab-4c9d-89e5-37d1bcc4506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:00.838985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:00.880482 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 544/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:01.175966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8899702-bd1e-4264-9f0b-498b24958aa7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:01.177678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c8899702-bd1e-4264-9f0b-498b24958aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:01.324397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8899702-bd1e-4264-9f0b-498b24958aa7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:01.395727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:01.435705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:01.436236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:01.436544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:01.436815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:01.438422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:01.529281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:01.530880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1eca-cc21-4a97-ba4b-c5908f3f850d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:01.549140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 549/1093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:02.688543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856fb8-4d75-4cb0-8b57-60b1503dcc4c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:02.689073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856fb8-4d75-4cb0-8b57-60b1503dcc4c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:02.689073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856fb8-4d75-4cb0-8b57-60b1503dcc4c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:02.690382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 545/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:02.695894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b90c4-3b9e-4de5-ba0b-8e8e46d0922d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:02.696292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b90c4-3b9e-4de5-ba0b-8e8e46d0922d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:02.696446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b90c4-3b9e-4de5-ba0b-8e8e46d0922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:02.776703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ed0b90c4-3b9e-4de5-ba0b-8e8e46d0922d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:02.777949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ed0b90c4-3b9e-4de5-ba0b-8e8e46d0922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:02.805458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:02.875637 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 550/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:03.056040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856fb8-4d75-4cb0-8b57-60b1503dcc4c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:03.057555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a856fb8-4d75-4cb0-8b57-60b1503dcc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:03.205225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856fb8-4d75-4cb0-8b57-60b1503dcc4c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:03.245844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:03.319195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:03.319747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:03.320007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:03.320282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:03.321851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:03.411900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:03.414358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b002f-7ef3-4911-b4ec-ff7c12e43b1d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:03.432084 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 546/1096] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:04.558483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5748d81-7105-45cb-9608-f727ba5ddf0b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:04.559023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5748d81-7105-45cb-9608-f727ba5ddf0b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:04.559023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5748d81-7105-45cb-9608-f727ba5ddf0b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:04.560273 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 551/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:04.565074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27765-fc69-4c60-a651-941d2f8bc338 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:04.565483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27765-fc69-4c60-a651-941d2f8bc338 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:04.565619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27765-fc69-4c60-a651-941d2f8bc338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:04.620326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:04.642695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7ee27765-fc69-4c60-a651-941d2f8bc338 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:04.643910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7ee27765-fc69-4c60-a651-941d2f8bc338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:04.740165 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 547/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:04.893492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5748d81-7105-45cb-9608-f727ba5ddf0b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:04.895122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e5748d81-7105-45cb-9608-f727ba5ddf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:05.044410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5748d81-7105-45cb-9608-f727ba5ddf0b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:05.056521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:05.159171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:05.159726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:05.160011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:05.160283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:05.161884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:05.257192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:05.259040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24124289-dc31-4924-8c98-5d0c1b160732 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:05.277796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 552/1099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:06.365667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999466f-d71f-47dd-9147-eef636f6be68 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:06.366285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999466f-d71f-47dd-9147-eef636f6be68 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:06.366775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999466f-d71f-47dd-9147-eef636f6be68 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:06.368139 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 548/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:06.372951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c723-3598-4d36-ab46-a1e7c7cb6b95 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:06.373374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c723-3598-4d36-ab46-a1e7c7cb6b95 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:06.373504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c723-3598-4d36-ab46-a1e7c7cb6b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:06.393269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:06.453055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-be41c723-3598-4d36-ab46-a1e7c7cb6b95 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:06.454368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-be41c723-3598-4d36-ab46-a1e7c7cb6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:06.556716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 553/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:06.707484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999466f-d71f-47dd-9147-eef636f6be68 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:06.709024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4999466f-d71f-47dd-9147-eef636f6be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:06.820724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:06.856977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999466f-d71f-47dd-9147-eef636f6be68 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:06.970451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:06.971079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:06.971356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:06.971622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:06.973198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:07.049846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:07.064180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:07.065823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ea3b6-d1f7-4f6b-add9-e2745dce165d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:07.084966 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 549/1102] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:08.188835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b72e9-a867-47b3-96cd-ea8f72aedf1c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:08.189381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b72e9-a867-47b3-96cd-ea8f72aedf1c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:08.189381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b72e9-a867-47b3-96cd-ea8f72aedf1c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:08.190777 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 554/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:08.196676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c186c-7c99-4dd2-b6f9-ff4217a598b2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:08.197063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c186c-7c99-4dd2-b6f9-ff4217a598b2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:08.197264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c186c-7c99-4dd2-b6f9-ff4217a598b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:08.275347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ed0c186c-7c99-4dd2-b6f9-ff4217a598b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:08.276539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ed0c186c-7c99-4dd2-b6f9-ff4217a598b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:08.374482 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 550/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:08.525470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b72e9-a867-47b3-96cd-ea8f72aedf1c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:08.527008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-589b72e9-a867-47b3-96cd-ea8f72aedf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:08.611418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:08.675379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b72e9-a867-47b3-96cd-ea8f72aedf1c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:08.788726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:08.789254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:08.789536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:08.789803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:08.791878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:08.840951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:08.883372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:08.884953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475b18-fbbd-43de-ab65-bc7b1e1a41fd service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:08.902648 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 555/1105] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:09.943877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575c713-0c64-46e1-98c9-814b25958693 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:09.944962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575c713-0c64-46e1-98c9-814b25958693 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:09.945135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575c713-0c64-46e1-98c9-814b25958693 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:09.946552 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 551/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:09.951617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76995d-fa97-47d6-94de-9fb0b7d497d9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:09.952028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76995d-fa97-47d6-94de-9fb0b7d497d9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:09.952180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76995d-fa97-47d6-94de-9fb0b7d497d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:10.028272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7d76995d-fa97-47d6-94de-9fb0b7d497d9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:10.029469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d76995d-fa97-47d6-94de-9fb0b7d497d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:10.125241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 556/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:10.278631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575c713-0c64-46e1-98c9-814b25958693 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:10.280140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3575c713-0c64-46e1-98c9-814b25958693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:10.329776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:10.426670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575c713-0c64-46e1-98c9-814b25958693 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:10.539678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:10.540213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:10.540496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:10.540770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:10.542404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:10.549329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:10.632911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:10.634546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418d032-6f32-4974-bbd0-93be6782439f service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:10.652356 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 552/1108] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:11.698311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183848d-1382-4374-b2f8-d22fee6e408b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:11.698821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183848d-1382-4374-b2f8-d22fee6e408b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:11.698821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183848d-1382-4374-b2f8-d22fee6e408b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:11.700121 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 557/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:11.704954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21830704-4043-491d-b76f-93b7c2a13ea1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:11.705387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21830704-4043-491d-b76f-93b7c2a13ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:11.705496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21830704-4043-491d-b76f-93b7c2a13ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:11.780822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-21830704-4043-491d-b76f-93b7c2a13ea1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:11.782012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21830704-4043-491d-b76f-93b7c2a13ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:11.849759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:11.880324 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 553/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:12.033328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183848d-1382-4374-b2f8-d22fee6e408b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:12.034848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a183848d-1382-4374-b2f8-d22fee6e408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:12.054037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:12.182550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183848d-1382-4374-b2f8-d22fee6e408b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:12.271227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:12.296969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:12.297590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:12.297869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:12.298171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:12.299765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:12.389376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:12.391042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de955fc0-ae18-4341-8eb2-1e92f1306600 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:12.409059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 558/1111] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:13.449168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431a566-0193-4fa4-bbbc-b08fa1f5d082 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:13.449681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431a566-0193-4fa4-bbbc-b08fa1f5d082 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:13.449681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431a566-0193-4fa4-bbbc-b08fa1f5d082 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:13.451024 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 554/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:13.455828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8916-2129-4d25-baca-b3ebb6c9d499 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:13.456238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8916-2129-4d25-baca-b3ebb6c9d499 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:13.456686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a8916-2129-4d25-baca-b3ebb6c9d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:13.532131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cd8a8916-2129-4d25-baca-b3ebb6c9d499 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:13.533324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd8a8916-2129-4d25-baca-b3ebb6c9d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:13.574729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:13.629743 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 559/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:13.780102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431a566-0193-4fa4-bbbc-b08fa1f5d082 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:13.781710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6431a566-0193-4fa4-bbbc-b08fa1f5d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:13.926689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431a566-0193-4fa4-bbbc-b08fa1f5d082 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:13.980632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:14.039804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:14.040332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:14.040606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:14.040875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:14.042496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:14.132748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:14.134373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cc835-eed8-4971-bd9c-494e4bdaa31d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:14.152855 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 555/1114] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:15.188558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63485f-e93e-4cf2-aa88-58faae62bddf None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:15.189068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63485f-e93e-4cf2-aa88-58faae62bddf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:15.189068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63485f-e93e-4cf2-aa88-58faae62bddf None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:15.190440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 560/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:15.195876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402459-3b4d-4c31-a96b-db66e42543c1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:15.196287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402459-3b4d-4c31-a96b-db66e42543c1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:15.196427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402459-3b4d-4c31-a96b-db66e42543c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:15.275225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-49402459-3b4d-4c31-a96b-db66e42543c1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:15.276441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-49402459-3b4d-4c31-a96b-db66e42543c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:15.278486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:15.375614 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 556/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:15.526482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63485f-e93e-4cf2-aa88-58faae62bddf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:15.527984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0a63485f-e93e-4cf2-aa88-58faae62bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:15.673075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63485f-e93e-4cf2-aa88-58faae62bddf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:15.701613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:15.789495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:15.790041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:15.790345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:15.790620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:15.792193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:15.882794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:15.884377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0f75a-5e0f-4adb-97f4-dd5f30fffcaa service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:15.903217 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 561/1117] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:18.070197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb3bc-f99b-465b-afe1-76c646f87197 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:18.070826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb3bc-f99b-465b-afe1-76c646f87197 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:18.070826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb3bc-f99b-465b-afe1-76c646f87197 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:18.072085 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 557/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:18.077461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8c49-12d8-4ae3-ba29-998e14de05bf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:18.077917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8c49-12d8-4ae3-ba29-998e14de05bf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:18.078039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8c49-12d8-4ae3-ba29-998e14de05bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:18.119451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:18.145098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-38dc8c49-12d8-4ae3-ba29-998e14de05bf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:18.146325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38dc8c49-12d8-4ae3-ba29-998e14de05bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:18.243603 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 562/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:18.530449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fb3bc-f99b-465b-afe1-76c646f87197 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:18.531984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-856fb3bc-f99b-465b-afe1-76c646f87197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:18.636308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fb3bc-f99b-465b-afe1-76c646f87197 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:18.669851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:18.714265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:18.714870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:18.715146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:18.715415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:18.717010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:18.824681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:18.826127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd66776-873d-4e53-92cb-bb7bcec43137 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:18.844447 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 558/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:21.143586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015e8fc-0f52-4163-9da0-8b3cc7c8a0d5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:21.144106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015e8fc-0f52-4163-9da0-8b3cc7c8a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:21.144106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015e8fc-0f52-4163-9da0-8b3cc7c8a0d5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:21.145374 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 563/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:21.151229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65fbd-0c8c-4c11-8cae-c9db7e5468c2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:21.151639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65fbd-0c8c-4c11-8cae-c9db7e5468c2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:21.151778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65fbd-0c8c-4c11-8cae-c9db7e5468c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:21.219200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4fa65fbd-0c8c-4c11-8cae-c9db7e5468c2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:21.220773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4fa65fbd-0c8c-4c11-8cae-c9db7e5468c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:21.233826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:21.321447 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 559/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:21.608445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015e8fc-0f52-4163-9da0-8b3cc7c8a0d5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:21.610554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0015e8fc-0f52-4163-9da0-8b3cc7c8a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:21.716131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015e8fc-0f52-4163-9da0-8b3cc7c8a0d5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:21.729264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:21.790576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:21.791215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:21.791496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:21.791766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:21.793348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:21.901169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:21.902556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9dadc-c061-4c60-811f-529d82de5335 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:21.919937 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 564/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:24.435472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60a03-2083-4257-a1ad-4239d5847b5c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:24.436001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60a03-2083-4257-a1ad-4239d5847b5c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:24.436001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60a03-2083-4257-a1ad-4239d5847b5c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:24.437277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 560/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:24.442665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855548b-872f-427f-a581-b8a73cba8547 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:24.443079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855548b-872f-427f-a581-b8a73cba8547 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:24.443223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855548b-872f-427f-a581-b8a73cba8547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:24.492737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:24.515651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a855548b-872f-427f-a581-b8a73cba8547 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:24.516872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a855548b-872f-427f-a581-b8a73cba8547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:24.614967 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 565/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:24.903108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f60a03-2083-4257-a1ad-4239d5847b5c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:24.904640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e6f60a03-2083-4257-a1ad-4239d5847b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:25.010760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f60a03-2083-4257-a1ad-4239d5847b5c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:25.051365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:25.085186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:25.085790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:25.086063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:25.086357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:25.087962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:25.197006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:25.198483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eff64-5aa0-4c64-8fb6-b5403d1ed731 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:25.216749 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 561/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:27.479073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eeb93-eec4-44d2-9ad6-3170ee82f895 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:27.479615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eeb93-eec4-44d2-9ad6-3170ee82f895 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:27.479615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eeb93-eec4-44d2-9ad6-3170ee82f895 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:27.481007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 566/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:27.486502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27682a1-51f2-498a-9326-2137f917f58c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:27.486917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27682a1-51f2-498a-9326-2137f917f58c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:27.487082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27682a1-51f2-498a-9326-2137f917f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:27.555168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d27682a1-51f2-498a-9326-2137f917f58c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:27.556293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d27682a1-51f2-498a-9326-2137f917f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:27.578051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:27.657172 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 562/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:27.950276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eeb93-eec4-44d2-9ad6-3170ee82f895 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:27.951810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1f4eeb93-eec4-44d2-9ad6-3170ee82f895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:28.054770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eeb93-eec4-44d2-9ad6-3170ee82f895 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:28.075574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:28.129239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:28.129849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:28.130133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:28.130437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:28.132593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:28.241944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:28.243339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bbd38-9414-47a7-8d61-a8281b112195 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:28.261870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 567/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:30.481958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2a56-e286-468e-a448-bba3674b4771 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:30.482496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2a56-e286-468e-a448-bba3674b4771 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:30.482496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2a56-e286-468e-a448-bba3674b4771 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:30.484102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 563/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:30.489456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78eaae-09c6-4469-97c0-634eae2c1264 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:30.489860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78eaae-09c6-4469-97c0-634eae2c1264 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:30.490046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78eaae-09c6-4469-97c0-634eae2c1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:30.554698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:30.557046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4e78eaae-09c6-4469-97c0-634eae2c1264 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:30.558892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4e78eaae-09c6-4469-97c0-634eae2c1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:30.657827 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 568/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:30.944423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2a56-e286-468e-a448-bba3674b4771 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:30.945968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1e0f2a56-e286-468e-a448-bba3674b4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:31.049921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2a56-e286-468e-a448-bba3674b4771 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:31.099283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:31.124948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:31.125563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:31.125846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:31.126121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:31.127741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:31.237102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:31.238578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d6f8b-f754-4830-ada5-95d4e95b5e8f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:31.257593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 564/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:33.473481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35723-3d71-4298-a439-3379c9ca2429 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:33.474037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35723-3d71-4298-a439-3379c9ca2429 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:33.474037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35723-3d71-4298-a439-3379c9ca2429 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:33.475396 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 569/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:33.480954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10da20-3197-4c2b-8576-305e0555a4f5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:33.481371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10da20-3197-4c2b-8576-305e0555a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:33.481506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10da20-3197-4c2b-8576-305e0555a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:33.548476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0d10da20-3197-4c2b-8576-305e0555a4f5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:33.549615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0d10da20-3197-4c2b-8576-305e0555a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:33.582115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:33.651892 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 565/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:33.940621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35723-3d71-4298-a439-3379c9ca2429 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:33.942199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-53a35723-3d71-4298-a439-3379c9ca2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:34.043799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35723-3d71-4298-a439-3379c9ca2429 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:34.072861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:34.118642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:34.119247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:34.119526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:34.119798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:34.121384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:34.233548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:34.235212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f8f7-f175-4e96-b70d-e5475f500a91 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:34.254118 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 570/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:36.454086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa2f6-f586-45b8-a12c-b3340662e3e7 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:36.454672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa2f6-f586-45b8-a12c-b3340662e3e7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:36.454672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa2f6-f586-45b8-a12c-b3340662e3e7 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:36.456088 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 566/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:36.462092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bc13-cc12-4d16-82e2-dbb7db143682 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:36.462551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bc13-cc12-4d16-82e2-dbb7db143682 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:36.462768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bc13-cc12-4d16-82e2-dbb7db143682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:36.528006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c3a7bc13-cc12-4d16-82e2-dbb7db143682 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:36.529208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3a7bc13-cc12-4d16-82e2-dbb7db143682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:36.537454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:36.632536 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 571/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:36.919645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aa2f6-f586-45b8-a12c-b3340662e3e7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:36.921311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-994aa2f6-f586-45b8-a12c-b3340662e3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:37.028739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aa2f6-f586-45b8-a12c-b3340662e3e7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:37.084712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:37.102712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:37.103318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:37.103594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:37.103864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:37.105450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:37.213581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:37.214969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746f8e-c2c0-44d7-ae9e-b0057bd1daee service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:37.232635 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 567/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:39.519393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dae03-fcbb-45b7-8493-7b6aa1ab31fe None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:39.519924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dae03-fcbb-45b7-8493-7b6aa1ab31fe None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:39.520020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dae03-fcbb-45b7-8493-7b6aa1ab31fe None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:39.521301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:39.526617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e6fd7-24e1-4be7-aa3b-c4a3f2270127 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:39.527026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e6fd7-24e1-4be7-aa3b-c4a3f2270127 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:39.527169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e6fd7-24e1-4be7-aa3b-c4a3f2270127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:39.592520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c61e6fd7-24e1-4be7-aa3b-c4a3f2270127 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:39.593634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c61e6fd7-24e1-4be7-aa3b-c4a3f2270127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:39.631960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:39.690944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:39.979488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dae03-fcbb-45b7-8493-7b6aa1ab31fe None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:39.980998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d8dae03-fcbb-45b7-8493-7b6aa1ab31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:40.085322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dae03-fcbb-45b7-8493-7b6aa1ab31fe None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:40.123114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:40.160163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:40.160767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:40.161046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:40.161316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:40.162970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:40.272378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:40.274481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d30a0-0af7-44da-9742-3259459cbd76 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:40.293506 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 573/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:42.467576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ebcd0-ada3-491e-88b4-67029d2b5db2 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:42.468107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ebcd0-ada3-491e-88b4-67029d2b5db2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:42.468107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ebcd0-ada3-491e-88b4-67029d2b5db2 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:42.469459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:42.474848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e3d17-291e-428c-91e4-ebc052c35bb0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:42.475291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e3d17-291e-428c-91e4-ebc052c35bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:42.475387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e3d17-291e-428c-91e4-ebc052c35bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:42.541527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1b1e3d17-291e-428c-91e4-ebc052c35bb0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:42.542671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b1e3d17-291e-428c-91e4-ebc052c35bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:42.560543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:42.639939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:42.923513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ebcd0-ada3-491e-88b4-67029d2b5db2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:42.925608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d5ebcd0-ada3-491e-88b4-67029d2b5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:43.031030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ebcd0-ada3-491e-88b4-67029d2b5db2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:43.102353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:43.109499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:43.110299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:43.110685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:43.111028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:43.112604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:43.222198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:43.223631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c47f6-61b8-410e-aa3f-850cff379efe service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:43.242364 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 570/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:45.416724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0908cc-bf25-4692-be88-68ad309f088e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:45.417258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0908cc-bf25-4692-be88-68ad309f088e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:45.417258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0908cc-bf25-4692-be88-68ad309f088e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:45.418676 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:03:45.423959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af680-ffcc-4314-9752-948d9def9279 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:45.424355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af680-ffcc-4314-9752-948d9def9279 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:45.424517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6af680-ffcc-4314-9752-948d9def9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:45.490500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6d6af680-ffcc-4314-9752-948d9def9279 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:03:45.491931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d6af680-ffcc-4314-9752-948d9def9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:45.539950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:45.588942 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:03:45.870527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0908cc-bf25-4692-be88-68ad309f088e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:03:45.872118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df0908cc-bf25-4692-be88-68ad309f088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:45.977040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0908cc-bf25-4692-be88-68ad309f088e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:03:46.024919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:46.050849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:03:46.051459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:03:46.051741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:03:46.052015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:03:46.054113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:03:46.162202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:03:46.164117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5863b3-c5d4-4f13-ba8a-e817a9c9eada service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:03:46.182057 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 576/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:03:55.587469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=22 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:03:56.179857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=66 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:06.354362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914a583-6470-4f25-a38c-69dd7dbba35a None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:06.354902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914a583-6470-4f25-a38c-69dd7dbba35a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:06.354902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914a583-6470-4f25-a38c-69dd7dbba35a None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:06.356261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 572/1148] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:06.361781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7f94-47f3-45de-9ec1-214cd515d231 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:06.362232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7f94-47f3-45de-9ec1-214cd515d231 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:06.362358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7f94-47f3-45de-9ec1-214cd515d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:06.427388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-79dd7f94-47f3-45de-9ec1-214cd515d231 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:06.428657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-79dd7f94-47f3-45de-9ec1-214cd515d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:06.523444 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 577/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:04:06.831061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9574b-576c-495f-b59a-642d8413b9c4 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:06.831344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9574b-576c-495f-b59a-642d8413b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:06.831616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9574b-576c-495f-b59a-642d8413b9c4 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:06.832964 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 573/1150] 10.222.0.23 () {54 vars in 962 bytes} [Mon Oct 31 05:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:06.838583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a38c2-d2ff-4f5c-af09-16a4eb4bb64e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:06.838876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a38c2-d2ff-4f5c-af09-16a4eb4bb64e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:06.839184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a38c2-d2ff-4f5c-af09-16a4eb4bb64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:06.915536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-eb4a38c2-d2ff-4f5c-af09-16a4eb4bb64e None None] MFA Rules not processed for user `d1a59dbd84f94e99ad696d60c25082c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:06.916744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb4a38c2-d2ff-4f5c-af09-16a4eb4bb64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:06.938333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:06.994392 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 578/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 31 05:04:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:07.002318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9574b-576c-495f-b59a-642d8413b9c4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:07.003818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ace9574b-576c-495f-b59a-642d8413b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:07.112769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9574b-576c-495f-b59a-642d8413b9c4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:07.187820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:07.188433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:07.188714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:07.188990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:07.190619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:07.245063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:07.300518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:07.301962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2efdc-da32-480d-81c6-704238576b46 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:07.320850 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 574/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:04:09.560869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea319c-d10e-4094-a42e-dc8d89e5cc4d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:09.561397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea319c-d10e-4094-a42e-dc8d89e5cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:09.561397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea319c-d10e-4094-a42e-dc8d89e5cc4d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:09.562710 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 579/1153] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:09.567989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278e30-696e-4389-841f-96658af2bc0b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:09.569355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278e30-696e-4389-841f-96658af2bc0b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:09.569355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278e30-696e-4389-841f-96658af2bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:09.634097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-24278e30-696e-4389-841f-96658af2bc0b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:09.635333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24278e30-696e-4389-841f-96658af2bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:09.730565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 575/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:10.003351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea319c-d10e-4094-a42e-dc8d89e5cc4d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:10.004794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4ea319c-d10e-4094-a42e-dc8d89e5cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:10.132241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea319c-d10e-4094-a42e-dc8d89e5cc4d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:10.181198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:10.224951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:10.225555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:10.225845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:10.226112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:10.226785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:10.227872 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:04:10.227872 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:04:10.227872 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:04:10.229019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabec2d-c7ac-4c48-9a26-ca134b0f4ea3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:10.248535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 580/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 05:04:10 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:04:12.433726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8a2b-bc50-4f2d-b12e-2da8d14f07ea None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:12.434370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8a2b-bc50-4f2d-b12e-2da8d14f07ea None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:12.434370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8a2b-bc50-4f2d-b12e-2da8d14f07ea None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:12.435655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 576/1156] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:12.440849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dabfd-94e8-42a1-a81d-41c81eb217f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:12.441249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dabfd-94e8-42a1-a81d-41c81eb217f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:12.441401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dabfd-94e8-42a1-a81d-41c81eb217f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:12.509428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bc8dabfd-94e8-42a1-a81d-41c81eb217f4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:12.510655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bc8dabfd-94e8-42a1-a81d-41c81eb217f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:12.607274 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 581/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:12.903237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8a2b-bc50-4f2d-b12e-2da8d14f07ea None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:12.904811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-88ae8a2b-bc50-4f2d-b12e-2da8d14f07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:12.914784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:13.050034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8a2b-bc50-4f2d-b12e-2da8d14f07ea None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:13.131771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:13.164955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:13.165519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:13.165795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:13.166067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:13.167670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:13.259059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:13.260662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73929b9-db33-4a4c-8427-9b50160986d6 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:13.279532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 577/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:04:15.627562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a107-450c-4c67-bd0e-f9bebc78e495 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:15.628087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a107-450c-4c67-bd0e-f9bebc78e495 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:15.628087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a107-450c-4c67-bd0e-f9bebc78e495 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:15.629382 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 582/1159] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:15.635537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110461-96ec-45d7-87b0-784d018f6b6d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:15.635947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110461-96ec-45d7-87b0-784d018f6b6d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:15.636094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110461-96ec-45d7-87b0-784d018f6b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:15.701562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bd110461-96ec-45d7-87b0-784d018f6b6d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:15.702799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bd110461-96ec-45d7-87b0-784d018f6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:15.749022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:15.800729 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 578/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:16.095790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1a107-450c-4c67-bd0e-f9bebc78e495 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:16.097324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f5b1a107-450c-4c67-bd0e-f9bebc78e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:16.121867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:16.201060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1a107-450c-4c67-bd0e-f9bebc78e495 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:16.274241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:16.274850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:16.275127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:16.275397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:16.276972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:16.352827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:16.388682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:16.390112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7275c2-3a79-42d4-a6f5-805c00c70f4a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:16.408028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 583/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:04:18.726520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315b82-9d4b-4d23-829e-92e7e87d9b1b None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:18.727132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315b82-9d4b-4d23-829e-92e7e87d9b1b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:18.727132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315b82-9d4b-4d23-829e-92e7e87d9b1b None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:18.728372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 579/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:18.733893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909a00-1bb9-4a0e-af46-58154b8b1f3e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:18.734372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909a00-1bb9-4a0e-af46-58154b8b1f3e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:18.734472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909a00-1bb9-4a0e-af46-58154b8b1f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:18.801159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f909a00-1bb9-4a0e-af46-58154b8b1f3e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:18.802992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f909a00-1bb9-4a0e-af46-58154b8b1f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:18.900462 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 584/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:19.191621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da315b82-9d4b-4d23-829e-92e7e87d9b1b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:19.193970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da315b82-9d4b-4d23-829e-92e7e87d9b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:19.298636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da315b82-9d4b-4d23-829e-92e7e87d9b1b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:19.370581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:19.372068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:19.372725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:19.373240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:19.373545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:19.375614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:19.491367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:19.492704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648d396-b74c-4927-8d59-8712ce7e7af7 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:19.510783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 580/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:04:21.843333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8611-008b-4e19-9923-57fa4311e75d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:21.843893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8611-008b-4e19-9923-57fa4311e75d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:21.843893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8611-008b-4e19-9923-57fa4311e75d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:21.845216 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 585/1165] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:21.851089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb764c-99b3-49cc-8cdb-d8d31472dc39 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:21.851514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb764c-99b3-49cc-8cdb-d8d31472dc39 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:21.851666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb764c-99b3-49cc-8cdb-d8d31472dc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:21.919627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b5fb764c-99b3-49cc-8cdb-d8d31472dc39 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:21.920821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b5fb764c-99b3-49cc-8cdb-d8d31472dc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:21.974921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:22.019357 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 581/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:22.311226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8611-008b-4e19-9923-57fa4311e75d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:22.312757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dfda8611-008b-4e19-9923-57fa4311e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:22.348428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:22.417604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8611-008b-4e19-9923-57fa4311e75d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:22.491317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:22.491949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:22.492226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:22.492497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:22.494085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:22.575024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:22.604305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:22.605742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6fa52-d424-4a2b-82e7-f54a687865e2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:22.624018 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 586/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:04:24.936590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b149-bf2c-4dcf-8621-fca564fe74d8 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:24.937157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b149-bf2c-4dcf-8621-fca564fe74d8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:24.937157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b149-bf2c-4dcf-8621-fca564fe74d8 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:24.938516 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 582/1168] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 05:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:04:24.944498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fb306-4372-4c76-93bd-3aed978a8db2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:24.945011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fb306-4372-4c76-93bd-3aed978a8db2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:24.945116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fb306-4372-4c76-93bd-3aed978a8db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:25.010954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5b2fb306-4372-4c76-93bd-3aed978a8db2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:04:25.012157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5b2fb306-4372-4c76-93bd-3aed978a8db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:25.105808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 587/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 05:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:04:25.391411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1b149-bf2c-4dcf-8621-fca564fe74d8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:04:25.392927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ce1b149-bf2c-4dcf-8621-fca564fe74d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:25.496052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1b149-bf2c-4dcf-8621-fca564fe74d8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:04:25.573426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:04:25.574032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:04:25.574340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:04:25.574635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:04:25.576186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:04:25.585247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:25.684888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:04:25.686263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fb228-d602-48fb-a362-c722f5306b79 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:04:25.704332 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 583/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:04:35.104357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=82 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:04:35.702004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=50 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:47.410584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920115-5593-47ac-a126-33202dea42ee None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:47.411150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920115-5593-47ac-a126-33202dea42ee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:47.411150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920115-5593-47ac-a126-33202dea42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:47.486299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c2920115-5593-47ac-a126-33202dea42ee None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:05:47.487498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c2920115-5593-47ac-a126-33202dea42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:47.582946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 588/1171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:05:47.591008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:47.591504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:47.591690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:47.667370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:05:47.668575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:47.764237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 584/1172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:05:47.768929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920115-5593-47ac-a126-33202dea42ee None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:47.770136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c2920115-5593-47ac-a126-33202dea42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:47.781617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920115-5593-47ac-a126-33202dea42ee None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:47.846840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:47.882643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:47.883255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:47.883538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:47.883813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:47.884457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:05:47.884761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:47.885766 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:05:47.885766 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:05:47.885766 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:05:47.886680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:47.898360 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 589/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:05:47.907811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:47.917129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2a9d3-e8d3-4ffa-aff8-051cbc5f9055 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:47.977726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:48.012204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:48.012812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.013094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.013378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.014003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:48.015139 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:05:48.015139 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:05:48.015139 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:05:48.016341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:48.072266 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 585/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:05:47 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:05:48.076438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:48.077966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:48.111763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c000-5a8f-4afa-bf6d-1ef7e44eaa25 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:48.205298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:48.205906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.206215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.206496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.207128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:48.208136 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:05:48.208136 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:05:48.208136 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:05:48.209886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:48.251923 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 590/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:05:48 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:05:48.256255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:48.258302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:48.321664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b42e7-b070-406a-af03-ef0caa103836 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:48.406902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:48.419744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:48.420355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.420635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.420909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.421549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:48.423211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:48.435553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 586/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:05:48.439580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:48.441088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:48.453105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afe0aa-91eb-4e80-94e5-8ce9e7eb8fb2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:48.479156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:48.549934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038063a-43ba-4f8f-bde7-f16bb63e2710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:48.550565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038063a-43ba-4f8f-bde7-f16bb63e2710 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.550844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038063a-43ba-4f8f-bde7-f16bb63e2710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.551114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038063a-43ba-4f8f-bde7-f16bb63e2710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.551751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038063a-43ba-4f8f-bde7-f16bb63e2710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:48.554008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038063a-43ba-4f8f-bde7-f16bb63e2710 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:48.566213 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 591/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:05:48.570422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:48.571936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:48.605578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f53dd5-8f76-4702-bbd4-a8fefd4af7a9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:48.702631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341655fa-6cd1-4203-935f-bba54184d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:48.703291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341655fa-6cd1-4203-935f-bba54184d27a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.703568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341655fa-6cd1-4203-935f-bba54184d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.703838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341655fa-6cd1-4203-935f-bba54184d27a admin admin] PATH_INFO: `/v3/projects/7143697bca9d4906bd53aff5d1e5223d/users/2142cf8f9cad4148bfcd818664f40ede/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.727172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341655fa-6cd1-4203-935f-bba54184d27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7143697bca9d4906bd53aff5d1e5223d, user_id=2142cf8f9cad4148bfcd818664f40ede, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:48.729841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341655fa-6cd1-4203-935f-bba54184d27a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:48.754846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 587/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:05:48 2022] PUT /identity/v3/projects/7143697bca9d4906bd53aff5d1e5223d/users/2142cf8f9cad4148bfcd818664f40ede/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:05:48.766042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116ba8-5217-42d4-8cf8-6fd34af15ff8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.766376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116ba8-5217-42d4-8cf8-6fd34af15ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.766655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116ba8-5217-42d4-8cf8-6fd34af15ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.822696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f116ba8-5217-42d4-8cf8-6fd34af15ff8 None None] MFA Rules not processed for user `2142cf8f9cad4148bfcd818664f40ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:05:48.823884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f116ba8-5217-42d4-8cf8-6fd34af15ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:48.901568 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 592/1179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:05:48.915918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffd56b-68dd-4e55-8844-9a8e361d56e4 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.915918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffd56b-68dd-4e55-8844-9a8e361d56e4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.916120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffd56b-68dd-4e55-8844-9a8e361d56e4 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.917474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 588/1180] 10.222.0.23 () {54 vars in 963 bytes} [Mon Oct 31 05:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:05:48.922547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e04e-7ac5-41f5-b32a-35f74bc6a21e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:48.922837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e04e-7ac5-41f5-b32a-35f74bc6a21e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:48.923157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e04e-7ac5-41f5-b32a-35f74bc6a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:48.955968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:49.004365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dd23e04e-7ac5-41f5-b32a-35f74bc6a21e None None] MFA Rules not processed for user `b46b252d8cc1405896f3f9b22531c08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:05:49.005562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dd23e04e-7ac5-41f5-b32a-35f74bc6a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:49.083810 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 593/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 31 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:05:49.092331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffd56b-68dd-4e55-8844-9a8e361d56e4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:49.093843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51ffd56b-68dd-4e55-8844-9a8e361d56e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:49.144567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:49.200164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffd56b-68dd-4e55-8844-9a8e361d56e4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:49.274850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:49.275453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:49.275727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:49.276014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:49.277612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:49.377183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:49.378663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:49.382942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:49.397593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 589/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:05:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:05:49.443409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094495a-ffcc-48c7-a86e-514b32279333 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:49.444018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094495a-ffcc-48c7-a86e-514b32279333 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:49.444709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094495a-ffcc-48c7-a86e-514b32279333 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:49.445989 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 594/1183] 10.222.0.23 () {52 vars in 830 bytes} [Mon Oct 31 05:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:05:49.449553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:49.450831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:49.548806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98175c31-013a-45bc-835d-c189906e0459 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:49.641650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:49.642335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:49.642591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:49.642862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] PATH_INFO: `/v3/users/2142cf8f9cad4148bfcd818664f40ede` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:49.656092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2142cf8f9cad4148bfcd818664f40ede)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:49.657103 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:05:49.657103 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:05:49.657103 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:05:49.658343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:49.668517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:49.729256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2142cf8f9cad4148bfcd818664f40ede'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:49.752035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2142cf8f9cad4148bfcd818664f40ede'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:49.752614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2142cf8f9cad4148bfcd818664f40ede'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:49.753029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2142cf8f9cad4148bfcd818664f40ede'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:49.767738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2142cf8f9cad4148bfcd818664f40ede'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:49.782291 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 590/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:05:49 2022] DELETE /identity/v3/users/2142cf8f9cad4148bfcd818664f40ede => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:05:49.786686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:49.786982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:49.787262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:49.845497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:05:49.846754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:49.922239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:49.934906 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 595/1185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:05:49.945261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:49.946605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:50.046139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98422c9-6474-406d-a233-035343c71ea0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:50.099775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:05:50.121056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:50.121671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:50.121947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:50.122269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:50.123839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:50.242390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:50.244080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9c07-7bda-422a-9338-587e0755b219 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:50.265628 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 591/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:05:50.605079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:05:50.606367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:05:50.618873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae7049-ad78-4d13-8adf-b744be7abb3a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:05:50.716315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:05:50.716957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:05:50.717241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:05:50.717520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] PATH_INFO: `/v3/projects/7143697bca9d4906bd53aff5d1e5223d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:05:50.728206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7143697bca9d4906bd53aff5d1e5223d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:05:50.729225 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:05:50.729225 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:05:50.729225 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:05:50.730465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:05:50.789468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7143697bca9d4906bd53aff5d1e5223d', 'request_id': 'req-a88338a7-31bd-4ab3-8978-284f18c3da4c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:50.795851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7143697bca9d4906bd53aff5d1e5223d', 'request_id': 'req-a88338a7-31bd-4ab3-8978-284f18c3da4c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:50.806135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7143697bca9d4906bd53aff5d1e5223d', 'request_id': 'req-a88338a7-31bd-4ab3-8978-284f18c3da4c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:50.839156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] The token cache is being invalidate because project 7143697bca9d4906bd53aff5d1e5223d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:05:50.839432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:50.839957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a88338a7-31bd-4ab3-8978-284f18c3da4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:05:50.841257 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 596/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:05:50 2022] DELETE /identity/v3/projects/7143697bca9d4906bd53aff5d1e5223d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:06:00.263341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=62 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:06:00.836801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:08:59.398881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b8482-55c9-4cb5-83d5-331ab19114d5 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:08:59.399646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b8482-55c9-4cb5-83d5-331ab19114d5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:08:59.399940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b8482-55c9-4cb5-83d5-331ab19114d5 None None] PATH_INFO: `/v3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:08:59.401278 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 592/1188] 10.222.0.42 () {54 vars in 925 bytes} [Mon Oct 31 05:08:59 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:08:59.413530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f21c-095a-4ea3-9138-c4d5125d3e7e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:08:59.413979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f21c-095a-4ea3-9138-c4d5125d3e7e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:08:59.414076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f21c-095a-4ea3-9138-c4d5125d3e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:08:59.496170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1729f21c-095a-4ea3-9138-c4d5125d3e7e None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:08:59.497411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1729f21c-095a-4ea3-9138-c4d5125d3e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:08:59.610569 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 597/1189] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Oct 31 05:08:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:03.251815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb71a5-0a18-4634-8f95-6730f77274d1 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:03.252275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb71a5-0a18-4634-8f95-6730f77274d1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:03.252374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb71a5-0a18-4634-8f95-6730f77274d1 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:03.253688 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 593/1190] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 05:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:09:03.259146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1a345-b825-4c2a-8f9c-e21b27261430 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:03.259615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1a345-b825-4c2a-8f9c-e21b27261430 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:03.259723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1a345-b825-4c2a-8f9c-e21b27261430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:03.279230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-47a1a345-b825-4c2a-8f9c-e21b27261430 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:03.280414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-47a1a345-b825-4c2a-8f9c-e21b27261430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:03.289438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 598/1191] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 05:09:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:03.297245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb71a5-0a18-4634-8f95-6730f77274d1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:09:03.312694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb71a5-0a18-4634-8f95-6730f77274d1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:09:03.317593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2857d10-36a3-4f2d-a7c7-927979d593f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:09:03.318219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2857d10-36a3-4f2d-a7c7-927979d593f9 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:03.318628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2857d10-36a3-4f2d-a7c7-927979d593f9 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:03.318906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2857d10-36a3-4f2d-a7c7-927979d593f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:03.327051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2857d10-36a3-4f2d-a7c7-927979d593f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:09:03.328620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2857d10-36a3-4f2d-a7c7-927979d593f9 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:09:03.338194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 594/1192] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:09:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:09:13.273497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=77 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:09:13.334162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:09:14.958602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc151c2-b8e7-40b5-8a15-7401b48be5a5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:14.959181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc151c2-b8e7-40b5-8a15-7401b48be5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:14.959181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc151c2-b8e7-40b5-8a15-7401b48be5a5 None None] PATH_INFO: `/v3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:14.960954 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 599/1193] 10.222.0.25 () {54 vars in 925 bytes} [Mon Oct 31 05:09:14 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:09:14.968259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a60b-6d77-49e1-a50c-56528b2264cd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:14.968697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a60b-6d77-49e1-a50c-56528b2264cd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:14.968799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a60b-6d77-49e1-a50c-56528b2264cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:14.988826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ac74a60b-6d77-49e1-a50c-56528b2264cd None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:14.990027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac74a60b-6d77-49e1-a50c-56528b2264cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:14.998867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 595/1194] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 05:09:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:23.571858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203614-7198-451a-ad55-850d9c8b9a62 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:23.572284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203614-7198-451a-ad55-850d9c8b9a62 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:23.572400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203614-7198-451a-ad55-850d9c8b9a62 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:23.573737 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 600/1195] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 05:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:09:23.578833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda999ca-6eb0-4d99-be3a-c60cbfdcd732 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:23.579270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda999ca-6eb0-4d99-be3a-c60cbfdcd732 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:23.579368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda999ca-6eb0-4d99-be3a-c60cbfdcd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:23.599183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cda999ca-6eb0-4d99-be3a-c60cbfdcd732 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:23.600384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cda999ca-6eb0-4d99-be3a-c60cbfdcd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:23.610091 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 596/1196] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 05:09:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:23.617859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77203614-7198-451a-ad55-850d9c8b9a62 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:09:23.630861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77203614-7198-451a-ad55-850d9c8b9a62 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:09:23.636074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c8816-b648-4b45-be51-caabc7db424a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:09:23.636668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8816-b648-4b45-be51-caabc7db424a service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:23.636952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8816-b648-4b45-be51-caabc7db424a service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:23.637225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8816-b648-4b45-be51-caabc7db424a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:23.645271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c8816-b648-4b45-be51-caabc7db424a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:09:23.646883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c8816-b648-4b45-be51-caabc7db424a service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:09:23.656958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 601/1197] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:09:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:09:33.593974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:09:33.653083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:09:39.254037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c8c3-d832-4ac6-911b-95fb3ed8cc68 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:39.254618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c8c3-d832-4ac6-911b-95fb3ed8cc68 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:39.254618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c8c3-d832-4ac6-911b-95fb3ed8cc68 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:39.256051 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 597/1198] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:09:39.261339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf4e6-7c39-4e64-8be3-22e8390fba52 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:39.261776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf4e6-7c39-4e64-8be3-22e8390fba52 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:39.261889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf4e6-7c39-4e64-8be3-22e8390fba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:39.322097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c4baf4e6-7c39-4e64-8be3-22e8390fba52 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:39.323336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4baf4e6-7c39-4e64-8be3-22e8390fba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:39.400921 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 602/1199] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:09:39.556412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2c8c3-d832-4ac6-911b-95fb3ed8cc68 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:09:39.558432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83c2c8c3-d832-4ac6-911b-95fb3ed8cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:39.658962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2c8c3-d832-4ac6-911b-95fb3ed8cc68 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:09:39.665334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba612c44-f25d-463b-9131-078ee6ae4fd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:09:39.665944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba612c44-f25d-463b-9131-078ee6ae4fd7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:39.666261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba612c44-f25d-463b-9131-078ee6ae4fd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:39.666536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba612c44-f25d-463b-9131-078ee6ae4fd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:39.674943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba612c44-f25d-463b-9131-078ee6ae4fd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:09:39.676549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba612c44-f25d-463b-9131-078ee6ae4fd7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:09:39.685964 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 598/1200] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:09:40.756913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bfad3-c0f2-46f6-8fb1-7b4aec8eaa1f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:40.757494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bfad3-c0f2-46f6-8fb1-7b4aec8eaa1f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:40.757494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bfad3-c0f2-46f6-8fb1-7b4aec8eaa1f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:40.758927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 603/1201] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 05:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:09:40.763721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2391f86-1181-4e45-9a92-bc4cd43967e1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:40.764183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2391f86-1181-4e45-9a92-bc4cd43967e1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:40.764287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2391f86-1181-4e45-9a92-bc4cd43967e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:40.783800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a2391f86-1181-4e45-9a92-bc4cd43967e1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:40.784996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a2391f86-1181-4e45-9a92-bc4cd43967e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:40.793586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 599/1202] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 05:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:40.947800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bfad3-c0f2-46f6-8fb1-7b4aec8eaa1f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:09:40.961967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bfad3-c0f2-46f6-8fb1-7b4aec8eaa1f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:09:40.967352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676ebcb-072c-4981-b33e-df9a78e7c7c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:09:40.967952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ebcb-072c-4981-b33e-df9a78e7c7c6 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:40.968234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ebcb-072c-4981-b33e-df9a78e7c7c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:40.968509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ebcb-072c-4981-b33e-df9a78e7c7c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:40.976387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676ebcb-072c-4981-b33e-df9a78e7c7c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:09:40.977966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676ebcb-072c-4981-b33e-df9a78e7c7c6 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:09:40.987434 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 604/1203] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:09:44.805892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c5c7-6ac8-4124-87a7-b8c62bebca9d None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:44.806523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c5c7-6ac8-4124-87a7-b8c62bebca9d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:44.806681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185c5c7-6ac8-4124-87a7-b8c62bebca9d None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:44.808287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 600/1204] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:09:44.813524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e61a2-8bb2-408d-9891-c1f3411007b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:44.813932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e61a2-8bb2-408d-9891-c1f3411007b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:44.814084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e61a2-8bb2-408d-9891-c1f3411007b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:44.833646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e45e61a2-8bb2-408d-9891-c1f3411007b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:44.834878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e45e61a2-8bb2-408d-9891-c1f3411007b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:44.843382 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 605/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:45.134445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c5c7-6ac8-4124-87a7-b8c62bebca9d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:09:45.136175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0185c5c7-6ac8-4124-87a7-b8c62bebca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:45.215687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185c5c7-6ac8-4124-87a7-b8c62bebca9d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:09:45.219263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112df24-dc8a-4189-9654-baa64c21f4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:09:45.219870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112df24-dc8a-4189-9654-baa64c21f4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:45.220153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112df24-dc8a-4189-9654-baa64c21f4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:45.220428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112df24-dc8a-4189-9654-baa64c21f4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:45.229316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112df24-dc8a-4189-9654-baa64c21f4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:09:45.230849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112df24-dc8a-4189-9654-baa64c21f4c6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:09:45.240379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 601/1206] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:09:47.417448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23a108-6213-4ea2-8e87-7d5c8116cb4c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:47.417999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23a108-6213-4ea2-8e87-7d5c8116cb4c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:47.417999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23a108-6213-4ea2-8e87-7d5c8116cb4c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:47.419364 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 606/1207] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 05:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:09:47.424521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456857d6-1f6c-41f6-9deb-5d26a203a883 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:47.424943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456857d6-1f6c-41f6-9deb-5d26a203a883 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:47.425077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456857d6-1f6c-41f6-9deb-5d26a203a883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:47.444385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-456857d6-1f6c-41f6-9deb-5d26a203a883 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:09:47.446360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-456857d6-1f6c-41f6-9deb-5d26a203a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:47.454182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 602/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:09:47.742456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23a108-6213-4ea2-8e87-7d5c8116cb4c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:09:47.744100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cb23a108-6213-4ea2-8e87-7d5c8116cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:09:47.756768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23a108-6213-4ea2-8e87-7d5c8116cb4c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:09:47.760812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e95a6-a755-40e7-abe8-a4177c5bf343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:09:47.761422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e95a6-a755-40e7-abe8-a4177c5bf343 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:09:47.761702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e95a6-a755-40e7-abe8-a4177c5bf343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:09:47.761975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e95a6-a755-40e7-abe8-a4177c5bf343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:09:47.770740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e95a6-a755-40e7-abe8-a4177c5bf343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:09:47.772165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e95a6-a755-40e7-abe8-a4177c5bf343 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:09:47.781412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 607/1209] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:09:57.439470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:09:57.777347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=65 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:10:37.261677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ded03-a597-48e2-96a9-3b2f93446454 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:10:37.262749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ded03-a597-48e2-96a9-3b2f93446454 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:10:37.263265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ded03-a597-48e2-96a9-3b2f93446454 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:10:37.264867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 603/1210] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:10:37.273129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e425f-a2e1-42c6-ac1e-fb76f5773a00 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:10:37.273129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e425f-a2e1-42c6-ac1e-fb76f5773a00 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:10:37.273129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e425f-a2e1-42c6-ac1e-fb76f5773a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:10:37.297017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-418e425f-a2e1-42c6-ac1e-fb76f5773a00 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:10:37.298659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-418e425f-a2e1-42c6-ac1e-fb76f5773a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:10:37.308705 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 608/1211] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:10:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:10:47.290589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:09.303835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.305566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.306058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.338081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.340417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.351108 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 604/1212] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.362296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a037-ff37-461d-b158-7cc997b35dc9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.362857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a037-ff37-461d-b158-7cc997b35dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.363252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a037-ff37-461d-b158-7cc997b35dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.387622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7ec6a037-ff37-461d-b158-7cc997b35dc9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.388839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ec6a037-ff37-461d-b158-7cc997b35dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.399932 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 609/1213] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.405100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.416479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16906db-d635-4b79-afe4-950d3e41082c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.418290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.418578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.418855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.426593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.427225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.427503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.427774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.428427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:09.428729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.429892 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:11:09.429892 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:11:09.429892 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:11:09.436227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c6cd4-ca3d-48ba-9987-fe5ac538c991 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.464577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.465750 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 605/1214] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:09.466410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.479997 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 610/1215] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:09.487808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37061-06d6-45b1-82a8-bcf5f6ee08ac None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.488118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37061-06d6-45b1-82a8-bcf5f6ee08ac None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.488400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37061-06d6-45b1-82a8-bcf5f6ee08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.498303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.520159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c149e-22e3-46fd-91f9-7202bb6d2571 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.523418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5bf37061-06d6-45b1-82a8-bcf5f6ee08ac None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.527187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5bf37061-06d6-45b1-82a8-bcf5f6ee08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.529426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.530097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.530408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.530683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.531517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.532341 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:11:09.532341 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:11:09.532341 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:11:09.533533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936313d5-7c8e-4bbb-af9e-347497924077 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.559786 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 606/1216] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 31 05:11:09.561190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1c98-3e26-484b-a6aa-0057d625284c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.561485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1c98-3e26-484b-a6aa-0057d625284c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.561767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1c98-3e26-484b-a6aa-0057d625284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.585569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1c5d1c98-3e26-484b-a6aa-0057d625284c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.586951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1c5d1c98-3e26-484b-a6aa-0057d625284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.590531 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 611/1217] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:11:09.591795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa31e1-8876-452d-ab6c-a1b472a2b0b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.592085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa31e1-8876-452d-ab6c-a1b472a2b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.592364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa31e1-8876-452d-ab6c-a1b472a2b0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.621086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-26aa31e1-8876-452d-ab6c-a1b472a2b0b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.622439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-26aa31e1-8876-452d-ab6c-a1b472a2b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.667031 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 607/1218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.668554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edce12-ae1a-4957-8442-a089e29c9a45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.668978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edce12-ae1a-4957-8442-a089e29c9a45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.669255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edce12-ae1a-4957-8442-a089e29c9a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.693207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-75edce12-ae1a-4957-8442-a089e29c9a45 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.694476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-75edce12-ae1a-4957-8442-a089e29c9a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.707069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 608/1219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.707273 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 612/1220] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.707380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.707380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.707380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.707605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaab3d-a57e-4637-bfc2-82a68cc02e09 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.707605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaab3d-a57e-4637-bfc2-82a68cc02e09 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.707605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaab3d-a57e-4637-bfc2-82a68cc02e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.725346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.726642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.729790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-49eaab3d-a57e-4637-bfc2-82a68cc02e09 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.731086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49eaab3d-a57e-4637-bfc2-82a68cc02e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.738228 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 609/1221] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.738228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.739438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 613/1222] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.740775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ef52-75cd-4700-a6e3-d91306662557 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.741060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ef52-75cd-4700-a6e3-d91306662557 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.741447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ef52-75cd-4700-a6e3-d91306662557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.745973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf9be-61f8-4b28-9e29-52e239e5a6d6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.751333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.752014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.752326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.752594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.753232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.754267 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:11:09.754267 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:11:09.754267 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:11:09.755494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687de212-3099-42a9-bc55-366a1999cb3f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.762866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6e88ef52-75cd-4700-a6e3-d91306662557 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.764058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e88ef52-75cd-4700-a6e3-d91306662557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.772103 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 614/1223] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.774539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.774831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.775104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.786497 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 610/1224] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:09.786497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4167-1a73-4a03-b59b-bf566192d936 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.786497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4167-1a73-4a03-b59b-bf566192d936 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.786497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4167-1a73-4a03-b59b-bf566192d936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.795581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.796772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.805153 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 615/1225] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.805358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-032f4167-1a73-4a03-b59b-bf566192d936 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.806442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.806623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-032f4167-1a73-4a03-b59b-bf566192d936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.814440 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 611/1226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.815644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc087-d961-4403-b2e7-5d60e03ad13d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.815926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc087-d961-4403-b2e7-5d60e03ad13d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.816197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc087-d961-4403-b2e7-5d60e03ad13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.816382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9de0-5c55-4d4b-aa16-4bd03bf46173 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.821553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.822197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.822485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.822762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.823419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:09.824015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.825646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.837056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ee2dc087-d961-4403-b2e7-5d60e03ad13d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.844903 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 616/1227] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:09.845072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee2dc087-d961-4403-b2e7-5d60e03ad13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.845186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.847047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 612/1228] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.848366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.848599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa147f5-cce1-4018-a5bf-4c7762a1c0b4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.848722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.848917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.853881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.854512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.854806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.855075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.855739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:09.856022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.857609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972c26-181c-4d30-927b-139f13cebffb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.869584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.869973 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 617/1229] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:09.870794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.871285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd30a3-dac6-4a61-b709-0f8cc4a32af7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.871629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd30a3-dac6-4a61-b709-0f8cc4a32af7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.871869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd30a3-dac6-4a61-b709-0f8cc4a32af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.879023 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 613/1230] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.879766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.889011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ada8-76c2-4cdb-bbd1-e2cfc1956d27 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.893866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.894505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.894787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.895060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.895700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.896183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-abdd30a3-dac6-4a61-b709-0f8cc4a32af7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.897331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.897449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-abdd30a3-dac6-4a61-b709-0f8cc4a32af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.906370 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 618/1231] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.907728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.908018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.911113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.911252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 614/1232] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:09.911252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.920707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a322-c28c-435f-8659-a263976a5deb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.925435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.926027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.926338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.926616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.927248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:09.927551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.929712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:09.929851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.931069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:09.938966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 619/1233] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:09.939737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.949332 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 615/1234] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:09.950262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.951884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d5be-9b98-43e9-a8c5-f548d56001c9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.956458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.957071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.957343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.957616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.958523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.960134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba2ac-5425-4a15-a480-9302f5358f61 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.961470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.965346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:09.965980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:09.966291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:09.966567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:09.967217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:09.967519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:09.969105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:09.981286 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 616/1235] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:09.982010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:09.992382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c30f-9589-44d3-ad27-e199012d6c7c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:09.992818 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 620/1236] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:09.993793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.036006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:10.037302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:10.053285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.053979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.055349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.055349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.055841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.057814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.060715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa8baf-161e-48fe-93fd-05ac8cdc5f91 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.065384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.065994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.066304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.066580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.067223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:10.067526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.069227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.082234 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 621/1237] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:10.082234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.090473 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 617/1238] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:09 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.090473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.095655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dda71-ff1b-4faa-9a09-3aabb96d25d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.152524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.153147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.153390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0c220-e92c-4fac-bd0c-416947bd5296 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.153515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.153686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.154395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:10.154701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.156326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.158035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.158671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.158946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.159214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.159844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.161418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.168312 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 622/1239] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:10.169115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.178589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac96a0a-75b6-4194-9ef3-6d603bf115a0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.182950 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 618/1240] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.182950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.187047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.187658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.187942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.188220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.188896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:10.189202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.189929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de032e-d298-451a-8987-98d616ad1315 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.190834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.194580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.195200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.195659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.195933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.196561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.198475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.210897 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 623/1241] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:10.210897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.215529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d73229-8fe4-44ba-aac0-d6823ed981b7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.221521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.222308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.222614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.222904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.223527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.225420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.229382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 619/1242] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.229382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.255506 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 624/1243] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.256375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.298116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8279-44de-442c-9d12-470b76929885 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.322732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2db12e-28e4-4b1e-a63d-97c62bc65059 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.327655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.328273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.328595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.328836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.329470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.331430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.346730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:10.358788 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 625/1244] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.358788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.362012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.362680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.362962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.363238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.363867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.365810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.366824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14ff7-7e96-4c96-a815-8930d62b0a62 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.371619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.372222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.372504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.372783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.373453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.375375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.389485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 620/1245] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.390386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.394218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:10.403170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111474ad-1bf0-415b-9854-985672590bd1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.407185 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 626/1246] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.407861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.407967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.408563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.408841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.409113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.409742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.411932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.441361 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 621/1247] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.446514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.473501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd917-1888-4a57-b810-2491805859e3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.508189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd8249-2c87-4713-ad83-c68d39880331 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.512737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.513349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.513629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.513902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.514586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.516496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.531907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.532678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.533064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.533254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] PATH_INFO: `/v3/projects/82892e66c60043e6b0e5fb1fea959e1e/users/5c2b4cbf702a4666ae9eb9a7c3be8aeb/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.543629 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 622/1248] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.544425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.549431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82892e66c60043e6b0e5fb1fea959e1e, user_id=5c2b4cbf702a4666ae9eb9a7c3be8aeb, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.552542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.566632 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 627/1249] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:10 2022] PUT /identity/v3/projects/82892e66c60043e6b0e5fb1fea959e1e/users/5c2b4cbf702a4666ae9eb9a7c3be8aeb/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:10.567414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.610100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913cc49-5b1e-49f3-ae54-38fb6efea7f9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.633636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428969-bc41-4567-88c9-64a89b93a428 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.638301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.638995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.639275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.639545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.640178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.642082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.661171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:10.664296 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 628/1250] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.664778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.673004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.673619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.673892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.674176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.674707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1421f6-5b19-47d5-88c4-f5c88eb536d5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.674832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.676716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.679775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.680372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.680710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.681036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.681704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.683345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.693415 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 629/1251] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.693415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.701375 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 623/1252] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.701375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.703259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:10.707730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6be7b-f8aa-494a-a0a5-643ffa2cea81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.709514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824c2fc-6e00-4b0f-8bde-2487c008a649 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.714199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.714805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.714947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.715080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.715354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.715545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.715824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.716015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.716110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.716719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.717585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.718672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.728186 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 630/1253] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.728950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.739540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2815-676a-4720-8f14-7046ef605637 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.744845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39cc26-9676-45f1-bcf3-5b2c9b225e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.745086 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 624/1254] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.745507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39cc26-9676-45f1-bcf3-5b2c9b225e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.745796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39cc26-9676-45f1-bcf3-5b2c9b225e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.746074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39cc26-9676-45f1-bcf3-5b2c9b225e44 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.746312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.746748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39cc26-9676-45f1-bcf3-5b2c9b225e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.748714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39cc26-9676-45f1-bcf3-5b2c9b225e44 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.756061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de458b-c904-4331-a153-eb1289bcec4c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.760859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.761383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.761649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.761989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.762833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.765105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.774837 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 631/1255] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.774837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.774837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.774837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.793407 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 625/1256] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/users => generated 305 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:10.793407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.801159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02443350-7494-41a4-84e6-f45ade1ee08d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.802928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] MFA Rules not processed for user `5c2b4cbf702a4666ae9eb9a7c3be8aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:10.804687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:10.806648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.807238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.807516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.807784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.808418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.810057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.821023 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 626/1257] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.821615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.831068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f87c1-eab8-4247-b948-bab673e0be2a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.836327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.836937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.837215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.837585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.838093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.839683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.849493 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 627/1258] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.850085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.863441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b51a9-b067-44d2-b9ad-a5cd7e714685 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.868171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.868767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.869051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.869328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.869963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.871635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.876144 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 632/1259] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:10.877064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.889053 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 628/1260] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.889053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.890416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac0f8-74fb-4bf3-a872-7fbf114fed73 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.895141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.895751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.896029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.896326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.896539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9d4b-72d8-4a92-be29-3276c01147b1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.896971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.899056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.901243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.901829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.902113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.902418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.903083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.904711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.909207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 633/1261] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.910060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.921242 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 629/1262] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.921242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.921513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b93d0-d8aa-4183-bfb5-125982463587 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.925730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.926356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.926648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.926949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.927585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.929805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.930024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb478-1571-4933-9d3c-6a8563681556 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.934926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.935516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.935799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.936071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.936702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.938346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.943253 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 634/1263] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.943253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.948802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 630/1264] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.949641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.950663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d71a9-f590-4426-97ab-784b5ab76136 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.955290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.955885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.956166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.956439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.957077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.959554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.960019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65c77-ad6e-41bd-bdb1-d3ccf3ebfb71 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.965850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.966609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.966966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.967313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] PATH_INFO: `/v3/projects/ab87252f86984e3d8737807d1ea9391f/users/f7c70d25b2c8415ea8257043d5468358/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.972283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 635/1265] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:10.973235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:10.984037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab87252f86984e3d8737807d1ea9391f, user_id=f7c70d25b2c8415ea8257043d5468358, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.985104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ded893-44cb-4cff-a613-c2018d47d791 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:10.987327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:10.990233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:10.990833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:10.991109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:10.991382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:10.992662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:10.994761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.002829 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 631/1266] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:10 2022] PUT /identity/v3/projects/ab87252f86984e3d8737807d1ea9391f/users/f7c70d25b2c8415ea8257043d5468358/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.003806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.033913 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 636/1267] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:10 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:11.035019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.070579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e340-0e7a-4520-a515-768ad1ba255e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.101919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fcfad-66c8-4344-88b9-c420455918ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.104361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:11.106723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.107401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.107690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.107971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] PATH_INFO: `/v3/projects/6f0501c716ae44e48cc0c36480eddd4e/users/5661ebea142e4edc99bcf21b0512fe50/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.124047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0501c716ae44e48cc0c36480eddd4e, user_id=5661ebea142e4edc99bcf21b0512fe50, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.126820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.129004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:11.130977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.131618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.131944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.132247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.132956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.134754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.141582 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 637/1268] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:11 2022] PUT /identity/v3/projects/6f0501c716ae44e48cc0c36480eddd4e/users/5661ebea142e4edc99bcf21b0512fe50/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.142431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.146215 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 632/1269] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:11.147341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.158543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b26fe4-07e8-42e0-95ca-136abfb3f317 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.210244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2dc70-907e-494a-9682-989fab43b1f8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.215554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.216180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.216466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.216596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.216753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.217158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.217399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.217517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.217713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.218388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.219033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.219978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.229203 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 638/1270] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:11.230008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.233566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 633/1271] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:11.233566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.240145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67695559-e0c0-4cc2-8245-a59bb7f6c101 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.243864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4f439-a4e7-4d9e-8519-70af2401c0ae admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.245703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125be412-f7e2-4586-8270-7a21f6398879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.246359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125be412-f7e2-4586-8270-7a21f6398879 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.246652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125be412-f7e2-4586-8270-7a21f6398879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.246933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125be412-f7e2-4586-8270-7a21f6398879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.247578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125be412-f7e2-4586-8270-7a21f6398879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.248609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.249210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125be412-f7e2-4586-8270-7a21f6398879 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.249323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.249522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.249826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] PATH_INFO: `/v3/projects/866a694ea6f742a799c7105fd8398022/users/065d16e8aa9145b9a2d21d573af6e37a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.262746 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 639/1272] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:11.262746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.262746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.262746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.267721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866a694ea6f742a799c7105fd8398022, user_id=065d16e8aa9145b9a2d21d573af6e37a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.270409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.284319 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 634/1273] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:11 2022] PUT /identity/v3/projects/866a694ea6f742a799c7105fd8398022/users/065d16e8aa9145b9a2d21d573af6e37a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.285433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.301652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] MFA Rules not processed for user `f7c70d25b2c8415ea8257043d5468358`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:11.302925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:11.351929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634246e-e4e2-4224-8574-3bca00c2f4b0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.356547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d84b3c-fde1-4f90-8266-590708262ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.357181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d84b3c-fde1-4f90-8266-590708262ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.357487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d84b3c-fde1-4f90-8266-590708262ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.357760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d84b3c-fde1-4f90-8266-590708262ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.358402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d84b3c-fde1-4f90-8266-590708262ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.360311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d84b3c-fde1-4f90-8266-590708262ea2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.371687 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 640/1274] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:11.372275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.383889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb5dbd-8ff9-4c0e-b154-929e81025d54 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.387744 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 635/1275] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:11.387744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.387744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.387744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.388655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.389326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.389613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.389896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] PATH_INFO: `/v3/projects/e5e45d5c90a7408baa30f22a941f38f8/users/ed56d776c2ee410d8bcbe4557f3e4da0/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.405875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e45d5c90a7408baa30f22a941f38f8, user_id=ed56d776c2ee410d8bcbe4557f3e4da0, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.408646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.416512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] MFA Rules not processed for user `5661ebea142e4edc99bcf21b0512fe50`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:11.417853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:11.422541 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 641/1276] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:11 2022] PUT /identity/v3/projects/e5e45d5c90a7408baa30f22a941f38f8/users/ed56d776c2ee410d8bcbe4557f3e4da0/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.432477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.438643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:11.472612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:11.488105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 636/1277] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:11.489158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.493358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216e2bd-1684-4967-b087-57d4b4280f16 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.498236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.498912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.499200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.499481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] PATH_INFO: `/v3/projects/ff1e0a67d2af41adaa924326838401ab/users/ba045fd5be9d482b8205237ddee4d5f3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.502356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eedfc-8365-4f07-952d-7af820692e15 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.506996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886ed50-2d5a-48dd-8160-1783b6012ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.508219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886ed50-2d5a-48dd-8160-1783b6012ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.508496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886ed50-2d5a-48dd-8160-1783b6012ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.508765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886ed50-2d5a-48dd-8160-1783b6012ef2 admin admin] PATH_INFO: `/v3/projects/7aee6a36444645bb95bd5c9d5780770d/users/f8e9e3a311f74c908431033c0bfb476e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.515346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1e0a67d2af41adaa924326838401ab, user_id=ba045fd5be9d482b8205237ddee4d5f3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.518050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.524018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886ed50-2d5a-48dd-8160-1783b6012ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aee6a36444645bb95bd5c9d5780770d, user_id=f8e9e3a311f74c908431033c0bfb476e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.527176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886ed50-2d5a-48dd-8160-1783b6012ef2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.532759 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 642/1278] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:11 2022] PUT /identity/v3/projects/ff1e0a67d2af41adaa924326838401ab/users/ba045fd5be9d482b8205237ddee4d5f3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.533702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.543835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 637/1279] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:11 2022] PUT /identity/v3/projects/7aee6a36444645bb95bd5c9d5780770d/users/f8e9e3a311f74c908431033c0bfb476e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.545001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.545286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.545583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.573426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] MFA Rules not processed for user `065d16e8aa9145b9a2d21d573af6e37a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:11.574771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:11.607763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4617-8eea-49ee-9b23-f424703211fe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.640252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 638/1280] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:11.641067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.669890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.670597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.670884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.671158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] PATH_INFO: `/v3/projects/4da76515f3924fc687b91ee782b092e0/users/cd9c74e205f74cc48a010b2526912fce/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.685381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da76515f3924fc687b91ee782b092e0, user_id=cd9c74e205f74cc48a010b2526912fce, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.688037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.701575 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 643/1281] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:11 2022] PUT /identity/v3/projects/4da76515f3924fc687b91ee782b092e0/users/cd9c74e205f74cc48a010b2526912fce/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:11.702564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.708162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ea0f-6bba-4bb0-945c-f9d31d93b4f1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.741998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:11.762614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:11.766662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832b05-2a80-4b7b-8210-330e13adf9b3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.768595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.769185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.769479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.769754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.770419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.772301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b4f49-df49-48e7-8671-d9312a36730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.772470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.773001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b4f49-df49-48e7-8671-d9312a36730b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.773274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b4f49-df49-48e7-8671-d9312a36730b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.773549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b4f49-df49-48e7-8671-d9312a36730b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.774214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b4f49-df49-48e7-8671-d9312a36730b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.775823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b4f49-df49-48e7-8671-d9312a36730b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.787690 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 644/1282] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:11.790006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c97d8-70fa-4ed3-a84d-61fe7e8c002a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.790494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c97d8-70fa-4ed3-a84d-61fe7e8c002a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.790770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c97d8-70fa-4ed3-a84d-61fe7e8c002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.805685 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 639/1283] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:11.805685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.819634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d04c97d8-70fa-4ed3-a84d-61fe7e8c002a None None] MFA Rules not processed for user `ed56d776c2ee410d8bcbe4557f3e4da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:11.820920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d04c97d8-70fa-4ed3-a84d-61fe7e8c002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:11.866359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22607506-ed96-47b5-b571-37a4e72cffd9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.871147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f49cdb-1db0-41d0-af3f-7f3a3d8965d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.871757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f49cdb-1db0-41d0-af3f-7f3a3d8965d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.872040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f49cdb-1db0-41d0-af3f-7f3a3d8965d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.872312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f49cdb-1db0-41d0-af3f-7f3a3d8965d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.872940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f49cdb-1db0-41d0-af3f-7f3a3d8965d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.874900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f49cdb-1db0-41d0-af3f-7f3a3d8965d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:11.887489 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 645/1284] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:11.888797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.889098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.889374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.907041 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 640/1285] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:11.907041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f04eb-41fb-41c4-959b-a0d723070228 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.907041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f04eb-41fb-41c4-959b-a0d723070228 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.907041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f04eb-41fb-41c4-959b-a0d723070228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.908990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:11.910227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:11.934199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-da4f04eb-41fb-41c4-959b-a0d723070228 None None] MFA Rules not processed for user `f8e9e3a311f74c908431033c0bfb476e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:11.935417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da4f04eb-41fb-41c4-959b-a0d723070228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:11.971765 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 646/1286] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:11.972732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:11.982914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbab6c-82b1-4bca-a85b-0939eda7e126 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:11.987745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:11.988355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:11.988633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:11.988905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:11.989534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:11.991449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.002932 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 641/1287] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:12.004234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.004596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.004956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.022195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 647/1288] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.022195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.037231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] MFA Rules not processed for user `cd9c74e205f74cc48a010b2526912fce`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:12.038745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:12.062892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:12.084431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ad8a8-05e8-435d-b836-d09012ba28ea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.089597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.090327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.090611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.090883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] PATH_INFO: `/v3/projects/b2f6d33ff078468dac18151f847fb544/users/538ab4f198774251952cc683e5a2a400/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.094709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:12.105837 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 642/1289] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:12.106587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.109204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f6d33ff078468dac18151f847fb544, user_id=538ab4f198774251952cc683e5a2a400, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.112227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.119488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3334e-5398-4975-843a-c2f9840cd79e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.124724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.125363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.125646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.125923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.126598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.128059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 648/1290] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:12 2022] PUT /identity/v3/projects/b2f6d33ff078468dac18151f847fb544/users/538ab4f198774251952cc683e5a2a400/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:12.128563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.128882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.152467 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 643/1291] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/users => generated 300 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.153497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.163847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ce2ea-e2be-419c-83f6-7c395fe9ed08 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.194032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4709-eb7a-48f9-8571-9ca4c91d7d6f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.199093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.199711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.199994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.200272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.200913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.202943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.221665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.222393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.222819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.223090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.223749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.226272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.233371 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 649/1292] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.233371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.252011 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 644/1293] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.252011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.260248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f713c3-a0df-4fae-b14a-cfc95f9eefa8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.297321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13fa3-6753-48e8-b2d4-82e7665e3b8e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.301303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.301614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.301905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.302294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.320234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.320815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.321101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.321378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.322002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.324029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.353246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 645/1294] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.354744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.365004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.366468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.376354 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 650/1295] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:12.377311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.379973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:12.387926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0758a-d149-45a6-b0e3-01ad4d3bbb62 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.409858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:12.426464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62603041-41e4-41d9-8c1b-7d38dad3459d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.433120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.433753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.434034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.434345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.434986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.436972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.460154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 646/1296] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.461095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.461223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.461853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.462161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.462567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.463408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.465473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.472790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1b67e-edb7-4673-8e60-91b3a02ebc71 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.481218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.481898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.482243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.482551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.483205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.485064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.496519 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 647/1297] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:12.497693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.498468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 651/1298] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/projects => generated 407 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.499408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.512670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783341-4a11-46d6-98b6-29db04c0fba1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.573954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415010-9d54-4f78-9fb9-a409ae5ce61a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.578977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.579273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.579561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.579895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.580520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.582777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.592898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.595739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.596219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.597366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.599190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.602633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.613921 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 652/1299] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.613921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.624633 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 648/1300] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:12.624633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.624917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cb69f-d258-4e7f-b9f1-d904adebed14 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.629461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.630208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.630507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.630788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.631434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.633693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.637625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d32b-cb99-4809-bdfc-d3179f92a523 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.644264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.644984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.645325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.645538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 653/1301] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:12.645983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.646706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.646891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.649044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.658647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811453-540b-4672-984f-6119ca79297f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.664922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.665549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.665862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.666545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.667524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.669339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.676096 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 649/1302] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/users => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.676096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.680656 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 654/1303] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:12.684368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.687169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e4d4-88c2-456d-8b1b-d28c16d7c121 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.695895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.696711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.696858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361d39-3447-4b17-9045-ea07dc0d5d07 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.697192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.697610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] PATH_INFO: `/v3/projects/b2f6d33ff078468dac18151f847fb544/users/538ab4f198774251952cc683e5a2a400/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.700150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f6d33ff078468dac18151f847fb544, user_id=538ab4f198774251952cc683e5a2a400, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.702921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.705649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.706705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.707393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.707683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.708444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.710465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.724800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 650/1304] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:12 2022] PUT /identity/v3/projects/b2f6d33ff078468dac18151f847fb544/users/538ab4f198774251952cc683e5a2a400/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:12.726589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.746992 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 655/1305] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:12 2022] POST /identity/v3/users => generated 310 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:12.746992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.755401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058e09-adfb-4dba-bb01-f9bc298631b0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.817159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:12.818025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181351b4-edfd-4718-a837-327ef560cd84 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.824426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.825149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.825560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.825807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.826724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.827700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.828380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.828634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.829259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.829612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] PATH_INFO: `/v3/projects/7876ab139e2f40c0917a117f35dd96f1/users/c6b34710ffb34deeaef4f905ba7a1b27/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.839485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 651/1306] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:12.843479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.847891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7876ab139e2f40c0917a117f35dd96f1, user_id=c6b34710ffb34deeaef4f905ba7a1b27, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.848756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:12.853433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.855414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513024d-f764-413f-9ea5-28ef1adcf38d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.862415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.863360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.863622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.863991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] PATH_INFO: `/v3/projects/e7dd666782c548be8123f1b8ee261a4a/users/1fd6c923d09d41299141073bad789f65/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:12.871347 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 656/1307] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:12 2022] PUT /identity/v3/projects/7876ab139e2f40c0917a117f35dd96f1/users/c6b34710ffb34deeaef4f905ba7a1b27/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:12.872050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.887486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7dd666782c548be8123f1b8ee261a4a, user_id=1fd6c923d09d41299141073bad789f65, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:12.890638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:12.907029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 652/1308] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:12 2022] PUT /identity/v3/projects/e7dd666782c548be8123f1b8ee261a4a/users/1fd6c923d09d41299141073bad789f65/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:12.907589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:12.954929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aa02e-c461-4d56-9b3d-fe2c3d688b16 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.981035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffd1e4-690a-41d8-b58e-c6324179ec36 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:12.986325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcf08b-76b4-408b-81cd-ffd4594d6769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:12.987053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcf08b-76b4-408b-81cd-ffd4594d6769 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:12.987334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcf08b-76b4-408b-81cd-ffd4594d6769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:12.987612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcf08b-76b4-408b-81cd-ffd4594d6769 admin admin] PATH_INFO: `/v3/projects/43366373a52941278e049d18d295db9a/users/33b8d2dfaf654bc495f95d468f1c63a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.008751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcf08b-76b4-408b-81cd-ffd4594d6769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43366373a52941278e049d18d295db9a, user_id=33b8d2dfaf654bc495f95d468f1c63a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.011512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcf08b-76b4-408b-81cd-ffd4594d6769 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.028685 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 653/1309] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:12 2022] PUT /identity/v3/projects/43366373a52941278e049d18d295db9a/users/33b8d2dfaf654bc495f95d468f1c63a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:13.030853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.031295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.031581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.033114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.034438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.035152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.035740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.037051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.041019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.060914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] MFA Rules not processed for user `538ab4f198774251952cc683e5a2a400`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:13.065063 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 657/1310] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.065230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:13.065350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.082930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba993-bd3c-4452-a0f3-7296eee68860 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.151974 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 654/1311] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:13.162543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.167929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.168736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.168974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.169257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.170037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.171786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.183626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242dd1-f3aa-4b01-aa2a-c1b301885cd8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.188365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.189053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.189333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.189612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] PATH_INFO: `/v3/projects/ae8f62da063f4c0988af2e543feb8571/users/031d3d6fc14545d28db543eb8ea326c8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.191398 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 658/1312] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.192361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.204561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9ed19-1ff2-420c-83e3-894125631e13 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.209755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.211753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.212712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.213051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.213797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.216178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.220108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8f62da063f4c0988af2e543feb8571, user_id=031d3d6fc14545d28db543eb8ea326c8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.225858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.232110 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 659/1313] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.233079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.252353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa849a-c7b0-4c0a-8920-709257fc13d4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.254541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 655/1314] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:13 2022] PUT /identity/v3/projects/ae8f62da063f4c0988af2e543feb8571/users/031d3d6fc14545d28db543eb8ea326c8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:13.255237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.261566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:13.305816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:13.338062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.339689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.339989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.340317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.341158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.343053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.360310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 660/1315] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.361155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.379091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c082c-374b-4ef3-949d-f572d0f8251d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.387445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fe47-04ff-4731-97c7-c31f62ce4472 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.389551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d086-ab25-4853-87c2-e4f68771a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.391050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d086-ab25-4853-87c2-e4f68771a08b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.391555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d086-ab25-4853-87c2-e4f68771a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.392041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d086-ab25-4853-87c2-e4f68771a08b admin admin] PATH_INFO: `/v3/projects/176202c739f84e7796d263441959f420/users/92023e3357994faca985aa599779203a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.402308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.403792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.404414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.405201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.406462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.409719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.426525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d086-ab25-4853-87c2-e4f68771a08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=176202c739f84e7796d263441959f420, user_id=92023e3357994faca985aa599779203a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.432372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 656/1316] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.434309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.438826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d086-ab25-4853-87c2-e4f68771a08b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.453597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1056-b29d-49a1-a100-a68df3b41f8b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.470754 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 661/1317] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:13 2022] PUT /identity/v3/projects/176202c739f84e7796d263441959f420/users/92023e3357994faca985aa599779203a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:13.473014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc858ae8-fec1-48ed-8556-b3cfe1ff146f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.473441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc858ae8-fec1-48ed-8556-b3cfe1ff146f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.474451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc858ae8-fec1-48ed-8556-b3cfe1ff146f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.477438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 662/1318] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 05:11:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:13.479588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc858ae8-fec1-48ed-8556-b3cfe1ff146f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.575119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.576441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.576601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.576855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] PATH_INFO: `/v3/projects/3036b08759564e2caec589f70b671018/users/45937b9f81d1489ca7ebd8e6101a5f61/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.594741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3036b08759564e2caec589f70b671018, user_id=45937b9f81d1489ca7ebd8e6101a5f61, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.597584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.608334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc858ae8-fec1-48ed-8556-b3cfe1ff146f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.617362 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 657/1319] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:13 2022] PUT /identity/v3/projects/3036b08759564e2caec589f70b671018/users/45937b9f81d1489ca7ebd8e6101a5f61/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:13.618570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.709681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee476-d636-4e98-97af-7904fc0ce751 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.717144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.717553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.717881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.718174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.718964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.720575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.732872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.734765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.735229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 658/1320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.736656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.741017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.742576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] PATH_INFO: `/v3/projects/7876ab139e2f40c0917a117f35dd96f1/users/c6b34710ffb34deeaef4f905ba7a1b27/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.748262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7876ab139e2f40c0917a117f35dd96f1, user_id=c6b34710ffb34deeaef4f905ba7a1b27, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.752828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.759198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183c5b9-a289-4432-a3f4-b43abccac5c2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.769442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.770192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.770525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.770801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] PATH_INFO: `/v3/projects/e7dd666782c548be8123f1b8ee261a4a/users/1fd6c923d09d41299141073bad789f65/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.774766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7dd666782c548be8123f1b8ee261a4a, user_id=1fd6c923d09d41299141073bad789f65, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.777565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.790851 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 663/1322] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:13 2022] PUT /identity/v3/projects/7876ab139e2f40c0917a117f35dd96f1/users/c6b34710ffb34deeaef4f905ba7a1b27/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:13.795007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.810850 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 659/1322] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:13 2022] PUT /identity/v3/projects/e7dd666782c548be8123f1b8ee261a4a/users/1fd6c923d09d41299141073bad789f65/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:13.810850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:13.848171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:13.862359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:13.928457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6f54-2f50-4245-b0db-f7ef1b4d34b5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.935364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877552-22d6-4098-b5d5-e6d4a2f1450a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:13.940514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.942050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.942560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.943037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] PATH_INFO: `/v3/projects/43366373a52941278e049d18d295db9a/users/33b8d2dfaf654bc495f95d468f1c63a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.943650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9122e-ad52-4bd6-9470-c8c7ef0dce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:13.945527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9122e-ad52-4bd6-9470-c8c7ef0dce5a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.946249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9122e-ad52-4bd6-9470-c8c7ef0dce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.946824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9122e-ad52-4bd6-9470-c8c7ef0dce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:13.947103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43366373a52941278e049d18d295db9a, user_id=33b8d2dfaf654bc495f95d468f1c63a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.948127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9122e-ad52-4bd6-9470-c8c7ef0dce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:13.951046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9122e-ad52-4bd6-9470-c8c7ef0dce5a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.952633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:13.973984 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 660/1323] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:13.977617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6d4d-f762-4b35-a500-86ff08aeac10 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:13.977617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6d4d-f762-4b35-a500-86ff08aeac10 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:13.978386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6d4d-f762-4b35-a500-86ff08aeac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.007789 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 664/1324] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:13 2022] PUT /identity/v3/projects/43366373a52941278e049d18d295db9a/users/33b8d2dfaf654bc495f95d468f1c63a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:14.009593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:14.053459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-07cc6d4d-f762-4b35-a500-86ff08aeac10 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.055220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-07cc6d4d-f762-4b35-a500-86ff08aeac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.116000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d56b1-58ae-42a8-a1ba-19fb7e09d50a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:14.121381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:14.122029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.129082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.129433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.130506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:14.131974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:14.148770 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 665/1325] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:14.149939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:14.161171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1608e-a6d6-488f-ac0b-dddc4c82e24f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:14.166493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b27ba0-d639-4876-af03-1d129b2462f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:14.167278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b27ba0-d639-4876-af03-1d129b2462f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.167566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b27ba0-d639-4876-af03-1d129b2462f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.167842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b27ba0-d639-4876-af03-1d129b2462f6 admin admin] PATH_INFO: `/v3/projects/ae8f62da063f4c0988af2e543feb8571/users/031d3d6fc14545d28db543eb8ea326c8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.169140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 661/1326] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.169901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b27ba0-d639-4876-af03-1d129b2462f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8f62da063f4c0988af2e543feb8571, user_id=031d3d6fc14545d28db543eb8ea326c8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:14.172963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b27ba0-d639-4876-af03-1d129b2462f6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:14.175713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.176230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.176507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.189095 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 666/1327] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:14 2022] PUT /identity/v3/projects/ae8f62da063f4c0988af2e543feb8571/users/031d3d6fc14545d28db543eb8ea326c8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:14.190635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3542-00b7-4c76-9fe0-ffc723e66a92 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.190927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3542-00b7-4c76-9fe0-ffc723e66a92 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.191354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3542-00b7-4c76-9fe0-ffc723e66a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.221551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] MFA Rules not processed for user `1fd6c923d09d41299141073bad789f65`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.223092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.228727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-78ae3542-00b7-4c76-9fe0-ffc723e66a92 None None] MFA Rules not processed for user `c6b34710ffb34deeaef4f905ba7a1b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.230483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78ae3542-00b7-4c76-9fe0-ffc723e66a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.365098 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 662/1328] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.365983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:14.386775 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 667/1329] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.389692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.390238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.390721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.428660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:14.430689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] MFA Rules not processed for user `33b8d2dfaf654bc495f95d468f1c63a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.432030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.447122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:14.483411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1a34d-e36a-4ac4-9f05-beef1db302e9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:14.490002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:14.490767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.491458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.492091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] PATH_INFO: `/v3/projects/176202c739f84e7796d263441959f420/users/92023e3357994faca985aa599779203a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.494253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176202c739f84e7796d263441959f420, user_id=92023e3357994faca985aa599779203a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:14.496928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:14.508543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 663/1330] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:14 2022] PUT /identity/v3/projects/176202c739f84e7796d263441959f420/users/92023e3357994faca985aa599779203a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:14.517733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:14.525450 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 668/1331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.526410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:14.588339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b70f52-7510-462b-919f-f06d0989a735 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:14.594464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abaa84-4a57-4d77-8692-1c854e36bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:14.595257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abaa84-4a57-4d77-8692-1c854e36bb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.595595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abaa84-4a57-4d77-8692-1c854e36bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.595940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abaa84-4a57-4d77-8692-1c854e36bb51 admin admin] PATH_INFO: `/v3/projects/3036b08759564e2caec589f70b671018/users/45937b9f81d1489ca7ebd8e6101a5f61/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.598031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abaa84-4a57-4d77-8692-1c854e36bb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3036b08759564e2caec589f70b671018, user_id=45937b9f81d1489ca7ebd8e6101a5f61, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:14.602258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abaa84-4a57-4d77-8692-1c854e36bb51 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:14.614088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25cf3c-2b13-411b-9afd-35c98aad88c8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:14.614956 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 664/1332] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:14 2022] PUT /identity/v3/projects/3036b08759564e2caec589f70b671018/users/45937b9f81d1489ca7ebd8e6101a5f61/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:14.616231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27228a-349f-432e-8efc-fe1efc7242d4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.616513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27228a-349f-432e-8efc-fe1efc7242d4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.616816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27228a-349f-432e-8efc-fe1efc7242d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.648040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9e27228a-349f-432e-8efc-fe1efc7242d4 None None] MFA Rules not processed for user `031d3d6fc14545d28db543eb8ea326c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.649420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9e27228a-349f-432e-8efc-fe1efc7242d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.698880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef479dd2-71a2-4bea-9c94-2a90a331f187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:14.699510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479dd2-71a2-4bea-9c94-2a90a331f187 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.699983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479dd2-71a2-4bea-9c94-2a90a331f187 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.700112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479dd2-71a2-4bea-9c94-2a90a331f187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.737128 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 665/1333] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.737128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df019ec-7f3d-42f8-8e7f-393451f52ae8 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.737128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df019ec-7f3d-42f8-8e7f-393451f52ae8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.737128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df019ec-7f3d-42f8-8e7f-393451f52ae8 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.737128 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 666/1334] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 05:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:14.737128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7890d9-49f3-4465-a12f-a9ac41862f4d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.737718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7890d9-49f3-4465-a12f-a9ac41862f4d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.737718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7890d9-49f3-4465-a12f-a9ac41862f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.756987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0d7890d9-49f3-4465-a12f-a9ac41862f4d None None] MFA Rules not processed for user `f7c70d25b2c8415ea8257043d5468358`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.758997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0d7890d9-49f3-4465-a12f-a9ac41862f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.760717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:14.786371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef479dd2-71a2-4bea-9c94-2a90a331f187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:14.788003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef479dd2-71a2-4bea-9c94-2a90a331f187 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:14.802115 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 669/1335] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:14.803292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52beed-9858-40fd-83d8-a5e5530dbd37 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.803582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52beed-9858-40fd-83d8-a5e5530dbd37 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.803859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52beed-9858-40fd-83d8-a5e5530dbd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.810852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:14.841707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fc52beed-9858-40fd-83d8-a5e5530dbd37 None None] MFA Rules not processed for user `92023e3357994faca985aa599779203a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.842969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc52beed-9858-40fd-83d8-a5e5530dbd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.848064 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 667/1336] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.848064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.848064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.848064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.886005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] MFA Rules not processed for user `45937b9f81d1489ca7ebd8e6101a5f61`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:14.888282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:14.978792 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 670/1337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:14.980502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:14.980860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:14.981153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:14.993831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 668/1338] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:15.007598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:15.009121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:15.019308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 671/1339] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:15.030290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.046443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba8fa-d4fa-4297-bccd-e69beb7f155f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:15.052251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:15.053103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.053531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.053950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.166798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:15.168443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:15.192407 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 669/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:15.276187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.297119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23098ac2-a870-49af-b941-39b94d330b7d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:15.314007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:15.314876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.315331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.316507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.456529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:15.458167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:15.485355 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 672/1341] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:15.575257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.605451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc027d5-a89c-41cd-a659-5a7034807462 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:15.618791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.620122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:15.620831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.621210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.621951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.634557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:15.636980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:15.638395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476355-0d04-435a-aa9b-bd12d6273dc7 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:15.649323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 670/1342] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:15.649484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2344-8f9b-4468-b93c-e8023238788b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:15.650222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2344-8f9b-4468-b93c-e8023238788b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.650509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2344-8f9b-4468-b93c-e8023238788b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.650968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2344-8f9b-4468-b93c-e8023238788b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.659806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2344-8f9b-4468-b93c-e8023238788b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:15.661414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2344-8f9b-4468-b93c-e8023238788b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:15.673302 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 673/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:15.705528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.719444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b010e-4290-404b-81c5-9502394f9097 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:15.728356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:15.729175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.729626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.730029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.753361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:15.755146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:15.763083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8494f-510c-4eb7-90dd-6040d3d94775 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.763396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8494f-510c-4eb7-90dd-6040d3d94775 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.763760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8494f-510c-4eb7-90dd-6040d3d94775 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.765704 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 674/1344] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:15.774491 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 671/1345] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:15.784546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.784946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.785583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.832311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.836134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:15.837548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:15.861584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32486c1-5196-47d9-ba31-e7d24225bae4 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:15.877064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:15.878408 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 675/1346] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:15.879003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:15.879624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:15.880489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:15.899819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:15.901549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:15.903708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:15.907018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:15.941794 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 672/1347] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:16.010342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:16.105690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd705a-c9a7-4099-9dcf-e261cb4de1ba None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:16.110227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:16.111109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:16.111751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:16.112042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:16.127779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:16.129245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:16.169671 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 676/1348] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:16.337717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:16.352819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb29a83-9059-4d1f-83e3-0b332035d304 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:16.359594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:16.360463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:16.361279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:16.361710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:16.388803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:16.477445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:16.477445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:16.501536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 673/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:16.844350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:16.864582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873e870-95c3-4a62-9476-fa60a62d27dd service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:16.871343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baee42b-dac1-49e3-9a28-d9710a276e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:16.871648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baee42b-dac1-49e3-9a28-d9710a276e97 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:16.871940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baee42b-dac1-49e3-9a28-d9710a276e97 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:16.872217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baee42b-dac1-49e3-9a28-d9710a276e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:16.943190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baee42b-dac1-49e3-9a28-d9710a276e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:16.945407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baee42b-dac1-49e3-9a28-d9710a276e97 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:16.955876 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 677/1350] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:16 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:17.127033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:17.240583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91196c95-7a8e-405e-a3f7-f8982f3f127b service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:17.247370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:17.248097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:17.248510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:17.248887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:17.251911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:17.268695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:17.270628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6489d-479a-42c4-91f8-7a0b3127de28 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:17.297680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 674/1351] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:17.484863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8645c-8673-4a44-b458-78232c78a195 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:17.485652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8645c-8673-4a44-b458-78232c78a195 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:17.486428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8645c-8673-4a44-b458-78232c78a195 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:17.488294 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 678/1352] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:17.509198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:17.509757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:17.510037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:17.514945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8645c-8673-4a44-b458-78232c78a195 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:17.592548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:17.593784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:17.652522 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 675/1353] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:17.689471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:17.716282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5ef2-572d-48e7-ad73-440285201fcd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:17.743020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:17.745106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:17.746444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:17.752271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:17.793521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:17.798624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:17.822582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8645c-8673-4a44-b458-78232c78a195 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:17.832154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:17.832885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:17.833161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:17.833708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] PATH_INFO: `/v3/users/f8e9e3a311f74c908431033c0bfb476e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:17.836531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e9e3a311f74c908431033c0bfb476e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:17.839197 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:11:17.839197 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:11:17.839197 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:11:17.840033 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 676/1354] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:17.863775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:18.030460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:18.050124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bf1e5-1030-4b44-a19a-666c845e7a22 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:18.055337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e9e3a311f74c908431033c0bfb476e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.059661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:18.060895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.062310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.063727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] PATH_INFO: `/v3/users/cd9c74e205f74cc48a010b2526912fce` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.065475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9c74e205f74cc48a010b2526912fce)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:18.067917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:18.075627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e9e3a311f74c908431033c0bfb476e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.076429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e9e3a311f74c908431033c0bfb476e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.077531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e9e3a311f74c908431033c0bfb476e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.082751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:18.119338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e9e3a311f74c908431033c0bfb476e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.235133 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 679/1355] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:17 2022] DELETE /identity/v3/users/f8e9e3a311f74c908431033c0bfb476e => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:18.237421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9c74e205f74cc48a010b2526912fce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.239921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:18.243118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.316086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9c74e205f74cc48a010b2526912fce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.319149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9c74e205f74cc48a010b2526912fce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.325197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9c74e205f74cc48a010b2526912fce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.344566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9faef8f0-c015-452d-a9d7-dacbbb3093b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9c74e205f74cc48a010b2526912fce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.368949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 677/1356] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:18 2022] DELETE /identity/v3/users/cd9c74e205f74cc48a010b2526912fce => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:18.373586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c9d0-cdfc-42fe-98c6-3730d4a958ed None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.373872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c9d0-cdfc-42fe-98c6-3730d4a958ed None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.374410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c9d0-cdfc-42fe-98c6-3730d4a958ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.384250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:18.406553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3be2c9d0-cdfc-42fe-98c6-3730d4a958ed None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:18.407847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3be2c9d0-cdfc-42fe-98c6-3730d4a958ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.484055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7439a90-d66e-4207-8681-c2f62a4139a4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:18.577607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 678/1357] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:18.581216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660720b3-feaa-4ee9-a472-daa96ec7fe03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.581511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660720b3-feaa-4ee9-a472-daa96ec7fe03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.582422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660720b3-feaa-4ee9-a472-daa96ec7fe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.591836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:18.592973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.593593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.594090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] PATH_INFO: `/v3/users/ed56d776c2ee410d8bcbe4557f3e4da0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.595722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed56d776c2ee410d8bcbe4557f3e4da0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:18.615109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:18.651988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-660720b3-feaa-4ee9-a472-daa96ec7fe03 None None] MFA Rules not processed for user `5c2b4cbf702a4666ae9eb9a7c3be8aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:18.653257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-660720b3-feaa-4ee9-a472-daa96ec7fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.724255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed56d776c2ee410d8bcbe4557f3e4da0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.744614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed56d776c2ee410d8bcbe4557f3e4da0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.758352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed56d776c2ee410d8bcbe4557f3e4da0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.761107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed56d776c2ee410d8bcbe4557f3e4da0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.778057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 679/1358] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:18.780113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345f0f-a1d0-4585-a3e1-6e693589a93d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.780462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345f0f-a1d0-4585-a3e1-6e693589a93d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.780669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345f0f-a1d0-4585-a3e1-6e693589a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.786935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed56d776c2ee410d8bcbe4557f3e4da0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:18.807313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-87345f0f-a1d0-4585-a3e1-6e693589a93d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:18.808502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87345f0f-a1d0-4585-a3e1-6e693589a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.821083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 680/1359] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:18.822435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8d75-10b4-4034-a508-66c20112c968 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.822729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8d75-10b4-4034-a508-66c20112c968 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.823007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8d75-10b4-4034-a508-66c20112c968 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.824550 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 681/1360] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:18.829834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:18.830357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8d75-10b4-4034-a508-66c20112c968 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:18.832645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-999e8d75-10b4-4034-a508-66c20112c968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.837223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 680/1361] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:18 2022] DELETE /identity/v3/users/ed56d776c2ee410d8bcbe4557f3e4da0 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:18.839124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:18.845848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.964587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8d75-10b4-4034-a508-66c20112c968 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:18.969158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:18.969849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:18.970133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:18.971603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:18.973302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:18.999283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07705d9e-52a5-487d-b7ff-11decf193a66 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.005927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:19.006608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.006961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.007859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.009906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.093215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:19.117998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.119703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.135729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.137766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05598b59-e9a6-4924-823a-7ccdc1316208 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.149751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 681/1362] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:19.151394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd9f63-ce25-4dd2-94e1-048ab3a93188 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.151686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd9f63-ce25-4dd2-94e1-048ab3a93188 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.151978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd9f63-ce25-4dd2-94e1-048ab3a93188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.154231 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 682/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:19.155288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:19.178303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035251cc-4950-48fe-a10a-40ec68004835 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.182830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-28bd9f63-ce25-4dd2-94e1-048ab3a93188 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:19.184106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-28bd9f63-ce25-4dd2-94e1-048ab3a93188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.192538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:19.193222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.193465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.193746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.213434 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 682/1364] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:11:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:19.217806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.218585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.219080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.240236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.246130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.280491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:19.283123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.283495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 683/1365] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:19.284478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:19.290876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.314281 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 683/1366] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:19.328522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91fd3-a7b2-4a14-9b22-4c91b7cbc28e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.341903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf40b16-2582-4bf0-aff7-8a00ee1c86bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:19.342636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40b16-2582-4bf0-aff7-8a00ee1c86bc service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.342888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40b16-2582-4bf0-aff7-8a00ee1c86bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.343186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf40b16-2582-4bf0-aff7-8a00ee1c86bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.370005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:19.383923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf40b16-2582-4bf0-aff7-8a00ee1c86bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.384446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6807d5-d610-445d-b039-b456bbf88a82 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.385405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf40b16-2582-4bf0-aff7-8a00ee1c86bc service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.389868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:19.390790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.391239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.391719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.403973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.406490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.408888 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 684/1367] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:19.420638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 684/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:19.609395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.609915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.610313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.659879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:19.662387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.675384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] MFA Rules not processed for user `ba045fd5be9d482b8205237ddee4d5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:19.676645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.695872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241565d-b926-4372-a9f2-0fc05178357e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.705506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:19.706383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.706765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.707257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.709428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.820201 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 685/1369] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:19.824514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:19.826228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:19.862919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781733-bb76-4519-a5e1-b693fe8ebc5c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.876591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:19.877387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:19.877761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:19.878099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:19.880150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.886770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.896195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:19.900207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:19.914037 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 685/1370] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:19.945889 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 686/1371] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:19 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:19.947620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:19.965644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9139-402a-4c74-9710-f411a0b3fb5f service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:19.977410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:20.130528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:20.131994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:20.133559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:20.139466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:20.140525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:20.142941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:20.165615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:20.167378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:20.190775 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 686/1372] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:19 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:20.199263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb5f8-4899-491c-810d-7fd0f0390852 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:20.200180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:20.222496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:20.223164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:20.223681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:20.223931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] PATH_INFO: `/v3/projects/7aee6a36444645bb95bd5c9d5780770d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:20.228760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aee6a36444645bb95bd5c9d5780770d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:20.232053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9ed9-660e-4e46-a5e3-da3d84461866 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:20.232380 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:11:20.232380 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:11:20.232380 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:11:20.235226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:20.248326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:20.249069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:20.249355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:20.249631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:20.270706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:20.272553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:20.295129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 687/1373] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:20.299347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:20.333988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff609c-bd0f-44e7-8229-5da2319e9d2b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:20.346382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:20.347394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:20.347759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:20.348136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] PATH_INFO: `/v3/projects/e899c3206c0f4dff94b64da5404cb8ea/users/97aed18524bd45c0b922286a6373e634/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:20.389711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e899c3206c0f4dff94b64da5404cb8ea, user_id=97aed18524bd45c0b922286a6373e634, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:20.400560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:20.427999 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 688/1374] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:20 2022] PUT /identity/v3/projects/e899c3206c0f4dff94b64da5404cb8ea/users/97aed18524bd45c0b922286a6373e634/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:20.429612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:20.432441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:20.476318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aee6a36444645bb95bd5c9d5780770d', 'request_id': 'req-6a3363d5-c701-4cca-9bb7-ff1164a258ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.531546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aee6a36444645bb95bd5c9d5780770d', 'request_id': 'req-6a3363d5-c701-4cca-9bb7-ff1164a258ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.556801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aee6a36444645bb95bd5c9d5780770d', 'request_id': 'req-6a3363d5-c701-4cca-9bb7-ff1164a258ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.571687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c364115-e0b9-439c-95ca-a4444799d116 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:20.585011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:20.590550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:20.592189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:20.592189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] PATH_INFO: `/v3/projects/e5e45d5c90a7408baa30f22a941f38f8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:20.594277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e45d5c90a7408baa30f22a941f38f8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:20.595637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:20.600178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] The token cache is being invalidate because project 7aee6a36444645bb95bd5c9d5780770d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:20.602584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.605645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.612189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 687/1375] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:20 2022] DELETE /identity/v3/projects/7aee6a36444645bb95bd5c9d5780770d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:11:20.613152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:20.621304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:20.659145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:20.732388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e45d5c90a7408baa30f22a941f38f8', 'request_id': 'req-93b522d4-d547-428c-b2cf-7c09f949b876'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.740647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e45d5c90a7408baa30f22a941f38f8', 'request_id': 'req-93b522d4-d547-428c-b2cf-7c09f949b876'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.747361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:20.754678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e45d5c90a7408baa30f22a941f38f8', 'request_id': 'req-93b522d4-d547-428c-b2cf-7c09f949b876'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.761135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3363d5-c701-4cca-9bb7-ff1164a258ee admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:20.775459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] The token cache is being invalidate because project e5e45d5c90a7408baa30f22a941f38f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:20.775757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.779092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:20.781731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 689/1376] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:20 2022] DELETE /identity/v3/projects/e5e45d5c90a7408baa30f22a941f38f8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:20.787838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:20.794753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:20.917210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:20.918958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:20.919330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:20.920874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] PATH_INFO: `/v3/projects/4da76515f3924fc687b91ee782b092e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:20.922539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da76515f3924fc687b91ee782b092e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:20.925990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:21.001296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b522d4-d547-428c-b2cf-7c09f949b876 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:21.019223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da76515f3924fc687b91ee782b092e0', 'request_id': 'req-46b73a6a-c7d9-4f77-817a-13fe59a61af8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.035570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da76515f3924fc687b91ee782b092e0', 'request_id': 'req-46b73a6a-c7d9-4f77-817a-13fe59a61af8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.060825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da76515f3924fc687b91ee782b092e0', 'request_id': 'req-46b73a6a-c7d9-4f77-817a-13fe59a61af8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.087401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] The token cache is being invalidate because project 4da76515f3924fc687b91ee782b092e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:21.087805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.088832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.096600 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 688/1377] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:20 2022] DELETE /identity/v3/projects/4da76515f3924fc687b91ee782b092e0 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:21.097500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:21.102235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:21.177236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d357ca-f3b9-4a0a-a7fb-faffab69b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:21.178077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d357ca-f3b9-4a0a-a7fb-faffab69b050 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:21.178431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d357ca-f3b9-4a0a-a7fb-faffab69b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:21.178708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d357ca-f3b9-4a0a-a7fb-faffab69b050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:21.180597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d357ca-f3b9-4a0a-a7fb-faffab69b050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:21.184228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d357ca-f3b9-4a0a-a7fb-faffab69b050 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:21.212473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 690/1378] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:21.215827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:21.215827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:21.215827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:21.254903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:21.298535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b73a6a-c7d9-4f77-817a-13fe59a61af8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:21.304510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:21.306056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:21.306720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:21.307137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] PATH_INFO: `/v3/users/92023e3357994faca985aa599779203a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:21.308687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92023e3357994faca985aa599779203a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:21.310982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:21.328237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:21.329519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:21.416352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92023e3357994faca985aa599779203a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.449022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92023e3357994faca985aa599779203a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.449830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92023e3357994faca985aa599779203a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.450810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92023e3357994faca985aa599779203a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.471835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92023e3357994faca985aa599779203a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.517179 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 689/1379] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:21 2022] DELETE /identity/v3/users/92023e3357994faca985aa599779203a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:21.517179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:21.534404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:21.551290 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 691/1380] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:11:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:21.552000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:21.560217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:21.616322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63e8c5-4dd0-4e61-9791-986ff270fc81 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:21.629161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:21.773335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a3a6-f72c-4e8e-a7c9-fa4802e2aaa6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:21.779525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:21.780189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:21.780471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:21.780793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] PATH_INFO: `/v3/users/031d3d6fc14545d28db543eb8ea326c8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:21.782641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] RBAC: Authorizing `identity:delete_user(user_id=031d3d6fc14545d28db543eb8ea326c8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:21.784878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:21.827357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:21.828452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:21.828786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:21.830198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] PATH_INFO: `/v3/users/45937b9f81d1489ca7ebd8e6101a5f61` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:21.836255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45937b9f81d1489ca7ebd8e6101a5f61)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:21.843789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:21.880925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031d3d6fc14545d28db543eb8ea326c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.918951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031d3d6fc14545d28db543eb8ea326c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.920011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031d3d6fc14545d28db543eb8ea326c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.921023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031d3d6fc14545d28db543eb8ea326c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.932894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031d3d6fc14545d28db543eb8ea326c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.939391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:21.969276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45937b9f81d1489ca7ebd8e6101a5f61'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.974116 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 690/1381] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:21 2022] DELETE /identity/v3/users/031d3d6fc14545d28db543eb8ea326c8 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:21.975262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:21.977146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:21.987517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45937b9f81d1489ca7ebd8e6101a5f61'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.989146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45937b9f81d1489ca7ebd8e6101a5f61'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:21.990313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45937b9f81d1489ca7ebd8e6101a5f61'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.015099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45937b9f81d1489ca7ebd8e6101a5f61'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.067239 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 692/1382] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:21 2022] DELETE /identity/v3/users/45937b9f81d1489ca7ebd8e6101a5f61 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:22.068267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:22.070677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:22.164532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f29b2-8dcf-4d02-b21f-8b46bc59898d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:22.278060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b21a9-359e-4ffd-81b7-e25b15fba6b2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:22.299477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:22.300362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:22.300663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:22.300938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:22.307207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:22.315597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:22.337588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:22.343046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:22.343529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:22.344620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] PATH_INFO: `/v3/projects/e899c3206c0f4dff94b64da5404cb8ea/users/97aed18524bd45c0b922286a6373e634/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:22.347697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e899c3206c0f4dff94b64da5404cb8ea, user_id=97aed18524bd45c0b922286a6373e634, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:22.354296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:22.388896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 691/1383] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:21 2022] PUT /identity/v3/projects/e899c3206c0f4dff94b64da5404cb8ea/users/97aed18524bd45c0b922286a6373e634/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:22.388896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:22.393833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:22.443916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:22.447175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a9ed-ff2f-4c76-911d-09c8701d5f99 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:22.474625 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 693/1384] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:11:22.657346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a31fc4-efd6-4840-bd59-0435ba4b4db4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:22.666414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:22.667580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:22.668077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:22.669393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] PATH_INFO: `/v3/users/5661ebea142e4edc99bcf21b0512fe50` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:22.671998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5661ebea142e4edc99bcf21b0512fe50)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:22.674457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:22.826527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=6,keystone:SELECT=92 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:22.876127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5661ebea142e4edc99bcf21b0512fe50'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.918331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5661ebea142e4edc99bcf21b0512fe50'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.921168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5661ebea142e4edc99bcf21b0512fe50'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.932432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5661ebea142e4edc99bcf21b0512fe50'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.953501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5661ebea142e4edc99bcf21b0512fe50'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:22.985632 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 692/1385] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:22 2022] DELETE /identity/v3/users/5661ebea142e4edc99bcf21b0512fe50 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:22.987684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:22.987980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:22.988265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:23.056575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:23.061222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:23.144924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:23.147019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:23.182408 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 694/1386] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:23.207268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:23.209112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:23.333537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0cdb0-1652-4fc6-bcf1-3af697847c18 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:23.346288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:23.347028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:23.347296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:23.347556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] PATH_INFO: `/v3/projects/3036b08759564e2caec589f70b671018` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:23.350894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3036b08759564e2caec589f70b671018)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:23.352878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:23.396415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7a83-1084-487f-8382-a60eac9d4da2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:23.405398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:23.406439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:23.406951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:23.407461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:23.429680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:23.434310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:23.462948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3036b08759564e2caec589f70b671018', 'request_id': 'req-ed77a112-fae4-47e5-bc10-0d2c718b119f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.467883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 695/1387] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:23.468880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:23.470397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:23.479811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3036b08759564e2caec589f70b671018', 'request_id': 'req-ed77a112-fae4-47e5-bc10-0d2c718b119f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.499500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f86d7-ad19-463c-a2a1-bd863d09a49e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:23.512973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3036b08759564e2caec589f70b671018', 'request_id': 'req-ed77a112-fae4-47e5-bc10-0d2c718b119f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.544588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] The token cache is being invalidate because project 3036b08759564e2caec589f70b671018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:23.544998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.545557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ed77a112-fae4-47e5-bc10-0d2c718b119f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.547493 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 693/1388] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:23 2022] DELETE /identity/v3/projects/3036b08759564e2caec589f70b671018 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:23.552231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:23.552550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:23.552860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:23.626477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:23.627841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:23.639761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:23.681995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:23.684757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:23.686386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:23.689843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] PATH_INFO: `/v3/projects/176202c739f84e7796d263441959f420` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:23.697739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176202c739f84e7796d263441959f420)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:23.701782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:23.817720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:23.876860 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 694/1389] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:23.890422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:23.892201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:23.931467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ce32f-bf81-489e-a5f6-368b414ddfe9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:23.940437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176202c739f84e7796d263441959f420', 'request_id': 'req-89c19510-097a-4cb0-aed9-2eb8f0731ac7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.949130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176202c739f84e7796d263441959f420', 'request_id': 'req-89c19510-097a-4cb0-aed9-2eb8f0731ac7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.967764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176202c739f84e7796d263441959f420', 'request_id': 'req-89c19510-097a-4cb0-aed9-2eb8f0731ac7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.989124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] The token cache is being invalidate because project 176202c739f84e7796d263441959f420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:23.989124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:23.990071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c19510-097a-4cb0-aed9-2eb8f0731ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:24.000135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 696/1390] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:23 2022] DELETE /identity/v3/projects/176202c739f84e7796d263441959f420 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:24.002073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccedb-d2ab-401d-8a57-6643a946939a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.002852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccedb-d2ab-401d-8a57-6643a946939a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.003438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccedb-d2ab-401d-8a57-6643a946939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.057465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-685ccedb-d2ab-401d-8a57-6643a946939a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:24.059946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-685ccedb-d2ab-401d-8a57-6643a946939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:24.120577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:24.121623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.122062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.122523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] PATH_INFO: `/v3/projects/ae8f62da063f4c0988af2e543feb8571` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.123968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8f62da063f4c0988af2e543feb8571)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:24.126177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:24.270514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8f62da063f4c0988af2e543feb8571', 'request_id': 'req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:24.287503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 697/1391] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:24.287503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c34a8-1efb-4006-8e12-e01d54d94b42 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.287503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c34a8-1efb-4006-8e12-e01d54d94b42 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.287503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c34a8-1efb-4006-8e12-e01d54d94b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.299908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8f62da063f4c0988af2e543feb8571', 'request_id': 'req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:24.314932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-de8c34a8-1efb-4006-8e12-e01d54d94b42 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:24.317096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8f62da063f4c0988af2e543feb8571', 'request_id': 'req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:24.317580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de8c34a8-1efb-4006-8e12-e01d54d94b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:24.347857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] The token cache is being invalidate because project ae8f62da063f4c0988af2e543feb8571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:24.348209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:24.352468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:24.355041 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 695/1392] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:23 2022] DELETE /identity/v3/projects/ae8f62da063f4c0988af2e543feb8571 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:24.355884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:24.367508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:24.547734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128acc6a-551e-4ca0-9e21-7efec4c7b6d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:24.577546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:24.578261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 698/1393] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:24.581149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.582993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.583923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.584215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.585377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:24.586083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.586617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.587339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:24.593324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6b8d-fbd8-4d93-bf1f-b1e46fda6a4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:24.628449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 696/1394] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:24.630611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0ecf-25fd-4233-9959-130424b1a6b2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.631050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0ecf-25fd-4233-9959-130424b1a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.633490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0ecf-25fd-4233-9959-130424b1a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.640173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:24.642764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:24.669563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:24.669743 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 699/1395] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:24.670577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:24.688974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-470b0ecf-25fd-4233-9959-130424b1a6b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:24.691942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-470b0ecf-25fd-4233-9959-130424b1a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:24.700242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a287f0-6c47-4fc0-8d82-3e449eedf763 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:24.715382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:24.716005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.716214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.716458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 697/1396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:24.716698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.717839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:24.720398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:24.721581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:24.721923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:24.727630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:24.747003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:24.784559 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 700/1397] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:24 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:24.785660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:24.825604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:24.831868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:24.989028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936c852-e47f-41d5-a3ef-92e87ae1a05d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.000182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.000829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.001178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.001459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.002352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:25.002663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.004902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.012861 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 698/1398] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:25.014107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.027059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 701/1399] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:25.030101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.034974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1897a-9c0c-48e7-a72d-04e5a567c35c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.043698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32454-6876-4224-b381-b69db0e72cfd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.049761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.050361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.050749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.051129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.052346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.058300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.059523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.060473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.060755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.061114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.061785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:25.062092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.064102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.111461 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 699/1400] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:25 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:25.117916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.152155 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 702/1401] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:25.155274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.199528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c6a6-04f5-4085-accc-215990e1884e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.207180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4ade-0f02-4c80-8693-50ba70cb4906 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.226409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c35c-1651-407c-b69f-eacdfe586a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.227427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c35c-1651-407c-b69f-eacdfe586a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.227817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c35c-1651-407c-b69f-eacdfe586a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.228186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.229545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.229698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c35c-1651-407c-b69f-eacdfe586a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.230666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c35c-1651-407c-b69f-eacdfe586a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.237087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c35c-1651-407c-b69f-eacdfe586a31 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.240050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.240374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.242172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.247539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.284583 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 703/1402] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:25.286080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.286542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.286926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.335776 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 700/1403] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:25 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:25.336933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.395849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:25.397683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:25.527386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09e02-81cd-4bb0-b678-8ec220322196 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.540843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.541719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.542187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.542481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.543139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.548698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.588414 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 704/1404] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Oct 31 05:11:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:25.591415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.619947 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 701/1405] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:25 2022] POST /identity/v3/projects => generated 391 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:25.620950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.628154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce082c8-c0e6-4eb0-961c-d869a6ef61a7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.779897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:25.830711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.832199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.838798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.839277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.840593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.843225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4307a5-c2a5-4db4-8210-1e9f1945e198 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.845136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.849736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:25.854022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.855064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.855543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.856283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.857366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.860454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.877957 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 705/1406] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:25.883072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.890426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:25.905666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622841b-c69f-4960-bde3-4c181e54475f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:25.910816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:25.911665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:25.912196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:25.912574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] PATH_INFO: `/v3/projects/6f0501c716ae44e48cc0c36480eddd4e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:25.914366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0501c716ae44e48cc0c36480eddd4e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:25.916179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:25.918479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 702/1407] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:25 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:25.926473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:25.944100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.031724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0501c716ae44e48cc0c36480eddd4e', 'request_id': 'req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:26.048168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0501c716ae44e48cc0c36480eddd4e', 'request_id': 'req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:26.065370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0501c716ae44e48cc0c36480eddd4e', 'request_id': 'req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:26.095782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] The token cache is being invalidate because project 6f0501c716ae44e48cc0c36480eddd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:26.096156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:26.102133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:26.115295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 706/1408] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:25 2022] DELETE /identity/v3/projects/6f0501c716ae44e48cc0c36480eddd4e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:26.117257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:26.122760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.170399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ea55a-6454-412d-ac30-e061733cf061 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:26.311874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0998d-8aea-4f8a-a596-47db2ab1b5ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:26.328435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:26.338449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.338449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.338449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.338449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:26.338449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:26.406247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:26.407749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.408033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.409833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.415901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.420687 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 707/1409] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:26 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:26.420687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:26.424391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.440736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:26.442281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:26.466374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291cfe5-38ff-4be7-9018-1e7231823e5d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:26.472040 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 703/1410] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:26.490530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:26.493992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.495086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:26.495821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.496106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.496465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] PATH_INFO: `/v3/projects/d0b208b5920a4ddcb3a200cdbd6fa6f7/users/06e506f335f845a18332a4cd5047f3d4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.551281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cca7a-3e1c-4340-9baf-b185ff1c1076 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:26.560776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b208b5920a4ddcb3a200cdbd6fa6f7, user_id=06e506f335f845a18332a4cd5047f3d4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:26.572293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:26.575196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:26.575839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.576182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.576463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.577175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:26.585122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:26.618375 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 708/1411] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:26 2022] PUT /identity/v3/projects/d0b208b5920a4ddcb3a200cdbd6fa6f7/users/06e506f335f845a18332a4cd5047f3d4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:26.622759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:26.626691 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 704/1412] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:26.630613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.633376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:26.667717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afebc13-db69-4f36-853e-4f3d6b9f1c2b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:26.799536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:26.855629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94725-cb88-46b8-8cac-c8395ec570e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:26.867194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac384-36c7-4d4d-a610-387783e20091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:26.868117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac384-36c7-4d4d-a610-387783e20091 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.868402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac384-36c7-4d4d-a610-387783e20091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.868736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac384-36c7-4d4d-a610-387783e20091 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.869525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac384-36c7-4d4d-a610-387783e20091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:26.873321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac384-36c7-4d4d-a610-387783e20091 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:26.875365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:26.876817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.877119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.878035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] PATH_INFO: `/v3/users/1fd6c923d09d41299141073bad789f65` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.878716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd6c923d09d41299141073bad789f65)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:26.883717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:26.902670 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 705/1413] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:26.906545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:26.906892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:26.907175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:26.958310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:26.960855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:26.990880 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 706/1414] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:26.995079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:27.004239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd6c923d09d41299141073bad789f65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:27.028020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd6c923d09d41299141073bad789f65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:27.028911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4f7ee-b8ea-44a1-88ca-3b6e51ac5976 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:27.029686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd6c923d09d41299141073bad789f65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:27.030664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd6c923d09d41299141073bad789f65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:27.044707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:27.047944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.048784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd6c923d09d41299141073bad789f65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:27.049818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.050965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.052408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:27.059828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:27.096242 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 707/1415] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:27.100264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:27.105010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:27.113522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 709/1416] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:26 2022] DELETE /identity/v3/users/1fd6c923d09d41299141073bad789f65 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:27.117287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:27.135067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:27.146105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:27.176972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbff2d2-7b16-4a00-bd54-b05034dbae16 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:27.313779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08286f2-3971-46e8-9f90-c9d17c79c5d6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:27.318862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:27.320479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.320984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.321488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.323643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:27.444068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:27.445271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.445635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.445914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.446612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:27.455600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:27.481022 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 708/1417] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:27.495418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:27.499016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:27.538052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca53c3-469d-4cc5-b002-79f4ec8be23d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:27.551638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:27.557327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54492bc-b5bc-464b-9142-c5a376a361b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:27.558068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:27.558293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54492bc-b5bc-464b-9142-c5a376a361b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.558574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54492bc-b5bc-464b-9142-c5a376a361b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.559147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54492bc-b5bc-464b-9142-c5a376a361b7 admin admin] PATH_INFO: `/v3/projects/8647f078c9f54cf39dca1c04ae6e1811/users/7ced1f2e8e6d40b8bc71c97300daef3d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.589934 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 710/1418] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:27.591964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:27.596924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54492bc-b5bc-464b-9142-c5a376a361b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8647f078c9f54cf39dca1c04ae6e1811, user_id=7ced1f2e8e6d40b8bc71c97300daef3d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:27.602727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54492bc-b5bc-464b-9142-c5a376a361b7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:27.631249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 709/1419] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:27 2022] PUT /identity/v3/projects/8647f078c9f54cf39dca1c04ae6e1811/users/7ced1f2e8e6d40b8bc71c97300daef3d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:27.631854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f115-59ea-44de-908b-bc2f38b041ae service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:27.642670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.643043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.643275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.670107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:27.750802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] MFA Rules not processed for user `7ced1f2e8e6d40b8bc71c97300daef3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:27.752046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:27.802264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbd493-413f-4338-ade1-356201624460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:27.802974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbd493-413f-4338-ade1-356201624460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.807563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbd493-413f-4338-ade1-356201624460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.808744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbd493-413f-4338-ade1-356201624460 admin admin] PATH_INFO: `/v3/projects/f4534bc77cc441b6862b4769cbe8c5ef/users/aeff55afa67b4aa9826ba52d775c35f8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.881028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbd493-413f-4338-ade1-356201624460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4534bc77cc441b6862b4769cbe8c5ef, user_id=aeff55afa67b4aa9826ba52d775c35f8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:27.890823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbd493-413f-4338-ade1-356201624460 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:27.924067 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 710/1420] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:27.928445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:27.953862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 711/1421] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:27 2022] PUT /identity/v3/projects/f4534bc77cc441b6862b4769cbe8c5ef/users/aeff55afa67b4aa9826ba52d775c35f8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:27.958624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:27.958931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:27.959230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:27.973391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c50d-cdf9-4248-9868-6638ed210ff1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.017695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] MFA Rules not processed for user `aeff55afa67b4aa9826ba52d775c35f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:28.021714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:28.137004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.140600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.141179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.141616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.143429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.151079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.176451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:28.177717 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 712/1422] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:28.182757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.207263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2c8b0-caa2-44da-a281-e223e3bbd24f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.216328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.216980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.217496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.217496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.218337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.220309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.238059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 711/1423] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:27 2022] POST /identity/v3/projects => generated 373 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:28.238810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.478988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc6e18-9888-4ba6-97c2-50b4e1f4524b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.501521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.503862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.504166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.504450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.505108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.512900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.593819 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 712/1424] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:28 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:28.595787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.636584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479609-78fe-43e1-8b39-e3690e33bac5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.643892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.644743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.645108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.645473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.646630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.649262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.674281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 713/1425] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:28.675314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.696264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980a36c-955e-4759-aac3-8e4da1feb618 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.703109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.704163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.704617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.704950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] PATH_INFO: `/v3/projects/6d35a9f04a38431abc6b1b8e7c8cd74c/users/a2eb97a92a7040b78f1e49a3a23976c2/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.750878 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 713/1426] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:28 2022] POST /identity/v3/projects => generated 393 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:11:28.755197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.760662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d35a9f04a38431abc6b1b8e7c8cd74c, user_id=a2eb97a92a7040b78f1e49a3a23976c2, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.764617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.808585 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 714/1427] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:28 2022] PUT /identity/v3/projects/6d35a9f04a38431abc6b1b8e7c8cd74c/users/a2eb97a92a7040b78f1e49a3a23976c2/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:28.809882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.894342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4a2ea-f111-49ca-887d-83507f9ab9cc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.903743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.905265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.905655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.906040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.906959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.909387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.925384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5b1bd-5ca9-42f3-a67d-fa8e9e006e9e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.928068 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 715/1428] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:28.933962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:28.947567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.948442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.948887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.949301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.953880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02c5b-f718-435f-b6f4-a81e13f743d0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:28.958012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.961776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.961935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e43e-29c7-4321-b7fd-07872da51d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:28.963716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e43e-29c7-4321-b7fd-07872da51d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:28.964387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e43e-29c7-4321-b7fd-07872da51d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:28.965833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e43e-29c7-4321-b7fd-07872da51d79 admin admin] PATH_INFO: `/v3/projects/6d35a9f04a38431abc6b1b8e7c8cd74c/users/a2eb97a92a7040b78f1e49a3a23976c2/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:28.969939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2e43e-29c7-4321-b7fd-07872da51d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d35a9f04a38431abc6b1b8e7c8cd74c, user_id=a2eb97a92a7040b78f1e49a3a23976c2, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:28.981604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2e43e-29c7-4321-b7fd-07872da51d79 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:28.993601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:29.023430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 714/1430] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:28 2022] POST /identity/v3/users => generated 303 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:29.023430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.028531 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 716/1430] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:28 2022] PUT /identity/v3/projects/6d35a9f04a38431abc6b1b8e7c8cd74c/users/a2eb97a92a7040b78f1e49a3a23976c2/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:29.030753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.031540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.032090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.040007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a020-a16a-4fb7-af14-5f65b32b78ca admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.155275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] MFA Rules not processed for user `a2eb97a92a7040b78f1e49a3a23976c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:29.156739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:29.223226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:29.337882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.339407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.339908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.340389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.341268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.345646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.396670 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 715/1431] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:29.400345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.429461 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 717/1432] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:29.436560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.450557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbac9-f5b3-4615-a9e5-b9079084602f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.450739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd824c-4994-4a67-a4d5-4898b2825724 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.464564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.465207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.465410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.465542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.465754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.466129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.466488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:29.466604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.466778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.468473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.470346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] PATH_INFO: `/v3/projects/b9286cb696384183954fb54970688928/users/ffb4d29b2c6b4659b7a9b0c175bbf72c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.489279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 718/1433] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:29.495312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.523068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9f0a-6515-49af-ad91-1fa3fefb6202 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.524181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9286cb696384183954fb54970688928, user_id=ffb4d29b2c6b4659b7a9b0c175bbf72c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.529632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.543572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.544451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.544633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.544827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.545490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.548314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.565421 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 716/1434] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:29 2022] PUT /identity/v3/projects/b9286cb696384183954fb54970688928/users/ffb4d29b2c6b4659b7a9b0c175bbf72c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:29.569590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.626783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 719/1435] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:29 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:29.630291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.684929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099531e-7d26-4bb1-b3e3-b31eaad0c174 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.806238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8720cc4-c542-43e9-86fc-5709c6503579 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.812619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.813350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.813621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.813970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.814707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:29.815058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.816721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.828569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.830518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.830845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.831105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.834045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.835871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.850044 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 720/1436] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:29.865053 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 717/1437] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:11:29.870979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.881997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.886940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:29.914371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7439a-8ad6-4c8b-8001-37d51b03d33e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.914371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:29.914371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:29.914823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:29.914823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] PATH_INFO: `/v3/projects/b9286cb696384183954fb54970688928/users/ffb4d29b2c6b4659b7a9b0c175bbf72c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:29.916491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9286cb696384183954fb54970688928, user_id=ffb4d29b2c6b4659b7a9b0c175bbf72c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:29.924747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:29.935768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816a3e3-3a85-4692-8a7e-3d848b2d5ede admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:29.942484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:29.953710 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 721/1438] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:29 2022] PUT /identity/v3/projects/b9286cb696384183954fb54970688928/users/ffb4d29b2c6b4659b7a9b0c175bbf72c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:29.953710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:29.958735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:30.057912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:30.058990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.059378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.059749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] PATH_INFO: `/v3/projects/e7dd666782c548be8123f1b8ee261a4a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.062233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7dd666782c548be8123f1b8ee261a4a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:30.064922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:30.177085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7dd666782c548be8123f1b8ee261a4a', 'request_id': 'req-fbf69163-b89f-4681-824e-324aaa30b379'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.201457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7dd666782c548be8123f1b8ee261a4a', 'request_id': 'req-fbf69163-b89f-4681-824e-324aaa30b379'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.222519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7dd666782c548be8123f1b8ee261a4a', 'request_id': 'req-fbf69163-b89f-4681-824e-324aaa30b379'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.240501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:30.247543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] The token cache is being invalidate because project e7dd666782c548be8123f1b8ee261a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:30.247849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.249271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf69163-b89f-4681-824e-324aaa30b379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.262607 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 718/1439] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:29 2022] DELETE /identity/v3/projects/e7dd666782c548be8123f1b8ee261a4a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:30.262916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad53e-9bcd-4974-92ef-5afb1a4cdb12 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.263177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad53e-9bcd-4974-92ef-5afb1a4cdb12 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.265900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad53e-9bcd-4974-92ef-5afb1a4cdb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.352565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1d7f-bf14-4308-82cf-a254058bcfc6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:30.356976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cbcad53e-9bcd-4974-92ef-5afb1a4cdb12 None None] MFA Rules not processed for user `ffb4d29b2c6b4659b7a9b0c175bbf72c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:30.358270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cbcad53e-9bcd-4974-92ef-5afb1a4cdb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:30.474448 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 719/1440] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:30.487300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.487775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.488227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.515215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:30.516733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:30.550480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:30.648429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:30.649673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.649960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.650349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.658605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:30.664394 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 720/1441] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:30.665385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:30.673738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:30.701644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707601-c7a6-4bb3-b266-53f934cd58e1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:30.716089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:30.718313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.719594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.721376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] PATH_INFO: `/v3/users/aeff55afa67b4aa9826ba52d775c35f8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.723919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeff55afa67b4aa9826ba52d775c35f8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:30.728637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:30.835574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:30.837414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf593ab-596c-4903-92b4-81017476cd78 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:30.875878 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 722/1442] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 928 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:30.876995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeff55afa67b4aa9826ba52d775c35f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.883531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd4a7-0988-4a75-a821-9bff95053501 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.884129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd4a7-0988-4a75-a821-9bff95053501 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.886799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd4a7-0988-4a75-a821-9bff95053501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.901286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeff55afa67b4aa9826ba52d775c35f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.902124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeff55afa67b4aa9826ba52d775c35f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.903676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeff55afa67b4aa9826ba52d775c35f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.940412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeff55afa67b4aa9826ba52d775c35f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:30.943566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-172bd4a7-0988-4a75-a821-9bff95053501 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:30.945164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-172bd4a7-0988-4a75-a821-9bff95053501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:30.971406 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 723/1443] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:30.972955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a945-0a54-4c2c-aa8a-ee3df0c88d36 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:30.973253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a945-0a54-4c2c-aa8a-ee3df0c88d36 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:30.973551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071a945-0a54-4c2c-aa8a-ee3df0c88d36 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:30.978770 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 724/1444] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:30.979766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a945-0a54-4c2c-aa8a-ee3df0c88d36 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:31.014580 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 721/1445] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:30 2022] DELETE /identity/v3/users/aeff55afa67b4aa9826ba52d775c35f8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:31.014580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:31.018598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:31.024416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071a945-0a54-4c2c-aa8a-ee3df0c88d36 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:31.208450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:31.220882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.221274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.221567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.222301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:31.222612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:31.224267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12448-c085-4589-9014-3854d686e8f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:31.277696 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 725/1446] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:31.279158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.279493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.288400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.360378 n-d-862355-5 devstack@keystone.service[81999]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 31 05:11:31.360744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:31.363204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:31.415072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:31.425595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:31.449300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:31.459304 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 726/1447] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:31.463428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:31.509456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560c75-51c4-4383-8f1a-94d863da068e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:31.538423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:31.543283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.543817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.544250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.545127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:31.548794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:31.560260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:31.571711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb3af-2bdb-40c6-8249-83c10bef4e52 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:31.578827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:31.579784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.581033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.581538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/projects/c2670dc430024fa2a8c00c462f000d52` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.583391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2670dc430024fa2a8c00c462f000d52)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:31.585985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:31.589243 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 722/1448] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:31 2022] GET /identity/v3/projects/c2670dc430024fa2a8c00c462f000d52 => generated 371 bytes in 582 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:31.627664 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 727/1449] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:31 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:31.633309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:31.656010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8da06-5067-4cb8-af19-8e4ebdaacf9d tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:31.738401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec42bf1-4d48-47a4-9ac4-46b1ca312748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:31.739032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec42bf1-4d48-47a4-9ac4-46b1ca312748 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.739315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec42bf1-4d48-47a4-9ac4-46b1ca312748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.739587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec42bf1-4d48-47a4-9ac4-46b1ca312748 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.740241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec42bf1-4d48-47a4-9ac4-46b1ca312748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:31.743206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec42bf1-4d48-47a4-9ac4-46b1ca312748 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:31.774704 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 723/1450] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:31 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:11:31.779165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:31.801374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1ecc-cd1c-417a-aff2-008e6aa8866f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:31.806110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c2d8-0c5f-4a2d-9f9d-3cc96fc95927 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.806325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c2d8-0c5f-4a2d-9f9d-3cc96fc95927 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.806525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c2d8-0c5f-4a2d-9f9d-3cc96fc95927 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.809342 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 724/1451] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:31.810400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c2d8-0c5f-4a2d-9f9d-3cc96fc95927 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:31.815049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1586c2d8-0c5f-4a2d-9f9d-3cc96fc95927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:31.828614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e63c5-264d-4efd-929c-a16ef8af9f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:31.831765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e63c5-264d-4efd-929c-a16ef8af9f47 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.837992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e63c5-264d-4efd-929c-a16ef8af9f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.838170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e63c5-264d-4efd-929c-a16ef8af9f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.842553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e63c5-264d-4efd-929c-a16ef8af9f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:31.851990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e63c5-264d-4efd-929c-a16ef8af9f47 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:31.907553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 728/1452] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:31.914294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350139b-51ac-4c8d-85cd-65b8dd1765ae None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:31.916085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350139b-51ac-4c8d-85cd-65b8dd1765ae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:31.916848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350139b-51ac-4c8d-85cd-65b8dd1765ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:31.982957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7350139b-51ac-4c8d-85cd-65b8dd1765ae None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:31.987098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7350139b-51ac-4c8d-85cd-65b8dd1765ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:32.079370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c2d8-0c5f-4a2d-9f9d-3cc96fc95927 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:32.093111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:32.093779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.094063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.094461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.119987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:32.121560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:32.148207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 725/1453] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:32.148983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.180709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbac8-bdec-4e6a-aaf2-8d98cbfe4676 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:32.205268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:32.206014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.206349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.206623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.207276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:32.228604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:32.229249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 729/1454] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:11:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:32.235040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad971-76fc-46fb-827e-6c5b5abde70b None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.235388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad971-76fc-46fb-827e-6c5b5abde70b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.235725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad971-76fc-46fb-827e-6c5b5abde70b None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.237929 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 730/1455] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:11:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:32.245850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7645-721f-4ff8-b88f-a80665861dfc None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.246982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7645-721f-4ff8-b88f-a80665861dfc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.247134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7645-721f-4ff8-b88f-a80665861dfc None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.248906 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 731/1456] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:32.251830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.252164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.252722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.270929 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 726/1457] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:32.277582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.312554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab420c-4530-4ef9-91d4-b919fd70cc5a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:32.321841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:32.323892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ff52-11df-4586-ad0f-14676fec39fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:32.324600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ff52-11df-4586-ad0f-14676fec39fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.324874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ff52-11df-4586-ad0f-14676fec39fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.325146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ff52-11df-4586-ad0f-14676fec39fa admin admin] PATH_INFO: `/v3/projects/14008a81d2cd49be92ac560856c095ff/users/7ed5efb1ef654c409f17d56c8b380311/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.326847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:32.351190 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 732/1458] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:11:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:32.353139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:32.355465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:32.363758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ff52-11df-4586-ad0f-14676fec39fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=14008a81d2cd49be92ac560856c095ff, user_id=7ed5efb1ef654c409f17d56c8b380311, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:32.373209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ff52-11df-4586-ad0f-14676fec39fa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:32.385221 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 31 05:11:32.385530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.393794 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 727/1459] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:32 2022] PUT /identity/v3/projects/14008a81d2cd49be92ac560856c095ff/users/7ed5efb1ef654c409f17d56c8b380311/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:32.406368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.406747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.407075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.450459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] MFA Rules not processed for user `7ed5efb1ef654c409f17d56c8b380311`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:32.451916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:32.492273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:32.502337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418e318-0a17-4efa-b35f-f6d6ff920d9a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:32.625311 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 728/1460] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:32.629926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.650765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:32.651572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.651859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.652142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/projects/c2670dc430024fa2a8c00c462f000d52` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.654028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2670dc430024fa2a8c00c462f000d52)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:32.656873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:32.670637 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 733/1461] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:32 2022] GET /identity/v3/projects/c2670dc430024fa2a8c00c462f000d52 => generated 371 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:32.779253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b592c-86c6-4b66-9a99-9d6597857d5c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:32.794356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:32.795002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.795346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.795695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.796420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:32.800556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:32.805748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.825523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79683d-8977-401e-b44b-6aa32913c654 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:32.847666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:32.848654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:32.849208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:32.849661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:32.852297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:32.853676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:32.857757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:32.863941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:32.869180 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 729/1462] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:32 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:32.869180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.905874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 734/1463] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:32.907110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:32.956721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8dac6-c996-4789-b9ba-9fd469d06026 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.106052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6312d-63d4-46f3-b4e5-877043eba4b7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.120586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.122706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.125468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.125867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.132252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.133062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.133368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.133628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.134617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.138220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.150565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.153171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.186400 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 730/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:33.188364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.211078 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 735/1465] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:32 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:33.216048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.270007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c8df7-b624-4009-8f82-9674f3a52d52 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.295296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.296256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.296913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.297425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.299824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:33.335849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.338961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.389564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35d3cf-01f4-4271-885f-ad36c1dfa7b8 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.401895 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 736/1466] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:33.402792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.403538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.403901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.404063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.404440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.405192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.409734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.449617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dee82-232c-462c-bd8c-35b0a76073f0 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.455394 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 731/1467] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:33 2022] POST /identity/v3/users => generated 381 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:33.459449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.476516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502312d-bc32-4b5a-9614-f9b4ffdcfcef tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.484593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.484823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.485237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.485524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.485971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.488874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.489358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.490377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.491272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:33.492970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.493796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.494790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.511333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48794-ec7d-4431-b174-4533a8d4608f tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.551549 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 737/1468] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:33.552532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.562318 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 732/1469] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:33.584883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938694-36d3-40d3-8234-a4ee42cddb88 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.606349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.607050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.607335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.607615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] PATH_INFO: `/v3/projects/8ae723abcb554e6fac4902aaee16841d/users/7220fface4e64d929d0aa9bfa8b219a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.672649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae723abcb554e6fac4902aaee16841d, user_id=7220fface4e64d929d0aa9bfa8b219a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.676689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.685590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6419-b7f7-4779-9072-a882daa012ee None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.686197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6419-b7f7-4779-9072-a882daa012ee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.686577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6419-b7f7-4779-9072-a882daa012ee None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.688503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 733/1470] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:11:33.695682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6419-b7f7-4779-9072-a882daa012ee None None] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:33.722488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6419-b7f7-4779-9072-a882daa012ee None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.737351 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 738/1471] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:33 2022] PUT /identity/v3/projects/8ae723abcb554e6fac4902aaee16841d/users/7220fface4e64d929d0aa9bfa8b219a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:33.739713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.746717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6419-b7f7-4779-9072-a882daa012ee None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.877576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.878421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.878545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.878800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/projects/c2670dc430024fa2a8c00c462f000d52` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.880184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2670dc430024fa2a8c00c462f000d52)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.885232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.890701 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 734/1472] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:33 2022] GET /identity/v3/projects/c2670dc430024fa2a8c00c462f000d52 => generated 371 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:33.926352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6eb5a-c861-468f-8b3a-8b4ea4ade16f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:33.933751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8f4b-c8aa-4d48-a909-c9cc07c6c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:33.934558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8f4b-c8aa-4d48-a909-c9cc07c6c27e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:33.934942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8f4b-c8aa-4d48-a909-c9cc07c6c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:33.936501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8f4b-c8aa-4d48-a909-c9cc07c6c27e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:33.938257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8f4b-c8aa-4d48-a909-c9cc07c6c27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:33.945081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8f4b-c8aa-4d48-a909-c9cc07c6c27e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:33.970952 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 739/1473] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:33.975869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:33.994817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdc962-9092-42c9-88f2-10b4ac2a5610 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:34.009590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f033eb-e19c-410a-8497-7c30742de3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:34.010356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f033eb-e19c-410a-8497-7c30742de3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:34.010643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f033eb-e19c-410a-8497-7c30742de3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:34.010925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f033eb-e19c-410a-8497-7c30742de3c6 admin admin] PATH_INFO: `/v3/projects/8ae723abcb554e6fac4902aaee16841d/users/7220fface4e64d929d0aa9bfa8b219a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:34.014931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f033eb-e19c-410a-8497-7c30742de3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae723abcb554e6fac4902aaee16841d, user_id=7220fface4e64d929d0aa9bfa8b219a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:34.023305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f033eb-e19c-410a-8497-7c30742de3c6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:34.067568 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 735/1474] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:33 2022] PUT /identity/v3/projects/8ae723abcb554e6fac4902aaee16841d/users/7220fface4e64d929d0aa9bfa8b219a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:34.073905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:34.075166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:34.075809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:34.135096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] MFA Rules not processed for user `7220fface4e64d929d0aa9bfa8b219a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:34.136661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:34.180691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:34.257988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97ac18-eec7-4974-ab1f-13a0d23f83a0 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:34.258557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97ac18-eec7-4974-ab1f-13a0d23f83a0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:34.258557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97ac18-eec7-4974-ab1f-13a0d23f83a0 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:34.270232 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 736/1475] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:34.275581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97ac18-eec7-4974-ab1f-13a0d23f83a0 None None] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:34.367985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 740/1476] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:34.502515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97ac18-eec7-4974-ab1f-13a0d23f83a0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:34.548081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:34.617939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97ac18-eec7-4974-ab1f-13a0d23f83a0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:34.623554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:34.624468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:34.624750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:34.625174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/projects/c2670dc430024fa2a8c00c462f000d52` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:34.626685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2670dc430024fa2a8c00c462f000d52)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:34.628868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:34.631181 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 737/1477] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:34 2022] GET /identity/v3/projects/c2670dc430024fa2a8c00c462f000d52 => generated 371 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:34.674304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:34.675711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:34.681954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:34.705099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ba5ab-73ad-4a15-b77e-1a6fe3cf714e tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:34.721058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:34.722529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:34.722936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:34.724173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/users/a53130930daa40cd853c57cd9b090fd1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:34.765301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a53130930daa40cd853c57cd9b090fd1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:34.767305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:34.898286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5becb-d6cf-45c5-9d76-0cc779c685d5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:34.906340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:34.908258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:34.908796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:34.909550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] PATH_INFO: `/v3/projects/f4534bc77cc441b6862b4769cbe8c5ef` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:34.911290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4534bc77cc441b6862b4769cbe8c5ef)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:34.914396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:34.924158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53130930daa40cd853c57cd9b090fd1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:34.938454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53130930daa40cd853c57cd9b090fd1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:34.938454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53130930daa40cd853c57cd9b090fd1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:34.939199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53130930daa40cd853c57cd9b090fd1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:34.953881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53130930daa40cd853c57cd9b090fd1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:34.993313 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 738/1478] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:34 2022] DELETE /identity/v3/users/a53130930daa40cd853c57cd9b090fd1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:11:34.994298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:34.999575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:35.030716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4534bc77cc441b6862b4769cbe8c5ef', 'request_id': 'req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.056428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4534bc77cc441b6862b4769cbe8c5ef', 'request_id': 'req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.099868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4534bc77cc441b6862b4769cbe8c5ef', 'request_id': 'req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.133467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] The token cache is being invalidate because project f4534bc77cc441b6862b4769cbe8c5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:35.133788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.141685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.153334 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 741/1479] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:34 2022] DELETE /identity/v3/projects/f4534bc77cc441b6862b4769cbe8c5ef => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:35.155231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:35.157458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:35.260622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e619a7-8d4b-443e-9696-c016afddfdf6 tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:35.276853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:35.277507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:35.277793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:35.278079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:35.282797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:35.304728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:35.354759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211abf9-5ff3-4b6a-8382-b4e8ec4bb4bc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:35.362540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:35.442918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:35.444951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:35.457339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 739/1480] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:35.468042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:35.474439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:35.494023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2eb97a92a7040b78f1e49a3a23976c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:35.495655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:35.495946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:35.498365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] PATH_INFO: `/v3/projects/c2670dc430024fa2a8c00c462f000d52` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:35.502833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2670dc430024fa2a8c00c462f000d52)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:35.513167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:35.625909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2670dc430024fa2a8c00c462f000d52', 'request_id': 'req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.629057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18690a-e467-4638-8351-d3a0c7f1dd38 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:35.636389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2670dc430024fa2a8c00c462f000d52', 'request_id': 'req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.646863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2670dc430024fa2a8c00c462f000d52', 'request_id': 'req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.672385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] The token cache is being invalidate because project c2670dc430024fa2a8c00c462f000d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:35.672975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.674240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dae1fc6a-e274-4b0f-adc4-0615d9de30aa tempest-QuotasAdminTestV236-892177188 tempest-QuotasAdminTestV236-892177188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.679495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 742/1481] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:35 2022] DELETE /identity/v3/projects/c2670dc430024fa2a8c00c462f000d52 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:35.683554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3652b6c-b58b-4a96-acc7-37f3e30d9a3f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:35.684176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3652b6c-b58b-4a96-acc7-37f3e30d9a3f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:35.684587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3652b6c-b58b-4a96-acc7-37f3e30d9a3f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:35.690520 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 743/1482] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:35.692118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3652b6c-b58b-4a96-acc7-37f3e30d9a3f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:35.699063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a3652b6c-b58b-4a96-acc7-37f3e30d9a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:35.763759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:35.764429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:35.764713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:35.764984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] PATH_INFO: `/v3/users/ffb4d29b2c6b4659b7a9b0c175bbf72c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:35.766209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb4d29b2c6b4659b7a9b0c175bbf72c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:35.768179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:35.894895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3652b6c-b58b-4a96-acc7-37f3e30d9a3f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:35.904290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:35.904967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:35.905251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:35.905528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] PATH_INFO: `/v3/users/7ced1f2e8e6d40b8bc71c97300daef3d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:35.908876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ced1f2e8e6d40b8bc71c97300daef3d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:35.910881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:35.925398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb4d29b2c6b4659b7a9b0c175bbf72c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.941709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb4d29b2c6b4659b7a9b0c175bbf72c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.943592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb4d29b2c6b4659b7a9b0c175bbf72c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.945889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb4d29b2c6b4659b7a9b0c175bbf72c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.968360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb4d29b2c6b4659b7a9b0c175bbf72c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:35.978731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:35.984769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:36.031577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ced1f2e8e6d40b8bc71c97300daef3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:36.033374 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 740/1483] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:35 2022] DELETE /identity/v3/users/ffb4d29b2c6b4659b7a9b0c175bbf72c => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:36.034625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:36.041068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.059727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ced1f2e8e6d40b8bc71c97300daef3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:36.062105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ced1f2e8e6d40b8bc71c97300daef3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:36.064780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ced1f2e8e6d40b8bc71c97300daef3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:36.082059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2341dc4c-03f9-4e93-b5eb-6785f54b1dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ced1f2e8e6d40b8bc71c97300daef3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:36.107495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 744/1484] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:35 2022] DELETE /identity/v3/users/7ced1f2e8e6d40b8bc71c97300daef3d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:36.112442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:36.112753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:36.113023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:36.158084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:36.158834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:36.159361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.160629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.270832 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 745/1485] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:36.285359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a6e2e-db8d-4504-b9cb-7a4ab2dbade8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:36.295736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:36.299273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.399982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581a88-7082-4990-a939-bff7b46d03bf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:36.404836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7220fface4e64d929d0aa9bfa8b219a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ae723abcb554e6fac4902aaee16841d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:36.407376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:36.407810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:36.408229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] PATH_INFO: `/v3/projects/14008a81d2cd49be92ac560856c095ff` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:36.411182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] RBAC: Authorizing `identity:get_project(project_id=14008a81d2cd49be92ac560856c095ff)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:36.416238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:36.416930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db222-5480-4256-a738-a27e39065134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:36.418092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db222-5480-4256-a738-a27e39065134 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:36.418418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db222-5480-4256-a738-a27e39065134 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:36.418698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db222-5480-4256-a738-a27e39065134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:36.421074 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 741/1486] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:36 2022] GET /identity/v3/projects/14008a81d2cd49be92ac560856c095ff => generated 377 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:36.462417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db222-5480-4256-a738-a27e39065134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:36.463912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db222-5480-4256-a738-a27e39065134 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:36.492260 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 746/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:36.500941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:36.503327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.576586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:36.662627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07631585-9927-46bd-98e0-18cd3a4a1dd5 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:36.680425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:36.681073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:36.681353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:36.681633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:36.691811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.827205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:36.828857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:36.848120 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 742/1488] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:36.932440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014738a-ab62-4b83-b9b6-d6eba63bd6fd None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:36.932758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014738a-ab62-4b83-b9b6-d6eba63bd6fd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:36.933043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014738a-ab62-4b83-b9b6-d6eba63bd6fd None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:36.935264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 747/1489] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:36.940067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:36.941911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:36.969147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:36.971470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:37.000918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efe6e-d58c-4d51-b786-4c931484f4c0 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:37.006328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7220fface4e64d929d0aa9bfa8b219a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ae723abcb554e6fac4902aaee16841d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:37.008333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:37.008855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:37.009349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] PATH_INFO: `/v3/projects/14008a81d2cd49be92ac560856c095ff` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:37.011503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] RBAC: Authorizing `identity:get_project(project_id=14008a81d2cd49be92ac560856c095ff)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:37.014364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:37.023134 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 743/1490] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:36 2022] GET /identity/v3/projects/14008a81d2cd49be92ac560856c095ff => generated 377 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:37.230006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014738a-ab62-4b83-b9b6-d6eba63bd6fd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:37.236896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a014738a-ab62-4b83-b9b6-d6eba63bd6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:37.279938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014738a-ab62-4b83-b9b6-d6eba63bd6fd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:37.292914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:37.293685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:37.293980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:37.294869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] PATH_INFO: `/v3/projects/b9286cb696384183954fb54970688928` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:37.296105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9286cb696384183954fb54970688928)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:37.304913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:37.349216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:37.353280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:37.395074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cbd9b-3eb7-44bd-9419-5bea72a85007 tempest-FlavorsAccessTestJSON-605139993 tempest-FlavorsAccessTestJSON-605139993-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:37.426415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:37.427096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:37.427382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:37.427681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] PATH_INFO: `/v3/projects/8647f078c9f54cf39dca1c04ae6e1811` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:37.434388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8647f078c9f54cf39dca1c04ae6e1811)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:37.448027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:37.502659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:37.526159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9286cb696384183954fb54970688928', 'request_id': 'req-f70308b3-e879-4f95-b8d6-d82ff7292c71'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.540839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9286cb696384183954fb54970688928', 'request_id': 'req-f70308b3-e879-4f95-b8d6-d82ff7292c71'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.552231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9286cb696384183954fb54970688928', 'request_id': 'req-f70308b3-e879-4f95-b8d6-d82ff7292c71'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.586850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] The token cache is being invalidate because project b9286cb696384183954fb54970688928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:37.590972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.592307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f70308b3-e879-4f95-b8d6-d82ff7292c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.599260 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 748/1491] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:37 2022] DELETE /identity/v3/projects/b9286cb696384183954fb54970688928 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:37.606951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:37.607823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:37.609286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:37.627207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8647f078c9f54cf39dca1c04ae6e1811', 'request_id': 'req-5fff3ea6-47b5-451a-b842-5a5363b90b87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.650988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8647f078c9f54cf39dca1c04ae6e1811', 'request_id': 'req-5fff3ea6-47b5-451a-b842-5a5363b90b87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.691213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8647f078c9f54cf39dca1c04ae6e1811', 'request_id': 'req-5fff3ea6-47b5-451a-b842-5a5363b90b87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.713689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:37.715435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:37.728266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] The token cache is being invalidate because project 8647f078c9f54cf39dca1c04ae6e1811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:37.728967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.731567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:37.739830 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 744/1492] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:37 2022] DELETE /identity/v3/projects/8647f078c9f54cf39dca1c04ae6e1811 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:37.741096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:37.744896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:37.852258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:37.855170 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 749/1493] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:37.857409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:37.862655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:37.900003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3ea6-47b5-451a-b842-5a5363b90b87 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:37.909685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda891c9-06d1-4d73-9e41-09d83b37750d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:37.916686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:37.918874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:37.920725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:37.921639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] PATH_INFO: `/v3/users/7ed5efb1ef654c409f17d56c8b380311` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:37.924777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed5efb1ef654c409f17d56c8b380311)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:37.929107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:37.930026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:37.931434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:37.932591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] PATH_INFO: `/v3/users/a2eb97a92a7040b78f1e49a3a23976c2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:37.934381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2eb97a92a7040b78f1e49a3a23976c2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:37.940801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:37.942185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.037520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2eb97a92a7040b78f1e49a3a23976c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.064242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2eb97a92a7040b78f1e49a3a23976c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.065724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2eb97a92a7040b78f1e49a3a23976c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.066610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2eb97a92a7040b78f1e49a3a23976c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.084119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1075ab9-35db-4b66-a233-6fcbed09e38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2eb97a92a7040b78f1e49a3a23976c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.090208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed5efb1ef654c409f17d56c8b380311'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.107076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed5efb1ef654c409f17d56c8b380311'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.107810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed5efb1ef654c409f17d56c8b380311'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.108534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed5efb1ef654c409f17d56c8b380311'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.121562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 750/1494] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:37 2022] DELETE /identity/v3/users/a2eb97a92a7040b78f1e49a3a23976c2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:38.122948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.123247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.123523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.126295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66b995a3-cbd1-4eb8-a535-3a63cdde251d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed5efb1ef654c409f17d56c8b380311'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:38.158868 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 745/1495] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:37 2022] DELETE /identity/v3/users/7ed5efb1ef654c409f17d56c8b380311 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:38.163572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.164752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.165039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.169930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:38.171233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:38.212019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:38.213555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:38.236752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:38.294616 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 751/1496] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:38.296208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.318695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04c23-d337-4deb-8685-4195978388a4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.332473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.333246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.334326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.334735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.337235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:38.339328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.341116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.375090 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 752/1497] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:38.379769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.380824 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 746/1498] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:38.393644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a62021-e9ea-461d-b50c-75e9b53a180c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.400582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.402006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.402581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.402997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.403795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.406237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.417331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.420214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:38.446962 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 753/1499] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:38 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:38.448702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.529025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5ea8-e5e9-4e8f-b8d3-9105463d3933 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.599704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:38.623875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2d96-3d7f-4244-ad10-286d1f07f102 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.635068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.636244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.637036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.637459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.638662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.641537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.679057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.679747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 754/1500] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:38 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:38.681138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.682001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.682459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.683185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.696477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562dc4a-d1a7-40f2-8599-ad685b190305 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.699434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.701451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.702811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.703482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.703818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.704094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.704787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.706525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.721925 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 755/1501] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:38.722871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.733406 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 747/1502] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:38.734631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918f06-2a69-4795-97d8-b4877c19a5df admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.739998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24a54-ec0e-4443-ab43-820b7df83213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.740770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24a54-ec0e-4443-ab43-820b7df83213 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.741857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24a54-ec0e-4443-ab43-820b7df83213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.741857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24a54-ec0e-4443-ab43-820b7df83213 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.742632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24a54-ec0e-4443-ab43-820b7df83213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.744262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24a54-ec0e-4443-ab43-820b7df83213 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.760964 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 756/1503] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:38.761898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:38.772022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dbcf1-5de0-4785-92a4-25b30519964d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:38.780143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:38.781201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.781558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.781914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] PATH_INFO: `/v3/projects/c7e5fd9541884c53ae7ec145212da2cb/users/d5e7ad7c522a4c4491edad3c635214f8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.829139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e5fd9541884c53ae7ec145212da2cb, user_id=d5e7ad7c522a4c4491edad3c635214f8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:38.834106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:38.868741 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 748/1504] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:38 2022] PUT /identity/v3/projects/c7e5fd9541884c53ae7ec145212da2cb/users/d5e7ad7c522a4c4491edad3c635214f8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:38.871543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:38.872236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:38.872728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:38.920499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] MFA Rules not processed for user `d5e7ad7c522a4c4491edad3c635214f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:38.922221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:39.052905 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 757/1505] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:39.058815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.210775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c7da-162d-4638-a77f-0dff6cadbf6e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:39.223055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:39.224185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:39.224575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:39.224894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:39.225643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:39.228311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:39.242327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.245025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:39.268689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:39.278277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fea04-7bbe-4612-bfc4-21304cf9aa50 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:39.285766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:39.286685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:39.287028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:39.287239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] PATH_INFO: `/v3/projects/14008a81d2cd49be92ac560856c095ff` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:39.289079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14008a81d2cd49be92ac560856c095ff)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:39.292956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:39.310105 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 749/1506] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:39.311575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.401517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14008a81d2cd49be92ac560856c095ff', 'request_id': 'req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.412061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14008a81d2cd49be92ac560856c095ff', 'request_id': 'req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.425661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14008a81d2cd49be92ac560856c095ff', 'request_id': 'req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.432474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3b6d-0f35-424c-afc9-f63c7d61c7f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:39.457862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] The token cache is being invalidate because project 14008a81d2cd49be92ac560856c095ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:39.458578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.459274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.461784 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 758/1507] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:39 2022] DELETE /identity/v3/projects/14008a81d2cd49be92ac560856c095ff => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:39.466264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.468008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:39.472494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:39.517241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:39.517881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:39.518178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:39.518854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:39.521068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:39.523598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:39.558864 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 750/1508] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:39 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:39.560764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.564388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:39.597092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a253-e895-4a56-90ea-e3df204f3b3b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:39.598990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7d12c-c8e7-4213-a5ff-df28a52d5f27 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:39.606437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:39.607367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:39.607767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:39.608162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:39.609007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:39.610772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:39.610928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:39.611915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:39.612268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:39.612612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] PATH_INFO: `/v3/users/7220fface4e64d929d0aa9bfa8b219a3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:39.613930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7220fface4e64d929d0aa9bfa8b219a3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:39.616055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:39.628801 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 751/1509] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:39.633704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.656797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca081e8-e864-465a-ac8b-3a5c97e0482e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:39.669727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:39.670962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:39.674286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:39.674793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] PATH_INFO: `/v3/projects/378a31b6eab7460ab871df9c3787b13c/users/2b7c1fcd20274fb98a31af38b85c553e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:39.717982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378a31b6eab7460ab871df9c3787b13c, user_id=2b7c1fcd20274fb98a31af38b85c553e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:39.722097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:39.728319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7220fface4e64d929d0aa9bfa8b219a3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.749520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7220fface4e64d929d0aa9bfa8b219a3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.750227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 752/1510] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:39 2022] PUT /identity/v3/projects/378a31b6eab7460ab871df9c3787b13c/users/2b7c1fcd20274fb98a31af38b85c553e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:39.751220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7220fface4e64d929d0aa9bfa8b219a3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.752292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7220fface4e64d929d0aa9bfa8b219a3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.754028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.755988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:39.764845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7220fface4e64d929d0aa9bfa8b219a3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:39.796647 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 759/1511] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:39 2022] DELETE /identity/v3/users/7220fface4e64d929d0aa9bfa8b219a3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:39.814275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:39.816600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:39.841000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:39.992331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34bba8-e7b8-4aef-91dc-98fa66e36ea8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.041982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809bc26-c904-4b90-8b3d-bb05b222954d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.052247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.052933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.053279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.053567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] PATH_INFO: `/v3/projects/6d35a9f04a38431abc6b1b8e7c8cd74c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.055624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d35a9f04a38431abc6b1b8e7c8cd74c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:40.057631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:40.123358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.123358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.123836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.123927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.124828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:40.127460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:40.150467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 753/1512] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:40.151861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:40.167033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53b93-3d17-48ec-873a-56b352998e44 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.168291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'request_id': 'req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.184106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'request_id': 'req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.195232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d35a9f04a38431abc6b1b8e7c8cd74c', 'request_id': 'req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.209429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:40.226513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] The token cache is being invalidate because project 6d35a9f04a38431abc6b1b8e7c8cd74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:40.227037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.227871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2be9c1d2-8bf1-47c9-810e-9272ac29dd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.235079 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 760/1513] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:39 2022] DELETE /identity/v3/projects/6d35a9f04a38431abc6b1b8e7c8cd74c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:40.237708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede586dd-e694-4e00-bd1c-e71c22bd1506 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.238115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede586dd-e694-4e00-bd1c-e71c22bd1506 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.238563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede586dd-e694-4e00-bd1c-e71c22bd1506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.267624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094ebf-c750-4ae4-8533-8ea2ab11a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.268331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094ebf-c750-4ae4-8533-8ea2ab11a9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.268622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094ebf-c750-4ae4-8533-8ea2ab11a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.268903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094ebf-c750-4ae4-8533-8ea2ab11a9bf admin admin] PATH_INFO: `/v3/projects/378a31b6eab7460ab871df9c3787b13c/users/2b7c1fcd20274fb98a31af38b85c553e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.273400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094ebf-c750-4ae4-8533-8ea2ab11a9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=378a31b6eab7460ab871df9c3787b13c, user_id=2b7c1fcd20274fb98a31af38b85c553e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:40.280816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094ebf-c750-4ae4-8533-8ea2ab11a9bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:40.280994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ede586dd-e694-4e00-bd1c-e71c22bd1506 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:40.282558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ede586dd-e694-4e00-bd1c-e71c22bd1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.309274 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 754/1514] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:40 2022] PUT /identity/v3/projects/378a31b6eab7460ab871df9c3787b13c/users/2b7c1fcd20274fb98a31af38b85c553e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:11:40.316506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.316899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.317061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.322650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 761/1515] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:40.327019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.327380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.327723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.364241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:40.365537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.398478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] MFA Rules not processed for user `2b7c1fcd20274fb98a31af38b85c553e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:40.400048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.490310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 755/1516] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:40.492347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:40.493841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.509444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fd42f-d558-451a-bcfd-a294ac0d49f2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.515848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.516838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.517274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.517694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] PATH_INFO: `/v3/projects/8ae723abcb554e6fac4902aaee16841d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.519350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae723abcb554e6fac4902aaee16841d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:40.521800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:40.571362 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 762/1517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:40.572284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:40.584183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfc680-d923-4a05-95d7-c381d748532c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.590920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.591834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.591834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.592112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.592910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:40.593485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:40.595028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:40.630939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 763/1518] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:40.637073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:40.642797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.649104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae723abcb554e6fac4902aaee16841d', 'request_id': 'req-f9adc80b-3206-4090-8323-88b86ea3a7bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.658816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:40.663382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae723abcb554e6fac4902aaee16841d', 'request_id': 'req-f9adc80b-3206-4090-8323-88b86ea3a7bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.681929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae723abcb554e6fac4902aaee16841d', 'request_id': 'req-f9adc80b-3206-4090-8323-88b86ea3a7bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.705801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] The token cache is being invalidate because project 8ae723abcb554e6fac4902aaee16841d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:40.706098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.706837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:40.709242 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 756/1519] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:40 2022] DELETE /identity/v3/projects/8ae723abcb554e6fac4902aaee16841d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:40.710729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:40.712058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.813722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:40.817199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93e2bd-fefa-4102-94b3-33f959c2e9db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.838084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc80b-3206-4090-8323-88b86ea3a7bb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:40.845254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1028ab-6b2a-4db6-b8c2-5daacbd64324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.846034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1028ab-6b2a-4db6-b8c2-5daacbd64324 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.846245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1028ab-6b2a-4db6-b8c2-5daacbd64324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.846479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1028ab-6b2a-4db6-b8c2-5daacbd64324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.847138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1028ab-6b2a-4db6-b8c2-5daacbd64324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:40.851018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1028ab-6b2a-4db6-b8c2-5daacbd64324 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:40.912780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 757/1520] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:40 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:40.915695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f506ee-fbad-4098-9aac-d45fb30419f8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.916150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f506ee-fbad-4098-9aac-d45fb30419f8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.916833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f506ee-fbad-4098-9aac-d45fb30419f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.940227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d8f506ee-fbad-4098-9aac-d45fb30419f8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:40.941707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d8f506ee-fbad-4098-9aac-d45fb30419f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:40.969760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:40.970712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:40.973034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:40.976423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:40.983502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:41.031913 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 758/1521] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:41.033364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595485-6c3d-4f13-ab9d-e27b047ac77e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.033662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595485-6c3d-4f13-ab9d-e27b047ac77e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.033942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595485-6c3d-4f13-ab9d-e27b047ac77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.123351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-12595485-6c3d-4f13-ab9d-e27b047ac77e None None] MFA Rules not processed for user `97aed18524bd45c0b922286a6373e634`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:41.124930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-12595485-6c3d-4f13-ab9d-e27b047ac77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:41.152931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.153445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.178202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 764/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:41.179772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.205756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694e5c1-5f08-4dbc-817a-4125ca6a0b7e service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.214461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.215533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.216047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.217059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.218320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.222502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.268534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 759/1523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:41.270386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.271088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.271576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.274917 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 765/1524] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:41.275937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.296901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4862c95-42a6-4760-9e43-7edcdcbb9a55 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.299736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:41.302266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:41.304675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.305583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.305985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.306362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.307794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.309326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.319709 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 760/1525] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:41.337355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.339754 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 766/1526] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:41.340691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.348906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:41.355355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39bbe-3c80-4106-a20d-eb6f3951bd88 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.357609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f9ad-6250-4003-be88-503d09dc15d1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.365954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.367585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.368096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.368691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.369553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.371866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.373917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.374594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.374889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.375163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.378984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:41.379312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.383916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.392569 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 767/1527] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:41.393804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.418243 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 761/1528] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:41.423519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.424423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043a88-b695-4889-bd7e-6e72f3b87789 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.444773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470a7f-8e9e-4ebf-a6ac-0a34da59c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.446959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470a7f-8e9e-4ebf-a6ac-0a34da59c318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.448067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470a7f-8e9e-4ebf-a6ac-0a34da59c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.450527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470a7f-8e9e-4ebf-a6ac-0a34da59c318 admin admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c/users/e6b2194b6b1641b8990f5c9064ab31ab/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.450753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3730a58-fc10-47a5-acef-b9220c8fd36b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.464297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.467452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.467750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.468036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.468707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.470708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.498344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470a7f-8e9e-4ebf-a6ac-0a34da59c318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242f6f54ffc646ed8969ab3938b68a8c, user_id=e6b2194b6b1641b8990f5c9064ab31ab, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.507596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470a7f-8e9e-4ebf-a6ac-0a34da59c318 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.541129 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 768/1529] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:41 2022] PUT /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c/users/e6b2194b6b1641b8990f5c9064ab31ab/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:41.556409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.557085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.557649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.569287 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 762/1530] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:41.572004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.627708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:41.643073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] MFA Rules not processed for user `e6b2194b6b1641b8990f5c9064ab31ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:41.653211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:41.740442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d3d8-e97b-4794-a4f4-e2a886ab8f76 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.748693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.749420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.750566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.751113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.751854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.755224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.798115 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 763/1531] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:41.806910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.815337 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 769/1532] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:41.817704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.817921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:41.851326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2a01-6170-4e61-a18c-98cf1bb2301b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.865480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.866384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.866719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.866999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.868234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.869890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.883103 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 770/1533] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:41.883999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.899278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a963f2-a564-4c87-ae1d-21848e88beff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:41.904846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:41.905476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:41.905812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:41.906092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:41.906771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:41.909291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:41.966114 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 771/1534] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:41 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:41.967236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:41.971343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:41.979347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325454de-ae46-4f04-b0e3-1f7e9267432b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.103738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.105582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.105941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.106375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.112473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:42.119607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdf3e1-7070-4875-82e2-ade213180a88 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.138917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.139585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.139866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.140139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] PATH_INFO: `/v3/users/d5e7ad7c522a4c4491edad3c635214f8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.141331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e7ad7c522a4c4491edad3c635214f8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.144358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.242491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:42.261565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:42.293266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e7ad7c522a4c4491edad3c635214f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:42.313507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.316738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.332362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e7ad7c522a4c4491edad3c635214f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:42.338529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e7ad7c522a4c4491edad3c635214f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:42.339270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e7ad7c522a4c4491edad3c635214f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:42.339561 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 764/1535] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:41 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:42.342252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:42.356629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e7ad7c522a4c4491edad3c635214f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:42.366186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250c88f-68a7-428b-a78a-d42e2a63383d service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.386863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.387577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.387851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.388187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.390025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.391147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.395342 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 772/1536] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:41 2022] DELETE /identity/v3/users/d5e7ad7c522a4c4491edad3c635214f8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:42.396078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:42.401495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:42.412094 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 765/1537] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:42.413685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:42.417321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:42.437730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b56c8-fd36-465d-9d98-10c0113bd99a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.574082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.574941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.575228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.575504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.577323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:42.637991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb442c-e89d-4670-bc47-5f888fc4984b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.646544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137b2cd-390b-4151-8432-cc517ed94411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.647489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137b2cd-390b-4151-8432-cc517ed94411 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.647918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137b2cd-390b-4151-8432-cc517ed94411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.648333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137b2cd-390b-4151-8432-cc517ed94411 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.649343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137b2cd-390b-4151-8432-cc517ed94411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.651693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137b2cd-390b-4151-8432-cc517ed94411 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.694696 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 773/1538] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:42 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:42.696388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.696686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.696970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.733604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.735860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.756148 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 766/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:42 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:42.770243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:42.775907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:42.784260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:42.790880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:42.801548 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 774/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:42.802526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:42.829991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd919ae-2277-4727-9e7a-526e1c06358b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.833082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bc3d5-d339-47a3-a484-a6d2b753c53f service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.841747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532783e-6e08-44b9-89ed-91853ef4c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.844239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532783e-6e08-44b9-89ed-91853ef4c5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.844682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532783e-6e08-44b9-89ed-91853ef4c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.845741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532783e-6e08-44b9-89ed-91853ef4c5eb admin admin] PATH_INFO: `/v3/projects/0001564ea5ec49808f59e578f65a290a/users/7eda42fefbba4a6084a3f550d3f1cc64/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.861081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:42.861081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.861081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.861081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:42.862293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.866707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.892248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532783e-6e08-44b9-89ed-91853ef4c5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0001564ea5ec49808f59e578f65a290a, user_id=7eda42fefbba4a6084a3f550d3f1cc64, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:42.902682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532783e-6e08-44b9-89ed-91853ef4c5eb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:42.938129 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 775/1541] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:42.939172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:42.962484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3027b4c-4c9f-469e-9d4b-b86194cf8058 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:42.963696 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 767/1542] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:42 2022] PUT /identity/v3/projects/0001564ea5ec49808f59e578f65a290a/users/7eda42fefbba4a6084a3f550d3f1cc64/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:42.974969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:42.975254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:42.977591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.069130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] MFA Rules not processed for user `7eda42fefbba4a6084a3f550d3f1cc64`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:43.070733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:43.114451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:43.171262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91ab64-4d61-4bd1-9735-d17ffd7f2d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:43.171961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91ab64-4d61-4bd1-9735-d17ffd7f2d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.172247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91ab64-4d61-4bd1-9735-d17ffd7f2d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.172537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91ab64-4d61-4bd1-9735-d17ffd7f2d18 admin admin] PATH_INFO: `/v3/projects/227773d41ee74984b9ccc7a9668057ce/users/9594eab71e254d12910ca1a85fa86fe4/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.186927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 768/1543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:43.188305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.190749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:43.203335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91ab64-4d61-4bd1-9735-d17ffd7f2d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227773d41ee74984b9ccc7a9668057ce, user_id=9594eab71e254d12910ca1a85fa86fe4, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:43.206554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91ab64-4d61-4bd1-9735-d17ffd7f2d18 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:43.224666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:43.233329 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 776/1544] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:42 2022] PUT /identity/v3/projects/227773d41ee74984b9ccc7a9668057ce/users/9594eab71e254d12910ca1a85fa86fe4/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:43.235480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.237775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.238071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.284693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f40ea-2b59-43d6-bc92-b8ba8b2b87ee None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:43.334608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] MFA Rules not processed for user `06e506f335f845a18332a4cd5047f3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:43.337240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:43.387768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:43.388781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.389368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.390238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.449466 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 777/1545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:43.450208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.559358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:43.560855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:43.595217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daad56-2bd2-45be-b4eb-9c32c8cfb994 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:43.601897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:43.602258 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 769/1546] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:43.603126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.603490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.603906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.604670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:43.606675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.607315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:43.639646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729acf7-7d17-4e67-b646-f85a6d85f073 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:43.652430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:43.653841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.655739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.657154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.659634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:43.661305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:43.679491 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 778/1547] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:43 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:43.681315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.683483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:43.693523 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 770/1548] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:43.697461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.717675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd68f0c-4cb4-4066-9f69-983ce7d524c9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:43.766442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:43.778656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc994c3e-4a70-496f-be5d-11d9147f63bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:43.785626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:43.786706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.787362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.787362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.788409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:43.790732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:43.822879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:43.831838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 779/1549] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:43 2022] POST /identity/v3/projects => generated 395 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:43.837534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.848673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:43.849374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:43.849719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:43.850063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:43.850940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:43.852920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:43.897645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 771/1550] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:43 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:43.899131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:43.927538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63d12-2ed4-4741-9722-9f2d9b1f3087 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.009303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab974-6ded-4c03-acd4-5ad69c4e9cba admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.026527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.027393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.027802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.028365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] PATH_INFO: `/v3/projects/227773d41ee74984b9ccc7a9668057ce/users/9594eab71e254d12910ca1a85fa86fe4/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.035165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=227773d41ee74984b9ccc7a9668057ce, user_id=9594eab71e254d12910ca1a85fa86fe4, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.038617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.064185 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 780/1551] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:43 2022] PUT /identity/v3/projects/227773d41ee74984b9ccc7a9668057ce/users/9594eab71e254d12910ca1a85fa86fe4/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:44.071352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.077060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6befccf-0854-443e-96ad-6be9b28ed936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.077772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6befccf-0854-443e-96ad-6be9b28ed936 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.078061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6befccf-0854-443e-96ad-6be9b28ed936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.078528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6befccf-0854-443e-96ad-6be9b28ed936 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.079178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6befccf-0854-443e-96ad-6be9b28ed936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.081156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6befccf-0854-443e-96ad-6be9b28ed936 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.130731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 772/1552] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:43 2022] POST /identity/v3/users => generated 304 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:44.133220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.136124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.136517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.197221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] MFA Rules not processed for user `9594eab71e254d12910ca1a85fa86fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:44.199454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:44.234431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe551da7-8876-4229-8edf-e0700474c96a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.249478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.250129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.250433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.250712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.251525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.253205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.275152 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 781/1553] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:44.276121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.297633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034f4b-9fc4-42d6-bf8a-0820ca51fdd9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.303015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe39fe-db8b-4205-92e2-847cb790f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.304324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe39fe-db8b-4205-92e2-847cb790f2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.304808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe39fe-db8b-4205-92e2-847cb790f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.304976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe39fe-db8b-4205-92e2-847cb790f2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.305809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe39fe-db8b-4205-92e2-847cb790f2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.307905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe39fe-db8b-4205-92e2-847cb790f2c6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.324746 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 782/1554] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:44.326045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f16328-8cec-47ef-8cc2-4f23cb9d46d5 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.326473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f16328-8cec-47ef-8cc2-4f23cb9d46d5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.326794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f16328-8cec-47ef-8cc2-4f23cb9d46d5 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.328533 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 783/1555] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:44.329871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f16328-8cec-47ef-8cc2-4f23cb9d46d5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.345844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f16328-8cec-47ef-8cc2-4f23cb9d46d5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.357763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61a92-b7c8-4eca-8801-2431b4b5e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.358581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61a92-b7c8-4eca-8801-2431b4b5e90b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.358955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61a92-b7c8-4eca-8801-2431b4b5e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.362204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61a92-b7c8-4eca-8801-2431b4b5e90b admin admin] PATH_INFO: `/v3/projects/d87f7d73e972409b8e29fd05625f70cf/users/6e929bae9d994253b8080052fb575932/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.365127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 773/1556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:44.366533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.386643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459384a-877f-44e9-891b-e2a47159d12e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.392027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.392885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.393491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.394046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] PATH_INFO: `/v3/projects/2de7c3b7f19c4f7f8d73015b0497bddc/users/ef4bb4c935814adc80197aaef07d30a8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.424218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de7c3b7f19c4f7f8d73015b0497bddc, user_id=ef4bb4c935814adc80197aaef07d30a8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.428037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61a92-b7c8-4eca-8801-2431b4b5e90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87f7d73e972409b8e29fd05625f70cf, user_id=6e929bae9d994253b8080052fb575932, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.429173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.439783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61a92-b7c8-4eca-8801-2431b4b5e90b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.452808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 774/1557] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:44 2022] PUT /identity/v3/projects/2de7c3b7f19c4f7f8d73015b0497bddc/users/ef4bb4c935814adc80197aaef07d30a8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:44.453819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.457157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:44.466012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:44.484804 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 784/1558] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:44 2022] PUT /identity/v3/projects/d87f7d73e972409b8e29fd05625f70cf/users/6e929bae9d994253b8080052fb575932/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:44.515527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.516123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.518944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.564577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eb75a-f846-4441-b13b-3eefae981776 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.580613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:44.582321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:44.675776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.676417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.676602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.676870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.682547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:44.724299 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 785/1559] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:11:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:44.726217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.800880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.803150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.825154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9598fb6-d60b-4ffb-8b44-3eb72ea0ab71 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.832038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 775/1560] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:44.833908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.845402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.846655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.847083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.847513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.848352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.850957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.857657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed80d3-d0b6-46b5-b262-5c6aacb94c2e service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.868824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 786/1561] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:44.868824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.872202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.872844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.873123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.873395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.874072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.875889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.880712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa0f6-24ae-4ff8-80d1-450f82afea84 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.888950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92a999-d0fc-419c-b8f9-8542b174e003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.889723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a999-d0fc-419c-b8f9-8542b174e003 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.890105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a999-d0fc-419c-b8f9-8542b174e003 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.890508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a999-d0fc-419c-b8f9-8542b174e003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.905147 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 776/1562] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:44.909294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.911927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:44.916903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a999-d0fc-419c-b8f9-8542b174e003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.920484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a999-d0fc-419c-b8f9-8542b174e003 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.929571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78543c40-a53f-437a-8c00-0224ced97a04 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:44.934941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:44.935740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.936121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.936500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] PATH_INFO: `/v3/projects/c7e5fd9541884c53ae7ec145212da2cb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.937767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e5fd9541884c53ae7ec145212da2cb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:44.940017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:44.946389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 787/1563] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:44.949671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e8d9-28d3-4f59-9e79-ebde2dbacce3 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:44.949958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e8d9-28d3-4f59-9e79-ebde2dbacce3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:44.950256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e8d9-28d3-4f59-9e79-ebde2dbacce3 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:44.960629 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 788/1564] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:44.962388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e8d9-28d3-4f59-9e79-ebde2dbacce3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:44.966834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:44.994091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e8d9-28d3-4f59-9e79-ebde2dbacce3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:45.012956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:45.013666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:45.013920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:45.014389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] PATH_INFO: `/v3/projects/2de7c3b7f19c4f7f8d73015b0497bddc/users/ef4bb4c935814adc80197aaef07d30a8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:45.016727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de7c3b7f19c4f7f8d73015b0497bddc, user_id=ef4bb4c935814adc80197aaef07d30a8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:45.019429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:45.037857 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 789/1565] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:44 2022] PUT /identity/v3/projects/2de7c3b7f19c4f7f8d73015b0497bddc/users/ef4bb4c935814adc80197aaef07d30a8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:45.041796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e5fd9541884c53ae7ec145212da2cb', 'request_id': 'req-df8f1186-63cc-4665-b225-b31d7a61ebae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.042851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:45.053085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e5fd9541884c53ae7ec145212da2cb', 'request_id': 'req-df8f1186-63cc-4665-b225-b31d7a61ebae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.066791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e5fd9541884c53ae7ec145212da2cb', 'request_id': 'req-df8f1186-63cc-4665-b225-b31d7a61ebae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.108486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] The token cache is being invalidate because project c7e5fd9541884c53ae7ec145212da2cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:45.108736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.111623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.116705 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 777/1566] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:44 2022] DELETE /identity/v3/projects/c7e5fd9541884c53ae7ec145212da2cb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:45.116705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:45.119844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:45.236577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf6db-ec52-4339-a27f-d6cc463f85c4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:45.247226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:45.247651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:45.248353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:45.248630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:45.248976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] PATH_INFO: `/v3/projects/d87f7d73e972409b8e29fd05625f70cf/users/6e929bae9d994253b8080052fb575932/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:45.251775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:45.257990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87f7d73e972409b8e29fd05625f70cf, user_id=6e929bae9d994253b8080052fb575932, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:45.260954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:45.303449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 790/1567] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:45 2022] PUT /identity/v3/projects/d87f7d73e972409b8e29fd05625f70cf/users/6e929bae9d994253b8080052fb575932/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:45.311990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:45.315171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:45.409630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f1186-63cc-4665-b225-b31d7a61ebae admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:45.451945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:45.480778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb527c-d188-4dcd-9ac6-c252adaa53c3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:45.502487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:45.503152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:45.503432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:45.503781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] PATH_INFO: `/v3/users/2b7c1fcd20274fb98a31af38b85c553e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:45.507382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7c1fcd20274fb98a31af38b85c553e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:45.509447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:45.524632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:45.558050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9b500-ea88-49cd-9624-fe0841b8aa29 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:45.558747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b500-ea88-49cd-9624-fe0841b8aa29 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:45.559038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b500-ea88-49cd-9624-fe0841b8aa29 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:45.559391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b500-ea88-49cd-9624-fe0841b8aa29 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:45.566242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9b500-ea88-49cd-9624-fe0841b8aa29 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:45.575648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9b500-ea88-49cd-9624-fe0841b8aa29 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:45.591579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 778/1568] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:45 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:45.593245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:45.593623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:45.593902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:45.660742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7c1fcd20274fb98a31af38b85c553e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.695145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] MFA Rules not processed for user `6e929bae9d994253b8080052fb575932`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:45.696709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:45.707302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7c1fcd20274fb98a31af38b85c553e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.711367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7c1fcd20274fb98a31af38b85c553e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.714079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7c1fcd20274fb98a31af38b85c553e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.734781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c735f73e-41c4-457e-a973-0e6f2235734a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7c1fcd20274fb98a31af38b85c553e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:45.771579 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 791/1569] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:45 2022] DELETE /identity/v3/users/2b7c1fcd20274fb98a31af38b85c553e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:45.771579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:45.771579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:45.771579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:45.772411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 792/1570] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:45.780624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:45.787691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:45.862549 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 779/1571] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:45.936628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:45.938299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:46.034486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda5f33-0ac6-466b-8161-00ea88d05704 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:46.042281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb93906-8064-454e-96cd-9868f66708f1 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:46.043099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93906-8064-454e-96cd-9868f66708f1 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:46.043688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93906-8064-454e-96cd-9868f66708f1 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:46.043944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93906-8064-454e-96cd-9868f66708f1 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:46.045639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb93906-8064-454e-96cd-9868f66708f1 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:46.049762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb93906-8064-454e-96cd-9868f66708f1 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:46.058932 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 793/1572] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:45 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:46.151844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:46.155260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:46.155539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:46.156356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:46.186630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:46.244601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] MFA Rules not processed for user `e6b2194b6b1641b8990f5c9064ab31ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:46.248570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:46.393018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b77a-05b8-432c-9572-e59bc0a26e8d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:46.408392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 794/1573] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:46.413455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:46.416417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:46.417322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:46.420005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:46.420585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:46.421000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:46.462472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae6e6-b083-449c-85c2-457d5ff1803f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:46.476596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:46.477662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:46.477662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:46.477904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:46.483245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:46.505993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:46.507993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a2d06-9d7d-4616-99e0-89a54c553e9b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:46.521252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:46.528822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 795/1574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:46.530328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:46.542692 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 780/1575] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:47.045374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.045708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.045999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.056195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:47.075930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbc5ff-fdbd-4dbb-a8f6-67cc384fe57b service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:47.077245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] MFA Rules not processed for user `ba045fd5be9d482b8205237ddee4d5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:47.078509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.087110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:47.089210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.089502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.090292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.098279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.122771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:47.230793 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 796/1576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:47.231753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:47.234004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.307826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:47.310239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bc6d7-3ae5-4ae1-a02f-02438eaec73d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:47.323565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 781/1577] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:47.334019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3d252-523b-42c9-9ade-e742a7a2246f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:47.339528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:47.340191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.340470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.340743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] PATH_INFO: `/v3/projects/378a31b6eab7460ab871df9c3787b13c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.341891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378a31b6eab7460ab871df9c3787b13c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:47.346705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:47.432548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:47.433668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378a31b6eab7460ab871df9c3787b13c', 'request_id': 'req-8b802f73-e9b5-4dd9-9423-5a9a196129a2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:47.447832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378a31b6eab7460ab871df9c3787b13c', 'request_id': 'req-8b802f73-e9b5-4dd9-9423-5a9a196129a2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:47.467415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378a31b6eab7460ab871df9c3787b13c', 'request_id': 'req-8b802f73-e9b5-4dd9-9423-5a9a196129a2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:47.489558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] The token cache is being invalidate because project 378a31b6eab7460ab871df9c3787b13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:47.490738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:47.492243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b802f73-e9b5-4dd9-9423-5a9a196129a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:47.496641 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 797/1578] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:47 2022] DELETE /identity/v3/projects/378a31b6eab7460ab871df9c3787b13c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:47.501435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475a0ce-0fed-46f0-b782-d0cebc42296e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.501902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475a0ce-0fed-46f0-b782-d0cebc42296e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.502979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475a0ce-0fed-46f0-b782-d0cebc42296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.548190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c475a0ce-0fed-46f0-b782-d0cebc42296e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:47.549657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c475a0ce-0fed-46f0-b782-d0cebc42296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.644074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.644543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.644925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.647027 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 798/1579] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:47.656151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:47.658799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.676766 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 782/1580] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:47.684765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.685264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.685599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.726748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:47.730533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.762346 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 783/1581] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:47.765741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:47.780817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:47.783580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d965e6-16b3-4b44-9bc4-89d25447b7ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:47.784781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:47.790686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:47.791666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.792159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.792988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.793887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:47.794431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:47.796856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:47.820535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 784/1582] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:47.824489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:47.841652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67fbc3-ebf4-475c-9abc-6525b3d82aec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:47.854894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:47.855644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.856048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.860176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.861180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:47.864949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:47.896424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be51b2-bc96-453d-8fcd-8e9e532608ae None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:47.905481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:47.906617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:47.907618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:47.907618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:47.909004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:47.911667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:47.923026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 785/1583] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:47 2022] POST /identity/v3/projects => generated 407 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:47.925738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:47.934773 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 799/1584] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:47 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:48.067104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf781-0ccf-4ce3-a8e9-aa60a38b58de admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:48.072480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:48.073134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.074237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.074526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.075263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:48.078809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:48.094740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:48.114877 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 786/1585] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:47 2022] POST /identity/v3/users => generated 304 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:48.115926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.131927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80648-f35f-4d88-995c-0b55ca6d488a tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:48.137417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:48.138041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.138357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.138933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.139685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:48.141460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:48.157750 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 800/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:48.158494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.172896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b5957-e6b8-4766-a887-232df470c6a3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:48.184693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367fa3-12ee-4cf1-8fd9-9565646762ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:48.186682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367fa3-12ee-4cf1-8fd9-9565646762ea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.188516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367fa3-12ee-4cf1-8fd9-9565646762ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.188805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367fa3-12ee-4cf1-8fd9-9565646762ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.192188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367fa3-12ee-4cf1-8fd9-9565646762ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:48.193948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367fa3-12ee-4cf1-8fd9-9565646762ea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:48.219361 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 787/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:11:48.220879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.232491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1157-66c0-4763-b0a6-3bb80b26fe26 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:48.238002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732062-0409-482a-825c-5cec35b4e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:48.239032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732062-0409-482a-825c-5cec35b4e598 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.239504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732062-0409-482a-825c-5cec35b4e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.240189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732062-0409-482a-825c-5cec35b4e598 admin admin] PATH_INFO: `/v3/projects/4ec52376cd0b42d398d3a861383ae1f9/users/907cc92759dd496dbd2d4aee09bcc0d6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.281762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732062-0409-482a-825c-5cec35b4e598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec52376cd0b42d398d3a861383ae1f9, user_id=907cc92759dd496dbd2d4aee09bcc0d6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:48.295100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732062-0409-482a-825c-5cec35b4e598 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:48.348669 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 801/1588] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:48 2022] PUT /identity/v3/projects/4ec52376cd0b42d398d3a861383ae1f9/users/907cc92759dd496dbd2d4aee09bcc0d6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:48.359702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.360080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.360301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.402824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] MFA Rules not processed for user `907cc92759dd496dbd2d4aee09bcc0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:48.403312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:48.468327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff5f8c-cf06-4192-8c29-37f77d6d71bb None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.469292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff5f8c-cf06-4192-8c29-37f77d6d71bb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.469802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff5f8c-cf06-4192-8c29-37f77d6d71bb None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.471468 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 802/1589] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:11:48.478034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff5f8c-cf06-4192-8c29-37f77d6d71bb None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:48.541780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 788/1590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:48 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:48.547284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.562829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:48.633001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff5f8c-cf06-4192-8c29-37f77d6d71bb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.660113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c1e07-84cd-4f04-a8a4-696ff2e4b636 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:48.669797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcd2bd-82d3-4396-bad9-9c232438da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:48.671168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd2bd-82d3-4396-bad9-9c232438da03 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.671168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd2bd-82d3-4396-bad9-9c232438da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.671407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd2bd-82d3-4396-bad9-9c232438da03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.672370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd2bd-82d3-4396-bad9-9c232438da03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:48.675123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd2bd-82d3-4396-bad9-9c232438da03 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:48.752464 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 789/1591] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:48 2022] POST /identity/v3/projects => generated 407 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:48.755103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.756511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.757127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.780995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff5f8c-cf06-4192-8c29-37f77d6d71bb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:48.813342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:48.814821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:48.911150 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 790/1592] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:11:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:48.913321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.914123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:48.915348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:48.916665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:48.917232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:48.921591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:48.924235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:48.928056 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 803/1593] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:48 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:48.950327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:48.952541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:48.958004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:49.011032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefc7c2-b1c0-456d-b8cc-d16f6657335c tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.027815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.028485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.028774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.029052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.040578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:49.043149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:49.056083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 804/1594] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:49.081492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15379a-c547-425c-8d9e-7d8b3349c9fd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.096016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.096395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.096773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.097141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.097938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:49.100161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:49.134724 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 791/1595] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:48 2022] POST /identity/v3/users => generated 310 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:49.139083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:49.161176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114461f2-995c-49c9-8acd-13bcae4bf8e5 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.170835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.171467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.171901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.172180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.172830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:49.174493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:49.200013 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 805/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:49.204245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:49.216388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071409-90ca-474c-af34-1875d474ac75 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.236274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.237610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.238092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.238589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] PATH_INFO: `/v3/projects/a0b5733587e84391b84f73e313434053/users/8821b82aae7145f0875d5ee9027e4a17/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.273763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b5733587e84391b84f73e313434053, user_id=8821b82aae7145f0875d5ee9027e4a17, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:49.278564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:49.309333 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 792/1597] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:49 2022] PUT /identity/v3/projects/a0b5733587e84391b84f73e313434053/users/8821b82aae7145f0875d5ee9027e4a17/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:49.314074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:49.333475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0735b-5682-4aa1-b77b-bdf5dea3051b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.428399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:49.438744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b297d-ed72-411d-b146-3ca2d2dc8e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.439632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b297d-ed72-411d-b146-3ca2d2dc8e54 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.440016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b297d-ed72-411d-b146-3ca2d2dc8e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.440369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b297d-ed72-411d-b146-3ca2d2dc8e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.441109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b297d-ed72-411d-b146-3ca2d2dc8e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:49.443642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b297d-ed72-411d-b146-3ca2d2dc8e54 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:49.456804 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 806/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:49.461216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:49.474395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9bac-51ae-4b9c-8f19-a31018411c83 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.483336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.484378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.484777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.485349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] PATH_INFO: `/v3/projects/a0b5733587e84391b84f73e313434053/users/8821b82aae7145f0875d5ee9027e4a17/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.488553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b5733587e84391b84f73e313434053, user_id=8821b82aae7145f0875d5ee9027e4a17, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:49.493671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:49.512839 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 793/1599] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:49 2022] PUT /identity/v3/projects/a0b5733587e84391b84f73e313434053/users/8821b82aae7145f0875d5ee9027e4a17/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:11:49.525974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe71638-0b43-41da-993c-5676c9259a69 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.526497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe71638-0b43-41da-993c-5676c9259a69 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.526573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe71638-0b43-41da-993c-5676c9259a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.584427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-abe71638-0b43-41da-993c-5676c9259a69 None None] MFA Rules not processed for user `8821b82aae7145f0875d5ee9027e4a17`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:49.586263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-abe71638-0b43-41da-993c-5676c9259a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:49.826230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 807/1600] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:49 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:49.830411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:49.921686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17fd2f-08ab-464c-bd13-c22d2ec0e635 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.922252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17fd2f-08ab-464c-bd13-c22d2ec0e635 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.922585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17fd2f-08ab-464c-bd13-c22d2ec0e635 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.925655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 808/1601] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:49.929773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17fd2f-08ab-464c-bd13-c22d2ec0e635 None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:49.977430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5662a5-055b-4bfd-98b1-3002410931ef admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:49.992003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:49.993086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:49.994342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:49.994694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] PATH_INFO: `/v3/users/907cc92759dd496dbd2d4aee09bcc0d6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:49.998119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907cc92759dd496dbd2d4aee09bcc0d6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:50.002762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:50.079095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17fd2f-08ab-464c-bd13-c22d2ec0e635 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:50.109725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907cc92759dd496dbd2d4aee09bcc0d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:50.129696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907cc92759dd496dbd2d4aee09bcc0d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:50.130840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907cc92759dd496dbd2d4aee09bcc0d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:50.131467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907cc92759dd496dbd2d4aee09bcc0d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:50.144789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:50.149770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47137361-ed43-4abf-ab6e-4b97f0616f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907cc92759dd496dbd2d4aee09bcc0d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:50.207056 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 794/1602] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:49 2022] DELETE /identity/v3/users/907cc92759dd496dbd2d4aee09bcc0d6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:50.210064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cc83-b430-4b26-9cc2-a56683e8be6b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:50.211629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cc83-b430-4b26-9cc2-a56683e8be6b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:50.211922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cc83-b430-4b26-9cc2-a56683e8be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:50.218419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17fd2f-08ab-464c-bd13-c22d2ec0e635 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:50.255957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:50.285543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d9b0cc83-b430-4b26-9cc2-a56683e8be6b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:50.289430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d9b0cc83-b430-4b26-9cc2-a56683e8be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:50.374799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:50.380489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:50.380892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:50.381184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:50.387310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:50.389632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:50.397783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 809/1603] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:49 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:50.502690 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 795/1604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:50.516518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:50.519127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:50.608172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:50.608743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:50.609151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:50.660569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] MFA Rules not processed for user `e6b2194b6b1641b8990f5c9064ab31ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:50.661855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:50.673249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95d53-ffea-4595-a9e0-5c43d58ba613 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:50.679923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:50.681053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:50.681492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:50.681938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:50.707084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:50.711729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:50.749830 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 810/1605] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:50.897621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 796/1606] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:51.413906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:51.416007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:51.446670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5ffbc-5090-4d4b-b6ea-7338717a748e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:51.453837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:51.455709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:51.457371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:51.458205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] PATH_INFO: `/v3/projects/4ec52376cd0b42d398d3a861383ae1f9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:51.459971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec52376cd0b42d398d3a861383ae1f9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:51.463531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:51.548546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec52376cd0b42d398d3a861383ae1f9', 'request_id': 'req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.560647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec52376cd0b42d398d3a861383ae1f9', 'request_id': 'req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.568407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec52376cd0b42d398d3a861383ae1f9', 'request_id': 'req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.593773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] The token cache is being invalidate because project 4ec52376cd0b42d398d3a861383ae1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:51.595505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.596810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a83fa9e-00db-4d69-97c3-1fa952b8bf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.604495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 811/1607] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:51 2022] DELETE /identity/v3/projects/4ec52376cd0b42d398d3a861383ae1f9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:51.604997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:51.620213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89e64-aa4b-4305-b06f-e5e3dfee713e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:51.779136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:51.780337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:51.780769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:51.781185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] PATH_INFO: `/v3/users/8821b82aae7145f0875d5ee9027e4a17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:51.782639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8821b82aae7145f0875d5ee9027e4a17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:51.785035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:51.827405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:51.827975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:51.827975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:51.829326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 812/1608] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:11:51.836368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:51.839723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:51.840294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:51.870182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8821b82aae7145f0875d5ee9027e4a17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.884487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8821b82aae7145f0875d5ee9027e4a17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.885562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8821b82aae7145f0875d5ee9027e4a17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.889846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8821b82aae7145f0875d5ee9027e4a17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.901676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8821b82aae7145f0875d5ee9027e4a17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:51.931442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:51.933001 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 797/1609] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:51 2022] DELETE /identity/v3/users/8821b82aae7145f0875d5ee9027e4a17 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:51.979157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:51.981318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:52.069730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6e075-793c-4bfc-871a-d50631363de8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:52.167115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:52.167851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:52.168141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:52.168423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:52.169665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:52.172190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:52.174934 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 813/1610] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:51 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:52.384265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:52.385934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:52.496823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ccc0-901f-4d32-9b7d-ccdcdbf43374 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:52.503547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:52.504191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:52.504476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:52.504755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:52.506938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:52.527721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:52.530085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:52.628218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:52.630208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a144db3-861d-4344-8aff-15032d1b5a3a service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:52.643221 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 798/1611] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:52.645040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:52.645532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:52.645816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:52.652503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 799/1612] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:52.653459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:52.655437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:52.698223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:52.699894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:52.724813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec974-0895-4fe4-8515-43cf37578c89 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:52.726898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447ebed-edb5-479d-9830-1cc7c8bd9ca9 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:52.734884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:52.735612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:52.735988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:52.736289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6385c-b5d0-4d12-8c3b-b4905a777762 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:52.736665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] PATH_INFO: `/v3/projects/a0b5733587e84391b84f73e313434053` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:52.737452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6385c-b5d0-4d12-8c3b-b4905a777762 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:52.737881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6385c-b5d0-4d12-8c3b-b4905a777762 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:52.738328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6385c-b5d0-4d12-8c3b-b4905a777762 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:52.738436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b5733587e84391b84f73e313434053)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:52.740282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6385c-b5d0-4d12-8c3b-b4905a777762 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:52.740633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:52.743552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6385c-b5d0-4d12-8c3b-b4905a777762 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:52.746950 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 800/1613] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:52 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:52.845974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:52.878993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b5733587e84391b84f73e313434053', 'request_id': 'req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:52.893470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b5733587e84391b84f73e313434053', 'request_id': 'req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:52.921937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b5733587e84391b84f73e313434053', 'request_id': 'req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:52.940596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] The token cache is being invalidate because project a0b5733587e84391b84f73e313434053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:52.940596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:52.941412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-123d1f7b-3c51-48f9-b721-8f7bf27ffd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:52.943447 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 814/1614] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:52 2022] DELETE /identity/v3/projects/a0b5733587e84391b84f73e313434053 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:52.950140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5044a9-c379-44c9-b0ef-530e2f115caf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:52.950525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5044a9-c379-44c9-b0ef-530e2f115caf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:52.950813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5044a9-c379-44c9-b0ef-530e2f115caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:52.984260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bc5044a9-c379-44c9-b0ef-530e2f115caf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:52.985557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bc5044a9-c379-44c9-b0ef-530e2f115caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:53.066679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:53.188507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.188798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.189169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.190465 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 815/1615] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:11:53.197232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:53.199239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:53.216900 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 801/1616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:53.230803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.231495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.232233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.276546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:53.277773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:53.305708 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 802/1617] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:53.309741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.328157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae403c3-1762-490d-ae50-9a738a5907bb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:53.343863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:53.344826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.345356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.345850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.346813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:53.347615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:53.349767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:53.389390 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 803/1618] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:53.395000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.409227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda578-a980-4adc-ba18-990197570560 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:53.418464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:53.419261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.419653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.420032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.421197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:53.424198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:53.470181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.471386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:53.507979 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 804/1619] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:53 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:53.514695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.672464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6e1f-00b9-445d-820e-9932804b0d56 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:53.693004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:53.695106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.695894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.699438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.700416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:53.706129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:53.748662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55a2c-ce5b-4c31-bb1f-69f5d7ceff42 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:53.750496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 805/1620] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:53 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:11:53.758276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.798655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d2ebd-e4fa-4434-ae69-4f89becabe3c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:53.807741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:53.809187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.809761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.810364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.811239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:53.813180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:53.841486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 806/1621] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:53.845691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.908765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:53.909596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.909886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.910184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.910365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738934dd-a56e-4fc4-b2d6-b2403fbdca14 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:53.919224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:53.923175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:53.925284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:53.926412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:53.926973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:53.929800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:53.929937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:53.934102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:53.938890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 816/1622] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:53 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 742 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:11:53.967980 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 807/1623] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:53.977487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:53.991849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:54.006581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c119f7-9db7-47c2-9262-24265652315b tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:54.032630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc213a-772f-467e-a0c5-97e12ddca00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:54.036709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc213a-772f-467e-a0c5-97e12ddca00c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.037144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc213a-772f-467e-a0c5-97e12ddca00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.037691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc213a-772f-467e-a0c5-97e12ddca00c admin admin] PATH_INFO: `/v3/projects/67f966dd7bb7486abbbbf8e96bb1b015/users/b023705824004068a0f207c3ac8e65ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.065895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc213a-772f-467e-a0c5-97e12ddca00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f966dd7bb7486abbbbf8e96bb1b015, user_id=b023705824004068a0f207c3ac8e65ae, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:54.074836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc213a-772f-467e-a0c5-97e12ddca00c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:54.118293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:54.120512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:54.133348 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 817/1624] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:53 2022] PUT /identity/v3/projects/67f966dd7bb7486abbbbf8e96bb1b015/users/b023705824004068a0f207c3ac8e65ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:54.136355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910ef1-9097-4079-b10e-9be22798ee46 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.136842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910ef1-9097-4079-b10e-9be22798ee46 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.137266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910ef1-9097-4079-b10e-9be22798ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.144454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee39e1-f932-4857-8164-fd17e8d82a57 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:54.205562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-19910ef1-9097-4079-b10e-9be22798ee46 None None] MFA Rules not processed for user `e6b2194b6b1641b8990f5c9064ab31ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:54.206388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-19910ef1-9097-4079-b10e-9be22798ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:54.270023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:54.284508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:54.285281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.285682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.286060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] PATH_INFO: `/v3/users/7eda42fefbba4a6084a3f550d3f1cc64` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.288428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eda42fefbba4a6084a3f550d3f1cc64)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:54.290681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:54.396604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eda42fefbba4a6084a3f550d3f1cc64'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:54.397187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 818/1625] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:54.399512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b707-c29d-4653-86c0-24663519450c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.402795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b707-c29d-4653-86c0-24663519450c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.403325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b707-c29d-4653-86c0-24663519450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.416292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eda42fefbba4a6084a3f550d3f1cc64'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:54.417291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eda42fefbba4a6084a3f550d3f1cc64'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:54.418121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eda42fefbba4a6084a3f550d3f1cc64'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:54.435034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e6164f9-afed-4406-91c6-75ab3d01041b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eda42fefbba4a6084a3f550d3f1cc64'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:54.459370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-99a4b707-c29d-4653-86c0-24663519450c None None] MFA Rules not processed for user `b023705824004068a0f207c3ac8e65ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:54.460341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99a4b707-c29d-4653-86c0-24663519450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:54.486955 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 808/1626] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:54 2022] DELETE /identity/v3/users/7eda42fefbba4a6084a3f550d3f1cc64 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:11:54.497536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.497833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.500652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.567760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:54.570111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:54.609862 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 819/1627] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:54.615434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b707-c29d-4653-86c0-24663519450c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:54.620586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99a4b707-c29d-4653-86c0-24663519450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:54.642119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b707-c29d-4653-86c0-24663519450c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:54.690016 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 809/1628] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:54.702688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:54.708718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:54.774601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:54.775315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.775724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.775947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.776596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:54.784527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:54.827928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282246b3-0010-4bb9-a385-826e3ff2a0e0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:54.830337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:54.854209 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 820/1629] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:54 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:11:54.855179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:54.861040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:54.861333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:54.863922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:54.864230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:54.881001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:54.883421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:54.896424 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 810/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:11:55.025679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4c68-30c6-4dd6-8235-2c27eeb4128e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.038236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.039108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.039647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.040075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.040901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.043629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.094546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 821/1631] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:54 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:55.098585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:55.142272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea6a08-7d9b-4e04-9f3d-325dc0ab26bf service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.165655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32716a-4210-4c81-8779-3a3e8e810dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.166038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32716a-4210-4c81-8779-3a3e8e810dae admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.166945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32716a-4210-4c81-8779-3a3e8e810dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.167240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32716a-4210-4c81-8779-3a3e8e810dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.167917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32716a-4210-4c81-8779-3a3e8e810dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.169543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32716a-4210-4c81-8779-3a3e8e810dae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.199780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 811/1632] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:55.204446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:55.244434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef68e5e-b550-40c0-bed1-0f9c0237f257 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.293971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.298716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.299489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.299984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] PATH_INFO: `/v3/projects/a735ec81e6f64f2eaae659cd2505be2c/users/c72dcc0909174f1989f8ebfb826fd4df/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.329127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a735ec81e6f64f2eaae659cd2505be2c, user_id=c72dcc0909174f1989f8ebfb826fd4df, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.333371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.379532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 822/1633] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:55 2022] PUT /identity/v3/projects/a735ec81e6f64f2eaae659cd2505be2c/users/c72dcc0909174f1989f8ebfb826fd4df/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:11:55.383923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.384564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.385063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.386496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 812/1634] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:11:55.387698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:55.392755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:11:55.395057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:55.408381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:55.531913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:55.533706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:55.558410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f24a-9e68-4aee-aa8c-2a601bfe7c46 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.565598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.567491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.568015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.568398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.570130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.581200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.606773 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 823/1635] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:55.609330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:55.624844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe314b-4ba7-48d6-a49a-d08a8a0cad7b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.635727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.635727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.635727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.635727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] PATH_INFO: `/v3/projects/a735ec81e6f64f2eaae659cd2505be2c/users/c72dcc0909174f1989f8ebfb826fd4df/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.636726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a735ec81e6f64f2eaae659cd2505be2c, user_id=c72dcc0909174f1989f8ebfb826fd4df, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.641653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.667738 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 824/1636] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:55 2022] PUT /identity/v3/projects/a735ec81e6f64f2eaae659cd2505be2c/users/c72dcc0909174f1989f8ebfb826fd4df/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:55.669180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:55.671618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:55.682787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b309226-f443-41e9-9d4f-4f7af2734496 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.766247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:55.797734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff2fb4-c33e-47e5-9d63-f6714e2130f3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:55.804637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.805454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.805744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.806082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] PATH_INFO: `/v3/projects/0001564ea5ec49808f59e578f65a290a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.807222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0001564ea5ec49808f59e578f65a290a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.809822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.810063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e5d6-8bf6-42da-ac06-e8f90cd60b92 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9594eab71e254d12910ca1a85fa86fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227773d41ee74984b9ccc7a9668057ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:55.810762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e5d6-8bf6-42da-ac06-e8f90cd60b92 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.811050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e5d6-8bf6-42da-ac06-e8f90cd60b92 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.811325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e5d6-8bf6-42da-ac06-e8f90cd60b92 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.812510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e5d6-8bf6-42da-ac06-e8f90cd60b92 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorizing `identity:get_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:55.814618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e5d6-8bf6-42da-ac06-e8f90cd60b92 tempest-QuotasAdminNegativeTest-625380307 tempest-QuotasAdminNegativeTest-625380307-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:55.816802 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 813/1637] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:11:55 2022] GET /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 381 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:55.818019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.818329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.818886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:55.898657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0001564ea5ec49808f59e578f65a290a', 'request_id': 'req-1034c98e-8c15-416c-92a7-139e4afeec9e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:55.899851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] MFA Rules not processed for user `c72dcc0909174f1989f8ebfb826fd4df`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:55.901581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:55.916122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0001564ea5ec49808f59e578f65a290a', 'request_id': 'req-1034c98e-8c15-416c-92a7-139e4afeec9e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:55.936548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0001564ea5ec49808f59e578f65a290a', 'request_id': 'req-1034c98e-8c15-416c-92a7-139e4afeec9e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:55.966204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] The token cache is being invalidate because project 0001564ea5ec49808f59e578f65a290a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:55.966767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:55.969189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1034c98e-8c15-416c-92a7-139e4afeec9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:55.972516 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 825/1638] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:55 2022] DELETE /identity/v3/projects/0001564ea5ec49808f59e578f65a290a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:55.975128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:55.976027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:55.976261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:56.069695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] MFA Rules not processed for user `ef4bb4c935814adc80197aaef07d30a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:56.073820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.074256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:56.183444 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 814/1639] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:56.186647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:56.190289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.239418 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 826/1640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:56.243460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:56.251328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.330224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dad17-5abf-4811-9eb7-2d7a7403cd89 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:56.353066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:56.353745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:56.354032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:56.354359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] PATH_INFO: `/v3/users/6e929bae9d994253b8080052fb575932` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:56.356605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e929bae9d994253b8080052fb575932)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:56.360130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:56.421009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b460bca-c0e9-4e63-ac69-2f0559b15c04 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:56.426429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:56.427125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:56.427534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:56.427948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] PATH_INFO: `/v3/users/e6b2194b6b1641b8990f5c9064ab31ab` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:56.430188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b2194b6b1641b8990f5c9064ab31ab)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:56.432110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:56.437103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e929bae9d994253b8080052fb575932'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.439271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:56.472645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e929bae9d994253b8080052fb575932'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.474371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e929bae9d994253b8080052fb575932'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.476290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e929bae9d994253b8080052fb575932'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.504138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2349952-1a2c-48f4-8c89-f34d64f57294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e929bae9d994253b8080052fb575932'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.529191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b2194b6b1641b8990f5c9064ab31ab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.544518 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 815/1641] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:56 2022] DELETE /identity/v3/users/6e929bae9d994253b8080052fb575932 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:56.545977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca00b-9768-4d85-bb3e-b39e0e23e7bb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:56.546305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca00b-9768-4d85-bb3e-b39e0e23e7bb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:56.546585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca00b-9768-4d85-bb3e-b39e0e23e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:56.584050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b2194b6b1641b8990f5c9064ab31ab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.585508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b2194b6b1641b8990f5c9064ab31ab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.586381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b2194b6b1641b8990f5c9064ab31ab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.595957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ea2ca00b-9768-4d85-bb3e-b39e0e23e7bb None None] MFA Rules not processed for user `b023705824004068a0f207c3ac8e65ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:56.596336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a6131f5f-8a47-4ef1-ab86-7d900f5ac5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b2194b6b1641b8990f5c9064ab31ab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:56.602913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ea2ca00b-9768-4d85-bb3e-b39e0e23e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.636367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 827/1642] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:56 2022] DELETE /identity/v3/users/e6b2194b6b1641b8990f5c9064ab31ab => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:56.636367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:56.636367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:56.636707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:56.666842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] MFA Rules not processed for user `06e506f335f845a18332a4cd5047f3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:56.669288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.742905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:56.776047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 816/1643] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:56.782634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:56.782934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:56.783219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:56.853558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:56.855331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.868558 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 828/1644] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:56.869782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:56.871180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:56.976730 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 817/1645] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:56.988758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:56.991349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.160742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53901f3d-608e-4dba-b053-7e2980de8d67 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.161324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5882-8ff7-4200-8c5d-75033ae4c581 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.166862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:57.167589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.168508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.168508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.176987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:57.177722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.178015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.178342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.181551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.186075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:57.187631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:57.198361 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 818/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:57.199283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:57.200709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.219910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae94dc-7319-4f90-83a2-4082af3b83a8 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.226292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:57.226955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.227293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.227571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] PATH_INFO: `/v3/projects/d87f7d73e972409b8e29fd05625f70cf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.228714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87f7d73e972409b8e29fd05625f70cf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:57.230895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:57.232244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:57.309843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:57.312271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:57.323063 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 829/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:57.339359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:57.340956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.342483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87f7d73e972409b8e29fd05625f70cf', 'request_id': 'req-109964b6-62ea-4279-be29-2abb6fed15af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.349641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87f7d73e972409b8e29fd05625f70cf', 'request_id': 'req-109964b6-62ea-4279-be29-2abb6fed15af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.366928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c897b-3a7f-44c8-919a-77e1926ccb3e service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.383986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87f7d73e972409b8e29fd05625f70cf', 'request_id': 'req-109964b6-62ea-4279-be29-2abb6fed15af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.423268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] The token cache is being invalidate because project d87f7d73e972409b8e29fd05625f70cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:57.424601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.425622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-109964b6-62ea-4279-be29-2abb6fed15af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.429073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 819/1648] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:57 2022] DELETE /identity/v3/projects/d87f7d73e972409b8e29fd05625f70cf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:57.436594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851b852-305b-4ca7-8b1c-d38c45e9bcf0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.438876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851b852-305b-4ca7-8b1c-d38c45e9bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.439992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851b852-305b-4ca7-8b1c-d38c45e9bcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.492415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:57.493459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.493952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.494443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.495767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a851b852-305b-4ca7-8b1c-d38c45e9bcf0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:57.496679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.497474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a851b852-305b-4ca7-8b1c-d38c45e9bcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.537149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:57.628384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:57.635103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:57.645621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 820/1649] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:57.657713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.660949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.662354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.666669 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 830/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:57.710392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:57.712129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.731895 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 821/1651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:57.740007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:57.775664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:57.781995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:57.785182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe39b9-4682-4cc4-a3ba-77bc9bf91ca6 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.801519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:57.802282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.802634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.802971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.804945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:11:57.805325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:57.807646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:57.810807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589492be-7ccb-478b-b57d-4b7a8106ba8b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.827272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:57.828017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:57.828828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:57.828828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] PATH_INFO: `/v3/projects/242f6f54ffc646ed8969ab3938b68a8c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:57.846176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242f6f54ffc646ed8969ab3938b68a8c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:57.848471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:57.852280 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 831/1652] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:11:57.864305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:57.898792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287235d-a4b3-419f-af87-7653d18f4d80 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:57.909927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242f6f54ffc646ed8969ab3938b68a8c', 'request_id': 'req-c6f856f4-d70a-4654-97ca-3b48da1196f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.917771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242f6f54ffc646ed8969ab3938b68a8c', 'request_id': 'req-c6f856f4-d70a-4654-97ca-3b48da1196f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.931776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242f6f54ffc646ed8969ab3938b68a8c', 'request_id': 'req-c6f856f4-d70a-4654-97ca-3b48da1196f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.946057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] The token cache is being invalidate because project 242f6f54ffc646ed8969ab3938b68a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:57.946535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.947816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:57.949557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 822/1653] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:57 2022] DELETE /identity/v3/projects/242f6f54ffc646ed8969ab3938b68a8c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:57.953901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:57.957061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.028948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:58.060609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:58.060903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f856f4-d70a-4654-97ca-3b48da1196f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:58.061555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.061935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.062414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.063167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:58.067031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:58.067570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:58.068134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.068552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.069107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] PATH_INFO: `/v3/users/9594eab71e254d12910ca1a85fa86fe4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.070812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9594eab71e254d12910ca1a85fa86fe4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:58.073488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:58.141778 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 832/1654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:57 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:58.145407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:58.147726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.201187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:58.206110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9594eab71e254d12910ca1a85fa86fe4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:58.218852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9594eab71e254d12910ca1a85fa86fe4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:58.220095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9594eab71e254d12910ca1a85fa86fe4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:58.221732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9594eab71e254d12910ca1a85fa86fe4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:58.233829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9594eab71e254d12910ca1a85fa86fe4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:58.282303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 823/1655] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:11:57 2022] DELETE /identity/v3/users/9594eab71e254d12910ca1a85fa86fe4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:58.308244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de2987-a1b1-4d15-ac00-73c063655953 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:58.395037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1e17-6906-40ea-88a2-3b1ede0c3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:58.395952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1e17-6906-40ea-88a2-3b1ede0c3bff admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.396394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1e17-6906-40ea-88a2-3b1ede0c3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.396635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1e17-6906-40ea-88a2-3b1ede0c3bff admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.397923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1e17-6906-40ea-88a2-3b1ede0c3bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:58.403066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1e17-6906-40ea-88a2-3b1ede0c3bff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:58.456424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 833/1656] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:58 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:58.460970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:58.462709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.492266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0dc93-d6a1-4f81-b7fb-45af3f840819 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:58.506992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:58.509264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175731c7-c6e7-4cd6-9f2f-58947ecad44f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.509579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175731c7-c6e7-4cd6-9f2f-58947ecad44f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.509860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175731c7-c6e7-4cd6-9f2f-58947ecad44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.512671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.512916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.513128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.513821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:58.531300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:58.566131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-175731c7-c6e7-4cd6-9f2f-58947ecad44f None None] MFA Rules not processed for user `f7c70d25b2c8415ea8257043d5468358`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:58.567712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-175731c7-c6e7-4cd6-9f2f-58947ecad44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.586283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 824/1657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:58.587268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:58.626060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eea249-cb92-48c7-8646-d061f4b2e777 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:58.642186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:58.644922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.645270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.645490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.646214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:58.649600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:58.692461 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 825/1658] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:11:58.696281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:58.701464 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 834/1659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:58.731039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229f7b-c459-4764-bd42-e98d962eef5c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.731704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229f7b-c459-4764-bd42-e98d962eef5c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.732125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229f7b-c459-4764-bd42-e98d962eef5c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.733655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 835/1660] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:11:58.735866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8f40-46f4-4b9b-9202-2855a81b205e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:58.741916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.742558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.742987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.747699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ac443-22e9-495b-bcb6-62daabbf0b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:58.748583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac443-22e9-495b-bcb6-62daabbf0b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.749865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac443-22e9-495b-bcb6-62daabbf0b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.750718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac443-22e9-495b-bcb6-62daabbf0b6c admin admin] PATH_INFO: `/v3/projects/53b82ff8a0604c44b17a8fc9887f7a57/users/f2c12c1d99cf42b699ed44b373c90862/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.775462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:58.776995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.792342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ac443-22e9-495b-bcb6-62daabbf0b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b82ff8a0604c44b17a8fc9887f7a57, user_id=f2c12c1d99cf42b699ed44b373c90862, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:58.793863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:58.795468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ac443-22e9-495b-bcb6-62daabbf0b6c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:58.829556 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 826/1661] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:11:58 2022] PUT /identity/v3/projects/53b82ff8a0604c44b17a8fc9887f7a57/users/f2c12c1d99cf42b699ed44b373c90862/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:58.845257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:58.845513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:58.850062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:58.875389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 836/1662] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:58.892395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:58.896056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.906791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] MFA Rules not processed for user `f2c12c1d99cf42b699ed44b373c90862`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:58.908027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:58.920398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f699f-0880-4700-a983-e8f1aa81db8b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:59.029871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:59.030454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.030735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.031010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.040137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:59.042138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:59.080528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 837/1663] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:11:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:11:59.099566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 827/1664] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:11:59.101555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:59.127616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:59.134490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:59.262586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecc5b9-c032-4e67-9f42-e4e659bb9afd service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:59.274783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:59.275423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.275714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.275987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.276737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:59.278859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:59.327113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c0ddc-02a4-41da-9698-f12d4089b25d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:59.333378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:59.334269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.335373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.336716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] PATH_INFO: `/v3/projects/227773d41ee74984b9ccc7a9668057ce` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.337859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=227773d41ee74984b9ccc7a9668057ce)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:59.341534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:59.344246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 838/1665] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:11:59 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:11:59.349371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:59.362379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:59.473957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227773d41ee74984b9ccc7a9668057ce', 'request_id': 'req-51d5778a-9167-4821-b775-16aebff588ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:59.499663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227773d41ee74984b9ccc7a9668057ce', 'request_id': 'req-51d5778a-9167-4821-b775-16aebff588ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:59.524729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227773d41ee74984b9ccc7a9668057ce', 'request_id': 'req-51d5778a-9167-4821-b775-16aebff588ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:59.541522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] The token cache is being invalidate because project 227773d41ee74984b9ccc7a9668057ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:11:59.542138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:59.544796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51d5778a-9167-4821-b775-16aebff588ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:11:59.547822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 828/1666] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:11:59 2022] DELETE /identity/v3/projects/227773d41ee74984b9ccc7a9668057ce => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:11:59.559139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d68c58-bce2-4688-af2b-80de95ea8873 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.559611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d68c58-bce2-4688-af2b-80de95ea8873 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.559891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d68c58-bce2-4688-af2b-80de95ea8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.561770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:11:59.589191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a765e0-3eb2-4703-a886-bff99ae68faf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:59.608252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-46d68c58-bce2-4688-af2b-80de95ea8873 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:59.612342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46d68c58-bce2-4688-af2b-80de95ea8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:59.752603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:59.753246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.757339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.758055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.758750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:59.766207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:59.851294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 839/1667] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:11:59 2022] POST /identity/v3/users => generated 293 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:11:59.859069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:11:59.867048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:11:59.899001 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 829/1668] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:11:59.914270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.914593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.914838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.930485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1362-8043-4605-8b10-cb3e09558b02 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:11:59.957549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:11:59.962202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:11:59.965198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:11:59.965549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:11:59.974387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:11:59.983221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:11:59.986250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:11:59.988060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:00.000421 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 830/1669] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:00.011283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.022782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698c94e-5ba8-45c5-81e9-db4bb025f6e7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.033173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.035257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.035550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.035829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.037236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:00.037363 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 840/1670] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:00.037564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.039303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.040677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.076034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 831/1671] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:00.080912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.087669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41dbec-bdef-4d8c-a064-743182f2340f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.104911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdc49-7608-4c8a-84f5-b012ecb7ba67 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.112453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.113759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.114274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.114863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.115748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.118930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.125511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.130088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.130800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.131140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] PATH_INFO: `/v3/projects/5c7f18fd09664343b49d15caace79cce/users/4973a67dde9d48359195efd5c8c8f0bf/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.186333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7f18fd09664343b49d15caace79cce, user_id=4973a67dde9d48359195efd5c8c8f0bf, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.191339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.199111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 832/1672] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:00 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:00.204020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.231676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 841/1673] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:00 2022] PUT /identity/v3/projects/5c7f18fd09664343b49d15caace79cce/users/4973a67dde9d48359195efd5c8c8f0bf/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:00.243214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.314386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:00.357877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f1793-d12b-409d-96e6-d795d81454cd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.442814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb992bd-a011-47a9-8e50-02436b4819a0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.454597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.455397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.455732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.456331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.457095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.463339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.464244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.464544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.464936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.466008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.468363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.470535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.503216 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 833/1674] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:00 2022] POST /identity/v3/users => generated 295 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:00.507823 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 842/1675] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:00.508267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.508921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.520864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566714-c5d5-4bb5-ba02-4b0d57eb2695 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.528981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288c10-3f3c-40cf-a397-61bc491ef66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.533186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288c10-3f3c-40cf-a397-61bc491ef66c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.534190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288c10-3f3c-40cf-a397-61bc491ef66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.534190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288c10-3f3c-40cf-a397-61bc491ef66c admin admin] PATH_INFO: `/v3/projects/5c7f18fd09664343b49d15caace79cce/users/4973a67dde9d48359195efd5c8c8f0bf/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.537468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288c10-3f3c-40cf-a397-61bc491ef66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7f18fd09664343b49d15caace79cce, user_id=4973a67dde9d48359195efd5c8c8f0bf, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.542327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288c10-3f3c-40cf-a397-61bc491ef66c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.559191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f736b-fc2f-4322-b0d6-0e30b3bc13d9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.579185 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 843/1676] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:00 2022] PUT /identity/v3/projects/5c7f18fd09664343b49d15caace79cce/users/4973a67dde9d48359195efd5c8c8f0bf/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:00.580685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe43f-d322-42da-9244-dc90193507a3 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.581123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe43f-d322-42da-9244-dc90193507a3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.581588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbe43f-d322-42da-9244-dc90193507a3 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.583254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 844/1677] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:00.594793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.595416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.595878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.633102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:00.634878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:00.691942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:00.694841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c19e-e9cb-4bc8-afe3-59a1d158baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.695667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c19e-e9cb-4bc8-afe3-59a1d158baed admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.695999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c19e-e9cb-4bc8-afe3-59a1d158baed admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.696276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c19e-e9cb-4bc8-afe3-59a1d158baed admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.697841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c19e-e9cb-4bc8-afe3-59a1d158baed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.699666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c19e-e9cb-4bc8-afe3-59a1d158baed admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.714031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 834/1678] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:00.716548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.717110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.717862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.757244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] MFA Rules not processed for user `4973a67dde9d48359195efd5c8c8f0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:00.758919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:00.761922 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 845/1679] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:12:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:00.763108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.779858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1714bf3-03ca-43e2-97d8-db7c4f8d7827 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.790195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.790897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.792086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.792635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.793875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.797348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.819179 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 846/1680] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:00.820792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.822986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:00.841239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a0aee-b0f0-4307-bc8e-e1dc33e4eda3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.848395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.849157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.849514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.849885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.860490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.863205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:00.880669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 835/1681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:00.880669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.880948 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 847/1682] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:00.889200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:00.891985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:00.903666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1364f-ef3f-4158-b327-256dd11c2cad None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:00.910336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c81ef8-194f-4845-95b5-8d0a45c07678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:00.911276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c81ef8-194f-4845-95b5-8d0a45c07678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:00.911659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c81ef8-194f-4845-95b5-8d0a45c07678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:00.912028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c81ef8-194f-4845-95b5-8d0a45c07678 admin admin] PATH_INFO: `/v3/projects/aca95dca6f30483cbee8f76f53183952/users/7411cbe975c1420c99213bd29bab0515/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:00.930104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:00.957465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c81ef8-194f-4845-95b5-8d0a45c07678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca95dca6f30483cbee8f76f53183952, user_id=7411cbe975c1420c99213bd29bab0515, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:00.963060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c81ef8-194f-4845-95b5-8d0a45c07678 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:01.000826 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 836/1683] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:00 2022] PUT /identity/v3/projects/aca95dca6f30483cbee8f76f53183952/users/7411cbe975c1420c99213bd29bab0515/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:01.011158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.011627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.011893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.078755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] MFA Rules not processed for user `7411cbe975c1420c99213bd29bab0515`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:01.080041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:01.145107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679363a5-be6c-49ea-85bc-4a1a546a869b service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:01.221851 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 837/1684] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:01.223347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:01.395723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7bd82-e4a2-4ebc-9c1a-c11606a78afb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:01.397404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1854bab-7d4c-457e-b960-2d297edd6f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:01.398050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1854bab-7d4c-457e-b960-2d297edd6f51 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.398341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1854bab-7d4c-457e-b960-2d297edd6f51 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.398608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1854bab-7d4c-457e-b960-2d297edd6f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.404976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:01.405637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.405922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.406467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.407140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:01.409119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:01.459616 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 838/1685] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:01 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:01.463251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:01.539426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:01.589465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1854bab-7d4c-457e-b960-2d297edd6f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:01.591125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1854bab-7d4c-457e-b960-2d297edd6f51 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:01.619371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 848/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:01.623637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.623930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.624413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.643399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f487f8-ad5f-49c5-b682-565bc13c3c42 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:01.678881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:01.685183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.685485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.689139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.694418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:01.701488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:01.702652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:01.704510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:01.733180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:01.767381 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 839/1687] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:01 2022] POST /identity/v3/users => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:01.769157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:01.797516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d15226-fa86-43fa-8753-57d958f5ecdb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:01.799029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 849/1688] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:01.814124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:01.814743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.815027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.815303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.815963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:01.820392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:01.862076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 840/1689] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:01.866680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:01.880797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090eb2d-3900-4836-9f91-5feff5feea81 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:01.891896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:01.892598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:01.892911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:01.893163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] PATH_INFO: `/v3/projects/1d7580a9eacc4c29afd52ee729f82464/users/b01ef08e0ba14c9883dfcd27cb5e3d6f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:01.905565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:01.910436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:01.915237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7580a9eacc4c29afd52ee729f82464, user_id=b01ef08e0ba14c9883dfcd27cb5e3d6f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:01.917932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:01.939117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 850/1690] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:01 2022] PUT /identity/v3/projects/1d7580a9eacc4c29afd52ee729f82464/users/b01ef08e0ba14c9883dfcd27cb5e3d6f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:01.943099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:02.021072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826a2c9-e5fd-46b7-9949-20defd9faf74 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:02.066658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2231-ab42-4232-8df2-fafa752e6b16 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:02.072767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:02.073506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:02.073856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:02.074222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:02.075100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:02.082392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:02.098191 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 851/1691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:02.098191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:02.102391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:02.146226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:02.148278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:02.148470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:02.148995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:02.154794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:02.239184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:02.242353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:02.243281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9d6f2-acac-40a8-ae84-b61aadb3ec64 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:02.254122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81698671-f701-4c89-a8b7-c22b98a8825d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:02.254797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698671-f701-4c89-a8b7-c22b98a8825d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:02.255077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698671-f701-4c89-a8b7-c22b98a8825d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:02.255350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698671-f701-4c89-a8b7-c22b98a8825d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:02.265884 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 841/1692] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:02.268194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:02.286812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81698671-f701-4c89-a8b7-c22b98a8825d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:02.289390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81698671-f701-4c89-a8b7-c22b98a8825d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:02.309070 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 852/1693] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:02.311378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c391c8c-ea59-4beb-b87c-fa26b4573fc6 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:02.324956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:02.326186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:02.326186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:02.326708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] PATH_INFO: `/v3/projects/1d7580a9eacc4c29afd52ee729f82464/users/b01ef08e0ba14c9883dfcd27cb5e3d6f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:02.331508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7580a9eacc4c29afd52ee729f82464, user_id=b01ef08e0ba14c9883dfcd27cb5e3d6f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:02.333986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:02.355256 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 842/1694] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:02 2022] PUT /identity/v3/projects/1d7580a9eacc4c29afd52ee729f82464/users/b01ef08e0ba14c9883dfcd27cb5e3d6f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:02.372035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:02.372035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:02.372035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:02.381433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:02.441337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] MFA Rules not processed for user `b01ef08e0ba14c9883dfcd27cb5e3d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:02.442785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:02.648707 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 853/1695] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:02.779401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:02.784634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:02.869897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dc190-7073-4496-9da8-116ce512c811 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:02.876372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:02.877582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:02.877582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:02.877582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:02.938316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:02.941436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:02.953121 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 843/1696] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:03.811014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:03.894563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:03.896916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:03.970398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21c82b-db86-49c6-9181-da2bce350261 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:03.994810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:03.995750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:03.996035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:03.996345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] PATH_INFO: `/v3/users/f2c12c1d99cf42b699ed44b373c90862` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:03.998579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c12c1d99cf42b699ed44b373c90862)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:04.002826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:04.074546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d572e-4045-49d6-8c85-9aafaade11ec service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:04.081361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:04.082231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:04.082731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:04.083168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] PATH_INFO: `/v3/users/065d16e8aa9145b9a2d21d573af6e37a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:04.086415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065d16e8aa9145b9a2d21d573af6e37a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:04.088818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:04.105032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c12c1d99cf42b699ed44b373c90862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.120691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c12c1d99cf42b699ed44b373c90862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.123346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c12c1d99cf42b699ed44b373c90862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.124359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c12c1d99cf42b699ed44b373c90862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.135639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c12c1d99cf42b699ed44b373c90862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.157045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:04.159119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 854/1697] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:03 2022] DELETE /identity/v3/users/f2c12c1d99cf42b699ed44b373c90862 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:04.160597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:04.165129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:04.166404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065d16e8aa9145b9a2d21d573af6e37a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.176746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065d16e8aa9145b9a2d21d573af6e37a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.178790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065d16e8aa9145b9a2d21d573af6e37a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.179832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065d16e8aa9145b9a2d21d573af6e37a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.181071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:04.202720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b169abb-d2b3-428a-a6a7-0f2501bd7af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065d16e8aa9145b9a2d21d573af6e37a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:04.237914 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 844/1698] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:03 2022] DELETE /identity/v3/users/065d16e8aa9145b9a2d21d573af6e37a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:04.244649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b670c-4d54-4ae1-8875-c24fe3ddc823 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:04.244937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b670c-4d54-4ae1-8875-c24fe3ddc823 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:04.245210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b670c-4d54-4ae1-8875-c24fe3ddc823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:04.289908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8b4b670c-4d54-4ae1-8875-c24fe3ddc823 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:04.289908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b4b670c-4d54-4ae1-8875-c24fe3ddc823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:04.298424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a0c0a-ecdb-4008-97ec-c7984b8f051f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:04.404759 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 845/1699] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:04.405773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359781-22f9-4df7-9936-713013847e54 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:04.406072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359781-22f9-4df7-9936-713013847e54 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:04.406384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359781-22f9-4df7-9936-713013847e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:04.443805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:04.445644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:04.445644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:04.445903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:04.448009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-38359781-22f9-4df7-9936-713013847e54 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:04.448148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:04.450968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38359781-22f9-4df7-9936-713013847e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:04.464748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 846/1700] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:04.467252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359781-22f9-4df7-9936-713013847e54 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:04.469356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38359781-22f9-4df7-9936-713013847e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:04.565967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359781-22f9-4df7-9936-713013847e54 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:04.566738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:04.569184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:04.570847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:04.571542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:04.571828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:04.572104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:04.582581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:04.584145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:04.586222 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 855/1701] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:04.587655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:04.597521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539ca1b-7521-416c-987a-b5319f4d204e service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:04.603182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:04.603927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:04.604279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:04.604824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:04.618511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:04.620584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:04.626535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 847/1702] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:04.634010 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 856/1703] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:05.401776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:05.403243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:05.423307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ecda3-1d92-400d-8039-da86092ae3d0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:05.439306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:05.439674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:05.439674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:05.439924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] PATH_INFO: `/v3/projects/866a694ea6f742a799c7105fd8398022` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:05.441417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866a694ea6f742a799c7105fd8398022)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:05.443412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:05.505242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:05.508543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:05.519017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866a694ea6f742a799c7105fd8398022', 'request_id': 'req-6eb6c8c7-f38e-4355-bfda-d0fca278b476'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.520519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:05.532513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c414d-c0a8-48cf-9442-62cae8be46ae service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:05.534233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866a694ea6f742a799c7105fd8398022', 'request_id': 'req-6eb6c8c7-f38e-4355-bfda-d0fca278b476'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.546811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866a694ea6f742a799c7105fd8398022', 'request_id': 'req-6eb6c8c7-f38e-4355-bfda-d0fca278b476'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.573799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:05.580947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] The token cache is being invalidate because project 866a694ea6f742a799c7105fd8398022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:05.581329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.582485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.585522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 848/1704] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:05 2022] DELETE /identity/v3/projects/866a694ea6f742a799c7105fd8398022 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:05.589055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:05.591537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:05.627069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:05.627629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:05.627907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:05.628180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] PATH_INFO: `/v3/projects/53b82ff8a0604c44b17a8fc9887f7a57` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:05.629335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b82ff8a0604c44b17a8fc9887f7a57)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:05.631274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:05.698585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b82ff8a0604c44b17a8fc9887f7a57', 'request_id': 'req-0053f1c9-a9ae-45d6-983c-c320516f5c11'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.708404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b82ff8a0604c44b17a8fc9887f7a57', 'request_id': 'req-0053f1c9-a9ae-45d6-983c-c320516f5c11'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.711806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c8c7-f38e-4355-bfda-d0fca278b476 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:05.716905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b82ff8a0604c44b17a8fc9887f7a57', 'request_id': 'req-0053f1c9-a9ae-45d6-983c-c320516f5c11'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.738624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] The token cache is being invalidate because project 53b82ff8a0604c44b17a8fc9887f7a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:05.739107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.740806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.746215 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 857/1705] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:05 2022] DELETE /identity/v3/projects/53b82ff8a0604c44b17a8fc9887f7a57 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:05.748676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:05.762506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:05.816858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:05.816858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:05.816858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:05.816858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] PATH_INFO: `/v3/users/33b8d2dfaf654bc495f95d468f1c63a3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:05.817216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b8d2dfaf654bc495f95d468f1c63a3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:05.821944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:05.857459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053f1c9-a9ae-45d6-983c-c320516f5c11 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:05.863943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:05.870813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:05.871242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:05.871650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] PATH_INFO: `/v3/users/4973a67dde9d48359195efd5c8c8f0bf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:05.873172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4973a67dde9d48359195efd5c8c8f0bf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:05.875408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:05.892931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b8d2dfaf654bc495f95d468f1c63a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.911234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b8d2dfaf654bc495f95d468f1c63a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.912018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b8d2dfaf654bc495f95d468f1c63a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.915172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b8d2dfaf654bc495f95d468f1c63a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.935105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b8d2dfaf654bc495f95d468f1c63a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.962987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4973a67dde9d48359195efd5c8c8f0bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.977172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:05.984637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4973a67dde9d48359195efd5c8c8f0bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.985623 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 849/1706] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:05 2022] DELETE /identity/v3/users/33b8d2dfaf654bc495f95d468f1c63a3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:05.986022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4973a67dde9d48359195efd5c8c8f0bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.987201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4973a67dde9d48359195efd5c8c8f0bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:05.999766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4973a67dde9d48359195efd5c8c8f0bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.019414 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 858/1707] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:05 2022] DELETE /identity/v3/users/4973a67dde9d48359195efd5c8c8f0bf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:06.488253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:06.489712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:06.497766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:06.570647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:06.572285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:06.585101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a842-5f10-491c-bcea-682e345c5202 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:06.661110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5084f-dc2d-4c98-ad7b-7ddb16733f0c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:06.667367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:06.668530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:06.669155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:06.669640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] PATH_INFO: `/v3/users/5c2b4cbf702a4666ae9eb9a7c3be8aeb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:06.671254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2b4cbf702a4666ae9eb9a7c3be8aeb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:06.674231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:06.683273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:06.684216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:06.685473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:06.685752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] PATH_INFO: `/v3/projects/43366373a52941278e049d18d295db9a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:06.687390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43366373a52941278e049d18d295db9a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:06.689818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:06.748500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2b4cbf702a4666ae9eb9a7c3be8aeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.758417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43366373a52941278e049d18d295db9a', 'request_id': 'req-9b3f0aa9-ed14-4b01-a402-0e3414d03763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.765213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43366373a52941278e049d18d295db9a', 'request_id': 'req-9b3f0aa9-ed14-4b01-a402-0e3414d03763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.765766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2b4cbf702a4666ae9eb9a7c3be8aeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.766742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2b4cbf702a4666ae9eb9a7c3be8aeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.767986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2b4cbf702a4666ae9eb9a7c3be8aeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.778022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43366373a52941278e049d18d295db9a', 'request_id': 'req-9b3f0aa9-ed14-4b01-a402-0e3414d03763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.792142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a592726-8ea1-438b-82fd-04290d972a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2b4cbf702a4666ae9eb9a7c3be8aeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.794943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] The token cache is being invalidate because project 43366373a52941278e049d18d295db9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:06.795179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.795718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b3f0aa9-ed14-4b01-a402-0e3414d03763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:06.797653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 850/1708] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:06 2022] DELETE /identity/v3/projects/43366373a52941278e049d18d295db9a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:06.806747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6b70-7404-4169-88dd-18eadbbaef11 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:06.807390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6b70-7404-4169-88dd-18eadbbaef11 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:06.808328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6b70-7404-4169-88dd-18eadbbaef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:06.819062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 859/1709] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:06 2022] DELETE /identity/v3/users/5c2b4cbf702a4666ae9eb9a7c3be8aeb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:06.823534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:06.823855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:06.824140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:06.851356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a25b6b70-7404-4169-88dd-18eadbbaef11 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:06.853152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a25b6b70-7404-4169-88dd-18eadbbaef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:06.856330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:06.857730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:06.921245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:06.931850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:06.951730 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 860/1710] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:06.962240 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 851/1711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:06.966563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:06.967991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:06.971130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:06.971566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:06.971956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.023235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:07.024934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:07.036496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 852/1712] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:07.041323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.055272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ec9b2-844e-4a25-8587-c2b663be6cee None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.062065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.063660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.064314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.064730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.065543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:07.065924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.067080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42b150-6cdf-4d3e-8bc4-99f7a91f6b0c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.067758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.073409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.074362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.074644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.074918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.082953 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 853/1713] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:07.087981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.089228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.091582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.100092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23158813-aa1f-4b53-bb82-3c08d8a3e3d2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.105430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.106133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.106530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.106893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.107598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.109963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.123147 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 861/1714] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:07.149860 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 854/1715] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:07 2022] POST /identity/v3/projects => generated 395 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:07.151037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.162042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca41e4-143e-44d9-8f7b-e93667fe0bd4 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.250209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.250843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.251148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.251453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.252145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.254081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.297774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 862/1716] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:07 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:07.300610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.317842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f43a9-91da-41c8-b205-50f49a664528 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.327778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.328422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.328709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.328980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.329878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.331562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.344338 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 855/1717] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:07.348646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.349285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.351887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:07.365182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bfdb0-219d-4c3a-bfcd-81b026529c2b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.369448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62231ba2-5c7f-492c-ae89-16b4e1283805 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.373313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.374238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.374680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.375091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.375366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.376282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.376747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.377149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] PATH_INFO: `/v3/projects/82892e66c60043e6b0e5fb1fea959e1e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.378447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82892e66c60043e6b0e5fb1fea959e1e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.380612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.391328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.396333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.413920 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 863/1718] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:07.418070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.429998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56970170-6e04-4b66-ad38-f09da3800d37 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.436383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3231e8-0fe6-4d41-9fb3-044e84b0ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.437135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3231e8-0fe6-4d41-9fb3-044e84b0ce22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.437472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3231e8-0fe6-4d41-9fb3-044e84b0ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.437756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3231e8-0fe6-4d41-9fb3-044e84b0ce22 admin admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7/users/797eb0f9145142d68e5ab1e476b6c64c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.459045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3231e8-0fe6-4d41-9fb3-044e84b0ce22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c9ebdf73c4791809bd168bc6db6d7, user_id=797eb0f9145142d68e5ab1e476b6c64c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.462783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3231e8-0fe6-4d41-9fb3-044e84b0ce22 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.478259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82892e66c60043e6b0e5fb1fea959e1e', 'request_id': 'req-998fe712-1edd-4bd7-9bed-8f1c9e475a60'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.483327 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 864/1719] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:07 2022] PUT /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7/users/797eb0f9145142d68e5ab1e476b6c64c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:07.488620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82892e66c60043e6b0e5fb1fea959e1e', 'request_id': 'req-998fe712-1edd-4bd7-9bed-8f1c9e475a60'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.496817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.497120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.497587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.503929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82892e66c60043e6b0e5fb1fea959e1e', 'request_id': 'req-998fe712-1edd-4bd7-9bed-8f1c9e475a60'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.523976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] The token cache is being invalidate because project 82892e66c60043e6b0e5fb1fea959e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:07.524689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.526221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.528323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 856/1720] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:07 2022] DELETE /identity/v3/projects/82892e66c60043e6b0e5fb1fea959e1e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:07.532989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.533936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:07.542616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] MFA Rules not processed for user `797eb0f9145142d68e5ab1e476b6c64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:07.545209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:07.615590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:07.674180 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 865/1721] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:07.675707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.679800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:07.680876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe712-1edd-4bd7-9bed-8f1c9e475a60 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.701028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:07.789864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7c4ce-7576-4772-b247-0b87a08dba7c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:07.795119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.795632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:07.796354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.796824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.797196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] PATH_INFO: `/v3/projects/5c7f18fd09664343b49d15caace79cce` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.797557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.798681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7f18fd09664343b49d15caace79cce)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.799341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.799927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] PATH_INFO: `/v3/users/538ab4f198774251952cc683e5a2a400` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:07.801330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.802317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538ab4f198774251952cc683e5a2a400)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:07.807607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:07.918549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7f18fd09664343b49d15caace79cce', 'request_id': 'req-760046f3-7cbc-49c5-b506-e85491bca993'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.918705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538ab4f198774251952cc683e5a2a400'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.925738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7f18fd09664343b49d15caace79cce', 'request_id': 'req-760046f3-7cbc-49c5-b506-e85491bca993'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.934443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538ab4f198774251952cc683e5a2a400'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.935916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538ab4f198774251952cc683e5a2a400'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.936775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7f18fd09664343b49d15caace79cce', 'request_id': 'req-760046f3-7cbc-49c5-b506-e85491bca993'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.937201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538ab4f198774251952cc683e5a2a400'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.951560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0b2f4446-e216-4d10-ae09-3a233c12a361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538ab4f198774251952cc683e5a2a400'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.959344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] The token cache is being invalidate because project 5c7f18fd09664343b49d15caace79cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:07.959813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.961491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:07.979222 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 866/1722] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:07 2022] DELETE /identity/v3/projects/5c7f18fd09664343b49d15caace79cce => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:07.980152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:07.985512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:07.989891 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 857/1723] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:07 2022] DELETE /identity/v3/users/538ab4f198774251952cc683e5a2a400 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:07.992073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5adf85-66b7-41bc-b7e5-f7b26b903b72 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:07.992073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5adf85-66b7-41bc-b7e5-f7b26b903b72 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:07.992406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5adf85-66b7-41bc-b7e5-f7b26b903b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.016938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5d5adf85-66b7-41bc-b7e5-f7b26b903b72 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:08.018315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5d5adf85-66b7-41bc-b7e5-f7b26b903b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.085792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760046f3-7cbc-49c5-b506-e85491bca993 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.092076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.098853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.098853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.098853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.098853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.098853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.099838 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 858/1724] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:08.102285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.102727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.103983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.127275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:08.137930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:08.139595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.140960 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 867/1725] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:07 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:08.145406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.212253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:08.232322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c0ce-b411-4431-bf33-bb985ba15cb6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.248077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.249208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.249694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.250207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.251436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.254005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.261483 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 859/1726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:08.265409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.282114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b02e1-ca53-45fe-a2a2-7290859a379a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.289117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.289855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.290165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.290437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.291197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:08.291393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.300694 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 868/1727] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:08.300881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.302319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.312563 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 860/1728] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:08.316316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf20cc-2ea7-4926-ac88-919435583d7f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.316465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.324122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.325069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.325546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.325938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.326632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.328233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.331844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06ca2-52dd-4d72-ba9d-f29b3b398782 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.338051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.338951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.339402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.339703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.340450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.343751 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 869/1729] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:08.343907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.344962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.360535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18778e2-d9f2-499e-874d-2b004d587a16 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.368013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.368793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.369078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.369355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] PATH_INFO: `/v3/projects/77db7ea0cfcf4b749b676dcd978bc3fb/users/7cc687eb7eb949f78523d1d0669eaf0f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.380668 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 861/1730] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:08.386095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.394478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77db7ea0cfcf4b749b676dcd978bc3fb, user_id=7cc687eb7eb949f78523d1d0669eaf0f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.399055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.425133 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 870/1731] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:08 2022] PUT /identity/v3/projects/77db7ea0cfcf4b749b676dcd978bc3fb/users/7cc687eb7eb949f78523d1d0669eaf0f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:08.431747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.487390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402dad2-0a2e-46a8-b491-3a2bf1e3d011 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.568833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b020a93-4915-4a80-bf6b-3db03c7d3f39 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.575530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.576152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.576581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.576698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.577333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.578985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.590514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.591155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.591469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.591717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.592371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.594652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.603605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 871/1732] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:08.604692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.608420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.625107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71828-d2f4-4d40-8a65-b3d67a1bf776 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.625773 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 862/1733] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:08.626008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.633498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.634781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.635278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.635863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] PATH_INFO: `/v3/projects/b2f6d33ff078468dac18151f847fb544` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.637396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f6d33ff078468dac18151f847fb544)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.638031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8cdc-ff1e-4055-9d5e-527b8a6b0448 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.640587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.642949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.643678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.643949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.644229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] PATH_INFO: `/v3/projects/77db7ea0cfcf4b749b676dcd978bc3fb/users/7cc687eb7eb949f78523d1d0669eaf0f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.646618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77db7ea0cfcf4b749b676dcd978bc3fb, user_id=7cc687eb7eb949f78523d1d0669eaf0f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.650083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.670981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 863/1734] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:08 2022] PUT /identity/v3/projects/77db7ea0cfcf4b749b676dcd978bc3fb/users/7cc687eb7eb949f78523d1d0669eaf0f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:08.671858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.719338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:08.730003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:08.736485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f6d33ff078468dac18151f847fb544', 'request_id': 'req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:08.749835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f6d33ff078468dac18151f847fb544', 'request_id': 'req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:08.760291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f6d33ff078468dac18151f847fb544', 'request_id': 'req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:08.763296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd043a-5fd0-47dc-af23-24171dd1386d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.778280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] The token cache is being invalidate because project b2f6d33ff078468dac18151f847fb544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:08.778706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:08.780107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1c0e5ca6-693a-4843-891f-f0d0b5823bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:08.782206 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 872/1735] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:08 2022] DELETE /identity/v3/projects/b2f6d33ff078468dac18151f847fb544 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:08.783499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb9eb-d350-4b73-8f55-c9f2136ab079 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.783926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb9eb-d350-4b73-8f55-c9f2136ab079 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.784301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb9eb-d350-4b73-8f55-c9f2136ab079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.818427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f82fb9eb-d350-4b73-8f55-c9f2136ab079 None None] MFA Rules not processed for user `7cc687eb7eb949f78523d1d0669eaf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:08.820875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f82fb9eb-d350-4b73-8f55-c9f2136ab079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.854466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d76471-8920-471f-8dd0-0a673725522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.855106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76471-8920-471f-8dd0-0a673725522b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.855388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76471-8920-471f-8dd0-0a673725522b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.855658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76471-8920-471f-8dd0-0a673725522b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.856315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d76471-8920-471f-8dd0-0a673725522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.858421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d76471-8920-471f-8dd0-0a673725522b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.870066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 864/1736] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:08.871467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.871764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.872028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.895369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:08.896598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.905663 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 865/1737] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:08.906338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.907583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.919707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4e3ad-8c62-4013-afa5-ccf14f10c0bc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.924795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.925453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.925738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.926014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.926699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.928437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:08.939644 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 873/1738] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:08.940917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.941203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.941481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.941972 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 866/1739] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:08.947130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.962350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fdc74-a012-4265-951b-72f03139764a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:08.964226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:08.965497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.971148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:08.972264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:08.972949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:08.973414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] PATH_INFO: `/v3/projects/9c81b70119684ef69f3aa9bad960701c/users/da48643198534666b0a4f1b2ca1ab65b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:08.976327 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 874/1740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:08.977261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:08.978753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:08.995453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c81b70119684ef69f3aa9bad960701c, user_id=da48643198534666b0a4f1b2ca1ab65b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:08.995655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d4412-9496-42f4-ba45-cf0d9160ac87 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.000287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.004118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a598309-424a-4346-8198-6ab1419a30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.005079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598309-424a-4346-8198-6ab1419a30ea admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.005454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598309-424a-4346-8198-6ab1419a30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.005744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598309-424a-4346-8198-6ab1419a30ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.007633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a598309-424a-4346-8198-6ab1419a30ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.009870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a598309-424a-4346-8198-6ab1419a30ea admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.019226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 867/1741] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:08 2022] PUT /identity/v3/projects/9c81b70119684ef69f3aa9bad960701c/users/da48643198534666b0a4f1b2ca1ab65b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:09.021057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.064799 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 875/1742] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:08 2022] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:09.066174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.066522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.066799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.095473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef8bd3-2574-4ef5-908f-9a7fd1fe8415 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.097847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] MFA Rules not processed for user `da48643198534666b0a4f1b2ca1ab65b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:09.099212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:09.138472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:09.169464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.170100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.170444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.170722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.171413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:09.171713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.171822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 876/1743] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:09.172648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.175912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.185118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4a94-988e-4bf9-9768-210c49acd388 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.192960 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 868/1744] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:09.192960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.193188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.193188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.193188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.193188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.193499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.194860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.203601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396761-9970-4997-a488-4dfcfb4601bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.216043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:09.216256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.217064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.217450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.217831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.218857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.225812 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 877/1745] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:09.227516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.232504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.242855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483a4f7-00d0-4bd6-97d0-24c8d6c6ec26 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.252071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.253119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.253676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.254362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.255423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.258634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.280134 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 869/1746] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:09.281863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.307819 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 878/1747] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:09.309196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.379506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459f45-d636-4153-ac60-7ddf773ba3c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.425967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85790c1-436f-4a85-b678-e4cd396c9a72 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.448019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.448667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.448950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.449285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.449872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.451880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.480472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 879/1748] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:09.480472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.482022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.482272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.482560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.482907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.483686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.485442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.491777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc9493-1b20-4bed-a19d-b2672d62e7f8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.496718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.497595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.497948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.498335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.499037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.501859 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 870/1749] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:09.503597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.504900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.520460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b2444-8345-4857-bcea-ccdfa817d734 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.527968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.528716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.529011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.529287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.530170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.531587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.537149 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 880/1750] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/users => generated 300 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:09.537149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.545520 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 871/1751] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:09.548745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006c824-6ded-40ed-a451-0adb8cdd0cb2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.551114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.554712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.555436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.555727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.556066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.556977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.559221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.564047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cbd9-140c-4f4a-b43d-6dd03c6ea3ef admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.572322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.573692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.574006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.574383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.575125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.576845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.595612 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 872/1752] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:09.595612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.608341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824558-0836-41cd-b1a3-6c0d81bfd100 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.617410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.618348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.618733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.619869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] PATH_INFO: `/v3/projects/0e5dc984f5f643f88dc8507aa240b10e/users/dacfe748931240fe924d6c988fe2c95f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.641899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5dc984f5f643f88dc8507aa240b10e, user_id=dacfe748931240fe924d6c988fe2c95f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.646024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.667647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 873/1753] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:09 2022] PUT /identity/v3/projects/0e5dc984f5f643f88dc8507aa240b10e/users/dacfe748931240fe924d6c988fe2c95f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:09.668709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.681094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:09.711915 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 881/1754] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:09.713554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.727468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229c24-f77d-4009-af51-3595ec7b8141 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.761413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9d58-5787-4d3e-8251-c6c0f4d490d4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.768779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.769416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.769707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.769988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.770695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.772980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.808315 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 874/1755] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:09.809716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.815345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.816081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.816655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.818378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.819415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.821341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.827766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457708-cf4d-4c07-a468-d9f82ba96587 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.833777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.835185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.835474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.839668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] PATH_INFO: `/v3/projects/05fdea5e921243a58ba0f966ea3cba67/users/225a66331fe9421ca8e194e51ceaf9f9/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.840945 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 882/1756] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:09.842067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.854506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e28f55-a485-48fc-8a4b-f5e1ddab9834 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:09.857586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fdea5e921243a58ba0f966ea3cba67, user_id=225a66331fe9421ca8e194e51ceaf9f9, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.860267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79289db0-6797-4fc7-8ed3-0b019d2fa4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:09.861517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.862203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79289db0-6797-4fc7-8ed3-0b019d2fa4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.862676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79289db0-6797-4fc7-8ed3-0b019d2fa4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.863135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79289db0-6797-4fc7-8ed3-0b019d2fa4fc admin admin] PATH_INFO: `/v3/projects/4d167a4931d74cefb01b1de904e1e758/users/2129aee110d04bc88f02937bcdc1c336/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.882671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79289db0-6797-4fc7-8ed3-0b019d2fa4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d167a4931d74cefb01b1de904e1e758, user_id=2129aee110d04bc88f02937bcdc1c336, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:09.885863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79289db0-6797-4fc7-8ed3-0b019d2fa4fc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:09.894454 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 875/1757] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:09 2022] PUT /identity/v3/projects/05fdea5e921243a58ba0f966ea3cba67/users/225a66331fe9421ca8e194e51ceaf9f9/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:09.895554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:09.907109 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 883/1758] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:09 2022] PUT /identity/v3/projects/4d167a4931d74cefb01b1de904e1e758/users/2129aee110d04bc88f02937bcdc1c336/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:09.908654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf6b72-bc49-4489-85cc-3d9217b32736 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:09.909037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf6b72-bc49-4489-85cc-3d9217b32736 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:09.909486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf6b72-bc49-4489-85cc-3d9217b32736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:09.939020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:09.954094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-24bf6b72-bc49-4489-85cc-3d9217b32736 None None] MFA Rules not processed for user `225a66331fe9421ca8e194e51ceaf9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:09.955794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24bf6b72-bc49-4489-85cc-3d9217b32736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:09.972971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1101f-0bed-4b8a-bb20-593fa86f0482 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.061636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9888a1-7530-449b-98c2-660edcf5f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.062856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9888a1-7530-449b-98c2-660edcf5f5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.063151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9888a1-7530-449b-98c2-660edcf5f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.063434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9888a1-7530-449b-98c2-660edcf5f5f7 admin admin] PATH_INFO: `/v3/projects/0e5dc984f5f643f88dc8507aa240b10e/users/dacfe748931240fe924d6c988fe2c95f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.073719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9888a1-7530-449b-98c2-660edcf5f5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5dc984f5f643f88dc8507aa240b10e, user_id=dacfe748931240fe924d6c988fe2c95f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.077262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9888a1-7530-449b-98c2-660edcf5f5f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.096833 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 876/1759] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:09 2022] PUT /identity/v3/projects/0e5dc984f5f643f88dc8507aa240b10e/users/dacfe748931240fe924d6c988fe2c95f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:10.097047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 884/1760] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:10.103732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.104337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.104829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.104952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.105124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.105404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.148988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] MFA Rules not processed for user `2129aee110d04bc88f02937bcdc1c336`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:10.150450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:10.161415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:10.165419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] MFA Rules not processed for user `dacfe748931240fe924d6c988fe2c95f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:10.168010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:10.274384 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 885/1761] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:10.279588 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 877/1762] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:10.286431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.343935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.347449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:10.383470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671b15b-4c5f-4b95-ac32-04475cd81af0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.390675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.391450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.391735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.392006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.392653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.394852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.432424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 886/1763] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:10 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:10.436117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.456197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:10.460462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2df2eb-5ad5-44f0-b461-ce64472dc10f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.518604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08f90d-aa42-4769-b874-cb010d998403 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.536469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.537372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.538084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.538612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.539632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.542001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.545573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.546270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.546558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.546837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.567426 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 887/1764] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:10 2022] POST /identity/v3/users => generated 306 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:10.571014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.583627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f892b-9bd4-4753-b039-52613a3e3091 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.590286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.590909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.591193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.591641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.592295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.593901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.602731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:10.605893 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 888/1765] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:10.609872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.622344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.624354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.624492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f65fd-1903-4205-bf68-8ddaee539b3d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.629596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.630882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.631527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.632026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] PATH_INFO: `/v3/projects/27428419952c4be18e0a726e36567907/users/3a90bd14f7014f30b54d8cdaa98a5c9a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.635669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 878/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:10.650811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27428419952c4be18e0a726e36567907, user_id=3a90bd14f7014f30b54d8cdaa98a5c9a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.653723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.668421 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 889/1767] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:10 2022] PUT /identity/v3/projects/27428419952c4be18e0a726e36567907/users/3a90bd14f7014f30b54d8cdaa98a5c9a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:10.672863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.685105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd461-0f9d-40d4-a410-08c4ade66326 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.689294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.771296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5bb40-494e-46c2-9a79-41c32a4c7d39 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.781429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c13ab-8383-4688-b81b-14d4ac4fdac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.781429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c13ab-8383-4688-b81b-14d4ac4fdac5 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.781429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c13ab-8383-4688-b81b-14d4ac4fdac5 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.781429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c13ab-8383-4688-b81b-14d4ac4fdac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.782908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.783630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.783918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.784258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.784971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.787755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.802649 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 879/1768] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:10.804237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:10.816797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815174f-168e-473d-a9f0-a2bb26aee3f2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:10.823263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bc24e-2521-407b-b337-8e4006da1837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:10.823946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc24e-2521-407b-b337-8e4006da1837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.824404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc24e-2521-407b-b337-8e4006da1837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.824683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc24e-2521-407b-b337-8e4006da1837 admin admin] PATH_INFO: `/v3/projects/27428419952c4be18e0a726e36567907/users/3a90bd14f7014f30b54d8cdaa98a5c9a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.827453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bc24e-2521-407b-b337-8e4006da1837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27428419952c4be18e0a726e36567907, user_id=3a90bd14f7014f30b54d8cdaa98a5c9a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.830248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bc24e-2521-407b-b337-8e4006da1837 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.844476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 880/1769] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:10 2022] PUT /identity/v3/projects/27428419952c4be18e0a726e36567907/users/3a90bd14f7014f30b54d8cdaa98a5c9a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:10.855112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:10.855407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:10.855664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:10.855778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c13ab-8383-4688-b81b-14d4ac4fdac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:10.857424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c13ab-8383-4688-b81b-14d4ac4fdac5 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:10.864575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:10.872054 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 890/1770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:10.889581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] MFA Rules not processed for user `3a90bd14f7014f30b54d8cdaa98a5c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:10.890600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:10.974116 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 881/1771] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:11.103153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fca67-2f9e-432b-9055-a448801ae00a None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.103431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fca67-2f9e-432b-9055-a448801ae00a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.104080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fca67-2f9e-432b-9055-a448801ae00a None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.105099 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 891/1772] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:11.110621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:12:11.164432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:11.188974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:11.266244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f644d-3f3b-4a7e-8a5b-2f1b1eeaa532 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:11.270994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1e1bb-9f68-4580-bc75-9bd5e3ef136f tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc687eb7eb949f78523d1d0669eaf0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77db7ea0cfcf4b749b676dcd978bc3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:11.271850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1e1bb-9f68-4580-bc75-9bd5e3ef136f tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.272702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1e1bb-9f68-4580-bc75-9bd5e3ef136f tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.273100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1e1bb-9f68-4580-bc75-9bd5e3ef136f tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.274455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1e1bb-9f68-4580-bc75-9bd5e3ef136f tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorizing `identity:get_project(project_id=b16c9ebdf73c4791809bd168bc6db6d7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:11.276570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1e1bb-9f68-4580-bc75-9bd5e3ef136f tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:11.278836 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 882/1773] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:12:11 2022] GET /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7 => generated 395 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:11.359758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fca67-2f9e-432b-9055-a448801ae00a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:11.374567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fca67-2f9e-432b-9055-a448801ae00a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:11.380030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:11.380727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.381072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.381647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.390656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:11.392396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:11.403105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 892/1774] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:11.675946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fabe95-76af-41b9-90a9-01afa68f747e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.676492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fabe95-76af-41b9-90a9-01afa68f747e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.676864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fabe95-76af-41b9-90a9-01afa68f747e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.680411 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 883/1775] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:11.685664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:12:11.710958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:11.735988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5359-d036-498d-b5e7-36c06126d44b service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:11.749571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc687eb7eb949f78523d1d0669eaf0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77db7ea0cfcf4b749b676dcd978bc3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:11.750369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.750676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.750945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.752285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorizing `identity:get_project(project_id=b16c9ebdf73c4791809bd168bc6db6d7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:11.754488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:11.756388 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 893/1776] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:12:11 2022] GET /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7 => generated 395 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:11.933345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a1be-d590-4062-99b3-2617b07b228c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.933632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a1be-d590-4062-99b3-2617b07b228c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.933931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a1be-d590-4062-99b3-2617b07b228c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.935321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 884/1777] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:11.940218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:12:11.942275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:11.961512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:11.971092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601dbca-05f8-4d65-a5bb-0417f0da7059 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:11.976457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98f95-d641-4bcb-a383-cf1449f1151a tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc687eb7eb949f78523d1d0669eaf0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77db7ea0cfcf4b749b676dcd978bc3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:11.977110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98f95-d641-4bcb-a383-cf1449f1151a tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:11.977396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98f95-d641-4bcb-a383-cf1449f1151a tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:11.977673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98f95-d641-4bcb-a383-cf1449f1151a tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:11.978853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98f95-d641-4bcb-a383-cf1449f1151a tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorizing `identity:get_project(project_id=b16c9ebdf73c4791809bd168bc6db6d7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:11.981591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98f95-d641-4bcb-a383-cf1449f1151a tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:11.983466 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 894/1778] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:12:11 2022] GET /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7 => generated 395 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:12:12.695260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a1be-d590-4062-99b3-2617b07b228c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:12.704328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bdc6a1be-d590-4062-99b3-2617b07b228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:12.815869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a1be-d590-4062-99b3-2617b07b228c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:12.822372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:12.823348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:12.823701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:12.824545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] PATH_INFO: `/v3/users/7411cbe975c1420c99213bd29bab0515` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:12.825786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7411cbe975c1420c99213bd29bab0515)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:12.828391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:12.900671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7411cbe975c1420c99213bd29bab0515'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:12.915938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7411cbe975c1420c99213bd29bab0515'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:12.916643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7411cbe975c1420c99213bd29bab0515'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:12.917484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7411cbe975c1420c99213bd29bab0515'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:12.926997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7411cbe975c1420c99213bd29bab0515'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:12.956198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 885/1779] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:12 2022] DELETE /identity/v3/users/7411cbe975c1420c99213bd29bab0515 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:12.961941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:12.963052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:12.963707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:12.996115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:12.997361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:12.998355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.000920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.014635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:13.107540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 895/1780] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:13.108702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:13.115331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.123134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d4e52-b023-4de1-a6fd-710fb8346b91 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:13.129019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:13.129713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.129946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.130267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] PATH_INFO: `/v3/users/da48643198534666b0a4f1b2ca1ab65b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.132002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=da48643198534666b0a4f1b2ca1ab65b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:13.133995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:13.197718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da48643198534666b0a4f1b2ca1ab65b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:13.206069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da48643198534666b0a4f1b2ca1ab65b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:13.206819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da48643198534666b0a4f1b2ca1ab65b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:13.207445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da48643198534666b0a4f1b2ca1ab65b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:13.214337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22ca4-a4db-4dbc-ba7e-9de1dfc28495 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:13.215253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da48643198534666b0a4f1b2ca1ab65b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:13.220191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:13.220815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.221101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.221377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.223163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.233146 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 886/1781] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:12 2022] DELETE /identity/v3/users/da48643198534666b0a4f1b2ca1ab65b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:13.234069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:13.235419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.297592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:13.299402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:13.307270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2da1-72c9-4dde-8865-e1865ac706cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:13.309408 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 896/1782] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:13.310411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:13.311902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.313303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:13.314048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.314351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.314617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.316644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.329475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1832f-4faf-4929-a8d2-d987222eea25 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:13.330409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:13.373891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:13.409259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:13.410759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41747d-6df1-4ab6-9b3c-ac77cbfceeab service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:13.422180 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 887/1783] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:13.423539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.423833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.424114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.445421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:13.446879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.457088 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 888/1784] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:13.466034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:13.466889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.467193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.467585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.469835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.476445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:13.477907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.506692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69187862-e484-4c04-b3af-8e52a63f23e0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:13.512064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077936a6-d5d7-4d67-8190-ce14965c5bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:13.513159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077936a6-d5d7-4d67-8190-ce14965c5bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.513493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077936a6-d5d7-4d67-8190-ce14965c5bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.513794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077936a6-d5d7-4d67-8190-ce14965c5bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.536978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077936a6-d5d7-4d67-8190-ce14965c5bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:13.539150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077936a6-d5d7-4d67-8190-ce14965c5bd6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:13.551359 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 889/1785] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:13.552714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:13.555531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:13.568245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 897/1786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:13.848850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6633dcb-a19f-4d99-a64f-1656d152f98f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.849808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6633dcb-a19f-4d99-a64f-1656d152f98f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.850512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6633dcb-a19f-4d99-a64f-1656d152f98f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.852306 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 890/1787] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:13.858640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:12:13.860618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.877482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:13.879765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.892980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6633dcb-a19f-4d99-a64f-1656d152f98f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:13.895203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6633dcb-a19f-4d99-a64f-1656d152f98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:13.925838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6633dcb-a19f-4d99-a64f-1656d152f98f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:13.937405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:13.938360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:13.938649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:13.938929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] PATH_INFO: `/v3/projects/aca95dca6f30483cbee8f76f53183952` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:13.943371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca95dca6f30483cbee8f76f53183952)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:13.947676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:14.034861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca95dca6f30483cbee8f76f53183952', 'request_id': 'req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.044663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca95dca6f30483cbee8f76f53183952', 'request_id': 'req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.045728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70333-0e1d-48da-8196-dbb6ba24d92a service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:14.055925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca95dca6f30483cbee8f76f53183952', 'request_id': 'req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.072828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] The token cache is being invalidate because project aca95dca6f30483cbee8f76f53183952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:14.073128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.073902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.075997 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 891/1788] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:13 2022] DELETE /identity/v3/projects/aca95dca6f30483cbee8f76f53183952 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:14.082976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:14.084399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:14.105644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:14.125170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc687eb7eb949f78523d1d0669eaf0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77db7ea0cfcf4b749b676dcd978bc3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:14.125833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:14.126395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:14.126681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:14.127892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorizing `identity:get_project(project_id=b16c9ebdf73c4791809bd168bc6db6d7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:14.130062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:14.132479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 898/1789] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:12:13 2022] GET /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7 => generated 395 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:14.155073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:14.157689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:14.202405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a3e77-a257-4577-a1c8-2f25ce4eee82 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:14.208080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:14.209692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:14.210334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:14.210781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] PATH_INFO: `/v3/users/b01ef08e0ba14c9883dfcd27cb5e3d6f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:14.212149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01ef08e0ba14c9883dfcd27cb5e3d6f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:14.214458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:14.248449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5f01-3784-40d3-a193-649686509a9e tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:14.261432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:14.261432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:14.261432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:14.261432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] PATH_INFO: `/v3/projects/9c81b70119684ef69f3aa9bad960701c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:14.261931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c81b70119684ef69f3aa9bad960701c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:14.264717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:14.283147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:14.296834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01ef08e0ba14c9883dfcd27cb5e3d6f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.308947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01ef08e0ba14c9883dfcd27cb5e3d6f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.312974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01ef08e0ba14c9883dfcd27cb5e3d6f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.315788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01ef08e0ba14c9883dfcd27cb5e3d6f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.328554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01ef08e0ba14c9883dfcd27cb5e3d6f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.344612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c81b70119684ef69f3aa9bad960701c', 'request_id': 'req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.354188 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 892/1790] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:14 2022] DELETE /identity/v3/users/b01ef08e0ba14c9883dfcd27cb5e3d6f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:14.354810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c81b70119684ef69f3aa9bad960701c', 'request_id': 'req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.366456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c81b70119684ef69f3aa9bad960701c', 'request_id': 'req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.384540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] The token cache is being invalidate because project 9c81b70119684ef69f3aa9bad960701c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:14.384877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.385785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9ffbba8a-6645-4935-bb3a-5bcf7122c14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.390562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 899/1791] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:14 2022] DELETE /identity/v3/projects/9c81b70119684ef69f3aa9bad960701c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:14.392726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:14.394424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:14.483630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7946e45-e1ea-4358-bd77-0bfb6c318399 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:14.489303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:14.489967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:14.490279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:14.490603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] PATH_INFO: `/v3/users/dacfe748931240fe924d6c988fe2c95f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:14.492108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dacfe748931240fe924d6c988fe2c95f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:14.494059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:14.595151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dacfe748931240fe924d6c988fe2c95f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.609313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dacfe748931240fe924d6c988fe2c95f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.610417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dacfe748931240fe924d6c988fe2c95f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.611202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dacfe748931240fe924d6c988fe2c95f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.626338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dacfe748931240fe924d6c988fe2c95f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:14.652497 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 893/1792] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:14 2022] DELETE /identity/v3/users/dacfe748931240fe924d6c988fe2c95f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:14.783064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ee3e-d9f9-48c4-bf74-86fb5f2306f4 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:14.783339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ee3e-d9f9-48c4-bf74-86fb5f2306f4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:14.784398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ee3e-d9f9-48c4-bf74-86fb5f2306f4 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:14.786005 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 900/1793] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:14.805243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:12:14.807023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:14.850022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ee3e-d9f9-48c4-bf74-86fb5f2306f4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:14.851880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2db6ee3e-d9f9-48c4-bf74-86fb5f2306f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:14.907681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:14.958558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:14.960148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:14.985727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ee3e-d9f9-48c4-bf74-86fb5f2306f4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:14.995636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:14.996456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:14.996735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:14.997023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] PATH_INFO: `/v3/projects/1d7580a9eacc4c29afd52ee729f82464` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:14.998559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7580a9eacc4c29afd52ee729f82464)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.002172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.037526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864fb7b-e3e8-40a0-840b-593a4fe31ed1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.048839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc687eb7eb949f78523d1d0669eaf0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77db7ea0cfcf4b749b676dcd978bc3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.048839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.048839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.049126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.049560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorizing `identity:get_project(project_id=b16c9ebdf73c4791809bd168bc6db6d7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.052209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.055456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 894/1794] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:12:14 2022] GET /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7 => generated 395 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:15.067001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.070278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.072220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:15.101240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9f91-357a-435b-9e7b-6cd9aead0bf4 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.112612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.113261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.113542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.113815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] PATH_INFO: `/v3/projects/0e5dc984f5f643f88dc8507aa240b10e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.121706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5dc984f5f643f88dc8507aa240b10e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.129796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.161090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7580a9eacc4c29afd52ee729f82464', 'request_id': 'req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.172847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7580a9eacc4c29afd52ee729f82464', 'request_id': 'req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.190385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7580a9eacc4c29afd52ee729f82464', 'request_id': 'req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.215848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] The token cache is being invalidate because project 1d7580a9eacc4c29afd52ee729f82464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:15.216722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.218123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d1d72ec-5366-4b2b-9ef7-27745cf2e78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.220352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 901/1795] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:14 2022] DELETE /identity/v3/projects/1d7580a9eacc4c29afd52ee729f82464 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:15.222092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5dc984f5f643f88dc8507aa240b10e', 'request_id': 'req-6fceccfb-17d5-456e-bc8e-995d050765b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.225965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.226440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.227240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.243618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5dc984f5f643f88dc8507aa240b10e', 'request_id': 'req-6fceccfb-17d5-456e-bc8e-995d050765b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.255225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5dc984f5f643f88dc8507aa240b10e', 'request_id': 'req-6fceccfb-17d5-456e-bc8e-995d050765b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.273698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:15.274527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] The token cache is being invalidate because project 0e5dc984f5f643f88dc8507aa240b10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:15.274892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.275008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.275702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fceccfb-17d5-456e-bc8e-995d050765b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:15.278046 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 895/1796] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:15 2022] DELETE /identity/v3/projects/0e5dc984f5f643f88dc8507aa240b10e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:15.279289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f656-0e02-4bb4-b473-7da7cc5b3919 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.279913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f656-0e02-4bb4-b473-7da7cc5b3919 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.280204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f656-0e02-4bb4-b473-7da7cc5b3919 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.282971 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 896/1797] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:15.286726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dd426-eb74-4491-920f-34d22bee8eea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.286726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dd426-eb74-4491-920f-34d22bee8eea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.286726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dd426-eb74-4491-920f-34d22bee8eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.315232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-826dd426-eb74-4491-920f-34d22bee8eea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:15.316976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-826dd426-eb74-4491-920f-34d22bee8eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.355740 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 902/1798] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:15.357325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:12:15.358905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.385038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:15.403050 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 897/1799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:15.416014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002c80-bd93-4f88-95be-4955ad51f950 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.416376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002c80-bd93-4f88-95be-4955ad51f950 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.416726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002c80-bd93-4f88-95be-4955ad51f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.445647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f6002c80-bd93-4f88-95be-4955ad51f950 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:15.447087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6002c80-bd93-4f88-95be-4955ad51f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.456872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.458163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.469548 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 898/1800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:15.471160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.472238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.472917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.501520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:15.502852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:15.528290 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 899/1801] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:15.529234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.533668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:15.543048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb55a-9278-4478-9562-255deb5eb69d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.549056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.549787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.550078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.550647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.551721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:15.551721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.553386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.567438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 900/1802] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:15.568278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.573582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b128dc-5f5d-4e31-9a5a-a9ccda869b1f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.583319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc687eb7eb949f78523d1d0669eaf0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77db7ea0cfcf4b749b676dcd978bc3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.584006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289e79-4dd5-4afa-9cce-15ac0550e749 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.585719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.586290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.586901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] PATH_INFO: `/v3/projects/05fdea5e921243a58ba0f966ea3cba67` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.588431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorizing `identity:get_project(project_id=05fdea5e921243a58ba0f966ea3cba67)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.590835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.591250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.591719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.592034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.592491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.594072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:15.594294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.595992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.602297 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 903/1803] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:12:15 2022] GET /identity/v3/projects/05fdea5e921243a58ba0f966ea3cba67 => generated 393 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:15.609796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.624663 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 901/1804] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:15.625323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.637495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9684eb9-60b3-46ad-ba1c-4e69ee7dc4dd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.638854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578a04e-2ff5-434c-ad69-b73ce23d1ed0 tempest-FlavorsAccessNegativeTestJSON-88177184 tempest-FlavorsAccessNegativeTestJSON-88177184-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.644991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.646028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.646528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.647239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.648588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.653874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.654577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.655223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.655510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.655855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.657567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.663582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.702886 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 904/1805] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/projects => generated 395 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:15.723439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.749444 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 902/1806] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:15.750378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.832519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ac30-f02d-458d-8ee1-144bd4a2c1fa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.896763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a543-da55-4b60-9f17-951031e52196 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.903004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.903654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.903989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.904203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.904847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.906955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.952049 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 903/1807] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:15.956613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:15.957081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:15.957362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:15.962412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:15.963397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:15.964951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:15.966351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:15.995948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566429f1-3ddd-489a-8da5-6a7c32705c56 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:15.998982 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 905/1808] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:15 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:15.998982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.001264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.016248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.016884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.017166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.017440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.017956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0cf7-a046-4209-89cc-1cf520f7fd94 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.018072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.020119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.024760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.025541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.025915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.026332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] PATH_INFO: `/v3/users/797eb0f9145142d68e5ab1e476b6c64c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.027726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=797eb0f9145142d68e5ab1e476b6c64c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.029948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.044775 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 904/1809] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:16.045579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.061808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e815f-9745-411c-96a3-f4bbf8d050df admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.070913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.072554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.072985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.073373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.074485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.102211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.108213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797eb0f9145142d68e5ab1e476b6c64c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.116072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 905/1810] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:16.117156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.126013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:16.133890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797eb0f9145142d68e5ab1e476b6c64c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.135454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797eb0f9145142d68e5ab1e476b6c64c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.136702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797eb0f9145142d68e5ab1e476b6c64c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.139500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9735-d61b-4a74-8441-ef1635d69bc3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.146966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.147820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.148104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.148272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797eb0f9145142d68e5ab1e476b6c64c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.148935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.149763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.151426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.171946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 906/1811] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:16.172931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.176322 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 906/1812] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:15 2022] DELETE /identity/v3/users/797eb0f9145142d68e5ab1e476b6c64c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:16.176322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.176552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.177485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.223583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7020f-c597-4aae-8f06-6f285189beff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.317052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1a82-4f95-46d4-b346-af5981576f0b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.324283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6f6da-ea75-4044-8c4e-786304d8ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.325120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6f6da-ea75-4044-8c4e-786304d8ed0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.325501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6f6da-ea75-4044-8c4e-786304d8ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.326116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6f6da-ea75-4044-8c4e-786304d8ed0f admin admin] PATH_INFO: `/v3/projects/60eb5e08f6f5427a82613b6cc3f9131c/users/6e3c2eb99c904e8fb736d69d51bf6c35/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.346638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6f6da-ea75-4044-8c4e-786304d8ed0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb5e08f6f5427a82613b6cc3f9131c, user_id=6e3c2eb99c904e8fb736d69d51bf6c35, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.349856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6f6da-ea75-4044-8c4e-786304d8ed0f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.368856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:16.385952 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 907/1813] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:16 2022] PUT /identity/v3/projects/60eb5e08f6f5427a82613b6cc3f9131c/users/6e3c2eb99c904e8fb736d69d51bf6c35/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:16.388476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9032-81e7-4a94-8f98-120cee813337 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.388825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9032-81e7-4a94-8f98-120cee813337 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.389162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9032-81e7-4a94-8f98-120cee813337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.396364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.406299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.406727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.407125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.407904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.410339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.426876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-130a9032-81e7-4a94-8f98-120cee813337 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:16.428914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-130a9032-81e7-4a94-8f98-120cee813337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.431496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 907/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:16.432519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.436868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.459700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb812c-623c-4dd6-857b-7431711bc2d0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.508329 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 908/1815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:16.508329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.510113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.510113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.543413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.544373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.544854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.545273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] PATH_INFO: `/v3/users/2129aee110d04bc88f02937bcdc1c336` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.546663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2129aee110d04bc88f02937bcdc1c336)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.549221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.551847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] MFA Rules not processed for user `6e3c2eb99c904e8fb736d69d51bf6c35`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:16.553725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.609365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:16.620352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2129aee110d04bc88f02937bcdc1c336'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.631096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2129aee110d04bc88f02937bcdc1c336'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.632021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2129aee110d04bc88f02937bcdc1c336'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.632702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2129aee110d04bc88f02937bcdc1c336'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.641003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2129aee110d04bc88f02937bcdc1c336'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:16.641716 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 909/1816] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:16.642650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.657150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa94c98-6808-4ad5-afd8-3aaea7d43570 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.660769 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 908/1817] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:16 2022] DELETE /identity/v3/users/2129aee110d04bc88f02937bcdc1c336 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:16.662904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.664057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.664448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.664695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.665070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] PATH_INFO: `/v3/projects/0e6f3d75496e444ea32cab113f800e24/users/e827a3f690234f60b149792bc772b3b2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.666089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.685060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6f3d75496e444ea32cab113f800e24, user_id=e827a3f690234f60b149792bc772b3b2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.687797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.707751 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 910/1818] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:16 2022] PUT /identity/v3/projects/0e6f3d75496e444ea32cab113f800e24/users/e827a3f690234f60b149792bc772b3b2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:16.708808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:16.718711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.762024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b905d-0e1d-4515-a5f4-6e9cb52c9747 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.810634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6cf6-308a-4858-8bf8-a6c56306f4fb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:16.816894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0912e4a-1447-4493-bf8b-98e3ca3cb48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.817534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0912e4a-1447-4493-bf8b-98e3ca3cb48a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.817814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0912e4a-1447-4493-bf8b-98e3ca3cb48a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.818088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0912e4a-1447-4493-bf8b-98e3ca3cb48a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.819840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0912e4a-1447-4493-bf8b-98e3ca3cb48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.822579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:16.822714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0912e4a-1447-4493-bf8b-98e3ca3cb48a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.868743 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 911/1819] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:16 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:16.870383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.870915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.871528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.880571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:16.882068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.882890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.882890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.889310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.893744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:16.894969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:16.918764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:16.920429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627694-2c69-4a0a-aefb-afe2d6c2dc88 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:16.937887 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 909/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:16.939383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:16.939682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:16.939967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:16.989610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] MFA Rules not processed for user `e827a3f690234f60b149792bc772b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:16.992344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:17.020003 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 912/1821] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:17.021116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.065061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676c38-cda9-4125-b43d-f94d730f089f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.074501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.075806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.076158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.076846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.077672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.080499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.116196 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 913/1822] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:17 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:17.119729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.134847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35354e-65a1-41f4-b53b-2ed17fafdd27 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.140845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.141665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.142041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.142578 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 910/1823] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:17.142698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.143609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.145455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.150993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.155691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:17.165665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 914/1824] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:17.170061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.192721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880fbf-d598-4628-bd48-edf98521a93e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.193506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735108e-0b6b-4f10-9f54-57de246e0a32 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.208256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.209051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.209551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.210026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] PATH_INFO: `/v3/projects/3e8549d9e7a748fbb6d0a4cce5b01637/users/54445bc491f149d793b8266d2ce7cc5c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.211203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.212582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.213093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.213452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.214198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.220782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.247000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8549d9e7a748fbb6d0a4cce5b01637, user_id=54445bc491f149d793b8266d2ce7cc5c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.257307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.265007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:17.290643 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 915/1825] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:17 2022] PUT /identity/v3/projects/3e8549d9e7a748fbb6d0a4cce5b01637/users/54445bc491f149d793b8266d2ce7cc5c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:17.291719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.295064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:17.300623 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 911/1826] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:17 2022] POST /identity/v3/projects => generated 395 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:17.301780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.415708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4570f8-b7ee-4d63-a26f-2167c4d8dd97 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.424503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.425206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.425727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.425834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.426489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.430487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.444194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9bbda-e01e-4607-a6d8-a659871352f4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.447323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 912/1827] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:17.448254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.487427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c5a8-a061-4086-883b-3eb422e8f61b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.502762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.503448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.503778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.504056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.504704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.511726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.568130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 913/1828] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:17 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:17.570785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.601280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.602341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.604898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.605504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.634186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d6b4e-379c-4be3-bdbf-df35390c3dd9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.645853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.650132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.667692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.669080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.672907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.673356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] PATH_INFO: `/v3/projects/3e8549d9e7a748fbb6d0a4cce5b01637/users/54445bc491f149d793b8266d2ce7cc5c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.680522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8549d9e7a748fbb6d0a4cce5b01637, user_id=54445bc491f149d793b8266d2ce7cc5c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.681022 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 916/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:17.699891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.703700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.720726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:17.735029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3773-53a9-40f9-9808-18fbb33e69dc service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:17.743822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 914/1830] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:17 2022] PUT /identity/v3/projects/3e8549d9e7a748fbb6d0a4cce5b01637/users/54445bc491f149d793b8266d2ce7cc5c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:17.747383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:17.755650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:17.932941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3ed34-591d-48e9-b926-9eae174fa123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:17.933769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ed34-591d-48e9-b926-9eae174fa123 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.934242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ed34-591d-48e9-b926-9eae174fa123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.934694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ed34-591d-48e9-b926-9eae174fa123 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.935499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ed34-591d-48e9-b926-9eae174fa123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:17.940732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ed34-591d-48e9-b926-9eae174fa123 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:17.958676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 917/1831] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:17.960179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:17.960561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:17.960844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:17.979180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c54c9-b3d5-4e10-a62f-236327db6771 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.006048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] MFA Rules not processed for user `54445bc491f149d793b8266d2ce7cc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:18.007036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.007799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.008085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.008206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.008361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] PATH_INFO: `/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.010704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16c9ebdf73c4791809bd168bc6db6d7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.012632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.057545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:18.121168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16c9ebdf73c4791809bd168bc6db6d7', 'request_id': 'req-c5f31c59-d649-415d-b330-e66d1df62e12'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.128859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 918/1832] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:18.128859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.136195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16c9ebdf73c4791809bd168bc6db6d7', 'request_id': 'req-c5f31c59-d649-415d-b330-e66d1df62e12'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.146423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16c9ebdf73c4791809bd168bc6db6d7', 'request_id': 'req-c5f31c59-d649-415d-b330-e66d1df62e12'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.148969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8307b-d145-4b12-8b18-3a7e134a1601 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.164680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] The token cache is being invalidate because project b16c9ebdf73c4791809bd168bc6db6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:18.165034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.165613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.167674 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 915/1833] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:17 2022] DELETE /identity/v3/projects/b16c9ebdf73c4791809bd168bc6db6d7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:18.168737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.170041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.273390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.274685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.275161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.275587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] PATH_INFO: `/v3/projects/b2323134055f48e08c5c7bf52281596d/users/a68ebaf8e156421798a01e9966ce4893/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.298699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2323134055f48e08c5c7bf52281596d, user_id=a68ebaf8e156421798a01e9966ce4893, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.307869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.336042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f31c59-d649-415d-b330-e66d1df62e12 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.340979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 919/1834] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:18 2022] PUT /identity/v3/projects/b2323134055f48e08c5c7bf52281596d/users/a68ebaf8e156421798a01e9966ce4893/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:18.340979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.344459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.404474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:18.468155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.468919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.469370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.469811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.471770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.472384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa1b4-8bb2-42c5-a557-86966a7e6f31 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.480039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.480776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.481134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.481482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] PATH_INFO: `/v3/users/7cc687eb7eb949f78523d1d0669eaf0f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.482866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc687eb7eb949f78523d1d0669eaf0f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.485121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.535984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc687eb7eb949f78523d1d0669eaf0f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.540000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.541939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.546664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:18.554237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc687eb7eb949f78523d1d0669eaf0f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.555673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc687eb7eb949f78523d1d0669eaf0f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.556112 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 916/1835] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:18.557130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.559016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.562593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc687eb7eb949f78523d1d0669eaf0f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.574409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc687eb7eb949f78523d1d0669eaf0f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.575061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feefbd-91e2-4fc9-ba64-f56fd775d7e1 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.580569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.581217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.581558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.581793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] PATH_INFO: `/v3/projects/4d167a4931d74cefb01b1de904e1e758` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.583105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d167a4931d74cefb01b1de904e1e758)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.585204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.593425 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 920/1836] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:18 2022] DELETE /identity/v3/users/7cc687eb7eb949f78523d1d0669eaf0f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:18.594495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.596044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.645943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d167a4931d74cefb01b1de904e1e758', 'request_id': 'req-c712f2ac-47d9-46ff-936a-e4f88696e315'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.652667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d167a4931d74cefb01b1de904e1e758', 'request_id': 'req-c712f2ac-47d9-46ff-936a-e4f88696e315'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.662099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d167a4931d74cefb01b1de904e1e758', 'request_id': 'req-c712f2ac-47d9-46ff-936a-e4f88696e315'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.677626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b405-756c-424b-b8cb-05e3700a6975 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.679040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] The token cache is being invalidate because project 4d167a4931d74cefb01b1de904e1e758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:18.679391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.680071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.682496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 917/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:18 2022] DELETE /identity/v3/projects/4d167a4931d74cefb01b1de904e1e758 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:18.683734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.686725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.741884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:18.753038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.753801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.754167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.754527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.755254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.757167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.768620 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 921/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:18.769488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.773682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.775050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f2ac-47d9-46ff-936a-e4f88696e315 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.781448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.782319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.782658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.783206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] PATH_INFO: `/v3/users/6e3c2eb99c904e8fb736d69d51bf6c35` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.785755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3c2eb99c904e8fb736d69d51bf6c35)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.788438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.790547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4213105-e005-4573-af20-469b2441ce2b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:18.809982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:18.810811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.811342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.811570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] PATH_INFO: `/v3/users/3a90bd14f7014f30b54d8cdaa98a5c9a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.812825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a90bd14f7014f30b54d8cdaa98a5c9a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:18.815079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:18.866211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3c2eb99c904e8fb736d69d51bf6c35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.876969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3c2eb99c904e8fb736d69d51bf6c35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.881459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3c2eb99c904e8fb736d69d51bf6c35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.883021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3c2eb99c904e8fb736d69d51bf6c35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.886522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a90bd14f7014f30b54d8cdaa98a5c9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.894417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3c2eb99c904e8fb736d69d51bf6c35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.914727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a90bd14f7014f30b54d8cdaa98a5c9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.915693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a90bd14f7014f30b54d8cdaa98a5c9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.916979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a90bd14f7014f30b54d8cdaa98a5c9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.920825 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 918/1839] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:18 2022] DELETE /identity/v3/users/6e3c2eb99c904e8fb736d69d51bf6c35 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:18.922193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:18.923636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:18.933426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f33e3f3-e00d-4b8d-9bc3-9fde65f9835e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a90bd14f7014f30b54d8cdaa98a5c9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:18.939568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:18.968540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 922/1840] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:18 2022] DELETE /identity/v3/users/3a90bd14f7014f30b54d8cdaa98a5c9a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:18.969968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:18.970332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:18.971195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:18.994969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:18.995989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.032189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5bf28-eff3-4d9f-a82b-746e554068e4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:19.081386 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 923/1841] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:19.083111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:19.086743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.101759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48182bc8-e5b1-43b1-bd80-2bff6a20739d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:19.108940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:19.109706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.109996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.110330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] PATH_INFO: `/v3/projects/77db7ea0cfcf4b749b676dcd978bc3fb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.112334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77db7ea0cfcf4b749b676dcd978bc3fb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:19.113996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:19.123687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:19.124455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.124804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.125144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] PATH_INFO: `/v3/projects/b2323134055f48e08c5c7bf52281596d/users/a68ebaf8e156421798a01e9966ce4893/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.127418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2323134055f48e08c5c7bf52281596d, user_id=a68ebaf8e156421798a01e9966ce4893, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:19.131392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:19.146094 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 919/1842] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:18 2022] PUT /identity/v3/projects/b2323134055f48e08c5c7bf52281596d/users/a68ebaf8e156421798a01e9966ce4893/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:19.148034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:19.151186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.160925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:19.199056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77db7ea0cfcf4b749b676dcd978bc3fb', 'request_id': 'req-f51b3990-8238-4303-9cb1-e5b7b5996ab7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.206509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77db7ea0cfcf4b749b676dcd978bc3fb', 'request_id': 'req-f51b3990-8238-4303-9cb1-e5b7b5996ab7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.215075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77db7ea0cfcf4b749b676dcd978bc3fb', 'request_id': 'req-f51b3990-8238-4303-9cb1-e5b7b5996ab7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.247522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] The token cache is being invalidate because project 77db7ea0cfcf4b749b676dcd978bc3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:19.247858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.249906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f51b3990-8238-4303-9cb1-e5b7b5996ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.250584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 924/1843] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:19 2022] DELETE /identity/v3/projects/77db7ea0cfcf4b749b676dcd978bc3fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:19.252235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.252684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.253228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.300114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] MFA Rules not processed for user `a68ebaf8e156421798a01e9966ce4893`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:19.301018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.311066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64566492-eaef-4dda-b77f-fdbfdf18d434 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:19.404557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:19.405881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.406495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.410325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.411446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:19.414417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.416536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 925/1844] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:19.426534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:19.428222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.500791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:19.502675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:19.517769 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 920/1845] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:19.519136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:19.520830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.540026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dd43a-9433-4ed3-8ed0-0c32812555a2 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:19.546701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:19.547737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.548230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.548743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] PATH_INFO: `/v3/users/f7c70d25b2c8415ea8257043d5468358` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.550548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c70d25b2c8415ea8257043d5468358)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:19.554203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:19.567450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef35cb-a89b-49da-9511-7e3e5ad5c981 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:19.577979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:19.578669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.578965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.579238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] PATH_INFO: `/v3/users/225a66331fe9421ca8e194e51ceaf9f9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.587750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=225a66331fe9421ca8e194e51ceaf9f9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:19.591458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:19.623796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c70d25b2c8415ea8257043d5468358'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.634050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c70d25b2c8415ea8257043d5468358'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.635081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c70d25b2c8415ea8257043d5468358'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.635868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c70d25b2c8415ea8257043d5468358'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.647516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bea9f100-aa5c-4a79-a81d-5c7b11657bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c70d25b2c8415ea8257043d5468358'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.649783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:19.685486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 921/1846] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:19 2022] DELETE /identity/v3/users/f7c70d25b2c8415ea8257043d5468358 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:19.687012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.687655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.687655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.717160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225a66331fe9421ca8e194e51ceaf9f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.725914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] MFA Rules not processed for user `e827a3f690234f60b149792bc772b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:19.727979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.754059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225a66331fe9421ca8e194e51ceaf9f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.755294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225a66331fe9421ca8e194e51ceaf9f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.756375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225a66331fe9421ca8e194e51ceaf9f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.771236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f5d8d74-5ab7-4399-9b1b-4092025c36ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225a66331fe9421ca8e194e51ceaf9f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:19.798449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 926/1847] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:19 2022] DELETE /identity/v3/users/225a66331fe9421ca8e194e51ceaf9f9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:19.800064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:19.800355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:19.800634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:19.849231 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 922/1848] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:19.857462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:19.859029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.875730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:19.880897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:19.973026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb34f2-8b4b-43ce-963a-c1bf7bfc29e3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:19.994306 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 927/1849] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:20.019406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.024366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.062871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:20.095759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.098122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.099278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.100481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.102933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.150183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3aaf1-e623-4a56-b068-c2e5c372a8cf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.152347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:20.156432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.156432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.156432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.156432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.181300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.183678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.206089 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 928/1850] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:20.207008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.209146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.231376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d2b15-cd46-46c8-aa52-6eac7b4df27c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.232567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.235939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.240463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.241762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.242044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.242352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] PATH_INFO: `/v3/projects/27428419952c4be18e0a726e36567907` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.243504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27428419952c4be18e0a726e36567907)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.245436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.248748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 923/1851] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:19 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:20.250639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.252732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.309488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439b5d-6367-4bd4-be5f-1cb4964ef564 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.315233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.316236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.316690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.317131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] PATH_INFO: `/v3/projects/60eb5e08f6f5427a82613b6cc3f9131c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.318738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eb5e08f6f5427a82613b6cc3f9131c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.322632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.388587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27428419952c4be18e0a726e36567907', 'request_id': 'req-b845321f-d9b2-4dd8-a8e1-a420431ca196'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.395146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eb5e08f6f5427a82613b6cc3f9131c', 'request_id': 'req-81ce0366-6ffe-4bf5-ab0d-11486688b18a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.395502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27428419952c4be18e0a726e36567907', 'request_id': 'req-b845321f-d9b2-4dd8-a8e1-a420431ca196'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.401737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eb5e08f6f5427a82613b6cc3f9131c', 'request_id': 'req-81ce0366-6ffe-4bf5-ab0d-11486688b18a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.407697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27428419952c4be18e0a726e36567907', 'request_id': 'req-b845321f-d9b2-4dd8-a8e1-a420431ca196'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.411047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eb5e08f6f5427a82613b6cc3f9131c', 'request_id': 'req-81ce0366-6ffe-4bf5-ab0d-11486688b18a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.425703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] The token cache is being invalidate because project 60eb5e08f6f5427a82613b6cc3f9131c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:20.426434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.427626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.431426 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 924/1852] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:20 2022] DELETE /identity/v3/projects/60eb5e08f6f5427a82613b6cc3f9131c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:20.434538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] The token cache is being invalidate because project 27428419952c4be18e0a726e36567907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:20.434823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.435498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b845321f-d9b2-4dd8-a8e1-a420431ca196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.436318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.437036 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 929/1853] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:20 2022] DELETE /identity/v3/projects/27428419952c4be18e0a726e36567907 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:20.438300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.441789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca964a-a181-4277-be8c-0bea337097fa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.442171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca964a-a181-4277-be8c-0bea337097fa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.442536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca964a-a181-4277-be8c-0bea337097fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.470463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-22ca964a-a181-4277-be8c-0bea337097fa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:20.472272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-22ca964a-a181-4277-be8c-0bea337097fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.528321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce0366-6ffe-4bf5-ab0d-11486688b18a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.533419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.534087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.534612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.534900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] PATH_INFO: `/v3/users/54445bc491f149d793b8266d2ce7cc5c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.536115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=54445bc491f149d793b8266d2ce7cc5c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.538774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.575582 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 930/1854] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:20.583962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.584829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.586125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.611524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:20.612620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54445bc491f149d793b8266d2ce7cc5c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.624151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:20.625513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:20.625731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54445bc491f149d793b8266d2ce7cc5c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.627239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54445bc491f149d793b8266d2ce7cc5c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.628436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54445bc491f149d793b8266d2ce7cc5c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.636136 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 931/1855] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:20.640420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54445bc491f149d793b8266d2ce7cc5c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:20.641054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.653894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9a00-bbf1-4f20-9170-7419e653f71a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.660731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 925/1856] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:20 2022] DELETE /identity/v3/users/54445bc491f149d793b8266d2ce7cc5c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:20.665664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.666358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.666652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.667071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.667745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:20.668053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.669703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.696941 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 932/1857] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:20.698725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.841449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdbb27-c3a9-4737-8e14-0095ea7c84fb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.847008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:20.847740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:20.848620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:20.848986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:20.850323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:20.852769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:20.898769 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 926/1858] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:20 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:20.900557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:20.924909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c0a1c-201a-411e-bccc-52af06f92f2f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:20.986732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:21.055804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.056351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.056653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.056933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.057616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.059753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.095301 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 933/1859] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:20 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:21.096173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.097033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.098086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.107608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796033-796a-4543-80ce-d7df8970a97a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.113506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.114231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.114521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.114799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.116376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.118391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.127171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a8fb-1ce3-474d-92da-ee103aa9936c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.133671 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 934/1860] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:21.134529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.134755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.135608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.136349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.136349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] PATH_INFO: `/v3/projects/3e8549d9e7a748fbb6d0a4cce5b01637` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.137294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8549d9e7a748fbb6d0a4cce5b01637)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.139289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.146381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe161-3fb8-420c-ba32-2040291539a5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.163318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.164543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.164825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.165112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.165776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.167557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.186562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 935/1861] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:21.192048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.218592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff41764-e559-4166-af61-7ae01b3bac6e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.234368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8549d9e7a748fbb6d0a4cce5b01637', 'request_id': 'req-eb2737e1-8545-4cdb-98cf-003cb788fdb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.247661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8549d9e7a748fbb6d0a4cce5b01637', 'request_id': 'req-eb2737e1-8545-4cdb-98cf-003cb788fdb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.300082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8549d9e7a748fbb6d0a4cce5b01637', 'request_id': 'req-eb2737e1-8545-4cdb-98cf-003cb788fdb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.319612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] The token cache is being invalidate because project 3e8549d9e7a748fbb6d0a4cce5b01637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:21.319907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.320669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.325708 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 927/1862] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:21 2022] DELETE /identity/v3/projects/3e8549d9e7a748fbb6d0a4cce5b01637 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:21.325708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.329744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.344662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4b3e4-80d4-439f-ad55-572b7011057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.345734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b3e4-80d4-439f-ad55-572b7011057d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.345734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b3e4-80d4-439f-ad55-572b7011057d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.345983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b3e4-80d4-439f-ad55-572b7011057d admin admin] PATH_INFO: `/v3/projects/7951c5eb43194597a5ca94b27bc307ae/users/58a252dea897406bacc165c52d73b1ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.367215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4b3e4-80d4-439f-ad55-572b7011057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7951c5eb43194597a5ca94b27bc307ae, user_id=58a252dea897406bacc165c52d73b1ae, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.370470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4b3e4-80d4-439f-ad55-572b7011057d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.382777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:21.391630 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 936/1863] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:21 2022] PUT /identity/v3/projects/7951c5eb43194597a5ca94b27bc307ae/users/58a252dea897406bacc165c52d73b1ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:21.393243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968155d2-c609-4bc1-9ac7-5f30a60da609 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.394003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968155d2-c609-4bc1-9ac7-5f30a60da609 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.394619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968155d2-c609-4bc1-9ac7-5f30a60da609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.420490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-968155d2-c609-4bc1-9ac7-5f30a60da609 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:21.422511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-968155d2-c609-4bc1-9ac7-5f30a60da609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.459113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2737e1-8545-4cdb-98cf-003cb788fdb6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.546955 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 937/1864] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:21.548899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.549924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.549924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.583180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.583414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.583675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.584027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] PATH_INFO: `/v3/projects/05fdea5e921243a58ba0f966ea3cba67` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.585943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fdea5e921243a58ba0f966ea3cba67)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.588033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.594368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] MFA Rules not processed for user `58a252dea897406bacc165c52d73b1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:21.596450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.606336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:21.662092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fdea5e921243a58ba0f966ea3cba67', 'request_id': 'req-fd999be1-2347-48cd-8db8-5ac39b901ed5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.680734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fdea5e921243a58ba0f966ea3cba67', 'request_id': 'req-fd999be1-2347-48cd-8db8-5ac39b901ed5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.692904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fdea5e921243a58ba0f966ea3cba67', 'request_id': 'req-fd999be1-2347-48cd-8db8-5ac39b901ed5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.708319 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 938/1865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:21.708319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.711013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.715733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] The token cache is being invalidate because project 05fdea5e921243a58ba0f966ea3cba67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:21.716031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.716740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.718520 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 928/1866] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:21 2022] DELETE /identity/v3/projects/05fdea5e921243a58ba0f966ea3cba67 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:21.719151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:21.720992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.731365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa70b1-aa98-434e-841f-3bc1b73086e0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.822586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.824009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.824379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.824719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] PATH_INFO: `/v3/projects/ab87252f86984e3d8737807d1ea9391f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.826454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab87252f86984e3d8737807d1ea9391f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.828550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:21.844815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd999be1-2347-48cd-8db8-5ac39b901ed5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:21.857886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:21.861354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.862468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.863398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.867315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:21.874165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:21.908600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab87252f86984e3d8737807d1ea9391f', 'request_id': 'req-f43b2346-ef21-483a-882e-db91e4d78b7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.915614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab87252f86984e3d8737807d1ea9391f', 'request_id': 'req-f43b2346-ef21-483a-882e-db91e4d78b7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.926779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab87252f86984e3d8737807d1ea9391f', 'request_id': 'req-f43b2346-ef21-483a-882e-db91e4d78b7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.953700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] The token cache is being invalidate because project ab87252f86984e3d8737807d1ea9391f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:21.954756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.956008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f43b2346-ef21-483a-882e-db91e4d78b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:21.963573 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 939/1867] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:21 2022] DELETE /identity/v3/projects/ab87252f86984e3d8737807d1ea9391f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:21.966451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:21.967098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:21.967323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:21.991268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:21.994593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f6b99-599e-4c8d-968a-8c8badd56833 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.000766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:22.002201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.026475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 929/1868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:22.029036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.029330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.029745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.052518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:22.083187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:22.084111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.094045 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 940/1869] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:22.097425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.101529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.106049 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 930/1870] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:22.108734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.110814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.133693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d00fb4-604f-415b-a5eb-6b1be35b1fc9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.140760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.141445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.141710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.141987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] PATH_INFO: `/v3/users/c6b34710ffb34deeaef4f905ba7a1b27` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.143538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b34710ffb34deeaef4f905ba7a1b27)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.145463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.225446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4fd96-94be-4105-9a01-ab9d34d20a88 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.231277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.232750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.233556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.234220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.236400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.250485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b34710ffb34deeaef4f905ba7a1b27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:22.263193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b34710ffb34deeaef4f905ba7a1b27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:22.264238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b34710ffb34deeaef4f905ba7a1b27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:22.264909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b34710ffb34deeaef4f905ba7a1b27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:22.280740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b34710ffb34deeaef4f905ba7a1b27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:22.342976 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 931/1871] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:22 2022] DELETE /identity/v3/users/c6b34710ffb34deeaef4f905ba7a1b27 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:22.343158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.344129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.344714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d969eed-f2ab-429b-968a-31d08e94406c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.350318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.385879 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 941/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:22.389987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.391087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.391476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.464796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:22.476650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:22.590044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56d0f2-20cd-40a1-b6f7-c52c0fc0a9cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.610316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.612248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.612248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.612248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.613670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:22.613989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.625673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.656179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:22.657148 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 942/1873] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:22.657902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.669902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 932/1874] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:22.671016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.686275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4900df-8ed0-475a-9c88-a53e9097fd92 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.687328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f829-84e4-47b8-97aa-6aec6b25c322 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.694836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.695723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.696102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.696620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.697500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.699144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.699927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.700095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.700600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.701121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.702314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:22.703793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.708903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.743269 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 933/1875] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:22 2022] POST /identity/v3/projects => generated 399 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:22.746246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 943/1876] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:22.746800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.749890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.771577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30face59-bdbf-4213-9de9-21f708a7cbd7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.814741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:22.898784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76238-d303-4a07-a8cb-224b5d0604dd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.904621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.905372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.905751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.906256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.907053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.907181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:22.907698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:22.907983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:22.908260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:22.909065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:22.909308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.911040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:22.951500 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 934/1877] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:22 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:22.954237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:22.969839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49e30-d34a-4181-80fc-4254b2bea32c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:22.991402 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 944/1878] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:22 2022] POST /identity/v3/projects => generated 395 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:22.997681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.062476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.063210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.063525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.063805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.064463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.066512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.114712 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 935/1879] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:23.116194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.126564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.153049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5c9d-f72d-42de-9605-ea6b99571303 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.166098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.167535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.167827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.168111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] PATH_INFO: `/v3/users/58a252dea897406bacc165c52d73b1ae` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.171632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b9dc-ef42-42a6-b0a3-f1d5132f5073 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.173014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a252dea897406bacc165c52d73b1ae)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.175003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.184590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.185238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.185520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.185795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.186476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.196597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.241395 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 945/1880] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:22 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:23.241395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.272321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159a95-6eca-4128-b601-d41900bd8270 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.288784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a252dea897406bacc165c52d73b1ae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.289949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.290678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.290957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.293848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.294588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.299927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.313441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a252dea897406bacc165c52d73b1ae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.314356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a252dea897406bacc165c52d73b1ae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.315942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a252dea897406bacc165c52d73b1ae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.326012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:23.332434 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 946/1881] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:23.332434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.332702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a252dea897406bacc165c52d73b1ae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.337142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.367501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88de97-2582-4a8f-b285-d93161db3c04 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.375199 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 936/1882] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:23 2022] DELETE /identity/v3/users/58a252dea897406bacc165c52d73b1ae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:23.376592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.379581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.381378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00a3a5-b229-439b-a6c1-b9e926448a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.382100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00a3a5-b229-439b-a6c1-b9e926448a80 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.382398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00a3a5-b229-439b-a6c1-b9e926448a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.383064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00a3a5-b229-439b-a6c1-b9e926448a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.383333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00a3a5-b229-439b-a6c1-b9e926448a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.385601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00a3a5-b229-439b-a6c1-b9e926448a80 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.430075 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 947/1883] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:23.433449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.433748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.434032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.471106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:23.475399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.535478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa8390-56f2-487c-bdcb-ab290466b65b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.551513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.552221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.552504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.552779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] PATH_INFO: `/v3/projects/5e9cd312159545e6b66e6bb057b56190/users/9eda7e8110ec4cc78a907f5abcfeab27/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.582138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9cd312159545e6b66e6bb057b56190, user_id=9eda7e8110ec4cc78a907f5abcfeab27, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.585821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.598192 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 948/1884] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:23.598978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.604379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.618808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 937/1885] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:23 2022] PUT /identity/v3/projects/5e9cd312159545e6b66e6bb057b56190/users/9eda7e8110ec4cc78a907f5abcfeab27/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:23.620169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.637034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2042-11db-4a6e-9b6d-4cf5988c6e3c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.654732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:23.737214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de7978-2e57-4296-9efd-a9af7e608a21 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.743464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.744596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.744750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.745247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.745366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.745593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.745875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] PATH_INFO: `/v3/projects/7876ab139e2f40c0917a117f35dd96f1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.746346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.747261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.747906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7876ab139e2f40c0917a117f35dd96f1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:23.749541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.750434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:23.768368 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 938/1886] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:23.769777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:23.779032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.823825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7876ab139e2f40c0917a117f35dd96f1', 'request_id': 'req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.833435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7876ab139e2f40c0917a117f35dd96f1', 'request_id': 'req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.853659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7876ab139e2f40c0917a117f35dd96f1', 'request_id': 'req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.870136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] The token cache is being invalidate because project 7876ab139e2f40c0917a117f35dd96f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:23.870710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.871433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a1c3430-6ede-4bc1-889e-6157ca0fc1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:23.873512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 949/1887] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:23 2022] DELETE /identity/v3/projects/7876ab139e2f40c0917a117f35dd96f1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:23.874924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.875262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.875543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:23.884990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd040-355c-4da1-a8ea-8ca9812b7c89 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:23.899899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:23.917305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] MFA Rules not processed for user `9eda7e8110ec4cc78a907f5abcfeab27`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:23.918767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:23.997029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:23.998959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:23.999377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:23.999751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.002666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.018288 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 950/1888] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:24.020388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.024058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.092364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:24.130053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.132224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.140794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8b368-d152-4e9e-893a-44b3f8cb9369 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.148280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba84991-d551-48d8-8c11-b7b12f3f089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.149313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84991-d551-48d8-8c11-b7b12f3f089d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.149748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84991-d551-48d8-8c11-b7b12f3f089d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.150289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84991-d551-48d8-8c11-b7b12f3f089d admin admin] PATH_INFO: `/v3/projects/18a4ab69f81a4f9998a309178da29a8c/users/2c4f5e2d445e4da7ba9ea04872e8e0e4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.158945 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 939/1889] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:24.161840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.166542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.170512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba84991-d551-48d8-8c11-b7b12f3f089d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a4ab69f81a4f9998a309178da29a8c, user_id=2c4f5e2d445e4da7ba9ea04872e8e0e4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.174120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba84991-d551-48d8-8c11-b7b12f3f089d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.202406 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 951/1890] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:24 2022] PUT /identity/v3/projects/18a4ab69f81a4f9998a309178da29a8c/users/2c4f5e2d445e4da7ba9ea04872e8e0e4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:24.202406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.202406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.202406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.226730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:24.228172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.327058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56428be-dd37-4cbf-9884-afa226703fa1 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.330811 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 952/1891] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:24.331287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.334775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.349024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25660978-9b93-4e33-919f-9cad1eb071d9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.354993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf075a93-2215-482a-841c-6047cb626c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.355629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075a93-2215-482a-841c-6047cb626c6d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.356063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075a93-2215-482a-841c-6047cb626c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.356347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075a93-2215-482a-841c-6047cb626c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.357035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf075a93-2215-482a-841c-6047cb626c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.359023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf075a93-2215-482a-841c-6047cb626c6d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.395596 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 953/1892] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/projects => generated 395 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:24.399102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.401103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.414725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.425696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.426704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.427530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.427736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.430013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.438656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:24.445484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.447802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674853c-0095-4f5c-9746-6a28d3be74b0 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.453088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] MFA Rules not processed for user `2c4f5e2d445e4da7ba9ea04872e8e0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:24.455141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.460126 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 940/1893] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:24.461564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.461845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.462126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.486506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:24.488381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.581335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 954/1894] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:24.582993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.584202 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 941/1895] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:24.585356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.609420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416dbfc-a965-4bf8-a0ab-3c2f9acd797e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.610843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91138053-465c-4b48-a3e5-831fc7f8cea9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.614965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.615943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.616245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.616567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.617237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.619635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.623841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.624487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.624768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.625046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.625689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.629591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.677010 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 942/1896] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/projects => generated 395 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:24.678946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.694105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 955/1897] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/users => generated 304 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:24.694708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.717499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d024f4-d456-4721-8dbe-5cba224a008a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.728013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:24.827763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248c04-c1fc-4c69-8aa2-f15e3e18c3a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.828916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.829703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.830165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.830783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.832840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.836450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.840371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.841037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.841325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.841602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.842300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:24.842610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.844378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.859060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 943/1898] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:24.859844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.862079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:24.875304 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 956/1899] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/users => generated 304 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:24.876532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.883265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7be5c-b06a-4d10-95b0-1f3fd6151c58 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.889458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b387-d2a3-4ab7-b61e-746d68f23f64 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.889955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.890770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.891121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.891346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] PATH_INFO: `/v3/projects/7951c5eb43194597a5ca94b27bc307ae` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.892814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7951c5eb43194597a5ca94b27bc307ae)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.895000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.896373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.897927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.898581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.899089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.901733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.903793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.919328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 957/1900] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:24.920807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:24.948864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20aa1-cb07-4397-b66d-678acaf3cd8f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:24.962672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:24.963412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:24.964988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:24.965430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:24.966088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:24.969225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:24.985936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7951c5eb43194597a5ca94b27bc307ae', 'request_id': 'req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:24.994189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7951c5eb43194597a5ca94b27bc307ae', 'request_id': 'req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:24.997314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:25.009085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7951c5eb43194597a5ca94b27bc307ae', 'request_id': 'req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:25.028030 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 958/1901] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:24 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:25.029053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.032109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] The token cache is being invalidate because project 7951c5eb43194597a5ca94b27bc307ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:25.033453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:25.034884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:25.039833 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 944/1902] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:24 2022] DELETE /identity/v3/projects/7951c5eb43194597a5ca94b27bc307ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:25.040917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.046081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.128292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54c8fb-b836-47d1-a888-6f10a67a4b05 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.134607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.135918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.136328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.136763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.137728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.139563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.153247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 959/1903] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:25.154161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.158047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.164084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7e5c-f28f-4cb0-97c0-c6fb5f30077b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.171925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4168de-8f83-481a-8302-5faf8658e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.172548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4168de-8f83-481a-8302-5faf8658e829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.172838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4168de-8f83-481a-8302-5faf8658e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.173121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4168de-8f83-481a-8302-5faf8658e829 admin admin] PATH_INFO: `/v3/projects/aacdf2efc2804f63abb217254c1906f1/users/767833170e1c4e45ae982446f16bea65/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.174981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c5999-cfae-43ba-9fc1-31ae7a07a6f3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.189467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.190032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.190391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.190742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.191392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.193355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.204484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4168de-8f83-481a-8302-5faf8658e829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacdf2efc2804f63abb217254c1906f1, user_id=767833170e1c4e45ae982446f16bea65, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.206103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4168de-8f83-481a-8302-5faf8658e829 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.223401 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 945/1904] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:25 2022] PUT /identity/v3/projects/aacdf2efc2804f63abb217254c1906f1/users/767833170e1c4e45ae982446f16bea65/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:25.225321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.226323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.226736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.230217 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 960/1905] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/users => generated 294 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:25.231927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.235584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.252565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806ae7b-4b37-417e-b3f0-7adbf28bf4b5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.276980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:25.278512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.312688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:25.339536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.340502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.340789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.341154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] PATH_INFO: `/v3/projects/6712baec00da4226bd969ae80a7aef74/users/4f5cbe2506c2405bbe1c7cb78f2746fb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.368261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6712baec00da4226bd969ae80a7aef74, user_id=4f5cbe2506c2405bbe1c7cb78f2746fb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.371311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.379366 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 946/1906] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:25.380371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.391454 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 961/1907] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:25 2022] PUT /identity/v3/projects/6712baec00da4226bd969ae80a7aef74/users/4f5cbe2506c2405bbe1c7cb78f2746fb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:25.392304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.397529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbddede-e62c-428c-8748-4aad03ccb1da None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.467764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a9b7f-b6d6-4b02-a429-659d96a8beb0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.468844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3ab76-6d31-474c-906c-97a7803d63c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.469476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ab76-6d31-474c-906c-97a7803d63c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.469761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ab76-6d31-474c-906c-97a7803d63c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.470242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ab76-6d31-474c-906c-97a7803d63c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.470855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3ab76-6d31-474c-906c-97a7803d63c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.472473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3ab76-6d31-474c-906c-97a7803d63c4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.472670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.473290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.473576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.473972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.474989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.476444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.483875 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 947/1908] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:25.485010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ea701-c432-4620-931f-8fa4ea7e19b9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.485303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ea701-c432-4620-931f-8fa4ea7e19b9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.485589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ea701-c432-4620-931f-8fa4ea7e19b9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.487207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 948/1909] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:12:25.492514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 962/1910] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:25.492514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.493211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.493479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.493759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.503809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ba55-2467-4a96-a254-0165f789f913 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.509207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e17a3c-e31e-40dc-bf20-59a1a19e9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.510067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e17a3c-e31e-40dc-bf20-59a1a19e9304 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.510401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e17a3c-e31e-40dc-bf20-59a1a19e9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.510836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e17a3c-e31e-40dc-bf20-59a1a19e9304 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.511501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e17a3c-e31e-40dc-bf20-59a1a19e9304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.513310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e17a3c-e31e-40dc-bf20-59a1a19e9304 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.515969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:25.517212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.526227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 949/1911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:25.527448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.530177 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 963/1912] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:25.531592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.531880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.532190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.534058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:25.541779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371c2f-4b54-4499-8c69-6c262a6a4956 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.547870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.549592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.550231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.550783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] PATH_INFO: `/v3/projects/aacdf2efc2804f63abb217254c1906f1/users/767833170e1c4e45ae982446f16bea65/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.554096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacdf2efc2804f63abb217254c1906f1, user_id=767833170e1c4e45ae982446f16bea65, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.555213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:25.556490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.557471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.571371 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 950/1913] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:25 2022] PUT /identity/v3/projects/aacdf2efc2804f63abb217254c1906f1/users/767833170e1c4e45ae982446f16bea65/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:25.572931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.639483 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 964/1914] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:25.640664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.652711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b108197-9e4b-48f6-b636-07f75eaeed77 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.653587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821337ee-a906-4b81-a904-d6f87c4cefdf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.657730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.658400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.658860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.659151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.659818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:25.659910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cbf28-9c2d-4190-849c-1d1658c86226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.660126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.660585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cbf28-9c2d-4190-849c-1d1658c86226 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.660937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cbf28-9c2d-4190-849c-1d1658c86226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.661284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cbf28-9c2d-4190-849c-1d1658c86226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.661751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.662080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cbf28-9c2d-4190-849c-1d1658c86226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.664149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cbf28-9c2d-4190-849c-1d1658c86226 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.675155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 965/1915] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:25.681024 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 951/1916] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:25.681175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.681275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.681275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.681275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.691569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d05ae-e6eb-461c-b28b-d671e673374d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.697020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.697635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.697925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.698274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] PATH_INFO: `/v3/projects/6712baec00da4226bd969ae80a7aef74/users/4f5cbe2506c2405bbe1c7cb78f2746fb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.700365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6712baec00da4226bd969ae80a7aef74, user_id=4f5cbe2506c2405bbe1c7cb78f2746fb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.703935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.716527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] MFA Rules not processed for user `767833170e1c4e45ae982446f16bea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:25.718183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.719733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 966/1917] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:25 2022] PUT /identity/v3/projects/6712baec00da4226bd969ae80a7aef74/users/4f5cbe2506c2405bbe1c7cb78f2746fb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:25.720614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.722221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:25.745110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:25.797502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f44504-7a98-4167-9db6-1f0c748c3436 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.801738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.802400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.802691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.803575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.825436 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 952/1918] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:25.831077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.898163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.900252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.905198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aedc82-7c52-400c-842a-17924ea48299 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.910277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c505c-83f2-45a2-83bb-723ba7f9c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.910905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c505c-83f2-45a2-83bb-723ba7f9c283 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.911190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c505c-83f2-45a2-83bb-723ba7f9c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.911468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c505c-83f2-45a2-83bb-723ba7f9c283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.912116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c505c-83f2-45a2-83bb-723ba7f9c283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.914750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c505c-83f2-45a2-83bb-723ba7f9c283 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.915779 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 967/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:25.924701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:25.932859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:25.936466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25a6a-02fc-4a6b-a6f8-c59a06aed118 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:25.942885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51b07a-45c3-471a-a131-e2a707592ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:25.944614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51b07a-45c3-471a-a131-e2a707592ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.944904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51b07a-45c3-471a-a131-e2a707592ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.945185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51b07a-45c3-471a-a131-e2a707592ec1 admin admin] PATH_INFO: `/v3/projects/956fc3597caf408bbdbb23c6f2fcad40/users/35e188f685d4474cb30ab3553f558dbe/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.955741 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 953/1920] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:25.955741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23df7-87c0-473e-9c9a-b280d0f7ec31 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.955975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23df7-87c0-473e-9c9a-b280d0f7ec31 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.956248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23df7-87c0-473e-9c9a-b280d0f7ec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.963793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51b07a-45c3-471a-a131-e2a707592ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956fc3597caf408bbdbb23c6f2fcad40, user_id=35e188f685d4474cb30ab3553f558dbe, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:25.967071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51b07a-45c3-471a-a131-e2a707592ec1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:25.984779 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 968/1921] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:25 2022] PUT /identity/v3/projects/956fc3597caf408bbdbb23c6f2fcad40/users/35e188f685d4474cb30ab3553f558dbe/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:25.986136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:25.986589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:25.988000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:25.997013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-23c23df7-87c0-473e-9c9a-b280d0f7ec31 None None] MFA Rules not processed for user `4f5cbe2506c2405bbe1c7cb78f2746fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:25.998250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23c23df7-87c0-473e-9c9a-b280d0f7ec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:26.009148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:26.010540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:26.063928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 969/1922] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:26.065142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.081920 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 954/1923] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:26.083474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98014e-6555-4659-9359-500200d3d11d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.083939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98014e-6555-4659-9359-500200d3d11d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.084442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98014e-6555-4659-9359-500200d3d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.118355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:26.120782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9c98014e-6555-4659-9359-500200d3d11d None None] MFA Rules not processed for user `35e188f685d4474cb30ab3553f558dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:26.122035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9c98014e-6555-4659-9359-500200d3d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:26.146512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3750dc3-e2b3-447f-9c87-d08825e87f36 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.151911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.152658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.152951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.153228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.153978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.156508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.181241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 970/1924] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:26.182116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.192759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbee5b-5686-44d7-9972-567f4a18d359 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.197379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.197999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.198451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.198732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.206510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.207880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.212237 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 955/1925] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:26.212237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98014e-6555-4659-9359-500200d3d11d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.212237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9c98014e-6555-4659-9359-500200d3d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:26.217350 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 971/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:26.218043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.231404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b629269-0641-4f5c-a10f-ac17704b2094 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.236672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.237815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.238746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.239027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.239678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.243121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.259753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 972/1927] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:26.259753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.276433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781cef5-090f-4f2f-bdd4-296e1510ff4e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.281733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.282696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.283049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.283399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.284146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.288807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.314318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98014e-6555-4659-9359-500200d3d11d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.321729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.322404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.322728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.323005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.325450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:26.329626 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 973/1928] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:26.330979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.338495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:26.405468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.407763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.420586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 956/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:26.421263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7436-a18c-4966-b4da-cd812bdcefa6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.421721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.429976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.430734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.431726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.432020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.432686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.433885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d597d51-0978-46e0-868d-af353083ba97 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.434580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.445422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.446607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.447040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.447461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.448656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 974/1930] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:26.448897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.451377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.453286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.468083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7988b6a-a8f4-4d83-b80b-326d14bd1c26 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.473685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.474556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.474981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.475351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] PATH_INFO: `/v3/projects/ad01229bc1c54c62acc0444ffdc71bd0/users/8a0cacf82f98431bb873cc18fbf3d27e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.482325 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 957/1931] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/users => generated 301 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:26.483270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.493869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad01229bc1c54c62acc0444ffdc71bd0, user_id=8a0cacf82f98431bb873cc18fbf3d27e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.496820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.512810 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 975/1932] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:26 2022] PUT /identity/v3/projects/ad01229bc1c54c62acc0444ffdc71bd0/users/8a0cacf82f98431bb873cc18fbf3d27e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:26.514072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.587185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b10f8-3aa7-47ec-8b0c-5ce178ef9833 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.592276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:26.597382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e870-b4c9-42e5-a5eb-596f32dd5d8b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.604764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dea69d-eab5-4ff4-9190-44bc9bfd561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.605399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea69d-eab5-4ff4-9190-44bc9bfd561f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.605689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea69d-eab5-4ff4-9190-44bc9bfd561f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.606011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea69d-eab5-4ff4-9190-44bc9bfd561f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.607924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dea69d-eab5-4ff4-9190-44bc9bfd561f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.609552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dea69d-eab5-4ff4-9190-44bc9bfd561f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.624011 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 976/1933] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:26.624011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.624011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.624011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.654598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] MFA Rules not processed for user `8a0cacf82f98431bb873cc18fbf3d27e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:26.655900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:26.662973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.662973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.663235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.663672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.701310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:26.736758 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 977/1934] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:26.737852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.749903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.751437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc205d7-e6c2-45db-a276-53690998fa13 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.751629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.756475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.757237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.757828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.758173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] PATH_INFO: `/v3/projects/7adc558822444a649e9f4226888a36f4/users/a182a41ad4ca4fe1922bd0fa539e68c1/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.761738 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 958/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:26.762802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.777845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dbf87-1bea-4818-ae6b-1c3af4be216d service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.780308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adc558822444a649e9f4226888a36f4, user_id=a182a41ad4ca4fe1922bd0fa539e68c1, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.782940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.783565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.783725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.783966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.784248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.784895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.787178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.807321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 978/1936] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:26 2022] PUT /identity/v3/projects/7adc558822444a649e9f4226888a36f4/users/a182a41ad4ca4fe1922bd0fa539e68c1/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:26.811411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.830871 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 959/1937] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:26.831779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.935650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea616-1f0c-4789-b326-dc731544f0c3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.950455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.950455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.950455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.950455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.950903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.950976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11015f3-ef32-42da-87da-3bcb55ec243e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.951060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.951139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.951222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.951602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.951761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:26.952387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:26.954539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:26.968155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 979/1938] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:26.973225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.988094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4897a-fd5f-4bd0-b81b-604553c09acb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:26.994453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:26.995134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:26.995504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 960/1939] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:26 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:26.996416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:26.998424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:26.998725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] PATH_INFO: `/v3/projects/7adc558822444a649e9f4226888a36f4/users/a182a41ad4ca4fe1922bd0fa539e68c1/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.001796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adc558822444a649e9f4226888a36f4, user_id=a182a41ad4ca4fe1922bd0fa539e68c1, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.004808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.009548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1bef-f431-4879-ae18-2694e1de0953 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.018228 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 980/1940] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:26 2022] PUT /identity/v3/projects/7adc558822444a649e9f4226888a36f4/users/a182a41ad4ca4fe1922bd0fa539e68c1/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:27.019426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.022863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.026593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.026881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.027167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] PATH_INFO: `/v3/users/2c4f5e2d445e4da7ba9ea04872e8e0e4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.028514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4f5e2d445e4da7ba9ea04872e8e0e4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.030477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.081509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:27.081717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4f5e2d445e4da7ba9ea04872e8e0e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.091290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4f5e2d445e4da7ba9ea04872e8e0e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.092010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4f5e2d445e4da7ba9ea04872e8e0e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.092633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4f5e2d445e4da7ba9ea04872e8e0e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.099725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4f5e2d445e4da7ba9ea04872e8e0e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.102951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc929-a2e9-4873-9b2e-bdb9d8f20e01 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.107673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a1045-f92a-4ddf-b02f-00ac177e4c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.108290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1045-f92a-4ddf-b02f-00ac177e4c77 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.108576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1045-f92a-4ddf-b02f-00ac177e4c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.108888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1045-f92a-4ddf-b02f-00ac177e4c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.109537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a1045-f92a-4ddf-b02f-00ac177e4c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.111208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a1045-f92a-4ddf-b02f-00ac177e4c77 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.116183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:27.122654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 961/1941] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:26 2022] DELETE /identity/v3/users/2c4f5e2d445e4da7ba9ea04872e8e0e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:27.122848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.125041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.125196 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 981/1942] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:27.126684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df011c3-9a00-4262-8787-847a60ed8fa0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.126976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df011c3-9a00-4262-8787-847a60ed8fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.127258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df011c3-9a00-4262-8787-847a60ed8fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.157642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4df011c3-9a00-4262-8787-847a60ed8fa0 None None] MFA Rules not processed for user `a182a41ad4ca4fe1922bd0fa539e68c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:27.158904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4df011c3-9a00-4262-8787-847a60ed8fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.210555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d422-ad1e-41f6-95cc-3a4b97bde9eb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.216588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.217235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.217484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.217759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.219570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.235336 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 982/1943] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:27.236400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.236687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.237210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.260516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:27.261731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.297835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.299621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.313282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 962/1944] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:27.314524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.315832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.349562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 983/1945] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:27.356125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.358097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.379299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac963951-3f15-48e3-8797-8fdb27e8570f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.390197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.390442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.390848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.391524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.402247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.404005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.416003 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 984/1946] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:27.417009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.418433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.438741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fcfc-0de7-42a6-b8d1-b20d2361e052 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.446752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.446752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.446752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.447349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] PATH_INFO: `/v3/projects/80c7f194d47443a3b8528f63f2ea29b4/users/5af001a4bb05470abbc6287b5c3d1ae8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.469348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c7f194d47443a3b8528f63f2ea29b4, user_id=5af001a4bb05470abbc6287b5c3d1ae8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.472267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.508862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30d9a-c101-4cfb-889b-22b4ede94cf8 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.516807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:27.516931 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 963/1947] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:27 2022] PUT /identity/v3/projects/80c7f194d47443a3b8528f63f2ea29b4/users/5af001a4bb05470abbc6287b5c3d1ae8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:27.518536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.543308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:27.605985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.606729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.607081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.612537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.649382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d62ae-1205-4121-aadd-8fde47750fa5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.656060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.656780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.656969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.657251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.659474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.712485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.713997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.724366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 985/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:27.725232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.733442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.734612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13eb96-facf-44fb-919f-265045ac2e1c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.736006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.739848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.741199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.741673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.742087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.742801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.744456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.753234 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 964/1949] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:27.754421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.756820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.774549 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 986/1950] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:27.775846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:27.779226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966c9e-a90b-45d0-92b6-6ce23f0a9dcb service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.792008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8fc09-f097-4fb2-a81e-0a95044f78f4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:27.798550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebba0b1-8aa6-462e-af0f-10c1c305dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.799383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebba0b1-8aa6-462e-af0f-10c1c305dc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.799809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebba0b1-8aa6-462e-af0f-10c1c305dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.800402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebba0b1-8aa6-462e-af0f-10c1c305dc52 admin admin] PATH_INFO: `/v3/projects/80c7f194d47443a3b8528f63f2ea29b4/users/5af001a4bb05470abbc6287b5c3d1ae8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.814450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:27.814737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebba0b1-8aa6-462e-af0f-10c1c305dc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c7f194d47443a3b8528f63f2ea29b4, user_id=5af001a4bb05470abbc6287b5c3d1ae8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.815013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.815013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.815013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] PATH_INFO: `/v3/users/9eda7e8110ec4cc78a907f5abcfeab27` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.815428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebba0b1-8aa6-462e-af0f-10c1c305dc52 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.815586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eda7e8110ec4cc78a907f5abcfeab27)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:27.817387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:27.832636 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 987/1951] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:27 2022] PUT /identity/v3/projects/80c7f194d47443a3b8528f63f2ea29b4/users/5af001a4bb05470abbc6287b5c3d1ae8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:27.844986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:27.845285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:27.845585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:27.927245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] MFA Rules not processed for user `5af001a4bb05470abbc6287b5c3d1ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:27.929437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:27.942317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eda7e8110ec4cc78a907f5abcfeab27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.959995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eda7e8110ec4cc78a907f5abcfeab27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.960695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eda7e8110ec4cc78a907f5abcfeab27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.963529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eda7e8110ec4cc78a907f5abcfeab27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:27.978060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78eba98b-6649-4717-87e6-19f02aa15a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eda7e8110ec4cc78a907f5abcfeab27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.023154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 965/1952] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:27 2022] DELETE /identity/v3/users/9eda7e8110ec4cc78a907f5abcfeab27 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:28.029841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:28.029841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:28.029841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:28.077447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:28.079050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.099485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 988/1953] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:28.103668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:28.160284 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 966/1954] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:28.179124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.180655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.217472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:28.272118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.273737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.276765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4135-96e6-44ea-9ddb-17582bf6d5c2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:28.376256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495b8d0-91fa-4ad3-8e88-826fc69639e9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:28.384437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:28.384437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:28.387622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:28.387622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:28.401153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:28.402034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:28.402673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:28.403146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:28.417509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:28.419726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:28.434107 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 989/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:28.493364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:28.496007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:28.510371 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 967/1956] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:28.510921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.513766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.538759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d7ea-a3a7-4c2a-9dc1-a5095910290d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:28.559611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:28.560261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:28.560546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:28.560917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] PATH_INFO: `/v3/projects/18a4ab69f81a4f9998a309178da29a8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:28.562861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a4ab69f81a4f9998a309178da29a8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:28.564740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:28.613102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.617082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.645685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83a4b-8e3e-47d1-b189-b37bfd0ff64e service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:28.665020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a4ab69f81a4f9998a309178da29a8c', 'request_id': 'req-f9841a83-9c12-442e-8b96-61395b36eb3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.679468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a4ab69f81a4f9998a309178da29a8c', 'request_id': 'req-f9841a83-9c12-442e-8b96-61395b36eb3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.695394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a4ab69f81a4f9998a309178da29a8c', 'request_id': 'req-f9841a83-9c12-442e-8b96-61395b36eb3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.715694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] The token cache is being invalidate because project 18a4ab69f81a4f9998a309178da29a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:28.716423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.717550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.724443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 990/1957] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:28 2022] DELETE /identity/v3/projects/18a4ab69f81a4f9998a309178da29a8c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:28.725416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.726971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.762719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:28.772249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:28.773361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:28.773814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:28.774096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] PATH_INFO: `/v3/users/35e188f685d4474cb30ab3553f558dbe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:28.775338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e188f685d4474cb30ab3553f558dbe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:28.777536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:28.820724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841a83-9c12-442e-8b96-61395b36eb3b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:28.829482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:28.830180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:28.833490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:28.833790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] PATH_INFO: `/v3/users/8a0cacf82f98431bb873cc18fbf3d27e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:28.835634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0cacf82f98431bb873cc18fbf3d27e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:28.838183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:28.840191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:28.844911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e188f685d4474cb30ab3553f558dbe'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.859278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e188f685d4474cb30ab3553f558dbe'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.859911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e188f685d4474cb30ab3553f558dbe'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.860517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e188f685d4474cb30ab3553f558dbe'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.871712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e188f685d4474cb30ab3553f558dbe'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.907353 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 968/1958] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:28 2022] DELETE /identity/v3/users/35e188f685d4474cb30ab3553f558dbe => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:28.907353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.907353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.916876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0cacf82f98431bb873cc18fbf3d27e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.950252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0cacf82f98431bb873cc18fbf3d27e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.951832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0cacf82f98431bb873cc18fbf3d27e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.952813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0cacf82f98431bb873cc18fbf3d27e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.968040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0cacf82f98431bb873cc18fbf3d27e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:28.990102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 991/1959] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:28 2022] DELETE /identity/v3/users/8a0cacf82f98431bb873cc18fbf3d27e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:28.991675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:28.993443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:28.994858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab1e1b-d352-4508-bd38-60b46271ffd8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:29.098964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:29.100544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.101093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.101551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] PATH_INFO: `/v3/users/4f5cbe2506c2405bbe1c7cb78f2746fb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.104323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4daa-753e-4c33-9511-5f2a68286e6c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:29.105151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5cbe2506c2405bbe1c7cb78f2746fb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:29.107418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:29.110960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:29.112199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.112494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.112780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] PATH_INFO: `/v3/projects/5e9cd312159545e6b66e6bb057b56190` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.115373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9cd312159545e6b66e6bb057b56190)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:29.117500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:29.144974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:29.173195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5cbe2506c2405bbe1c7cb78f2746fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.185161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5cbe2506c2405bbe1c7cb78f2746fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.185944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5cbe2506c2405bbe1c7cb78f2746fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.186798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5cbe2506c2405bbe1c7cb78f2746fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.189733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9cd312159545e6b66e6bb057b56190', 'request_id': 'req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.196149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f6b3516-0061-4c4b-89dc-2532e7995a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5cbe2506c2405bbe1c7cb78f2746fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.197297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9cd312159545e6b66e6bb057b56190', 'request_id': 'req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.204240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9cd312159545e6b66e6bb057b56190', 'request_id': 'req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.219636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 969/1960] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:28 2022] DELETE /identity/v3/users/4f5cbe2506c2405bbe1c7cb78f2746fb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:29.220098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] The token cache is being invalidate because project 5e9cd312159545e6b66e6bb057b56190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:29.220481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.221279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-246d8e1c-6ba2-4af2-b3fe-b42e2e24ba4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.222159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.223885 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 992/1961] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:28 2022] DELETE /identity/v3/projects/5e9cd312159545e6b66e6bb057b56190 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:29.227457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.227457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.227457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.231119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.231707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.251060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:29.252873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:29.263428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:29.283582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:29.286725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:29.380502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 993/1962] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:29.380703 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 970/1963] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:29.381812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:29.385651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:29.401241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:29.403136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:29.410528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed97b2-0b0a-4240-8209-7c894d865028 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:29.430416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:29.431311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.431425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.431792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] PATH_INFO: `/v3/users/767833170e1c4e45ae982446f16bea65` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.434304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767833170e1c4e45ae982446f16bea65)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:29.436418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:29.532865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414ca3f-96d6-4c4d-bc15-4f969e21e7ac None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:29.540721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767833170e1c4e45ae982446f16bea65'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.542510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:29.543648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.544109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.545351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.560169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:29.562294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:29.566312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767833170e1c4e45ae982446f16bea65'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.568238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767833170e1c4e45ae982446f16bea65'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.569627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767833170e1c4e45ae982446f16bea65'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.577519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 971/1964] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:29.578725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:29.582422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767833170e1c4e45ae982446f16bea65'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.590957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563bd3-806f-4c1e-8437-f6386b794bb0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:29.604023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:29.604678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.604961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.605240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.614257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:29.615029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 994/1965] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:29 2022] DELETE /identity/v3/users/767833170e1c4e45ae982446f16bea65 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:29.634706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:29.637311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0182a-7997-47c5-9f68-29b967e455bb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:29.650669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 972/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:29.668293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:29.669576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:29.766410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49a15a-62f4-4cad-8bff-14ec22290831 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:29.774597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:29.775293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.775577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.775914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] PATH_INFO: `/v3/projects/6712baec00da4226bd969ae80a7aef74` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.777071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6712baec00da4226bd969ae80a7aef74)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:29.780301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:29.814642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:29.863720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6712baec00da4226bd969ae80a7aef74', 'request_id': 'req-f20d10a7-39b0-4158-9f35-dee77843dec7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.877130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6712baec00da4226bd969ae80a7aef74', 'request_id': 'req-f20d10a7-39b0-4158-9f35-dee77843dec7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.889462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6712baec00da4226bd969ae80a7aef74', 'request_id': 'req-f20d10a7-39b0-4158-9f35-dee77843dec7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.920416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] The token cache is being invalidate because project 6712baec00da4226bd969ae80a7aef74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:29.922962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.923802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f20d10a7-39b0-4158-9f35-dee77843dec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:29.932935 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 995/1967] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:29 2022] DELETE /identity/v3/projects/6712baec00da4226bd969ae80a7aef74 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:29.935196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:29.936825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:29.937172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:29.989270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:29.991819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.050829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:30.146235 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 973/1968] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:30.148471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.149603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.151226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.186091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:30.188072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.213993 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 996/1969] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:30.218612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.230465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819c901-45a6-4e86-9447-8d56739e8487 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.236710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.237648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.237926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.238282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.238952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:30.239775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.242004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.263440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 974/1970] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:30.264934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.302761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280bb08-61b5-4508-8177-841f0e828252 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.309656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.310506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.311775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.311775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.312625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.313296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.315733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.319194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.346774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617ae19-a56e-42a2-91f4-2483ecf01cdf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.355490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.356771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.357319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.358088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] PATH_INFO: `/v3/projects/aacdf2efc2804f63abb217254c1906f1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.360759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacdf2efc2804f63abb217254c1906f1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.366611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.381674 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 997/1971] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:30 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:30.382823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.385068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.456218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacdf2efc2804f63abb217254c1906f1', 'request_id': 'req-9a0e263e-9df2-428e-b857-9ac852fa37db'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.464645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacdf2efc2804f63abb217254c1906f1', 'request_id': 'req-9a0e263e-9df2-428e-b857-9ac852fa37db'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.472943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8ce8-2dc9-4a03-8852-3961802d745f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.477365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacdf2efc2804f63abb217254c1906f1', 'request_id': 'req-9a0e263e-9df2-428e-b857-9ac852fa37db'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.497544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] The token cache is being invalidate because project aacdf2efc2804f63abb217254c1906f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:30.497915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.499224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.501504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 975/1972] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:30 2022] DELETE /identity/v3/projects/aacdf2efc2804f63abb217254c1906f1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:30.502610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.505649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.555162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.556917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.557415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.558474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] PATH_INFO: `/v3/projects/ad01229bc1c54c62acc0444ffdc71bd0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.562962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad01229bc1c54c62acc0444ffdc71bd0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.564756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.590957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e263e-9df2-428e-b857-9ac852fa37db admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.596522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.597174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.597459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.597735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] PATH_INFO: `/v3/projects/956fc3597caf408bbdbb23c6f2fcad40` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.598907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956fc3597caf408bbdbb23c6f2fcad40)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.601375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.605343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:30.620232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad01229bc1c54c62acc0444ffdc71bd0', 'request_id': 'req-9aabbd6f-580d-4b8d-8a41-52c979c2904d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.626832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad01229bc1c54c62acc0444ffdc71bd0', 'request_id': 'req-9aabbd6f-580d-4b8d-8a41-52c979c2904d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.633640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad01229bc1c54c62acc0444ffdc71bd0', 'request_id': 'req-9aabbd6f-580d-4b8d-8a41-52c979c2904d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.649373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] The token cache is being invalidate because project ad01229bc1c54c62acc0444ffdc71bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:30.649835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.650812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.653080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 998/1973] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:30 2022] DELETE /identity/v3/projects/ad01229bc1c54c62acc0444ffdc71bd0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:30.654099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:30.654366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.656372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.658510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956fc3597caf408bbdbb23c6f2fcad40', 'request_id': 'req-7d6eee64-97b5-4896-b06b-4766ad15fb71'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.666617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956fc3597caf408bbdbb23c6f2fcad40', 'request_id': 'req-7d6eee64-97b5-4896-b06b-4766ad15fb71'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.675063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956fc3597caf408bbdbb23c6f2fcad40', 'request_id': 'req-7d6eee64-97b5-4896-b06b-4766ad15fb71'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.696008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] The token cache is being invalidate because project 956fc3597caf408bbdbb23c6f2fcad40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:30.696481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.697410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d6eee64-97b5-4896-b06b-4766ad15fb71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.700331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 976/1974] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:30 2022] DELETE /identity/v3/projects/956fc3597caf408bbdbb23c6f2fcad40 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:30.702597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.703361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.703747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.733202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:30.734480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.754323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabbd6f-580d-4b8d-8a41-52c979c2904d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.818944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 977/1975] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:30.819980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.821280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.836960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828ad8-5262-4c1f-b0bf-f79028816087 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.844459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.845082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.845362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.845508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.845615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.846301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.846837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.847416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.848184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] PATH_INFO: `/v3/users/5af001a4bb05470abbc6287b5c3d1ae8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.848746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.851368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af001a4bb05470abbc6287b5c3d1ae8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.854976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.874509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 999/1976] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:30 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:30.878882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:30.880552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:30.896097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52287b-62eb-472f-8926-7317f4498bf3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:30.902450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:30.903753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.904136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.904387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] PATH_INFO: `/v3/users/a182a41ad4ca4fe1922bd0fa539e68c1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.905897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a182a41ad4ca4fe1922bd0fa539e68c1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:30.908956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:30.924007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af001a4bb05470abbc6287b5c3d1ae8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.932012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af001a4bb05470abbc6287b5c3d1ae8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.932670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af001a4bb05470abbc6287b5c3d1ae8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.933329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af001a4bb05470abbc6287b5c3d1ae8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.940863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9017a18e-2151-4329-b8ce-ce33b017c74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af001a4bb05470abbc6287b5c3d1ae8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.957039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a182a41ad4ca4fe1922bd0fa539e68c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.960044 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 978/1977] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:30 2022] DELETE /identity/v3/users/5af001a4bb05470abbc6287b5c3d1ae8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:30.962943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:30.963232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:30.963513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:30.969452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:30.983160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a182a41ad4ca4fe1922bd0fa539e68c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.984183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a182a41ad4ca4fe1922bd0fa539e68c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:30.985161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a182a41ad4ca4fe1922bd0fa539e68c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.001378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a182a41ad4ca4fe1922bd0fa539e68c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.014848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:31.016607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:31.028835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1000/1978] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:30 2022] DELETE /identity/v3/users/a182a41ad4ca4fe1922bd0fa539e68c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:31.029702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.031087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:31.081941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:31.132516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e21b3-9bea-464b-8040-f79df9935785 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.137809 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 979/1979] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:31.138784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.141666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.142858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.143483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.143483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.144391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.146537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.149297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851947a9-543c-4d86-accf-be48c43e6bd4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.154529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.155161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.155448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.155729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.156939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:31.157256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.159076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.164728 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1001/1980] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:31.169175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.177072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 980/1981] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:31.178224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.183571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47a9a-4ac0-45f5-98d2-0c773e04e002 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.189639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc705be7-7670-4d98-a820-cf1ac76d71fe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.191027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.191921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.192228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.192548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.193251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.195722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.196438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.197169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.197558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.198010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.201841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.203907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.228156 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1002/1982] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:31.232751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.245839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65971166-9969-4216-bb13-cf2278b218ba admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.250205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 981/1983] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:31 2022] POST /identity/v3/projects => generated 411 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:31.250731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85559b-7dcd-48e4-8624-45c1d136aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.251934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85559b-7dcd-48e4-8624-45c1d136aa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.253207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85559b-7dcd-48e4-8624-45c1d136aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.253472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.253594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85559b-7dcd-48e4-8624-45c1d136aa0c admin admin] PATH_INFO: `/v3/projects/5b589c02db3f41d486cb86a55bfab2bc/users/c5c42a5f4ca54a25b6e39ba9857295b8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.280559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85559b-7dcd-48e4-8624-45c1d136aa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b589c02db3f41d486cb86a55bfab2bc, user_id=c5c42a5f4ca54a25b6e39ba9857295b8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.287821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85559b-7dcd-48e4-8624-45c1d136aa0c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.312747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1003/1984] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:31 2022] PUT /identity/v3/projects/5b589c02db3f41d486cb86a55bfab2bc/users/c5c42a5f4ca54a25b6e39ba9857295b8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:31.328798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.329543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.330327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.360843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d582d-a8f2-4cf4-aa6f-6e488f99bd37 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.398642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:31.401031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:31.467484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.468486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.468486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.468711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.469436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.474410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.507159 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 982/1985] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:31 2022] POST /identity/v3/users => generated 306 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:31.508187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.519714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb62d2-284e-44bd-9b1e-2c99b2ca2184 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.525683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.526520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.526807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.527082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.527739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.529340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.542078 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1004/1986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:31.543141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.545265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 983/1987] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:31.551802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.559244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60fb61-262c-4ec8-a563-00ac7126608c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.566290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.567011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.567418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.567797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.568659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.568903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e27ff4-a032-4b64-b748-3255ff3d4c63 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.571008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.574106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.575009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.575297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.575575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.576233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.578482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.603317 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 984/1988] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:31.607151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.613488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:31.623115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fb46-61ba-4dd5-afee-262bb576c6ea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.626399 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1005/1989] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:31 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:31.627658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.667449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:31.727369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.728053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.728334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.729135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] PATH_INFO: `/v3/projects/b6b90451d0e94ccd8874d87a2c129483/users/cf30691cea85442384943baca7f21b3d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.730293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30211-02f6-4297-8bd6-275d91e75377 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.735144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.735955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.736322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.736669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.737630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.739958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.745818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b90451d0e94ccd8874d87a2c129483, user_id=cf30691cea85442384943baca7f21b3d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.749140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.766096 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1006/1990] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:31 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:31.766821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.769573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:31.781643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 985/1991] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:31 2022] PUT /identity/v3/projects/b6b90451d0e94ccd8874d87a2c129483/users/cf30691cea85442384943baca7f21b3d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:31.781643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.783869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06372a-886c-4b7b-b6a5-e428ed59c498 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.789041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:31.851576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.852193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.852504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.852808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] PATH_INFO: `/v3/projects/7adc558822444a649e9f4226888a36f4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.854239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7adc558822444a649e9f4226888a36f4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.856181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.867381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c664f6-f964-4c9b-8a0f-97b53e4544a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:31.872629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:31.873392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.873579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.873859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] PATH_INFO: `/v3/projects/80c7f194d47443a3b8528f63f2ea29b4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.875207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c7f194d47443a3b8528f63f2ea29b4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:31.877128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:31.915472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7adc558822444a649e9f4226888a36f4', 'request_id': 'req-93ae8c90-4497-4dde-898f-38cff4d81c70'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.924839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7adc558822444a649e9f4226888a36f4', 'request_id': 'req-93ae8c90-4497-4dde-898f-38cff4d81c70'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.933140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7adc558822444a649e9f4226888a36f4', 'request_id': 'req-93ae8c90-4497-4dde-898f-38cff4d81c70'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.947818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c7f194d47443a3b8528f63f2ea29b4', 'request_id': 'req-86ffdd80-706f-40db-8abd-904884ea1169'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.951699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] The token cache is being invalidate because project 7adc558822444a649e9f4226888a36f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:31.952081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.952745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.954276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c7f194d47443a3b8528f63f2ea29b4', 'request_id': 'req-86ffdd80-706f-40db-8abd-904884ea1169'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.958210 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1007/1992] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:31 2022] DELETE /identity/v3/projects/7adc558822444a649e9f4226888a36f4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:31.960071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:31.962592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:31.967267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c7f194d47443a3b8528f63f2ea29b4', 'request_id': 'req-86ffdd80-706f-40db-8abd-904884ea1169'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.984486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] The token cache is being invalidate because project 80c7f194d47443a3b8528f63f2ea29b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:31.985206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.986297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ffdd80-706f-40db-8abd-904884ea1169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:31.988430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 986/1993] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:31 2022] DELETE /identity/v3/projects/80c7f194d47443a3b8528f63f2ea29b4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:31.990217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312e86-8859-426d-ae84-bc747ee31e15 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:31.991212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312e86-8859-426d-ae84-bc747ee31e15 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:31.991770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312e86-8859-426d-ae84-bc747ee31e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:31.994719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:32.041290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-02312e86-8859-426d-ae84-bc747ee31e15 None None] MFA Rules not processed for user `cf30691cea85442384943baca7f21b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:32.042938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-02312e86-8859-426d-ae84-bc747ee31e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.060834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8c90-4497-4dde-898f-38cff4d81c70 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.084594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:32.151883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 987/1994] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:31 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:32.153716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c054ed-db8d-4d1b-a975-c1901ff60379 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.154222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c054ed-db8d-4d1b-a975-c1901ff60379 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.154646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c054ed-db8d-4d1b-a975-c1901ff60379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.185711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.186933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.187225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.187504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.190938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.191250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d0c054ed-db8d-4d1b-a975-c1901ff60379 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:32.192604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.192916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0c054ed-db8d-4d1b-a975-c1901ff60379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.210205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 988/1995] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:32.210205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35acae-44f9-492d-a5b7-7d909cec98ba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.210205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35acae-44f9-492d-a5b7-7d909cec98ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.210205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35acae-44f9-492d-a5b7-7d909cec98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.218996 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1008/1996] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:32.219941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.223565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.255744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88a63-3e92-47ee-9644-672cc6310166 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.268359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3c35acae-44f9-492d-a5b7-7d909cec98ba None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:32.270207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.270965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.271081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c35acae-44f9-492d-a5b7-7d909cec98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.271315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.272436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.273131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.276023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.297808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 989/1997] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:32.301066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51307-44b4-4ffe-98a1-260d6141e1a5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.301469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51307-44b4-4ffe-98a1-260d6141e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.304172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51307-44b4-4ffe-98a1-260d6141e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.331010 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1009/1998] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:32.331010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.334869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.345873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1dd51307-44b4-4ffe-98a1-260d6141e1a5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:32.347257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1dd51307-44b4-4ffe-98a1-260d6141e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.420360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed400a6-c827-45de-b899-06ec5c9203ad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.424623 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 990/1999] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:32.426857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.427522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.427973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.429081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] PATH_INFO: `/v3/projects/fb5c670be8544923987e02e1cd3ed7bd/users/b876ba682a714ca89a35b989e04745b0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.429207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.429414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.429689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.446306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5c670be8544923987e02e1cd3ed7bd, user_id=b876ba682a714ca89a35b989e04745b0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.449059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.449777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:32.451019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:32.460762 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 991/2000] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:32.461665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.464814 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1010/2001] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:32 2022] PUT /identity/v3/projects/fb5c670be8544923987e02e1cd3ed7bd/users/b876ba682a714ca89a35b989e04745b0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:32.467603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.471763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72013990-0d80-4fb0-bd68-a4482e95a7d8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.499904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:32.542649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.542911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff8ca-1fc2-4981-85b1-9c09b4ef91e8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.543286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.543563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.543869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.544506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.546806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.547803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.550929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.550929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.550929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.550929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:32.550929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.551485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.570713 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1011/2002] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:32.570713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.583168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1988377-e15c-4636-ab57-b967c278efb2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.589242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.589859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.590140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.590441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.591185 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 992/2003] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/users => generated 311 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:32.591317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:32.591393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.591854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.592971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.607274 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1012/2004] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:32.608336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03300c-8b64-4620-be72-1703bc60c4f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.611515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.613792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.615045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.615849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.616478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.616669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.618668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.622584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421432fa-bae0-408a-b2c1-30df27e0e48f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.628055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.628475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.628821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.629160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.629861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.634653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 993/2005] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:32.634653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.634900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.648045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb6e74-7012-44b0-a684-f95833c46810 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.653600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.654453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.654815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.655130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.655803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.657662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.673648 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1013/2006] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:32.673648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.673914 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 994/2007] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:32.673914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.684619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c326-e009-476c-a0d9-e1d617c4ee94 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.698823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:32.736273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3373f-54dc-4592-97b7-7694423cac4d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.742300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.742925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.743210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.743486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.744125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.745717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.746079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.746418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.746702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.746978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] PATH_INFO: `/v3/projects/fb5c670be8544923987e02e1cd3ed7bd/users/b876ba682a714ca89a35b989e04745b0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.748879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5c670be8544923987e02e1cd3ed7bd, user_id=b876ba682a714ca89a35b989e04745b0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.751562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.772888 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 995/2008] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:32 2022] PUT /identity/v3/projects/fb5c670be8544923987e02e1cd3ed7bd/users/b876ba682a714ca89a35b989e04745b0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:32.772888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.781722 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1014/2009] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:32.781722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.840278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077dc0-b921-4e65-a040-de1d0b98cfe8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.845221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1754582-67fc-47f4-8264-849716cc19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.845929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1754582-67fc-47f4-8264-849716cc19a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.846247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1754582-67fc-47f4-8264-849716cc19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.846530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1754582-67fc-47f4-8264-849716cc19a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.847124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa85a3-26ad-4353-97f0-99dc9f3c92dd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:32.847262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1754582-67fc-47f4-8264-849716cc19a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.849089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1754582-67fc-47f4-8264-849716cc19a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.852488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:32.853174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.853460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.853738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] PATH_INFO: `/v3/projects/ed1cbed984c64fe49eb83af846fcbfa4/users/d5d6924a890644d39d72db50b10d3f56/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.868203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:32.876512 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 996/2010] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:32.876512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:32.876512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:32.876512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:32.886911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1cbed984c64fe49eb83af846fcbfa4, user_id=d5d6924a890644d39d72db50b10d3f56, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:32.889788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:32.907824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1015/2011] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:32 2022] PUT /identity/v3/projects/ed1cbed984c64fe49eb83af846fcbfa4/users/d5d6924a890644d39d72db50b10d3f56/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:32.907824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:32.922075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] MFA Rules not processed for user `b876ba682a714ca89a35b989e04745b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:32.923732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.000337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30ef8-f551-4f09-9066-9161ea280c0b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.005010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.005630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.005932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.007273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.007495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.009427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.009552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 997/2012] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:33.009552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.028467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09ec9-5518-4ef3-bbfe-33291311149c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.033755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349610-0767-4ef4-8951-a1db06c8a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.034416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349610-0767-4ef4-8951-a1db06c8a45c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.034706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349610-0767-4ef4-8951-a1db06c8a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.034981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349610-0767-4ef4-8951-a1db06c8a45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.035634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03349610-0767-4ef4-8951-a1db06c8a45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.041481 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1016/2013] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:32 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:33.041643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03349610-0767-4ef4-8951-a1db06c8a45c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.041734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.048480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4954-51b5-4ed4-913e-89601d791096 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.051545 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 998/2014] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:33.051545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.051545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.051545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.054682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.055290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.055567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.055840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.056477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.058052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.068331 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1017/2015] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:33.070090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.073352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:33.074682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.081168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc05a01-6952-4a6e-85ed-3f32a7403c18 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.084215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:33.086782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.087476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.087731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.088177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.088644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.090744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.102124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1018/2016] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:33.103069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.112894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1d672-b2d4-4740-9d5a-b5fdda787275 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.119323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.119920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.120196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.120467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.121098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.122755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.136993 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1019/2017] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:33.136993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.144326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e6b9e-196a-400c-8ba6-6fbf039bfb35 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.146438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 999/2018] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:33.147522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.155368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.156038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.156447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.156724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] PATH_INFO: `/v3/projects/ed1cbed984c64fe49eb83af846fcbfa4/users/d5d6924a890644d39d72db50b10d3f56/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.158779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1cbed984c64fe49eb83af846fcbfa4, user_id=d5d6924a890644d39d72db50b10d3f56, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.161447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.161739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b637-b75c-4809-9094-7c44ff5d5202 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.167526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.168247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.168593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.168930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.169677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.171315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.172411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1020/2019] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:33 2022] PUT /identity/v3/projects/ed1cbed984c64fe49eb83af846fcbfa4/users/d5d6924a890644d39d72db50b10d3f56/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:33.173182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.189468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1000/2020] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:33.190763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.192670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.241424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb9bf-0307-446f-8fa2-0d05cc602085 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.246166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b2916-0bcc-4a61-8c23-35b9e662f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.246846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b2916-0bcc-4a61-8c23-35b9e662f17a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.247135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b2916-0bcc-4a61-8c23-35b9e662f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.247418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b2916-0bcc-4a61-8c23-35b9e662f17a admin admin] PATH_INFO: `/v3/projects/6d4c51fc140844dd94e700cac860ea7f/users/4bc71a1f6b564a38bae5e152344853da/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.267518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b2916-0bcc-4a61-8c23-35b9e662f17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4c51fc140844dd94e700cac860ea7f, user_id=4bc71a1f6b564a38bae5e152344853da, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.268794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16827a2-ccf3-472a-a06c-cef49941ddea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.270309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b2916-0bcc-4a61-8c23-35b9e662f17a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.284225 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1021/2021] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:33 2022] PUT /identity/v3/projects/6d4c51fc140844dd94e700cac860ea7f/users/4bc71a1f6b564a38bae5e152344853da/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:33.285503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.285790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.286064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.324982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] MFA Rules not processed for user `d5d6924a890644d39d72db50b10d3f56`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:33.326284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.330209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:33.340112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.340963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.341549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.342329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.344507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.396364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:33.406917 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1022/2022] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:33.407785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.413198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.414810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d9000-e697-4024-a486-9755f9cff80b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.425065 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1001/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:33.426376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.426664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.426940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.457285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] MFA Rules not processed for user `4bc71a1f6b564a38bae5e152344853da`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:33.458919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.489312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2a29d-a2f9-483c-b2b1-0750f841a11d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.494444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.495256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.495682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.495968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] PATH_INFO: `/v3/projects/7ae5b446d8c04574be8108b9174d0daa/users/4ee06e7a5c5a4b50b8dc196727fd92c7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.514273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae5b446d8c04574be8108b9174d0daa, user_id=4ee06e7a5c5a4b50b8dc196727fd92c7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.517115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.534234 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1023/2024] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:33 2022] PUT /identity/v3/projects/7ae5b446d8c04574be8108b9174d0daa/users/4ee06e7a5c5a4b50b8dc196727fd92c7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:33.535293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.536867 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1002/2025] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:33.537397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.541647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.553666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c727-20e3-4070-8c80-d8308a245917 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.642992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af114ee2-b4de-447b-a887-7c62b3900126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.643911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af114ee2-b4de-447b-a887-7c62b3900126 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.644441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af114ee2-b4de-447b-a887-7c62b3900126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.644933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af114ee2-b4de-447b-a887-7c62b3900126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.645918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af114ee2-b4de-447b-a887-7c62b3900126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.649746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af114ee2-b4de-447b-a887-7c62b3900126 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.660102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f8ac5-466b-4cd6-94cc-49d68d0fc451 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.666983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.667522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.667808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.668084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.687128 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1003/2026] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:33.687128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.687128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.687128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.696825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:33.719724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] MFA Rules not processed for user `4ee06e7a5c5a4b50b8dc196727fd92c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:33.721025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:33.746034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.747690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.759910 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1024/2027] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:33.760698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.773809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18930b09-9366-4f50-8353-b30b34989169 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.775823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:33.800495 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1004/2028] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:33.805010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.859040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.860085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.860545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.860981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.862864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.866583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.906764 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1025/2029] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:33.909195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:33.924251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299738-6914-4bdd-bda2-d08b595ac4d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.935893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.939012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.939557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.940069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.940947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.941857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda17f26-f8e9-4bb2-8c4b-4726f2760407 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:33.946510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.949130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:33.949940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:33.950254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:33.950531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:33.951324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:33.953137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:33.974000 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1026/2030] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:33.976643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.001609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42941707-644d-4c1a-948f-10e39c0367a9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.002784 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1005/2031] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:33 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:34.003754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.099115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f432bcd-0207-4e6b-8b56-917b8a1fdfe3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.105220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.105929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.106315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.106666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.107387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.109901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.130577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.132788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.132975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.133804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] PATH_INFO: `/v3/projects/95bbc3bba6c044baa55fc77444a782b7/users/7d1c958361564fa3ac4ecaacc3c4dd25/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.140970 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1006/2032] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:34 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:34.141845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.151494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95bbc3bba6c044baa55fc77444a782b7, user_id=7d1c958361564fa3ac4ecaacc3c4dd25, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.160002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.195723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1027/2033] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:33 2022] PUT /identity/v3/projects/95bbc3bba6c044baa55fc77444a782b7/users/7d1c958361564fa3ac4ecaacc3c4dd25/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:34.196576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.226087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:34.247897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:34.273874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915667-0513-4107-a71a-88db61a6e273 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.292540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888831f-85be-437f-9494-633b63e12e89 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.306696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.307380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.307599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.307868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.309112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.310857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.330484 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1028/2034] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:34.331558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.345407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de97953-593e-48ea-810c-e1f281e859d3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.351790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.352851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.353297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.353725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.355019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.357040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.374261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1029/2035] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:34.374261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.377723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.378668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.379176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.379587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.405328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293f69c-bb7f-4676-9c79-bc054948f750 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.409683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.410446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.410670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.410947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] PATH_INFO: `/v3/projects/a7951f750c764f2eac1a40b09cc96404/users/1244b33ce6d84bb99066ecfa7447c41e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.434937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7951f750c764f2eac1a40b09cc96404, user_id=1244b33ce6d84bb99066ecfa7447c41e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.437646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.456649 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1030/2036] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:34 2022] PUT /identity/v3/projects/a7951f750c764f2eac1a40b09cc96404/users/1244b33ce6d84bb99066ecfa7447c41e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:34.457845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.477700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.481008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.493085 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1007/2037] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:34 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:34.493931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.508862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd799-9867-463d-a0d7-dc26540e17f2 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.565014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae50a88-709f-4782-99b6-5a46bd224c75 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.581838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.582668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.583094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.585958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] PATH_INFO: `/v3/projects/95bbc3bba6c044baa55fc77444a782b7/users/7d1c958361564fa3ac4ecaacc3c4dd25/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.588708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=95bbc3bba6c044baa55fc77444a782b7, user_id=7d1c958361564fa3ac4ecaacc3c4dd25, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.591458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.612816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.613443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.613736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.614126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.614973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.616814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.630340 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1031/2038] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:34 2022] PUT /identity/v3/projects/95bbc3bba6c044baa55fc77444a782b7/users/7d1c958361564fa3ac4ecaacc3c4dd25/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:34.630340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.630647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1008/2039] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:34.631895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:34.643947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a972ba3-5bb4-4cc5-8d07-be0f45d57ccf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.716103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:34.720204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee4129-ee75-4a08-8e9a-8a4c49d3b2ee admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:34.725398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.726762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.727342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.728129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] PATH_INFO: `/v3/users/cf30691cea85442384943baca7f21b3d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.729747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf30691cea85442384943baca7f21b3d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.732261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.746773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b6a3-e56b-468c-b260-9e2a42c44d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:34.747454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b6a3-e56b-468c-b260-9e2a42c44d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.747742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b6a3-e56b-468c-b260-9e2a42c44d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.748024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b6a3-e56b-468c-b260-9e2a42c44d6e admin admin] PATH_INFO: `/v3/projects/a7951f750c764f2eac1a40b09cc96404/users/1244b33ce6d84bb99066ecfa7447c41e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.748612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:34.750724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476b6a3-e56b-468c-b260-9e2a42c44d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7951f750c764f2eac1a40b09cc96404, user_id=1244b33ce6d84bb99066ecfa7447c41e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:34.754059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476b6a3-e56b-468c-b260-9e2a42c44d6e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:34.768631 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1009/2040] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:34 2022] PUT /identity/v3/projects/a7951f750c764f2eac1a40b09cc96404/users/1244b33ce6d84bb99066ecfa7447c41e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:34.779147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09071427-f7bb-4019-9e61-f1f1e32f0b8d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.779147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09071427-f7bb-4019-9e61-f1f1e32f0b8d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.779147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09071427-f7bb-4019-9e61-f1f1e32f0b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.802677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf30691cea85442384943baca7f21b3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:34.821190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-09071427-f7bb-4019-9e61-f1f1e32f0b8d None None] MFA Rules not processed for user `7d1c958361564fa3ac4ecaacc3c4dd25`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:34.822486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09071427-f7bb-4019-9e61-f1f1e32f0b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:34.831507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf30691cea85442384943baca7f21b3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:34.832250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf30691cea85442384943baca7f21b3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:34.832881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf30691cea85442384943baca7f21b3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:34.850417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3fdf434d-ba13-4661-9b0a-7d8c88dfdd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf30691cea85442384943baca7f21b3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:34.867022 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1032/2041] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:34 2022] DELETE /identity/v3/users/cf30691cea85442384943baca7f21b3d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:34.868127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.868414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.868683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.901560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] MFA Rules not processed for user `1244b33ce6d84bb99066ecfa7447c41e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:34.903223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:34.940323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1010/2042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:34.942184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:34.942671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:34.942886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:34.967295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:34.968782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.000772 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1033/2043] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:35.003965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:35.006855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.041728 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1011/2044] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:35.042697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:35.043974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.100810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335ff3e-6a6c-46e2-ac16-23ea6447206d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:35.101112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:35.107549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:35.108165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.108444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.108712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.121075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:35.126267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1a3a0-8262-4a6a-ac4c-39637640ec69 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:35.133879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:35.134605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.134890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.135166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.136923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.173624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:35.175336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:35.185070 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1034/2045] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:35.185860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:35.187155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.198788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:35.200871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:35.212653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1012/2046] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:35.235534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:35.237497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.254825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0921-bcfd-40e2-a9c9-e836f6a86652 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:35.262216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:35.262216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.267111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.267111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] PATH_INFO: `/v3/users/4ee06e7a5c5a4b50b8dc196727fd92c7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.267111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee06e7a5c5a4b50b8dc196727fd92c7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:35.267111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:35.279319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fdaf3-d751-45d1-a9c1-61136dd5e76f service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:35.283516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0810137-4760-4d2b-891f-be86716a6fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:35.284133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810137-4760-4d2b-891f-be86716a6fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.284491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810137-4760-4d2b-891f-be86716a6fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.285067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810137-4760-4d2b-891f-be86716a6fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.301103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0810137-4760-4d2b-891f-be86716a6fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:35.304269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0810137-4760-4d2b-891f-be86716a6fc9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:35.326545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1035/2047] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:35.353614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee06e7a5c5a4b50b8dc196727fd92c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.368075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee06e7a5c5a4b50b8dc196727fd92c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.368870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee06e7a5c5a4b50b8dc196727fd92c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.369571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee06e7a5c5a4b50b8dc196727fd92c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.381796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee06e7a5c5a4b50b8dc196727fd92c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.426467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1013/2048] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:35 2022] DELETE /identity/v3/users/4ee06e7a5c5a4b50b8dc196727fd92c7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:35.431186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.431500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.431781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.458842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:35.460750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.539226 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1036/2049] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:35.602643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:35.603540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.706539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51111fd7-04f5-47a2-885c-b5f3375b8c82 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:35.711033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137929df-3200-44c4-bd2d-d15cc8d5828f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:35.711735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137929df-3200-44c4-bd2d-d15cc8d5828f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.712309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137929df-3200-44c4-bd2d-d15cc8d5828f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.712666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137929df-3200-44c4-bd2d-d15cc8d5828f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.727654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137929df-3200-44c4-bd2d-d15cc8d5828f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:35.729188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137929df-3200-44c4-bd2d-d15cc8d5828f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:35.741585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1014/2050] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:35.759255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:35.760739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:35.773825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a283-e150-402d-89ee-d5f2e87da52a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:35.779099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:35.779772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.780071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.780349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] PATH_INFO: `/v3/users/4bc71a1f6b564a38bae5e152344853da` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.781474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc71a1f6b564a38bae5e152344853da)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:35.783417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:35.833151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc71a1f6b564a38bae5e152344853da'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.834544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:35.848648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc71a1f6b564a38bae5e152344853da'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.849397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc71a1f6b564a38bae5e152344853da'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.851283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc71a1f6b564a38bae5e152344853da'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.859214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc71a1f6b564a38bae5e152344853da'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:35.880281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1037/2051] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:35 2022] DELETE /identity/v3/users/4bc71a1f6b564a38bae5e152344853da => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:35.882955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee2735-b170-4759-88b0-3584517c776b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:35.885869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee2735-b170-4759-88b0-3584517c776b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:35.885869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee2735-b170-4759-88b0-3584517c776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:35.899244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:35.911420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-94ee2735-b170-4759-88b0-3584517c776b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:35.914456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94ee2735-b170-4759-88b0-3584517c776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:36.010869 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1015/2052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:36.027590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:36.029098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:36.063460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee2735-b170-4759-88b0-3584517c776b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:36.066706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94ee2735-b170-4759-88b0-3584517c776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:36.103913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee2735-b170-4759-88b0-3584517c776b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:36.111212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:36.111884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:36.112422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:36.112701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] PATH_INFO: `/v3/projects/b6b90451d0e94ccd8874d87a2c129483` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:36.116044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b90451d0e94ccd8874d87a2c129483)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:36.116216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd00ae-e861-4f73-ab32-ae107ae1b3ba admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:36.119804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:36.120921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:36.121602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:36.121818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:36.122095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:36.134604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:36.136072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:36.148956 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1038/2053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:36.174921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b90451d0e94ccd8874d87a2c129483', 'request_id': 'req-9322e49e-be4c-4fce-881a-3a33b5874e8f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.183352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b90451d0e94ccd8874d87a2c129483', 'request_id': 'req-9322e49e-be4c-4fce-881a-3a33b5874e8f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.192182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b90451d0e94ccd8874d87a2c129483', 'request_id': 'req-9322e49e-be4c-4fce-881a-3a33b5874e8f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.206512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] The token cache is being invalidate because project b6b90451d0e94ccd8874d87a2c129483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:36.206837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.207627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.213077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1016/2054] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:36 2022] DELETE /identity/v3/projects/b6b90451d0e94ccd8874d87a2c129483 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:36.214700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:36.226266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e922-39d4-49ec-bc2f-06da9cb32f4b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:36.316901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:36.319261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:36.330983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:36.331327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] PATH_INFO: `/v3/users/d5d6924a890644d39d72db50b10d3f56` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:36.336219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d6924a890644d39d72db50b10d3f56)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:36.338220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:36.412873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d6924a890644d39d72db50b10d3f56'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.432032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d6924a890644d39d72db50b10d3f56'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.436220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d6924a890644d39d72db50b10d3f56'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.437773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d6924a890644d39d72db50b10d3f56'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.449972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:36.453770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d6924a890644d39d72db50b10d3f56'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.465053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:36.466740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:36.500300 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1039/2055] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:36 2022] DELETE /identity/v3/users/d5d6924a890644d39d72db50b10d3f56 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:36.504219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e49e-be4c-4fce-881a-3a33b5874e8f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:36.598436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:36.600648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:36.601167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:36.601787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] PATH_INFO: `/v3/projects/6d4c51fc140844dd94e700cac860ea7f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:36.604960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4c51fc140844dd94e700cac860ea7f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:36.610938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:36.665069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:36.681831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4c51fc140844dd94e700cac860ea7f', 'request_id': 'req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.692204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4c51fc140844dd94e700cac860ea7f', 'request_id': 'req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.706520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4c51fc140844dd94e700cac860ea7f', 'request_id': 'req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.722542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] The token cache is being invalidate because project 6d4c51fc140844dd94e700cac860ea7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:36.723166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.723942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.725822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1017/2056] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:36 2022] DELETE /identity/v3/projects/6d4c51fc140844dd94e700cac860ea7f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:36.729662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:36.731200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:36.747257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4573-5a2e-454c-8ac1-7771f9a92e9d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:36.864545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:36.868782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:36.869199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:36.869579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] PATH_INFO: `/v3/users/7d1c958361564fa3ac4ecaacc3c4dd25` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:36.871853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1c958361564fa3ac4ecaacc3c4dd25)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:36.874090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:36.941376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1c958361564fa3ac4ecaacc3c4dd25'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.960321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1c958361564fa3ac4ecaacc3c4dd25'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.961501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1c958361564fa3ac4ecaacc3c4dd25'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.962280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1c958361564fa3ac4ecaacc3c4dd25'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.972805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ec1e470-8176-44e3-83b8-7697cda2c0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1c958361564fa3ac4ecaacc3c4dd25'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:36.980173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:36.982301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.001855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad48e5-9fcc-4bd5-89e7-42445dc1010e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.008386 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1040/2057] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:36 2022] DELETE /identity/v3/users/7d1c958361564fa3ac4ecaacc3c4dd25 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:37.009547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.010510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.010943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.011231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] PATH_INFO: `/v3/projects/ed1cbed984c64fe49eb83af846fcbfa4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.012760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1cbed984c64fe49eb83af846fcbfa4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.015698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.092603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1cbed984c64fe49eb83af846fcbfa4', 'request_id': 'req-72010613-3571-4008-bfc4-7c03f7875eea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.101022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1cbed984c64fe49eb83af846fcbfa4', 'request_id': 'req-72010613-3571-4008-bfc4-7c03f7875eea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.111909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1cbed984c64fe49eb83af846fcbfa4', 'request_id': 'req-72010613-3571-4008-bfc4-7c03f7875eea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.134231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] The token cache is being invalidate because project ed1cbed984c64fe49eb83af846fcbfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:37.134400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.135183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.144297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1018/2058] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:36 2022] DELETE /identity/v3/projects/ed1cbed984c64fe49eb83af846fcbfa4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:37.145092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e3df-ea55-4aac-bdcd-feb120906b9f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.145436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e3df-ea55-4aac-bdcd-feb120906b9f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.145972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e3df-ea55-4aac-bdcd-feb120906b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.151396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.153079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.172414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-87f0e3df-ea55-4aac-bdcd-feb120906b9f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:37.173887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87f0e3df-ea55-4aac-bdcd-feb120906b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.254858 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1041/2059] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:37.263738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.263738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.263738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.281985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:37.294239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:37.296926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.314490 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1042/2060] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:37.315639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.326779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8243c2-3407-49ee-a07c-60722fe82dc6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.331964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.332607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.332944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.333327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.334037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:37.334795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.339798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.366135 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1043/2061] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:37.367380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.385989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010613-3571-4008-bfc4-7c03f7875eea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.391698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.392413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.392702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.392985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] PATH_INFO: `/v3/projects/7ae5b446d8c04574be8108b9174d0daa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.394254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae5b446d8c04574be8108b9174d0daa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.395285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341e4e-8a4b-494a-b978-e735d770b97a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.396176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.400996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.401779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.402068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.402390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.403041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.406011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.451333 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1044/2062] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:37 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:37.453074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.481584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:37.492443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae5b446d8c04574be8108b9174d0daa', 'request_id': 'req-3a703680-ac1d-472f-b678-7ed0a4b4cecc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.500659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae5b446d8c04574be8108b9174d0daa', 'request_id': 'req-3a703680-ac1d-472f-b678-7ed0a4b4cecc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.515739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae5b446d8c04574be8108b9174d0daa', 'request_id': 'req-3a703680-ac1d-472f-b678-7ed0a4b4cecc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.533125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] The token cache is being invalidate because project 7ae5b446d8c04574be8108b9174d0daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:37.533438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.534216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.539584 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1019/2063] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:37 2022] DELETE /identity/v3/projects/7ae5b446d8c04574be8108b9174d0daa => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:37.540736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.544372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.572605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f311049-1cac-419c-8a3b-9baf450737f1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.641507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a703680-ac1d-472f-b678-7ed0a4b4cecc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.647656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.648619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.648871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.649218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] PATH_INFO: `/v3/users/1244b33ce6d84bb99066ecfa7447c41e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.650524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1244b33ce6d84bb99066ecfa7447c41e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.652733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.670551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.671457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.671894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.672730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.673524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.677458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.715997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1045/2064] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:37 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:37.719540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.721240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.735240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350e8a3-37a2-46a9-b261-fa141456925a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.742136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.743209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.743209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.743413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.744018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.745935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.746075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1244b33ce6d84bb99066ecfa7447c41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.760937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1244b33ce6d84bb99066ecfa7447c41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.761915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1244b33ce6d84bb99066ecfa7447c41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.762794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1244b33ce6d84bb99066ecfa7447c41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.768876 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1046/2065] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:37.770424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.772291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1244b33ce6d84bb99066ecfa7447c41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:37.773427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:37.795108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51204e43-a666-46a0-b284-aebcda8ed0db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.797368 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1020/2066] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:37 2022] DELETE /identity/v3/users/1244b33ce6d84bb99066ecfa7447c41e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:37.870139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:37.892234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247fcb8-27ff-47eb-99eb-e5a2fc2f41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.893165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fcb8-27ff-47eb-99eb-e5a2fc2f41e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.893599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fcb8-27ff-47eb-99eb-e5a2fc2f41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.894437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fcb8-27ff-47eb-99eb-e5a2fc2f41e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.895246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247fcb8-27ff-47eb-99eb-e5a2fc2f41e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.897393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247fcb8-27ff-47eb-99eb-e5a2fc2f41e7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:37.917585 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1047/2067] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:37.921507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:37.934857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f6aaa-8c06-45f3-83e7-6007f5d3b7e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:37.940517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:37.941435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:37.945612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:37.946042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] PATH_INFO: `/v3/projects/b626e4aab9ca45afb6e9ade0a2ce8e7f/users/87e1757ebd804b4aa9cd907ae74d32d3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:37.986213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b626e4aab9ca45afb6e9ade0a2ce8e7f, user_id=87e1757ebd804b4aa9cd907ae74d32d3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:37.991145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.029407 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1021/2068] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:37 2022] PUT /identity/v3/projects/b626e4aab9ca45afb6e9ade0a2ce8e7f/users/87e1757ebd804b4aa9cd907ae74d32d3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:38.032214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.032763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.033113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.075282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.083542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:38.102310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] MFA Rules not processed for user `87e1757ebd804b4aa9cd907ae74d32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:38.103814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:38.176227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:38.236261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1048/2069] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:38.246823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.265709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f089-b0e1-4b9f-a1da-6fcb195c6080 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.274895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.276259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.276624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.276926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] PATH_INFO: `/v3/projects/95bbc3bba6c044baa55fc77444a782b7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.278268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95bbc3bba6c044baa55fc77444a782b7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.280563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.291295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96be4-2b85-4cc8-8123-3cf213191cc9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.317481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.321682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.322518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.322898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.326226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.328488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.372190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95bbc3bba6c044baa55fc77444a782b7', 'request_id': 'req-edf41318-562f-4b1c-88cf-6b2b004d9207'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:38.380424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95bbc3bba6c044baa55fc77444a782b7', 'request_id': 'req-edf41318-562f-4b1c-88cf-6b2b004d9207'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:38.381833 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1049/2070] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:38.385739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.421269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95bbc3bba6c044baa55fc77444a782b7', 'request_id': 'req-edf41318-562f-4b1c-88cf-6b2b004d9207'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:38.470410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] The token cache is being invalidate because project 95bbc3bba6c044baa55fc77444a782b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:38.470719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:38.471915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf41318-562f-4b1c-88cf-6b2b004d9207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:38.475455 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1022/2071] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:38 2022] DELETE /identity/v3/projects/95bbc3bba6c044baa55fc77444a782b7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:38.479636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949d06-f187-4883-bf47-04f207e36dcb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.480076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949d06-f187-4883-bf47-04f207e36dcb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.480446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949d06-f187-4883-bf47-04f207e36dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.527912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f925216-7100-4b30-a5fe-afd23497abf6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.532233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b1949d06-f187-4883-bf47-04f207e36dcb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:38.538282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1949d06-f187-4883-bf47-04f207e36dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:38.544528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.545481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.545996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.546645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.547506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.549933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.564542 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1023/2072] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:38.578241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.578585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.578851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.588539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1050/2073] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:38.592622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.594889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:38.610330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff5b7-5ebe-447c-802c-0000103b2475 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.618653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.620941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.621399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.621835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.623181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.627226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.629978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:38.633566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:38.642526 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1024/2074] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:38.646434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.651704 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1051/2075] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:38.653270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.658132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69f36-e08d-4403-8156-bc0a4e3d9e74 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.664611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.665537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.666040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.666519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.666844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a00d-fa0b-45eb-8816-86ef9ec5e3f4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.668572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:38.669057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.671483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.673982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.674858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.675279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.675491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] PATH_INFO: `/v3/projects/617dce0b22464537854c883011740fa6/users/ea0df95cd75748049f587ee459c2e1d3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.692905 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1025/2076] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:38.697890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.712204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=617dce0b22464537854c883011740fa6, user_id=ea0df95cd75748049f587ee459c2e1d3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.716090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.718603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc434f2-2cfb-4c9c-ab8b-879aa24cd7f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.734022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.734798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.735116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.735508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.736364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.738774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.749724 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1052/2077] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:38 2022] PUT /identity/v3/projects/617dce0b22464537854c883011740fa6/users/ea0df95cd75748049f587ee459c2e1d3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:38.754221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.770776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:38.789164 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1026/2078] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:38.790355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.877949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270ed7-6918-4cad-a908-7a1976edd46f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.882037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652239a4-ff73-468e-935a-a82550525ecb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.884772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.885516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.885896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.886304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.887105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.889709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.891026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.891847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.892276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.892695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.893634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.895471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.916660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1053/2079] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:38.917065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:38.917988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.931989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e376d-da8a-4c83-b5ad-b41e3d77ae13 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.936333 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1027/2080] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:38.939382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfd13-d244-47c6-9c59-56a2530635ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:38.940324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfd13-d244-47c6-9c59-56a2530635ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:38.940991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfd13-d244-47c6-9c59-56a2530635ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:38.941901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfd13-d244-47c6-9c59-56a2530635ac admin admin] PATH_INFO: `/v3/projects/617dce0b22464537854c883011740fa6/users/ea0df95cd75748049f587ee459c2e1d3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:38.942017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:38.945224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cfd13-d244-47c6-9c59-56a2530635ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=617dce0b22464537854c883011740fa6, user_id=ea0df95cd75748049f587ee459c2e1d3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:38.948470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cfd13-d244-47c6-9c59-56a2530635ac admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:38.982688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9139-42cf-420a-ba2b-9cb4518ed34c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:38.983903 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1054/2081] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:38 2022] PUT /identity/v3/projects/617dce0b22464537854c883011740fa6/users/ea0df95cd75748049f587ee459c2e1d3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:39.000729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1a19a-0b0e-4626-9c39-95a12ae63f82 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.001789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1a19a-0b0e-4626-9c39-95a12ae63f82 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.002247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1a19a-0b0e-4626-9c39-95a12ae63f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.050294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6fb1a19a-0b0e-4626-9c39-95a12ae63f82 None None] MFA Rules not processed for user `ea0df95cd75748049f587ee459c2e1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:39.052635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6fb1a19a-0b0e-4626-9c39-95a12ae63f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.149512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.150478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.150814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.151091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.151819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.153481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.178786 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1028/2082] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:39.178786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.179339 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1055/2083] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:39.184775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.185562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.185893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.203021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d6f47-b6e8-4975-b591-e87c99d613e6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:39.214665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.215899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.216363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.216811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.217863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.219864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.223639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] MFA Rules not processed for user `87e1757ebd804b4aa9cd907ae74d32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:39.224689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.242056 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1029/2084] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:39.243400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.256252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54210-8b15-4f24-b22d-6c39e7a2484a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:39.272787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568383-b32f-42fc-a270-76eb4ba0d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.273846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568383-b32f-42fc-a270-76eb4ba0d509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.274351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568383-b32f-42fc-a270-76eb4ba0d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.274712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568383-b32f-42fc-a270-76eb4ba0d509 admin admin] PATH_INFO: `/v3/projects/11ed857b7c084a1b96573501c47be1f5/users/e478de82935c4f9b93a698e3fa3c6d78/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.298735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9568383-b32f-42fc-a270-76eb4ba0d509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ed857b7c084a1b96573501c47be1f5, user_id=e478de82935c4f9b93a698e3fa3c6d78, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.301905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9568383-b32f-42fc-a270-76eb4ba0d509 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.319788 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1056/2085] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:39.320775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.325803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.327853 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1030/2086] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:39 2022] PUT /identity/v3/projects/11ed857b7c084a1b96573501c47be1f5/users/e478de82935c4f9b93a698e3fa3c6d78/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:39.338734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.338984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.339229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.354385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a67c-7dbf-4795-936c-d7b690133291 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:39.376067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] MFA Rules not processed for user `e478de82935c4f9b93a698e3fa3c6d78`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:39.377305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.387575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:39.458715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.460538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.460538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.460758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] PATH_INFO: `/v3/projects/a7951f750c764f2eac1a40b09cc96404` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.463761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7951f750c764f2eac1a40b09cc96404)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.469795 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1031/2087] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:39.469795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.471144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.472155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.551599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:39.574918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7951f750c764f2eac1a40b09cc96404', 'request_id': 'req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:39.582990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ca2e7-86e3-49f0-a47e-ab141f7c9d33 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:39.588135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7951f750c764f2eac1a40b09cc96404', 'request_id': 'req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:39.594380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7951f750c764f2eac1a40b09cc96404', 'request_id': 'req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:39.617502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] The token cache is being invalidate because project a7951f750c764f2eac1a40b09cc96404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:39.617796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:39.620943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:39.623161 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1057/2088] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:39 2022] DELETE /identity/v3/projects/a7951f750c764f2eac1a40b09cc96404 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:39.627829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.628743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.706803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b0d1a-d55c-4cb8-8b0d-8bfae5616618 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:39.712469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef795a10-b736-4d82-870f-a31ef0192dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.713094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef795a10-b736-4d82-870f-a31ef0192dec admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.713373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef795a10-b736-4d82-870f-a31ef0192dec admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.713643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef795a10-b736-4d82-870f-a31ef0192dec admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.714326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef795a10-b736-4d82-870f-a31ef0192dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.716230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef795a10-b736-4d82-870f-a31ef0192dec admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.754122 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1058/2089] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:39 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:39.754122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.754122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.754122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.760833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.761738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.762232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.762615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.765752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.781204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:39.782802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.846877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:39.876316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.878368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5663f0b-459d-49b7-9bce-7bf326c3b726 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.885071 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1059/2090] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:39.885983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.912122 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1032/2091] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:39.916955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb905b69-7625-4fa5-a81d-f982b7b86827 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:39.922295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:39.922566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.922859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.922991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:39.923137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.923256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:39.923448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:39.924319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:39.926672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:39.956660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1060/2092] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:39 2022] POST /identity/v3/users => generated 292 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:39.963388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:39.965476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:39.966353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.981579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1033/2093] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:39.983288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:39.998463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389478e-074d-4c6c-bf4f-578d2326470a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.003407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1c727-997d-42e1-8f4b-c5f99163916b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.008886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.009705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.009993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.012177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.013226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.013226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.013446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.013743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.013987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.014815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:40.015224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.016173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.017117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.036548 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1034/2094] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:40.038899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.048885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a001f-5004-4171-a9b4-dc859c1e1b60 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.051179 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1061/2095] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:40.055733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.056132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.056252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.056717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.057014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.057812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.060705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.069893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0f1e-7109-4eaa-91f0-5a40dbefc47d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.077126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.078532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.078996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.079479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] PATH_INFO: `/v3/projects/41628f6a7a2d4d71a150109f875c618e/users/7b8a99bedd9d4f99a70445ffe7462b84/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.107843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=41628f6a7a2d4d71a150109f875c618e, user_id=7b8a99bedd9d4f99a70445ffe7462b84, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.112474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.119393 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1035/2096] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:40.120995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.142263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1062/2097] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:40 2022] PUT /identity/v3/projects/41628f6a7a2d4d71a150109f875c618e/users/7b8a99bedd9d4f99a70445ffe7462b84/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:40.146493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.202722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:40.241407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a7735-f28e-43e0-8827-948d7ce1f627 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.249372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c9dc6-80bf-444b-975a-a7d6e20f13ef admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.253181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.253826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.254107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.255095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.263836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.267942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.276608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.282773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.284622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.285640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.288017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.291129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.305748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1036/2098] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:40.307586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.315189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1063/2099] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:40.320693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.322595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722fac-6784-4f83-af2e-ba1ec728e0f1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.327872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.328637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.328989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.329339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.330776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.333028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.342291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1f49-a6cd-42d7-9458-68fd8157b20c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.348433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c5ae9-b4bb-4640-853b-b8a5154df7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.349196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c5ae9-b4bb-4640-853b-b8a5154df7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.350102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c5ae9-b4bb-4640-853b-b8a5154df7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.350723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c5ae9-b4bb-4640-853b-b8a5154df7a6 admin admin] PATH_INFO: `/v3/projects/41628f6a7a2d4d71a150109f875c618e/users/7b8a99bedd9d4f99a70445ffe7462b84/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.354310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1037/2100] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:40.355581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.355925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c5ae9-b4bb-4640-853b-b8a5154df7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41628f6a7a2d4d71a150109f875c618e, user_id=7b8a99bedd9d4f99a70445ffe7462b84, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.358893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c5ae9-b4bb-4640-853b-b8a5154df7a6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.372329 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1064/2101] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:40 2022] PUT /identity/v3/projects/41628f6a7a2d4d71a150109f875c618e/users/7b8a99bedd9d4f99a70445ffe7462b84/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:40.383940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0664643-acba-46f4-8bd3-68aaf35364d0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.384986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0664643-acba-46f4-8bd3-68aaf35364d0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.385446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0664643-acba-46f4-8bd3-68aaf35364d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.405254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b4e9-45d5-4c40-8574-7a67bdcc425e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.474897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b0664643-acba-46f4-8bd3-68aaf35364d0 None None] MFA Rules not processed for user `7b8a99bedd9d4f99a70445ffe7462b84`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:40.476247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b0664643-acba-46f4-8bd3-68aaf35364d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:40.499062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.500167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.500821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.501424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.502341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.504590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.524264 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1038/2102] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:40.528389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.543038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cdb9a-2f2a-493b-a9c9-9eeabcd0b7f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.551510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494faa76-c278-4615-ac17-36c98a3f4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.553209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faa76-c278-4615-ac17-36c98a3f4f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.553772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faa76-c278-4615-ac17-36c98a3f4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.554238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faa76-c278-4615-ac17-36c98a3f4f06 admin admin] PATH_INFO: `/v3/projects/3a6e7371bff74b97a5df7869195b567f/users/69c4e2c7ac30439ca91325faa05bffee/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.561957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:40.578596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faa76-c278-4615-ac17-36c98a3f4f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6e7371bff74b97a5df7869195b567f, user_id=69c4e2c7ac30439ca91325faa05bffee, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.582262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faa76-c278-4615-ac17-36c98a3f4f06 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.597450 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1065/2103] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:40.599225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.601634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.602074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.618965 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1039/2104] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:40 2022] PUT /identity/v3/projects/3a6e7371bff74b97a5df7869195b567f/users/69c4e2c7ac30439ca91325faa05bffee/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:40.624092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d660-799c-47d3-8333-31ea08031169 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.624092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d660-799c-47d3-8333-31ea08031169 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.625502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d660-799c-47d3-8333-31ea08031169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.649828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] MFA Rules not processed for user `e478de82935c4f9b93a698e3fa3c6d78`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:40.653333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:40.669443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9643d660-799c-47d3-8333-31ea08031169 None None] MFA Rules not processed for user `69c4e2c7ac30439ca91325faa05bffee`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:40.670797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9643d660-799c-47d3-8333-31ea08031169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:40.797985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1066/2105] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:40.810694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.811038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1040/2106] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:40.812998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:40.816351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643d660-799c-47d3-8333-31ea08031169 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.877551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:40.928522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643d660-799c-47d3-8333-31ea08031169 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.933548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.934319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.934600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.934874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.935516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.940497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508d98-450d-437c-8d73-1b503479d557 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:40.944021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.949917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:40.951654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:40.952037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:40.952694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:40.955875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:40.977181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:40.978993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:40.988462 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1041/2107] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:40.992630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:40.994517 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1067/2108] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:41.003193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.004594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:41.021235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bcfdb-fe36-454c-baa5-a6dbcd3a2cfd service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.089984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c522c-5024-4acb-a984-41eb6fc352f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.095947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.096916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.097391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.097945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.098773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.102389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.130510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.132236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.133606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.133897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.136502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:41.146304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1042/2109] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:40 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:41.147788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.162976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26fd3a-9bee-4245-a30a-1a657868b77e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.165709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:41.169776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.170838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.171819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.171819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.172269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.174977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.191053 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1043/2110] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:41.197528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.212113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5896478-5eb3-4c6b-ad88-b5d768704698 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.218928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.219843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.220140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.220411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] PATH_INFO: `/v3/projects/6aa2d3ac6eae43f682610365db22c87d/users/027b5d8d56a7476b8a21958ed475d85a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.238630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa2d3ac6eae43f682610365db22c87d, user_id=027b5d8d56a7476b8a21958ed475d85a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.242031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.242193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.243642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.262413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1068/2111] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:41.273798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1044/2112] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:41 2022] PUT /identity/v3/projects/6aa2d3ac6eae43f682610365db22c87d/users/027b5d8d56a7476b8a21958ed475d85a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:41.275284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.289732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cd68c-0ff8-428e-aa6e-7561536b379b service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.389836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927f09-b333-4d23-822e-2faa6536f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.391029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927f09-b333-4d23-822e-2faa6536f842 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.391803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927f09-b333-4d23-822e-2faa6536f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.392088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927f09-b333-4d23-822e-2faa6536f842 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.393317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1927f09-b333-4d23-822e-2faa6536f842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.394557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1927f09-b333-4d23-822e-2faa6536f842 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.412739 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1069/2113] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:41.416832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.441327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a05ac-01ed-422c-b323-a0bd1b9b324b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.447457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.448264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.448596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.448875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] PATH_INFO: `/v3/projects/6aa2d3ac6eae43f682610365db22c87d/users/027b5d8d56a7476b8a21958ed475d85a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.452161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa2d3ac6eae43f682610365db22c87d, user_id=027b5d8d56a7476b8a21958ed475d85a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.455722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.526528 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1045/2114] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:41 2022] PUT /identity/v3/projects/6aa2d3ac6eae43f682610365db22c87d/users/027b5d8d56a7476b8a21958ed475d85a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:41.528548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.529144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.529639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.580036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] MFA Rules not processed for user `027b5d8d56a7476b8a21958ed475d85a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:41.581291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:41.754181 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1070/2115] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:41.774675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.777577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:41.844328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:41.882414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:41.905504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b147-1399-49a6-8fbd-95665512ba71 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.913343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.914018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.914335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.914616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] PATH_INFO: `/v3/users/e827a3f690234f60b149792bc772b3b2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:41.915525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:41.917431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e827a3f690234f60b149792bc772b3b2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:41.919726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:41.975850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4b0e-aeae-4f90-998f-6d959248b94c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:41.986527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447656-d91a-4ac3-b3df-bf9f7e1dbb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:41.988254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447656-d91a-4ac3-b3df-bf9f7e1dbb0b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:41.988673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447656-d91a-4ac3-b3df-bf9f7e1dbb0b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:41.989316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447656-d91a-4ac3-b3df-bf9f7e1dbb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.000404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447656-d91a-4ac3-b3df-bf9f7e1dbb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:42.002531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447656-d91a-4ac3-b3df-bf9f7e1dbb0b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:42.002794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e827a3f690234f60b149792bc772b3b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.013683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1071/2116] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:42.020043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e827a3f690234f60b149792bc772b3b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.020914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e827a3f690234f60b149792bc772b3b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.022791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e827a3f690234f60b149792bc772b3b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.034682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e827a3f690234f60b149792bc772b3b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.103639 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1046/2117] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:41 2022] DELETE /identity/v3/users/e827a3f690234f60b149792bc772b3b2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:42.105800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965288f-c6a3-4185-bf52-74214b181503 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:42.106066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965288f-c6a3-4185-bf52-74214b181503 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:42.106369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965288f-c6a3-4185-bf52-74214b181503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.134576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9965288f-c6a3-4185-bf52-74214b181503 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:42.135824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9965288f-c6a3-4185-bf52-74214b181503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:42.218211 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1072/2118] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:42.235551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:42.237797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:42.324893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a42e9-444d-49b6-b628-a3ad2cacc136 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:42.332006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:42.336389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:42.337907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:42.338444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.376488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:42.377876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:42.406595 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1047/2119] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:42.466760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:42.467345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:42.467824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.507366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] MFA Rules not processed for user `06e506f335f845a18332a4cd5047f3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:42.508616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:42.597092 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1073/2120] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:42.688869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:42.690387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:42.714025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3541ba3-44e2-4e64-b902-4e97ac8c70a8 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:42.720682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:42.721539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:42.721800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:42.722090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] PATH_INFO: `/v3/users/69c4e2c7ac30439ca91325faa05bffee` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.723364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c4e2c7ac30439ca91325faa05bffee)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:42.725551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:42.737339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:42.739231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:42.759153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c741f-9899-48fe-99bc-31302aeb93fc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:42.765234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:42.766542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:42.767050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:42.767478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] PATH_INFO: `/v3/projects/0e6f3d75496e444ea32cab113f800e24` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.781528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6f3d75496e444ea32cab113f800e24)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:42.784477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:42.827732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c4e2c7ac30439ca91325faa05bffee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.849529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c4e2c7ac30439ca91325faa05bffee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.851097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6f3d75496e444ea32cab113f800e24', 'request_id': 'req-162c9de4-f414-4892-8d63-b753348b6f06'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.851341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c4e2c7ac30439ca91325faa05bffee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.851957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c4e2c7ac30439ca91325faa05bffee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.860675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9125b501-05d3-41d0-973c-096e6ade9844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c4e2c7ac30439ca91325faa05bffee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.866626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:42.874807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6f3d75496e444ea32cab113f800e24', 'request_id': 'req-162c9de4-f414-4892-8d63-b753348b6f06'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.890291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6f3d75496e444ea32cab113f800e24', 'request_id': 'req-162c9de4-f414-4892-8d63-b753348b6f06'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.892131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:42.922044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] The token cache is being invalidate because project 0e6f3d75496e444ea32cab113f800e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:42.922044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.922044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:42.922812 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1048/2121] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:42 2022] DELETE /identity/v3/users/69c4e2c7ac30439ca91325faa05bffee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:42.924879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:42.926745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:42.926866 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1074/2122] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:42 2022] DELETE /identity/v3/projects/0e6f3d75496e444ea32cab113f800e24 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:42.927359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:42.928437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:42.930124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:42.949745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:42.952398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:43.050503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1049/2123] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:43.079368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:43.080868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:43.124787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c9de4-f414-4892-8d63-b753348b6f06 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:43.138103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:43.141947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:43.142361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:43.142559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] PATH_INFO: `/v3/users/a68ebaf8e156421798a01e9966ce4893` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:43.145494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68ebaf8e156421798a01e9966ce4893)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:43.152409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:43.221299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244e74-4d9e-4f91-a651-cd579cb6e2b2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:43.226164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:43.226852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:43.227141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:43.227421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:43.242063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:43.245545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:43.293866 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1050/2124] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:12:43.304588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68ebaf8e156421798a01e9966ce4893'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:43.330937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68ebaf8e156421798a01e9966ce4893'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:43.331844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68ebaf8e156421798a01e9966ce4893'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:43.332551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68ebaf8e156421798a01e9966ce4893'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:43.351898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68ebaf8e156421798a01e9966ce4893'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:43.395254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1075/2125] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:42 2022] DELETE /identity/v3/users/a68ebaf8e156421798a01e9966ce4893 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:44.341668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:44.343005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:44.364352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3733-dd25-46b2-96d0-60aa2b77fa74 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:44.499310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:44.499904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:44.500189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:44.500465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] PATH_INFO: `/v3/projects/3a6e7371bff74b97a5df7869195b567f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:44.501669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6e7371bff74b97a5df7869195b567f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:44.503737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:44.566689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:44.586713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6e7371bff74b97a5df7869195b567f', 'request_id': 'req-1b8133c2-14e0-486d-8570-ce6f47704a6e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.595050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6e7371bff74b97a5df7869195b567f', 'request_id': 'req-1b8133c2-14e0-486d-8570-ce6f47704a6e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.604651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6e7371bff74b97a5df7869195b567f', 'request_id': 'req-1b8133c2-14e0-486d-8570-ce6f47704a6e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.619942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] The token cache is being invalidate because project 3a6e7371bff74b97a5df7869195b567f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:44.620243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.621014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.626839 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1051/2126] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:44 2022] DELETE /identity/v3/projects/3a6e7371bff74b97a5df7869195b567f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:44.628355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:44.629872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:44.648725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381c6f8-17da-4191-bf7c-51ca426ca5af admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:44.711702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:44.713192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:44.746672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:44.747712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:44.748520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:44.748864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] PATH_INFO: `/v3/users/027b5d8d56a7476b8a21958ed475d85a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:44.750204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027b5d8d56a7476b8a21958ed475d85a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:44.752459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:44.793092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:44.864847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8133c2-14e0-486d-8570-ce6f47704a6e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:44.871407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:44.872106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:44.872582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:44.872954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] PATH_INFO: `/v3/projects/b2323134055f48e08c5c7bf52281596d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:44.874289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2323134055f48e08c5c7bf52281596d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:44.876352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:44.881742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027b5d8d56a7476b8a21958ed475d85a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.914580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027b5d8d56a7476b8a21958ed475d85a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.915359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027b5d8d56a7476b8a21958ed475d85a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.915996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027b5d8d56a7476b8a21958ed475d85a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.932121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-47598beb-591e-4df3-81cf-6e5bb80e7318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027b5d8d56a7476b8a21958ed475d85a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:44.956974 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1076/2127] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:44 2022] DELETE /identity/v3/users/027b5d8d56a7476b8a21958ed475d85a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:44.986481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2323134055f48e08c5c7bf52281596d', 'request_id': 'req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:45.009673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2323134055f48e08c5c7bf52281596d', 'request_id': 'req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:45.019151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2323134055f48e08c5c7bf52281596d', 'request_id': 'req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:45.047743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] The token cache is being invalidate because project b2323134055f48e08c5c7bf52281596d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:45.048305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:45.049436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3a1e5fa-9d4f-4980-8280-63aa4d988ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:45.057293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.058013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.058486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.062300 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1052/2128] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:44 2022] DELETE /identity/v3/projects/b2323134055f48e08c5c7bf52281596d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:45.106544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:45.108154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:45.218193 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1077/2129] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:45.223942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.224236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.224545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.254813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:45.256992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:45.267909 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1053/2130] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:45.272780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:45.285391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a08a-e478-4ed4-864b-f3a822194632 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:45.291486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:45.293276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.293276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.293537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.294360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:45.294672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:45.296754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:45.321394 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1078/2131] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:45.324196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:45.336476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf7830-e9e0-400c-ac62-476249c83bb5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:45.343931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:45.345348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.345861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.346544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.347427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:45.350822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:45.383540 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1054/2132] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:45 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:45.387563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:45.398329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa849aa4-898a-42a8-9486-9b1f7d533693 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:45.483776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:45.484545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.484898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.485185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.486244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:45.489148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:45.520524 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1079/2133] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:45 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:45.525648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:45.543972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0998c-3ccd-4e15-8ec0-bd78461b5686 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:45.550539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:45.551512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.551899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.552376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.553542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:45.555334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:45.591157 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1055/2134] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:45.595003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:45.620604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6439-cfb9-4b2d-b6f0-49c01f9edf30 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:45.630307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ed2b-b4c3-4d97-990d-c1ff2fa755f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:45.633901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ed2b-b4c3-4d97-990d-c1ff2fa755f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.634533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ed2b-b4c3-4d97-990d-c1ff2fa755f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.635036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ed2b-b4c3-4d97-990d-c1ff2fa755f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.642034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681ed2b-b4c3-4d97-990d-c1ff2fa755f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:45.652294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681ed2b-b4c3-4d97-990d-c1ff2fa755f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:45.660367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:45.680752 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1080/2135] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:45.684884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:45.703462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b508-6e48-40ba-bce4-63485ae1aad8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:45.716090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:45.717148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.717534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.718132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] PATH_INFO: `/v3/projects/fbbb4865e18c4263a900558df96e5441/users/f2b462c4a7e54fe29b3a88ca2996f851/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.724711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:45.764211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbb4865e18c4263a900558df96e5441, user_id=f2b462c4a7e54fe29b3a88ca2996f851, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:45.770654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:45.806196 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1056/2136] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:45 2022] PUT /identity/v3/projects/fbbb4865e18c4263a900558df96e5441/users/f2b462c4a7e54fe29b3a88ca2996f851/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:45.814033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:45.814773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:45.815725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:45.909029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] MFA Rules not processed for user `f2b462c4a7e54fe29b3a88ca2996f851`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:45.915031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:46.058520 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1081/2137] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:46.058930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.175163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a3f06-57d7-4cb5-a58d-d3c795a6d3dc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.191954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.192594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.192878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.193144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.194661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.196580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.241869 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1057/2138] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:46 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:46.243272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.258648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f3d4-7215-4a33-a00a-a3c39f676ed5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.265684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.267881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:46.361794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.362690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.362974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.363310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.363938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.367694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.372953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f385-cf92-4af9-8b7f-a9ab94264815 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.379736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.381248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.381728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.382269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] PATH_INFO: `/v3/projects/6aa2d3ac6eae43f682610365db22c87d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.383760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa2d3ac6eae43f682610365db22c87d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.386724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.406281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1082/2139] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:46 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:46.409837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.427762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ab47-1be1-47e2-a13c-1d60a77adca0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.435095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.435803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.436066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.437304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.437994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.440803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.454316 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1083/2140] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:46.457282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.463638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa2d3ac6eae43f682610365db22c87d', 'request_id': 'req-b3c283ba-8a1b-46e3-bf81-a6cee37db578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:46.469361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ea4c-26e4-422b-a4c6-ecdeae395453 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.474040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa2d3ac6eae43f682610365db22c87d', 'request_id': 'req-b3c283ba-8a1b-46e3-bf81-a6cee37db578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:46.491992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa2d3ac6eae43f682610365db22c87d', 'request_id': 'req-b3c283ba-8a1b-46e3-bf81-a6cee37db578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:46.502472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:46.508114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] The token cache is being invalidate because project 6aa2d3ac6eae43f682610365db22c87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:46.508866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:46.510578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3c283ba-8a1b-46e3-bf81-a6cee37db578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:46.517976 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1058/2141] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:46 2022] DELETE /identity/v3/projects/6aa2d3ac6eae43f682610365db22c87d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:46.519683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1a89-f09f-4a5d-8d8c-3a75e79f919b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.520259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1a89-f09f-4a5d-8d8c-3a75e79f919b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.520842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1a89-f09f-4a5d-8d8c-3a75e79f919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.557018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-faba1a89-f09f-4a5d-8d8c-3a75e79f919b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:46.558824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-faba1a89-f09f-4a5d-8d8c-3a75e79f919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:46.582091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.582820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.583104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.583387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] PATH_INFO: `/v3/projects/abd6677a34454cb38a877b6045ec50ef/users/b48ea9d84eed48b1803bbc5d7f667d83/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.594981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:46.610636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd6677a34454cb38a877b6045ec50ef, user_id=b48ea9d84eed48b1803bbc5d7f667d83, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.614674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.638240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1084/2142] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:46 2022] PUT /identity/v3/projects/abd6677a34454cb38a877b6045ec50ef/users/b48ea9d84eed48b1803bbc5d7f667d83/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:46.644248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.648022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:46.659942 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1059/2143] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:46.663983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.664277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.664557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.695186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:46.696914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:46.745828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d58bd3-c86d-4cbd-81c0-941afd883e68 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.751564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.752194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.752473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.752746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.753396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.755756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.772277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1085/2144] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:46.773167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.785686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2903e-d9c7-4a6e-9768-abcbc06c986f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.790877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8e1b9-e30b-411b-a5a0-a6c5aef86619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.791550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8e1b9-e30b-411b-a5a0-a6c5aef86619 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.791829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8e1b9-e30b-411b-a5a0-a6c5aef86619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.792105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8e1b9-e30b-411b-a5a0-a6c5aef86619 admin admin] PATH_INFO: `/v3/projects/abd6677a34454cb38a877b6045ec50ef/users/b48ea9d84eed48b1803bbc5d7f667d83/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.796811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8e1b9-e30b-411b-a5a0-a6c5aef86619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd6677a34454cb38a877b6045ec50ef, user_id=b48ea9d84eed48b1803bbc5d7f667d83, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.797777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8e1b9-e30b-411b-a5a0-a6c5aef86619 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.801167 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1060/2145] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:46.806452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.810684 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1086/2146] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:46 2022] PUT /identity/v3/projects/abd6677a34454cb38a877b6045ec50ef/users/b48ea9d84eed48b1803bbc5d7f667d83/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:46.822132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4cd98-2f66-4a4b-8a94-cb72feefd8e5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.822545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4cd98-2f66-4a4b-8a94-cb72feefd8e5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.822952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4cd98-2f66-4a4b-8a94-cb72feefd8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.834551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace44f-3fe5-4827-bdba-29f998a27451 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.861772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4ad4cd98-2f66-4a4b-8a94-cb72feefd8e5 None None] MFA Rules not processed for user `b48ea9d84eed48b1803bbc5d7f667d83`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:46.863432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ad4cd98-2f66-4a4b-8a94-cb72feefd8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:46.935004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.935930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.936220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.936505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.937167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:46.937473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:46.939545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:46.954647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1061/2147] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:12:46.974358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:46.984707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a251c-7110-4a21-a1de-9bc6de508cb1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:46.995703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:46.996394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:46.996682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:46.996962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:46.997997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.000505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.006528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1087/2148] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:47.008190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.010605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.011602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.060955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] MFA Rules not processed for user `f2b462c4a7e54fe29b3a88ca2996f851`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:47.064688 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1062/2149] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:46 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:47.064820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:47.065803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.086759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:47.137400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:47.148545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1088/2150] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:47.186662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9120-dc80-4173-a254-246a5332d125 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.191906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.192710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.193051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.195437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.195437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.197386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.213416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.215539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:47.225896 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1063/2151] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:47 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:47.230124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.252407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344aa3-251c-4f5d-9e2b-26592492cb1e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.264395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.265093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.265376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.265748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.266342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.268030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.283658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1064/2152] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:12:47.291460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.304630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2fb7-02e6-4be1-bf47-6ba6fb1a13bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.310061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.311443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.311732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.312011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.312671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.314445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.326415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbad36-745f-4cc5-8a48-fdbc3c386547 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.328505 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1065/2153] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:47.332568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.335796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.336569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.336967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.337491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.339681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:47.346736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd4999-7669-49aa-a865-b63ccfb6b2c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.354010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.355004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.355392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.355835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] PATH_INFO: `/v3/projects/07112aaa101349b89d95514d7f2afcc3/users/06437d4736e042fdad77c5cd6203ebec/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.357614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.359263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712c8de-db94-4a93-abba-ce38e4790b89 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.372752 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1089/2154] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:47.376433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07112aaa101349b89d95514d7f2afcc3, user_id=06437d4736e042fdad77c5cd6203ebec, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.379249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.401332 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1066/2155] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:47 2022] PUT /identity/v3/projects/07112aaa101349b89d95514d7f2afcc3/users/06437d4736e042fdad77c5cd6203ebec/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:47.408057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.408347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.408682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.445843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] MFA Rules not processed for user `06437d4736e042fdad77c5cd6203ebec`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:47.447701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:47.525381 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1090/2156] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:47.530053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.605178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a4f25-84fa-443d-8fdd-a76065a4f2f3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.610478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.611098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.611378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.611649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.612538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.614460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.646825 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1067/2157] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:47 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:47.651025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.663188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe5e3-cdbf-435e-af09-f2ba146a6660 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.739797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.740726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.741011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.741289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.741943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.743933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.784049 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1091/2158] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:47 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:12:47.785619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.799235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a83f59-92ba-453e-9b54-26cb60a78566 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.804678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.805510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.805807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.806086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.806800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.815232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.832860 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1068/2159] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:47.837323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.844453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:47.848596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1c4b-6928-4e6e-b385-a5469999c27b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.855530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fdc54-5492-4d4c-9328-9974442de7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:47.856701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fdc54-5492-4d4c-9328-9974442de7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.857124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fdc54-5492-4d4c-9328-9974442de7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.857466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fdc54-5492-4d4c-9328-9974442de7d8 admin admin] PATH_INFO: `/v3/projects/6c067d49cab140c08b713df56052d089/users/dad7c0213a0545aa82f202c29acfc62c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:47.878434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fdc54-5492-4d4c-9328-9974442de7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c067d49cab140c08b713df56052d089, user_id=dad7c0213a0545aa82f202c29acfc62c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:47.881890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fdc54-5492-4d4c-9328-9974442de7d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:47.902188 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1092/2160] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:47 2022] PUT /identity/v3/projects/6c067d49cab140c08b713df56052d089/users/dad7c0213a0545aa82f202c29acfc62c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:47.906287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:47.921550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76908ad-4e1d-4b2b-9536-7d0cce3efd1e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:47.957811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3048-b84a-4e6a-b35c-ed8ff527ccdb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:47.958290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3048-b84a-4e6a-b35c-ed8ff527ccdb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:47.958722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3048-b84a-4e6a-b35c-ed8ff527ccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:48.010813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:48.012526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6bee3048-b84a-4e6a-b35c-ed8ff527ccdb None None] MFA Rules not processed for user `f2b462c4a7e54fe29b3a88ca2996f851`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:48.014232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bee3048-b84a-4e6a-b35c-ed8ff527ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:48.078660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:48.079298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:48.079579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:48.079852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:48.082820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:48.087819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:48.113417 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1069/2161] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:48.116693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:48.130182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1093/2162] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:48.144499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad2c0-45bb-499f-9a8e-2170f047a506 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:48.153205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:48.154815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:48.155201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:48.155535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] PATH_INFO: `/v3/projects/6c067d49cab140c08b713df56052d089/users/dad7c0213a0545aa82f202c29acfc62c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:48.161235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c067d49cab140c08b713df56052d089, user_id=dad7c0213a0545aa82f202c29acfc62c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:48.165871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:48.216597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1070/2163] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:48 2022] PUT /identity/v3/projects/6c067d49cab140c08b713df56052d089/users/dad7c0213a0545aa82f202c29acfc62c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:48.220054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:48.220370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:48.220651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:48.291349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] MFA Rules not processed for user `dad7c0213a0545aa82f202c29acfc62c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:48.291349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:48.421586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1094/2164] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:48.472357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:48.571917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438e7f-2597-442e-a554-9a640a5f11a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:48.580063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a816f4-783e-49bd-a836-1ea221937cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:48.580845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a816f4-783e-49bd-a836-1ea221937cbf service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:48.581446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a816f4-783e-49bd-a836-1ea221937cbf service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:48.581446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a816f4-783e-49bd-a836-1ea221937cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:48.592816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a816f4-783e-49bd-a836-1ea221937cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:48.595307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a816f4-783e-49bd-a836-1ea221937cbf service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:48.607199 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1071/2165] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:48.761188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:48.774313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6089-974e-4b93-a4b2-7a6667a43c58 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:48.781640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:48.782302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:48.782586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:48.782864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:48.784701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:48.858219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:48.860278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:48.886527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1095/2166] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:49.543849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1adbed-8584-4131-bb78-cab2ef0672fb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:49.544300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1adbed-8584-4131-bb78-cab2ef0672fb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:49.544391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1adbed-8584-4131-bb78-cab2ef0672fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:49.593751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e1adbed-8584-4131-bb78-cab2ef0672fb None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:49.598915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e1adbed-8584-4131-bb78-cab2ef0672fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:49.679429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:49.690935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:49.718382 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1072/2167] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:49.839811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f5c82-c093-45d8-8d90-43430f2bf8ae service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:49.853741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:49.854189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:49.854478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:49.854747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] PATH_INFO: `/v3/users/06437d4736e042fdad77c5cd6203ebec` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:49.859681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06437d4736e042fdad77c5cd6203ebec)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:49.865481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:49.983792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06437d4736e042fdad77c5cd6203ebec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:50.008008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06437d4736e042fdad77c5cd6203ebec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:50.009285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06437d4736e042fdad77c5cd6203ebec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:50.010061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06437d4736e042fdad77c5cd6203ebec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:50.018346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06437d4736e042fdad77c5cd6203ebec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:50.037876 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1096/2168] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:49 2022] DELETE /identity/v3/users/06437d4736e042fdad77c5cd6203ebec => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:12:50.039488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:50.039775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:50.040050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:50.062545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:50.064121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:50.116429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:50.140622 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1073/2169] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:50.190542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:50.192384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:50.332375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b50e7-db58-49c7-92d2-a0ac4ca80a1e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:50.337497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:50.338122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:50.338458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:50.338699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:50.371676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:50.373053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:50.399276 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1097/2170] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:51.876796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:51.878376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:51.893881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ab2a-3e76-47af-81d9-25ec2479dd95 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:51.899999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:51.900804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:51.901086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:51.901361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] PATH_INFO: `/v3/projects/07112aaa101349b89d95514d7f2afcc3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:51.902540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07112aaa101349b89d95514d7f2afcc3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:51.904440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:51.961429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07112aaa101349b89d95514d7f2afcc3', 'request_id': 'req-387f892c-834e-441c-885e-fca8389f11a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:51.967989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07112aaa101349b89d95514d7f2afcc3', 'request_id': 'req-387f892c-834e-441c-885e-fca8389f11a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:51.982285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07112aaa101349b89d95514d7f2afcc3', 'request_id': 'req-387f892c-834e-441c-885e-fca8389f11a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.000757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] The token cache is being invalidate because project 07112aaa101349b89d95514d7f2afcc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:52.001550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.002688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.007117 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1074/2171] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:51 2022] DELETE /identity/v3/projects/07112aaa101349b89d95514d7f2afcc3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:52.015925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:52.032242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3aa61-80a2-4267-b356-bca9ab273bdc service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:52.070312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:52.120528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:52.121473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:52.121915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:52.122514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] PATH_INFO: `/v3/users/dad7c0213a0545aa82f202c29acfc62c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:52.124688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad7c0213a0545aa82f202c29acfc62c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:52.127768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:52.203463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad7c0213a0545aa82f202c29acfc62c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.222731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad7c0213a0545aa82f202c29acfc62c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.234859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad7c0213a0545aa82f202c29acfc62c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.235940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad7c0213a0545aa82f202c29acfc62c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.251454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6eb87ed6-547e-4144-8ccc-c7e70c446216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad7c0213a0545aa82f202c29acfc62c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.277387 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1098/2172] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:12:52 2022] DELETE /identity/v3/users/dad7c0213a0545aa82f202c29acfc62c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:52.785650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:52.787388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:52.802398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f892c-834e-441c-885e-fca8389f11a9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:52.894329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:52.895239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:52.895536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:52.895918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] PATH_INFO: `/v3/projects/6c067d49cab140c08b713df56052d089` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:52.897978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c067d49cab140c08b713df56052d089)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:52.900506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:52.964049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c067d49cab140c08b713df56052d089', 'request_id': 'req-ea2381d6-e299-4f54-8633-b3a5f0560081'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.971935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c067d49cab140c08b713df56052d089', 'request_id': 'req-ea2381d6-e299-4f54-8633-b3a5f0560081'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:52.985657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c067d49cab140c08b713df56052d089', 'request_id': 'req-ea2381d6-e299-4f54-8633-b3a5f0560081'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:53.001543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:53.009108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] The token cache is being invalidate because project 6c067d49cab140c08b713df56052d089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:12:53.009406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:53.010309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ea2381d6-e299-4f54-8633-b3a5f0560081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:12:53.016232 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1075/2173] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:12:52 2022] DELETE /identity/v3/projects/6c067d49cab140c08b713df56052d089 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:53.019237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.020035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.020451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.053724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:53.055187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:53.180788 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1099/2174] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:53.188210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.188504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.188783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.210012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:53.211265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:53.219703 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1076/2175] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:12:53.223960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.235565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efd3dc-d712-41c1-9ddf-8ffcdaf769c6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.242033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.242696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.242954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.243574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.244520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:12:53.244975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.246781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.272414 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1100/2176] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:12:53.276652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.286547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86a6b7-7495-45a2-aa71-f750077db67b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.295596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.296413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.296762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.297270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.298092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.300144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.340346 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1077/2177] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:12:53 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:53.344151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.356351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6502f-2e3d-4201-adba-2c7afdf4edad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.392445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:53.430776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.431402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.431686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.431968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.432613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.435068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.461136 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1101/2178] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:12:53 2022] POST /identity/v3/users => generated 302 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:12:53.465431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.476498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04285dd5-a669-483b-92fe-cdc06fdb5c49 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.481180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.481790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.482091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.482368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.483019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.484617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.496129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1078/2179] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:53.500018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.511533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbe633-b3e0-4551-b2a4-db9675852209 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.516443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b5a7b-3a96-48ef-b74c-b88ee31bccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.517048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b5a7b-3a96-48ef-b74c-b88ee31bccb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.517371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b5a7b-3a96-48ef-b74c-b88ee31bccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.517607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b5a7b-3a96-48ef-b74c-b88ee31bccb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.518404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b5a7b-3a96-48ef-b74c-b88ee31bccb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.519917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b5a7b-3a96-48ef-b74c-b88ee31bccb0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.531224 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1102/2180] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:12:53.535412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.545951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367b2c-635d-49d3-b537-eec3de0d3a9c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.551478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.552266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.553938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.554374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] PATH_INFO: `/v3/projects/6efad02241674786ae78827cf6658d3e/users/96553bf2c75347cb9738cbc7e0f58ee7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.570464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efad02241674786ae78827cf6658d3e, user_id=96553bf2c75347cb9738cbc7e0f58ee7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.573173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.587476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1079/2181] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:12:53 2022] PUT /identity/v3/projects/6efad02241674786ae78827cf6658d3e/users/96553bf2c75347cb9738cbc7e0f58ee7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:12:53.593116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239d56-08e0-4286-838f-29ad94128288 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.593404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239d56-08e0-4286-838f-29ad94128288 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.593754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239d56-08e0-4286-838f-29ad94128288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.623939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-21239d56-08e0-4286-838f-29ad94128288 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:53.625165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21239d56-08e0-4286-838f-29ad94128288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:53.714464 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1103/2182] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:12:53.761406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:53.763534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:53.889790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b3fa-3d0f-479b-8ab8-8c2c3b5afbee admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:53.896510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667cd4a-dde4-4f3d-a017-9e64d87a4b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:53.901987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667cd4a-dde4-4f3d-a017-9e64d87a4b32 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:53.903074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667cd4a-dde4-4f3d-a017-9e64d87a4b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:53.903995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667cd4a-dde4-4f3d-a017-9e64d87a4b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:53.932320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667cd4a-dde4-4f3d-a017-9e64d87a4b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:53.933911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667cd4a-dde4-4f3d-a017-9e64d87a4b32 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:53.956475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1080/2183] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:58.517078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21239d56-08e0-4286-838f-29ad94128288 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:12:58.518585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21239d56-08e0-4286-838f-29ad94128288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:58.640881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21239d56-08e0-4286-838f-29ad94128288 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:12:58.651305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:12:58.652740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:58.653173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:58.654535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:58.656480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:58.736487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:12:58.765341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:12:58.765341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:12:58.770219 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1104/2184] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:12:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:12:59.336400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e32c0-c486-461a-bd87-b9d6cc30d96c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:12:59.336966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e32c0-c486-461a-bd87-b9d6cc30d96c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:12:59.336966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e32c0-c486-461a-bd87-b9d6cc30d96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:12:59.389298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0d7e32c0-c486-461a-bd87-b9d6cc30d96c None None] MFA Rules not processed for user `87e1757ebd804b4aa9cd907ae74d32d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:12:59.392500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0d7e32c0-c486-461a-bd87-b9d6cc30d96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:12:59.512111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1081/2185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:12:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:00.512318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:00.514444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:00.532863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fae165-dde8-446b-b719-80c0d6aeef82 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:00.540324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:00.540962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:00.541436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:00.541719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:00.543997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:00.635927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:00.639209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f2f3-b986-40c8-b6e3-5968821f9855 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:00.684827 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1105/2186] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:03.660441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edaad3-759f-420a-8502-a44ddcbb14e4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:03.660936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edaad3-759f-420a-8502-a44ddcbb14e4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:03.661133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edaad3-759f-420a-8502-a44ddcbb14e4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:03.663515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1082/2187] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:13:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:03.673733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0461-b2cc-429f-9c72-ac3ae67f3f82 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:03.674242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0461-b2cc-429f-9c72-ac3ae67f3f82 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:03.674406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0461-b2cc-429f-9c72-ac3ae67f3f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:03.716685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0b9c0461-b2cc-429f-9c72-ac3ae67f3f82 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:03.718229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b9c0461-b2cc-429f-9c72-ac3ae67f3f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:03.742918 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1106/2188] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:13:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:03.772784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edaad3-759f-420a-8502-a44ddcbb14e4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:03.784795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edaad3-759f-420a-8502-a44ddcbb14e4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:03.789459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:03.790412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:03.790930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:03.791381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:03.823337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:03.825201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:03.839174 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1083/2189] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:05.197525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.198181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.198181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.267867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] MFA Rules not processed for user `96553bf2c75347cb9738cbc7e0f58ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:05.272732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:05.453727 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1107/2190] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:05.454418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:05.485608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1074fe-8f49-4450-a801-bd905f7781a7 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:05.494703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:05.495746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.496197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.496640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.497457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:05.504690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:05.573618 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1084/2191] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:05 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:13:05.578959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:05.594849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3c0c-b7b5-4913-93ee-4116a560ac14 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:05.676304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:05.676842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.677646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.678003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.679216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:05.681184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:05.692437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:05.713032 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1108/2192] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:05 2022] POST /identity/v3/users => generated 308 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:05.717333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:05.729444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a1cd-e6a6-4bd0-9daf-8ef759470b56 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:05.734233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:05.735399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.735690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.735966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.736962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:05.738874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:05.741012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:05.756489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:05.758231 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1085/2193] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:05.767621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd1fc6-10bc-449f-837b-81be208e3c60 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:05.774043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:05.775383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.775383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.775597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] PATH_INFO: `/v3/projects/b516ca2826644acc8bac8aadc1fe28e9/users/c035732406a24666b32043a9ae99e599/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.803154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b516ca2826644acc8bac8aadc1fe28e9, user_id=c035732406a24666b32043a9ae99e599, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:05.805513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:05.823970 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1109/2194] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:05 2022] PUT /identity/v3/projects/b516ca2826644acc8bac8aadc1fe28e9/users/c035732406a24666b32043a9ae99e599/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:05.828003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:05.840863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3233db-8963-4e14-87ad-dccacec2a65f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:05.910059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9947c-465a-4469-9d31-073751e92650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:05.911116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9947c-465a-4469-9d31-073751e92650 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.913394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9947c-465a-4469-9d31-073751e92650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.913394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9947c-465a-4469-9d31-073751e92650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.913394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9947c-465a-4469-9d31-073751e92650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:05.914523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9947c-465a-4469-9d31-073751e92650 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:05.925686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1086/2195] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:13:05.931062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:05.951307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68caf7e-1f28-495c-88a1-aaa5771377fa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:05.957047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9f21f-7c71-4c94-9218-0f39a4623f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:05.958078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9f21f-7c71-4c94-9218-0f39a4623f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:05.959234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9f21f-7c71-4c94-9218-0f39a4623f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:05.959879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9f21f-7c71-4c94-9218-0f39a4623f1b admin admin] PATH_INFO: `/v3/projects/b516ca2826644acc8bac8aadc1fe28e9/users/c035732406a24666b32043a9ae99e599/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:05.962936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9f21f-7c71-4c94-9218-0f39a4623f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b516ca2826644acc8bac8aadc1fe28e9, user_id=c035732406a24666b32043a9ae99e599, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:05.965936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9f21f-7c71-4c94-9218-0f39a4623f1b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:06.011876 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1110/2196] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:05 2022] PUT /identity/v3/projects/b516ca2826644acc8bac8aadc1fe28e9/users/c035732406a24666b32043a9ae99e599/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:11.609134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916bf0-8c6c-455e-a533-2af698748eb6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:11.609747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916bf0-8c6c-455e-a533-2af698748eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:11.609747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916bf0-8c6c-455e-a533-2af698748eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:11.653894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-31916bf0-8c6c-455e-a533-2af698748eb6 None None] MFA Rules not processed for user `f2b462c4a7e54fe29b3a88ca2996f851`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:11.655195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-31916bf0-8c6c-455e-a533-2af698748eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:11.806651 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1087/2197] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:12.639725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a151-9763-458d-93d4-69533a21775f None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:12.640278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a151-9763-458d-93d4-69533a21775f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:12.640635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a151-9763-458d-93d4-69533a21775f None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:12.644027 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1111/2198] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:13:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:12.650016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63081bb-8924-437d-8d37-1002845427e5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:12.650571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63081bb-8924-437d-8d37-1002845427e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:12.650571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63081bb-8924-437d-8d37-1002845427e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:12.713970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f63081bb-8924-437d-8d37-1002845427e5 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:12.720026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f63081bb-8924-437d-8d37-1002845427e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:12.891871 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1088/2199] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:13:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:12.907729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0a151-9763-458d-93d4-69533a21775f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:12.909658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a3e0a151-9763-458d-93d4-69533a21775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:13.106712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0a151-9763-458d-93d4-69533a21775f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:13.113145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:13.114779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:13.115779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:13.117043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:13.131771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:13.133669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:13.156462 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1112/2200] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:13.295751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484852f5-66a5-4c43-ab94-a3f00a6fa2e5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:13.296307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484852f5-66a5-4c43-ab94-a3f00a6fa2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:13.296793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484852f5-66a5-4c43-ab94-a3f00a6fa2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:13.332960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-484852f5-66a5-4c43-ab94-a3f00a6fa2e5 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:13.334380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-484852f5-66a5-4c43-ab94-a3f00a6fa2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:13.341538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1089/2201] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:13:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:13.383428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:13.400108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec75549-cd6e-4c68-911f-dfa28e99c6cb service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:13.420380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:13.420832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:13.421111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:13.421382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:13.441755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:13.444841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:13.463717 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1113/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:14.761678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e7aa7-10f9-48eb-bbd4-6e84d1009330 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:14.762356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e7aa7-10f9-48eb-bbd4-6e84d1009330 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:14.762498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e7aa7-10f9-48eb-bbd4-6e84d1009330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:14.824111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d2e7aa7-10f9-48eb-bbd4-6e84d1009330 None None] MFA Rules not processed for user `c035732406a24666b32043a9ae99e599`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:14.825684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d2e7aa7-10f9-48eb-bbd4-6e84d1009330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:14.838654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:14.913646 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1090/2203] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:14 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:19.128618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:19.130829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:19.303948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcedc-7aa0-4fd2-a125-6a36bdd0c8a3 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:19.322400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:19.323192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:19.323581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:19.323959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] PATH_INFO: `/v3/users/b023705824004068a0f207c3ac8e65ae` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:19.325433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b023705824004068a0f207c3ac8e65ae)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:19.328179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:19.452308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:19.457828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b023705824004068a0f207c3ac8e65ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:19.503320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b023705824004068a0f207c3ac8e65ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:19.504238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b023705824004068a0f207c3ac8e65ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:19.510564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b023705824004068a0f207c3ac8e65ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:19.522611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b023705824004068a0f207c3ac8e65ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:19.551355 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1114/2204] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:19 2022] DELETE /identity/v3/users/b023705824004068a0f207c3ac8e65ae => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:19.556323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546240f-0540-48ac-b981-3b326608df25 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:19.556862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546240f-0540-48ac-b981-3b326608df25 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:19.556862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546240f-0540-48ac-b981-3b326608df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:19.601315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b546240f-0540-48ac-b981-3b326608df25 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:19.602910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b546240f-0540-48ac-b981-3b326608df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:19.750170 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1091/2205] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:19.786376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:19.786376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:19.935228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ee66-3bd3-4857-a3ed-4ad5993aa429 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:19.946042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:19.946705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:19.947049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:19.947244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:19.979166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:19.980886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:20.009605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1115/2206] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:21.287827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546240f-0540-48ac-b981-3b326608df25 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:21.295263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b546240f-0540-48ac-b981-3b326608df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:21.324469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546240f-0540-48ac-b981-3b326608df25 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:21.344240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:21.347898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:21.348718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:21.349315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] PATH_INFO: `/v3/projects/67f966dd7bb7486abbbbf8e96bb1b015` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:21.352808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f966dd7bb7486abbbbf8e96bb1b015)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:21.354814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:21.461486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f966dd7bb7486abbbbf8e96bb1b015', 'request_id': 'req-b97a3662-a4e2-43e5-9086-f777a13ecdf1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.490634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f966dd7bb7486abbbbf8e96bb1b015', 'request_id': 'req-b97a3662-a4e2-43e5-9086-f777a13ecdf1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.509011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f966dd7bb7486abbbbf8e96bb1b015', 'request_id': 'req-b97a3662-a4e2-43e5-9086-f777a13ecdf1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.541450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] The token cache is being invalidate because project 67f966dd7bb7486abbbbf8e96bb1b015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:21.543482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.546040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b97a3662-a4e2-43e5-9086-f777a13ecdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.552052 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1092/2207] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:21 2022] DELETE /identity/v3/projects/67f966dd7bb7486abbbbf8e96bb1b015 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:21.554574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:21.586401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef66eb-7365-4f7b-b5cb-2e2aea1070a1 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:21.732650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:21.734436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:21.735026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:21.735781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] PATH_INFO: `/v3/users/c72dcc0909174f1989f8ebfb826fd4df` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:21.738448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72dcc0909174f1989f8ebfb826fd4df)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:21.744368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:21.817963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72dcc0909174f1989f8ebfb826fd4df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.853425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72dcc0909174f1989f8ebfb826fd4df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.854716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72dcc0909174f1989f8ebfb826fd4df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.855711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72dcc0909174f1989f8ebfb826fd4df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.859891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:21.873088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72dcc0909174f1989f8ebfb826fd4df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:21.906239 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1116/2208] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:21 2022] DELETE /identity/v3/users/c72dcc0909174f1989f8ebfb826fd4df => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:22.130986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab916d2-fff8-4f6f-aba1-d5de4233f729 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:22.131678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab916d2-fff8-4f6f-aba1-d5de4233f729 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:22.132215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab916d2-fff8-4f6f-aba1-d5de4233f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:22.163338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4ab916d2-fff8-4f6f-aba1-d5de4233f729 None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:22.164869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ab916d2-fff8-4f6f-aba1-d5de4233f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:22.195179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:22.238417 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1093/2209] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:22.579069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:22.581505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:22.704099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170017-cd00-4224-b50b-effb67e624fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:22.709318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:22.709962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:22.710285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:22.710576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] PATH_INFO: `/v3/projects/a735ec81e6f64f2eaae659cd2505be2c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:22.711797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a735ec81e6f64f2eaae659cd2505be2c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:22.713730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:22.764490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a735ec81e6f64f2eaae659cd2505be2c', 'request_id': 'req-949de12c-0e72-4e58-b881-a7faccb59733'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:22.774836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a735ec81e6f64f2eaae659cd2505be2c', 'request_id': 'req-949de12c-0e72-4e58-b881-a7faccb59733'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:22.787085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a735ec81e6f64f2eaae659cd2505be2c', 'request_id': 'req-949de12c-0e72-4e58-b881-a7faccb59733'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:22.806176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] The token cache is being invalidate because project a735ec81e6f64f2eaae659cd2505be2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:22.806512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:22.807210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-949de12c-0e72-4e58-b881-a7faccb59733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:22.808769 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1117/2210] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:22 2022] DELETE /identity/v3/projects/a735ec81e6f64f2eaae659cd2505be2c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:22.814984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:22.815469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:22.815561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:22.847328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:22.848608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:22.942756 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1094/2211] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:22.948140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:22.948449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:22.948889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:22.981738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:22.983744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:22.997474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1118/2212] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:23.002712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.013390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95e564-db9e-4a42-ae8d-3c7c20d83516 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.022276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.023288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.025252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.025752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.026666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:23.027169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.029184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.048146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.060235 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1095/2213] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:23.064504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21b14f-3cfc-4397-ae28-50174ccc7ab4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.071508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.072403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.072746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.073820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.074727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.076823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.127561 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1119/2214] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:23 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:13:23.128907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.144227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd9a9-34eb-48f1-a097-51c4d43df5bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.282129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.283397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.283831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.284247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.294695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.298139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.344101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.344397 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1096/2215] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:23 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:23.362449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620e6b-668e-4c2b-844f-a37db53dd471 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.373110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.374686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.375404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.375886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.376790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.379072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.443167 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1120/2216] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:23.447088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.459447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188b8d-4324-4423-aef9-dd2b89e5f41c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.484713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545357f4-f7c3-4d0b-8ea6-dfd4bea65597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.485524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545357f4-f7c3-4d0b-8ea6-dfd4bea65597 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.485794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545357f4-f7c3-4d0b-8ea6-dfd4bea65597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.486140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545357f4-f7c3-4d0b-8ea6-dfd4bea65597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.487224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545357f4-f7c3-4d0b-8ea6-dfd4bea65597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.499180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545357f4-f7c3-4d0b-8ea6-dfd4bea65597 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.526535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1097/2217] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:23.533137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.557923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88b7d-2b32-457a-ba98-ad25495902e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.585728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.592435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.594067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.594815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] PATH_INFO: `/v3/projects/9f6309881d2341128d2ce5f3e2ee0f25/users/c79d1907e3b34a5ab2fc4f3b86b2eb33/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.621054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6309881d2341128d2ce5f3e2ee0f25, user_id=c79d1907e3b34a5ab2fc4f3b86b2eb33, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.626107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.655634 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1121/2218] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:23 2022] PUT /identity/v3/projects/9f6309881d2341128d2ce5f3e2ee0f25/users/c79d1907e3b34a5ab2fc4f3b86b2eb33/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:23.666752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.667269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.667721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.700012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] MFA Rules not processed for user `c79d1907e3b34a5ab2fc4f3b86b2eb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:23.701737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:23.772104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:23.827401 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1098/2219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:23.829650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:23.846077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:23.912548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d34f-8b27-4946-b19b-94d48db5343b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:23.919465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:23.920539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:23.921057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:23.921570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:23.922635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:23.925644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:23.982555 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1122/2220] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:23 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:23.993024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:24.017227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39f1d6-81ae-4bea-938c-62c18cb17fd0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:24.250717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:24.251360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.253746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.254040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.254730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:24.261103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:24.325515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1099/2221] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:23 2022] POST /identity/v3/users => generated 295 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:24.330412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:24.357178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296f08-f97a-401c-8729-3107566abf70 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:24.364030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:24.365706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.366063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.366479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.367458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:24.369595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:24.392605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1123/2222] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:24.393366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:24.406782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424896-cdce-4756-9ecc-8a41ac339748 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:24.422995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:24.424319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.424622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.424908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] PATH_INFO: `/v3/projects/7f9f66c2a8074fea9a585e2030093775/users/58b0d8e8f945436292bc8fa3221dbec6/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.458964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9f66c2a8074fea9a585e2030093775, user_id=58b0d8e8f945436292bc8fa3221dbec6, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:24.462376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:24.483696 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1100/2223] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:24 2022] PUT /identity/v3/projects/7f9f66c2a8074fea9a585e2030093775/users/58b0d8e8f945436292bc8fa3221dbec6/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:24.485595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:24.496861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9985d-d991-40c9-93c6-6ca674581f99 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:24.616914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c1ac-7990-4c9e-8315-0cedec5423f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:24.618403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c1ac-7990-4c9e-8315-0cedec5423f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.618854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c1ac-7990-4c9e-8315-0cedec5423f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.619353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c1ac-7990-4c9e-8315-0cedec5423f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.620017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c1ac-7990-4c9e-8315-0cedec5423f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:24.622345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c1ac-7990-4c9e-8315-0cedec5423f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:24.641571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:24.653577 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1124/2224] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:13:24.657193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fc9f7-e6a2-48d1-83c1-49a43177f9f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:24.665525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c20021-9805-4d6a-9776-b617448f3f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:24.666445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20021-9805-4d6a-9776-b617448f3f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.667008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20021-9805-4d6a-9776-b617448f3f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.667392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20021-9805-4d6a-9776-b617448f3f3d admin admin] PATH_INFO: `/v3/projects/7f9f66c2a8074fea9a585e2030093775/users/58b0d8e8f945436292bc8fa3221dbec6/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.670488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c20021-9805-4d6a-9776-b617448f3f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9f66c2a8074fea9a585e2030093775, user_id=58b0d8e8f945436292bc8fa3221dbec6, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:24.675515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c20021-9805-4d6a-9776-b617448f3f3d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:24.694730 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1101/2225] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:24 2022] PUT /identity/v3/projects/7f9f66c2a8074fea9a585e2030093775/users/58b0d8e8f945436292bc8fa3221dbec6/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:24.703650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.704380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.704732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.751917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] MFA Rules not processed for user `58b0d8e8f945436292bc8fa3221dbec6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:24.754317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:24.870218 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1125/2226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:24.874328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b604c3-5972-4ccf-9f59-a3cb77daaf23 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:24.875263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b604c3-5972-4ccf-9f59-a3cb77daaf23 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:24.876740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b604c3-5972-4ccf-9f59-a3cb77daaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:24.898703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d6b604c3-5972-4ccf-9f59-a3cb77daaf23 None None] MFA Rules not processed for user `c79d1907e3b34a5ab2fc4f3b86b2eb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:24.900576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d6b604c3-5972-4ccf-9f59-a3cb77daaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:24.963447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1102/2227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:24.974800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:24.976469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:25.004950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:25.119468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbdaf2-589a-4fb7-8d63-1c3544ce7d9c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:25.132598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef5ae6-09d8-4665-b3fb-a030373b698f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:25.133248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef5ae6-09d8-4665-b3fb-a030373b698f service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:25.133585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef5ae6-09d8-4665-b3fb-a030373b698f service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:25.133875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef5ae6-09d8-4665-b3fb-a030373b698f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:25.145508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef5ae6-09d8-4665-b3fb-a030373b698f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:25.147566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef5ae6-09d8-4665-b3fb-a030373b698f service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:25.158229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1126/2228] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:25.515403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e0bb-948f-4c1f-beb5-5a9331948035 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:25.515935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e0bb-948f-4c1f-beb5-5a9331948035 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:25.516468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e0bb-948f-4c1f-beb5-5a9331948035 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:25.518577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1103/2229] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:25.541172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:25.542509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:25.543141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:25.592384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:25.595326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:25.715220 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1127/2230] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:13:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:25.754491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e0bb-948f-4c1f-beb5-5a9331948035 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:25.758639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3fa9e0bb-948f-4c1f-beb5-5a9331948035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:25.794244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e0bb-948f-4c1f-beb5-5a9331948035 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:25.803817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624bffe-0564-4ff8-9c33-925ff6133826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:25.806219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624bffe-0564-4ff8-9c33-925ff6133826 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:25.806679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624bffe-0564-4ff8-9c33-925ff6133826 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:25.807266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624bffe-0564-4ff8-9c33-925ff6133826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:25.819556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624bffe-0564-4ff8-9c33-925ff6133826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:25.822040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624bffe-0564-4ff8-9c33-925ff6133826 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:25.848746 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1104/2231] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:28.541181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:28.543058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:28.646412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3134ea-83db-48ff-87fe-71b8bf855f26 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:28.653020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:28.653995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:28.654528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:28.655267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] PATH_INFO: `/v3/users/87e1757ebd804b4aa9cd907ae74d32d3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:28.656651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e1757ebd804b4aa9cd907ae74d32d3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:28.659282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:28.720053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:28.749709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e1757ebd804b4aa9cd907ae74d32d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:28.772381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e1757ebd804b4aa9cd907ae74d32d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:28.773279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e1757ebd804b4aa9cd907ae74d32d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:28.777276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e1757ebd804b4aa9cd907ae74d32d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:28.795892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e1757ebd804b4aa9cd907ae74d32d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:28.815732 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1128/2232] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:28 2022] DELETE /identity/v3/users/87e1757ebd804b4aa9cd907ae74d32d3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:28.820310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:28.820732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:28.820829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:28.860553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:28.862381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:28.884809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:28.993918 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1105/2233] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:29.017170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:29.019567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:29.170727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b11f-ad14-47ac-8eda-94503309b66c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:29.188286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:29.189283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:29.189709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:29.190130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:29.205829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:29.207673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:29.226083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1129/2234] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:13:30.490694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:30.493499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:30.506916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9b326-25e7-467e-8798-494dd4faf75b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:30.513560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:30.514751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:30.515345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:30.515830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] PATH_INFO: `/v3/projects/b626e4aab9ca45afb6e9ade0a2ce8e7f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:30.517297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b626e4aab9ca45afb6e9ade0a2ce8e7f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:30.520422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:30.606658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b626e4aab9ca45afb6e9ade0a2ce8e7f', 'request_id': 'req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.614389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b626e4aab9ca45afb6e9ade0a2ce8e7f', 'request_id': 'req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.628638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b626e4aab9ca45afb6e9ade0a2ce8e7f', 'request_id': 'req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.645317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] The token cache is being invalidate because project b626e4aab9ca45afb6e9ade0a2ce8e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:30.646381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.647505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.649252 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1106/2235] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:30 2022] DELETE /identity/v3/projects/b626e4aab9ca45afb6e9ade0a2ce8e7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:30.653299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:30.666849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22510e66-9744-4ee1-a997-c7a646a6dd5b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:30.764536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:30.765995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:30.766734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:30.767118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] PATH_INFO: `/v3/users/ea0df95cd75748049f587ee459c2e1d3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:30.769078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0df95cd75748049f587ee459c2e1d3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:30.771914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:30.853162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0df95cd75748049f587ee459c2e1d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.858940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:30.889003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0df95cd75748049f587ee459c2e1d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.893175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0df95cd75748049f587ee459c2e1d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.894396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0df95cd75748049f587ee459c2e1d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.905413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fe5acc5-f1c1-4615-af13-c31b103b5721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0df95cd75748049f587ee459c2e1d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:30.926481 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1130/2236] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:30 2022] DELETE /identity/v3/users/ea0df95cd75748049f587ee459c2e1d3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:31.714768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:31.716758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:31.745996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b5ce5-8ba4-4987-979e-56a1d1ac68c7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:31.843736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:31.844720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:31.845150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:31.845605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] PATH_INFO: `/v3/projects/617dce0b22464537854c883011740fa6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:31.847579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=617dce0b22464537854c883011740fa6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:31.853011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:31.910441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:31.920542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617dce0b22464537854c883011740fa6', 'request_id': 'req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:31.930341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617dce0b22464537854c883011740fa6', 'request_id': 'req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:31.945422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617dce0b22464537854c883011740fa6', 'request_id': 'req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:31.971258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] The token cache is being invalidate because project 617dce0b22464537854c883011740fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:31.971562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:31.974889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39cf0fb9-b184-4890-b4ca-8cab7c9a87f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:31.983979 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1107/2237] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:31 2022] DELETE /identity/v3/projects/617dce0b22464537854c883011740fa6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:31.985077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c950449-4484-4211-8f88-be74af070385 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:31.985648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c950449-4484-4211-8f88-be74af070385 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:31.986030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c950449-4484-4211-8f88-be74af070385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.015038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2c950449-4484-4211-8f88-be74af070385 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:32.016349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c950449-4484-4211-8f88-be74af070385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:32.091694 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1131/2238] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:32.099657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.099945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.100279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.156051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:32.157492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:32.173152 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1108/2239] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:32.174487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c950449-4484-4211-8f88-be74af070385 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:32.190934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c950449-4484-4211-8f88-be74af070385 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:32.197059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:32.198375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.198663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.198941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.199819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:32.199932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:32.201906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:32.214928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1132/2240] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:13:32.219830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:32.232059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287242b-be29-422b-9e7f-c189f5d467ba None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:32.237507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:32.243961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.244243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.244519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.245185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:32.247492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:32.320340 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1109/2241] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:32 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:32.326066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:32.356379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb8e2-778e-4e72-8d01-b8d09df1d844 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:32.563537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:32.564560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.565379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.566161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.567175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:32.569495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:32.611807 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1133/2242] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:32 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:32.616255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:32.632386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014493-7829-4fc1-a136-d4b5d9ec38cd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:32.659534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:32.660229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.660538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.660936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.662861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:32.664603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:32.686137 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1110/2243] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:32.686716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:32.703045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa54dc-66a7-4648-8fd0-f796e15cf85f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:32.710160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abb78e-6ec8-4f88-b8fc-1bb9e31ace03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:32.711764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb78e-6ec8-4f88-b8fc-1bb9e31ace03 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.717032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb78e-6ec8-4f88-b8fc-1bb9e31ace03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.717531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb78e-6ec8-4f88-b8fc-1bb9e31ace03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.718520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb78e-6ec8-4f88-b8fc-1bb9e31ace03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:32.720444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb78e-6ec8-4f88-b8fc-1bb9e31ace03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:32.735183 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1134/2244] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:13:32.739647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:32.754119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c918f-77cd-480a-a5fd-c10460a9ae60 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:32.760755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:32.761837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.762364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.762846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] PATH_INFO: `/v3/projects/3cdb42d8ded24d90a3fa4186835fab56/users/8e6529be84604e9e91bcc9e1517bce96/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.797303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdb42d8ded24d90a3fa4186835fab56, user_id=8e6529be84604e9e91bcc9e1517bce96, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:32.800713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:32.834610 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1111/2245] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:32 2022] PUT /identity/v3/projects/3cdb42d8ded24d90a3fa4186835fab56/users/8e6529be84604e9e91bcc9e1517bce96/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:32.836128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:32.836421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:32.836701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:32.869183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] MFA Rules not processed for user `8e6529be84604e9e91bcc9e1517bce96`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:32.880871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:32.916754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:32.977081 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1135/2246] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:32.978941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:33.071535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec3c4-9238-43a3-ba5d-1dda710efca9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:33.078056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:33.079090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.079631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.080124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.080980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:33.084057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:33.147413 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1112/2247] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:32 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:33.151823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:33.169473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97e47d-f157-47ce-bbe6-160891522c29 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:33.257728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:33.258563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.259079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.259457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.260343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:33.262879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:33.296388 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1136/2248] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:33 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:33.300379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:33.314516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea1d5-5908-493c-888c-596f4aff1111 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:33.321759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:33.322364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.322652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.322931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.324458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:33.326098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:33.342292 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1113/2249] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:33.347063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:33.390841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a95f-f07a-4ce3-be58-8fe2ec44c7c6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:33.413328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:33.414385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.414882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.415406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] PATH_INFO: `/v3/projects/e26b058aeede405eab8a5bd80eaddb1c/users/951142cacb6847bfba8e4675668daa58/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.459317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26b058aeede405eab8a5bd80eaddb1c, user_id=951142cacb6847bfba8e4675668daa58, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:33.462628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:33.517698 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1137/2250] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:33 2022] PUT /identity/v3/projects/e26b058aeede405eab8a5bd80eaddb1c/users/951142cacb6847bfba8e4675668daa58/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:33.521539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:33.556586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fecc67-c89c-4f37-b9e6-99c60f177bd3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:33.645778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:33.690792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4769e-b887-4a6b-a8b3-b131ac010f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:33.691539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4769e-b887-4a6b-a8b3-b131ac010f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.691895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4769e-b887-4a6b-a8b3-b131ac010f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.692276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4769e-b887-4a6b-a8b3-b131ac010f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.693676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4769e-b887-4a6b-a8b3-b131ac010f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:33.695592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4769e-b887-4a6b-a8b3-b131ac010f1b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:33.714546 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1114/2251] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:33.717573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:33.743157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cca7a-bacc-4b0a-af86-50a6405b787f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:33.752065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:33.753369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.753853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.754223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] PATH_INFO: `/v3/projects/e26b058aeede405eab8a5bd80eaddb1c/users/951142cacb6847bfba8e4675668daa58/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.758135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26b058aeede405eab8a5bd80eaddb1c, user_id=951142cacb6847bfba8e4675668daa58, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:33.762358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:33.783260 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1138/2252] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:33 2022] PUT /identity/v3/projects/e26b058aeede405eab8a5bd80eaddb1c/users/951142cacb6847bfba8e4675668daa58/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:33.795450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:33.796085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:33.796498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:33.842978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] MFA Rules not processed for user `951142cacb6847bfba8e4675668daa58`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:33.844693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:33.973751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1115/2253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:34.010803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:34.012850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:34.114285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0456ef0-969e-4221-bbd3-b9d8d465e873 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:34.120718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38654477-1f86-4ef9-a5a3-f84d4a7f7ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:34.121590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38654477-1f86-4ef9-a5a3-f84d4a7f7ec1 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:34.121970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38654477-1f86-4ef9-a5a3-f84d4a7f7ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:34.122342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38654477-1f86-4ef9-a5a3-f84d4a7f7ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:34.133336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38654477-1f86-4ef9-a5a3-f84d4a7f7ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:34.135180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38654477-1f86-4ef9-a5a3-f84d4a7f7ec1 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:34.145262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1139/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:13:34.572775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:34.726979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10f82-45ca-4b12-985f-97c2b2780724 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:34.735758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:34.736337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:34.736627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:34.736907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] PATH_INFO: `/v3/users/8e6529be84604e9e91bcc9e1517bce96` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:34.745426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6529be84604e9e91bcc9e1517bce96)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:34.747402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:34.822304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6529be84604e9e91bcc9e1517bce96'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:34.831328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6529be84604e9e91bcc9e1517bce96'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:34.832040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6529be84604e9e91bcc9e1517bce96'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:34.833075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6529be84604e9e91bcc9e1517bce96'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:34.853210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6529be84604e9e91bcc9e1517bce96'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:34.855359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:34.883765 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1116/2255] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:34 2022] DELETE /identity/v3/users/8e6529be84604e9e91bcc9e1517bce96 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:34.885302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:34.885768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:34.885877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:34.895398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:34.928890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:34.930213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:35.043983 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1140/2256] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:35.054831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:35.056480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:35.156404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f7de-a686-4c4d-ad3e-b0e60691ad74 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:35.160243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:35.160970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:35.162617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:35.162617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:35.178702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:35.180651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:35.193853 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1117/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:35.522336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:35.523740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:35.596104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:35.597783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:35.614111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e41c6-c16a-4583-b10f-7cf645192881 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:35.620465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:35.621116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:35.621397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:35.621673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] PATH_INFO: `/v3/users/96553bf2c75347cb9738cbc7e0f58ee7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:35.623421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96553bf2c75347cb9738cbc7e0f58ee7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:35.626062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:35.663376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b1069-099a-49cc-adb2-bbd13afdde4d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:35.679644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:35.680719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:35.681289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:35.681742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:35.686359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:35.704132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96553bf2c75347cb9738cbc7e0f58ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:35.717247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96553bf2c75347cb9738cbc7e0f58ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:35.718534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96553bf2c75347cb9738cbc7e0f58ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:35.720386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96553bf2c75347cb9738cbc7e0f58ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:35.753579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96553bf2c75347cb9738cbc7e0f58ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:35.776412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:35.778491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:35.792124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1141/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:35.793100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:35.794467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:35.817022 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1118/2259] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:35 2022] DELETE /identity/v3/users/96553bf2c75347cb9738cbc7e0f58ee7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:35.828339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad8c3-36e8-46ec-b3bf-6148d01283e5 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:35.890641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:35.927985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:35.928828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:35.929179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:35.929536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] PATH_INFO: `/v3/projects/3cdb42d8ded24d90a3fa4186835fab56` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:35.931127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdb42d8ded24d90a3fa4186835fab56)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:35.934045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:36.014274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdb42d8ded24d90a3fa4186835fab56', 'request_id': 'req-b2eca3bf-413a-4c4f-b621-db27a240348f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.021933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdb42d8ded24d90a3fa4186835fab56', 'request_id': 'req-b2eca3bf-413a-4c4f-b621-db27a240348f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.030275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdb42d8ded24d90a3fa4186835fab56', 'request_id': 'req-b2eca3bf-413a-4c4f-b621-db27a240348f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.047150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] The token cache is being invalidate because project 3cdb42d8ded24d90a3fa4186835fab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:36.047476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.048222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.052992 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1142/2260] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:35 2022] DELETE /identity/v3/projects/3cdb42d8ded24d90a3fa4186835fab56 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:36.054219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:36.056267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:36.057202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:36.060276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:36.076576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fbdb-e1ac-4fc2-9766-bb496cc49bb3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:36.168418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:36.183140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:36.185008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:36.185323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:36.185607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] PATH_INFO: `/v3/users/951142cacb6847bfba8e4675668daa58` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:36.187313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] RBAC: Authorizing `identity:delete_user(user_id=951142cacb6847bfba8e4675668daa58)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:36.189757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:36.228942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca3bf-413a-4c4f-b621-db27a240348f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:36.236650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:36.237296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:36.237582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:36.238165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] PATH_INFO: `/v3/projects/6efad02241674786ae78827cf6658d3e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:36.242873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efad02241674786ae78827cf6658d3e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:36.246347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:36.285413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951142cacb6847bfba8e4675668daa58'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.295572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951142cacb6847bfba8e4675668daa58'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.296391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951142cacb6847bfba8e4675668daa58'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.297032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951142cacb6847bfba8e4675668daa58'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.306010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951142cacb6847bfba8e4675668daa58'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.325202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efad02241674786ae78827cf6658d3e', 'request_id': 'req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.325539 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1119/2261] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:36 2022] DELETE /identity/v3/users/951142cacb6847bfba8e4675668daa58 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:36.336134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efad02241674786ae78827cf6658d3e', 'request_id': 'req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.342621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efad02241674786ae78827cf6658d3e', 'request_id': 'req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.347064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:36.365484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] The token cache is being invalidate because project 6efad02241674786ae78827cf6658d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:36.365777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.367933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.370197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1143/2262] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:36 2022] DELETE /identity/v3/projects/6efad02241674786ae78827cf6658d3e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:36.374198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:36.375755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:36.475670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80253-0575-41b2-b508-00fbbfd7605b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:36.480798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:36.481539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:36.481852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:36.482125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] PATH_INFO: `/v3/users/c035732406a24666b32043a9ae99e599` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:36.483438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c035732406a24666b32043a9ae99e599)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:36.485431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:36.546110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c035732406a24666b32043a9ae99e599'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.563729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c035732406a24666b32043a9ae99e599'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.564678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c035732406a24666b32043a9ae99e599'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.565513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c035732406a24666b32043a9ae99e599'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.579892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d79e8b0-1dd5-494f-b958-3e80d2f76cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c035732406a24666b32043a9ae99e599'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:36.598501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:36.611692 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1120/2263] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:36 2022] DELETE /identity/v3/users/c035732406a24666b32043a9ae99e599 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:36.838244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:36.839859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:36.916276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af25f03-afbd-45d7-b760-7ce5cf6fd79a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.010894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.011924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.012265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.012605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] PATH_INFO: `/v3/projects/e26b058aeede405eab8a5bd80eaddb1c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.014096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26b058aeede405eab8a5bd80eaddb1c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.016565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.137235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26b058aeede405eab8a5bd80eaddb1c', 'request_id': 'req-a1b8dd0a-7fb2-46bc-a050-686771d1d551'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.158960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26b058aeede405eab8a5bd80eaddb1c', 'request_id': 'req-a1b8dd0a-7fb2-46bc-a050-686771d1d551'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.174540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26b058aeede405eab8a5bd80eaddb1c', 'request_id': 'req-a1b8dd0a-7fb2-46bc-a050-686771d1d551'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.209671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] The token cache is being invalidate because project e26b058aeede405eab8a5bd80eaddb1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:37.219143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.220598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a1b8dd0a-7fb2-46bc-a050-686771d1d551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.226037 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1144/2264] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:36 2022] DELETE /identity/v3/projects/e26b058aeede405eab8a5bd80eaddb1c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:37.228257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.228257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.228257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.229727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19787f2-f8da-49da-83d5-944ffe484d1c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.230685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19787f2-f8da-49da-83d5-944ffe484d1c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.231273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19787f2-f8da-49da-83d5-944ffe484d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.252562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:37.254666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.269077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a19787f2-f8da-49da-83d5-944ffe484d1c None None] MFA Rules not processed for user `ba045fd5be9d482b8205237ddee4d5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:37.274209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a19787f2-f8da-49da-83d5-944ffe484d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.304898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:37.359640 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1145/2265] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:37.360751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.362124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.375326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4938bc-9d5e-4b83-b91f-a1dea472539b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.377251 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1121/2266] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:37.378628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.378908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.379186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.383349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.384319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.384795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.385098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] PATH_INFO: `/v3/projects/b516ca2826644acc8bac8aadc1fe28e9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.386297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b516ca2826644acc8bac8aadc1fe28e9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.388309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.411098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:37.413998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.429961 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1122/2267] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:37.448224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.460628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b516ca2826644acc8bac8aadc1fe28e9', 'request_id': 'req-1a6c540b-3684-4d5c-a189-ca4092d91fea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.461248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b046-cead-46c3-928a-c0185d1dc664 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.468155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b516ca2826644acc8bac8aadc1fe28e9', 'request_id': 'req-1a6c540b-3684-4d5c-a189-ca4092d91fea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.477106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b516ca2826644acc8bac8aadc1fe28e9', 'request_id': 'req-1a6c540b-3684-4d5c-a189-ca4092d91fea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.504031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] The token cache is being invalidate because project b516ca2826644acc8bac8aadc1fe28e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:37.504668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.505594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1a6c540b-3684-4d5c-a189-ca4092d91fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:37.509353 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1146/2268] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:37 2022] DELETE /identity/v3/projects/b516ca2826644acc8bac8aadc1fe28e9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:37.517802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783ee3a-8853-4d66-ad2d-efcb52c19b2e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.518658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783ee3a-8853-4d66-ad2d-efcb52c19b2e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.519535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783ee3a-8853-4d66-ad2d-efcb52c19b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.548362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5783ee3a-8853-4d66-ad2d-efcb52c19b2e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:37.549733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5783ee3a-8853-4d66-ad2d-efcb52c19b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.592010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.592797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.593081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.593357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.594017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:37.594366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.596143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.609702 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1123/2269] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:37.613636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.616711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.632466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bafd0-4942-4fa4-bc7d-79e3b31f915f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.638258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.638894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.639182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.639462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.640233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.642183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.654247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1147/2270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:37.656333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.656967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.657481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.690745 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1124/2271] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:13:37.691714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.702547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:37.703767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:37.766774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:37.781214 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1148/2272] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:37.782174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.785264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994082a8-45f4-4e90-a66f-9c18405ffdf8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.793165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0a33-90ad-4ae7-8659-4ac8838f183e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.793994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.794663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.794944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.795216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.795938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.797848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.803019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.804083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.804749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.805237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.806397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:37.807042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.809636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.811784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:37.826083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1149/2273] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:37.830486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.834990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1125/2274] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:37.835913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.847454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061028-9e32-4505-a410-7dc795438454 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.847654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe775d-c9be-448c-9693-b1d4c29fe260 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.854749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.855418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.855698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.856000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.856382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.856789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.857668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.858188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.858571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.858799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.860575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.863619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.872992 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1126/2275] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:37.874039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.892712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d8fef-6642-4474-b853-e83e5adfc4ab admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.898867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1150/2276] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:13:37.899525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.900329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.900637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.901028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.901947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.902925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.904205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:37.930184 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1127/2277] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:37.933726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:37.946297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc29a0-0749-4529-8ea4-25a00d481120 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.984345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7db58-d1bd-4b18-827a-f2b78c3b4329 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:37.993499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:37.994637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:37.994964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:37.995207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:37.995858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:37.997920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.026350 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1151/2278] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:37 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:13:38.034579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.035836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9212b-50f5-4645-b5db-af29e3295fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.037580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9212b-50f5-4645-b5db-af29e3295fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.037580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9212b-50f5-4645-b5db-af29e3295fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.038094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9212b-50f5-4645-b5db-af29e3295fd7 admin admin] PATH_INFO: `/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0/users/f5d6d011906e42a29d4226d65776908d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.055899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8955240-e0ec-4789-9c96-e49e8c12e35f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.056442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9212b-50f5-4645-b5db-af29e3295fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2977b55a0f14c47b9e62a0c162f64d0, user_id=f5d6d011906e42a29d4226d65776908d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.059389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9212b-50f5-4645-b5db-af29e3295fd7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.060772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.061553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.061836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.062414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.063090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.064828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.079016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1152/2279] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:38.083244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.093255 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1128/2280] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:37 2022] PUT /identity/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0/users/f5d6d011906e42a29d4226d65776908d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:38.094486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4f56-f5a5-4a94-a123-11773b9505fe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.104254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958622cd-4893-42b2-abad-72299068a6da None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.104537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958622cd-4893-42b2-abad-72299068a6da None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.104810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958622cd-4893-42b2-abad-72299068a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.144560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-958622cd-4893-42b2-abad-72299068a6da None None] MFA Rules not processed for user `f5d6d011906e42a29d4226d65776908d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:38.147008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-958622cd-4893-42b2-abad-72299068a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:38.184167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.184793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.185124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.185391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.186073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.187709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.203860 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1153/2281] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:38.206135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.220038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659af14-e7eb-429b-81ae-a5b638175f12 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.225613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704bc65-4396-4a4e-bfd6-a47ac45092ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.226322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704bc65-4396-4a4e-bfd6-a47ac45092ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.226609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704bc65-4396-4a4e-bfd6-a47ac45092ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.226883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704bc65-4396-4a4e-bfd6-a47ac45092ac admin admin] PATH_INFO: `/v3/projects/e9f91db7e2d14e8ba3fe506f4c034c98/users/614a5366d0d14df6b7ab4530882646f3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.232678 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1129/2282] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:38.238232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958622cd-4893-42b2-abad-72299068a6da None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.253420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958622cd-4893-42b2-abad-72299068a6da None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.254864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704bc65-4396-4a4e-bfd6-a47ac45092ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f91db7e2d14e8ba3fe506f4c034c98, user_id=614a5366d0d14df6b7ab4530882646f3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.258380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.259080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.259421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.259581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704bc65-4396-4a4e-bfd6-a47ac45092ac admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.259806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.260512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.262709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.287217 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1154/2283] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:38 2022] PUT /identity/v3/projects/e9f91db7e2d14e8ba3fe506f4c034c98/users/614a5366d0d14df6b7ab4530882646f3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:38.287217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.287217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.287217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.309151 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1130/2284] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:38 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:13:38.310205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.311536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:38.312934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:38.324680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:38.346188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:38.401216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe15037-8128-4925-a0cb-d877d36304bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.402132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1155/2285] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:38.410357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.413254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:38.416669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.416828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.416996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.417270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.417915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.419980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.455040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1131/2286] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:38 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:38.456750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.470476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70627915-594f-4c95-ac21-da7bbaa60556 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.478939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.479567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.479851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.480879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.482009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.492739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.507573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1fb0f-7a3f-443d-adb9-a4711401ba6f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.510185 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1132/2287] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:13:38.512557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.522226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.524278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.524804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.525242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.533851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fcf93-770f-4799-8793-3b75c346598d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.541014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.543188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.550077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.550995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.556235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.556849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] PATH_INFO: `/v3/projects/67c6ce4316e540f4a8565239260181dc/users/78e5d44f1d564ea28bc7d252ab70585f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.558581 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1156/2288] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:38.593673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c6ce4316e540f4a8565239260181dc, user_id=78e5d44f1d564ea28bc7d252ab70585f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.597619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.655636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1133/2289] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:38 2022] PUT /identity/v3/projects/67c6ce4316e540f4a8565239260181dc/users/78e5d44f1d564ea28bc7d252ab70585f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:38.660243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.677527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9addf-d535-492a-a069-57ba410aba8f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:38.940503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0fecd-817e-4735-a44a-e6902c58bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:38.941877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0fecd-817e-4735-a44a-e6902c58bb90 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:38.941877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0fecd-817e-4735-a44a-e6902c58bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:38.942303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0fecd-817e-4735-a44a-e6902c58bb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:38.943704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0fecd-817e-4735-a44a-e6902c58bb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:38.945636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0fecd-817e-4735-a44a-e6902c58bb90 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:38.965800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1157/2290] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:38.969606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:38.997082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2823ea-f909-427d-b8dc-30613e7a5bc4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:39.018638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:39.019337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:39.019612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:39.019890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] PATH_INFO: `/v3/projects/67c6ce4316e540f4a8565239260181dc/users/78e5d44f1d564ea28bc7d252ab70585f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:39.024504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c6ce4316e540f4a8565239260181dc, user_id=78e5d44f1d564ea28bc7d252ab70585f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:39.038530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:39.069168 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1134/2291] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:38 2022] PUT /identity/v3/projects/67c6ce4316e540f4a8565239260181dc/users/78e5d44f1d564ea28bc7d252ab70585f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:39.081154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:39.081859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:39.082331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:39.143855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] MFA Rules not processed for user `78e5d44f1d564ea28bc7d252ab70585f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:39.145232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:39.294899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:39.341355 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1158/2292] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:39.345842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:39.361777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ad51f-865c-4164-91da-593d5eb0f4f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:39.375489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:39.376285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:39.377340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:39.377340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:39.378245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:39.378399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:39.380833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:39.404482 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1135/2293] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:13:39.408953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:39.419748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569bb11-07e0-409d-b094-2486f42a97c6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:39.425524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:39.426505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:39.427610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:39.428413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:39.428747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:39.430980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:39.487630 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1159/2294] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:39 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:39.489223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:39.507826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb98e35-1be3-4b04-840e-d3d3c9826871 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:39.618458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:39.619681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:39.620129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:39.620616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:39.621517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:39.622721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:39.624682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ae07-e3b9-486a-b8f1-495e8bf7b243 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:39.662314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1136/2295] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:39.885174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:39.887061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:39.981502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6dcb-4f20-4e12-9420-443f39691022 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:39.990744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:39.991542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:39.992149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:39.992705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:40.012159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:40.015105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:40.027327 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1160/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:40.048029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c4c1-40cd-4b75-8994-4abf44d404fb None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:40.048330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c4c1-40cd-4b75-8994-4abf44d404fb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:40.048614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c4c1-40cd-4b75-8994-4abf44d404fb None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:40.049948 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1137/2297] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:40.055823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:40.076624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:40.088859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec0378-2ada-415f-afcc-d68c40e6adf1 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:40.094033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:40.095165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:40.095165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:40.095387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8c55719273af4d399bd0fd0204ff4602` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:40.096381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c55719273af4d399bd0fd0204ff4602)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:40.098615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:40.120141 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1161/2298] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:40 2022] GET /identity/v3/projects/8c55719273af4d399bd0fd0204ff4602 => generated 371 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:13:40.431407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117263c-4056-4912-87aa-389769f0cd9e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:40.431957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117263c-4056-4912-87aa-389769f0cd9e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:40.431957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117263c-4056-4912-87aa-389769f0cd9e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:40.433552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1138/2299] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:40.438837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:40.452982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:40.465974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a6e8-6a38-46d5-ad2c-1dd82470309c tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:40.471692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:40.472449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:40.472842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:40.473481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8c55719273af4d399bd0fd0204ff4602` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:40.475366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c55719273af4d399bd0fd0204ff4602)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:40.477551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:40.479545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1162/2300] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:40 2022] GET /identity/v3/projects/8c55719273af4d399bd0fd0204ff4602 => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:41.042783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424766c-1007-450b-a428-5a32b352ee5e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:41.043330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424766c-1007-450b-a428-5a32b352ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:41.043817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424766c-1007-450b-a428-5a32b352ee5e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:41.046386 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1139/2301] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:41.052448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:41.054386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:41.074009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:41.085282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b37d-f7c5-46b5-ae33-4326b07533ac tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:41.090565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80e0b4-1538-44f2-af20-4db816631e97 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:41.091403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80e0b4-1538-44f2-af20-4db816631e97 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:41.091793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80e0b4-1538-44f2-af20-4db816631e97 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:41.092170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80e0b4-1538-44f2-af20-4db816631e97 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8c55719273af4d399bd0fd0204ff4602` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:41.093507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80e0b4-1538-44f2-af20-4db816631e97 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c55719273af4d399bd0fd0204ff4602)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:41.096427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80e0b4-1538-44f2-af20-4db816631e97 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:41.110472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1163/2302] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:41 2022] GET /identity/v3/projects/8c55719273af4d399bd0fd0204ff4602 => generated 371 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:41.129812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424766c-1007-450b-a428-5a32b352ee5e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:41.149722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424766c-1007-450b-a428-5a32b352ee5e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:41.163039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:41.163982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:41.164364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:41.164749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8c55719273af4d399bd0fd0204ff4602` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:41.166907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c55719273af4d399bd0fd0204ff4602)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:41.172423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:41.268182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:41.293840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c55719273af4d399bd0fd0204ff4602', 'request_id': 'req-be47e271-5a7d-46e0-a182-7ddfb41106d1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:41.323890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c55719273af4d399bd0fd0204ff4602', 'request_id': 'req-be47e271-5a7d-46e0-a182-7ddfb41106d1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:41.339403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c55719273af4d399bd0fd0204ff4602', 'request_id': 'req-be47e271-5a7d-46e0-a182-7ddfb41106d1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:41.361911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] The token cache is being invalidate because project 8c55719273af4d399bd0fd0204ff4602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:41.361911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:41.363233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:41.372235 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1140/2303] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:41 2022] DELETE /identity/v3/projects/8c55719273af4d399bd0fd0204ff4602 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:41.834259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135a89f-5e8c-47dc-aae6-a8d19bbef70b None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:41.835400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135a89f-5e8c-47dc-aae6-a8d19bbef70b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:41.835923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135a89f-5e8c-47dc-aae6-a8d19bbef70b None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:41.837997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1164/2304] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:41.843461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:41.845459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:42.065083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:42.066709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:42.211604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47e271-5a7d-46e0-a182-7ddfb41106d1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:42.217820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:42.219781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:42.220284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:42.221027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:42.222574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2977b55a0f14c47b9e62a0c162f64d0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:42.227291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:42.232410 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1141/2305] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:41 2022] GET /identity/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0 => generated 375 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:42.253870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135a89f-5e8c-47dc-aae6-a8d19bbef70b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:42.275875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135a89f-5e8c-47dc-aae6-a8d19bbef70b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:42.290125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:42.291025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:42.291514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:42.292480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:42.293373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:42.294067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:42.296726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:42.326248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1165/2306] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:42.330551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:42.361041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc8b60-0738-4888-8a4c-63c078b42a02 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:42.374204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946647-0a2d-4e03-9970-1b8c7545a22e tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:42.384191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946647-0a2d-4e03-9970-1b8c7545a22e tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:42.387103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946647-0a2d-4e03-9970-1b8c7545a22e tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:42.391384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946647-0a2d-4e03-9970-1b8c7545a22e tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:42.391639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946647-0a2d-4e03-9970-1b8c7545a22e tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:42.397751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946647-0a2d-4e03-9970-1b8c7545a22e tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:42.491034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1142/2307] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:42 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:42.494841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:42.513238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a66467-593e-4d7c-bffa-2bc3e315e724 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:42.658807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:42.659430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:42.659937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:42.660211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:42.660865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:42.661675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:42.664345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:42.684575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:42.699552 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1166/2308] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:42.917803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342acdf-1401-4839-b658-b68f8f33ed43 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:42.918312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342acdf-1401-4839-b658-b68f8f33ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:42.919916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342acdf-1401-4839-b658-b68f8f33ed43 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:42.924402 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1143/2309] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:42.932960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:42.935236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:43.142040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:43.156054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfdd82-e2cf-4829-94b7-e2bfe0d5c0e4 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:43.164193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:43.164933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:43.165394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:43.165690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8f9973f4c02947efb78de75f7208f262` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:43.170410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f9973f4c02947efb78de75f7208f262)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:43.173967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:43.179015 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1167/2310] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:42 2022] GET /identity/v3/projects/8f9973f4c02947efb78de75f7208f262 => generated 371 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:43.885352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08978e14-8c32-416a-95d3-d468ecd451ba None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:43.885661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08978e14-8c32-416a-95d3-d468ecd451ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:43.886333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08978e14-8c32-416a-95d3-d468ecd451ba None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:43.888138 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1144/2311] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:43.903344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:43.931851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:43.965806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeac7ca-8360-456c-88fc-deabfad96ad1 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:43.979727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:43.980457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:43.980689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:43.980968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8f9973f4c02947efb78de75f7208f262` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:43.982632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f9973f4c02947efb78de75f7208f262)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:43.987680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:43.993785 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1168/2312] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:43 2022] GET /identity/v3/projects/8f9973f4c02947efb78de75f7208f262 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:44.089207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08978e14-8c32-416a-95d3-d468ecd451ba None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:44.109633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08978e14-8c32-416a-95d3-d468ecd451ba None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:44.125465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:44.126117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:44.126427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:44.126707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:44.130781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:44.131153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:44.135124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:44.166374 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1145/2313] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:44.170720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:44.190712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4c20-cbbc-4dda-a388-ebf891d643ca tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:44.205445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d6033-d047-4378-ad8d-6580dfb0f856 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:44.206073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6033-d047-4378-ad8d-6580dfb0f856 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:44.206499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6033-d047-4378-ad8d-6580dfb0f856 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:44.206830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6033-d047-4378-ad8d-6580dfb0f856 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:44.207503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d6033-d047-4378-ad8d-6580dfb0f856 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:44.219269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d6033-d047-4378-ad8d-6580dfb0f856 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:44.285990 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1169/2314] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:44 2022] POST /identity/v3/users => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:44.291130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:44.309244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e19d6-1c4e-4b20-bf7a-b7f87b308262 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:44.322212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:44.323134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:44.323674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:44.324107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:44.326592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:44.327139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:44.331737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:44.360280 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1146/2315] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:44.596029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674876-6a24-4db6-9bf9-fd97b02b8f8c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:44.596128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674876-6a24-4db6-9bf9-fd97b02b8f8c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:44.596460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674876-6a24-4db6-9bf9-fd97b02b8f8c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:44.598020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1170/2316] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:44.605178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:44.637161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:44.663763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158964-08a1-4693-a06b-584073c62a75 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:44.690100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:44.691055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:44.691490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:44.691913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8f9973f4c02947efb78de75f7208f262` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:44.693847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f9973f4c02947efb78de75f7208f262)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:44.696143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:44.698360 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1147/2317] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:44 2022] GET /identity/v3/projects/8f9973f4c02947efb78de75f7208f262 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:45.752758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e16b9-2ecb-45f1-a376-0b2b70e334ae None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:45.753349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e16b9-2ecb-45f1-a376-0b2b70e334ae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:45.753556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e16b9-2ecb-45f1-a376-0b2b70e334ae None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:45.756031 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1171/2318] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:45.772957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:45.794882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:45.802897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:45.814394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f12ba-8638-4b2b-a7b8-65de6c7396fe tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:45.834985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:45.835937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:45.837901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:45.838801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8f9973f4c02947efb78de75f7208f262` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:45.842441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f9973f4c02947efb78de75f7208f262)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:45.845487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:45.850878 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1148/2319] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:45 2022] GET /identity/v3/projects/8f9973f4c02947efb78de75f7208f262 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:45.910419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e16b9-2ecb-45f1-a376-0b2b70e334ae None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:45.932705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e16b9-2ecb-45f1-a376-0b2b70e334ae None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:45.944750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:45.945641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:45.946020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:45.946424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/users/f2681ef5060f4dfca4f5b518b05ed2f4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:45.980357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f2681ef5060f4dfca4f5b518b05ed2f4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:45.982455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:46.090833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2681ef5060f4dfca4f5b518b05ed2f4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.127626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2681ef5060f4dfca4f5b518b05ed2f4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.130587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2681ef5060f4dfca4f5b518b05ed2f4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.133188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2681ef5060f4dfca4f5b518b05ed2f4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.150052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2681ef5060f4dfca4f5b518b05ed2f4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.174968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1172/2320] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:45 2022] DELETE /identity/v3/users/f2681ef5060f4dfca4f5b518b05ed2f4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:46.179140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:46.182231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:46.200371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0466f1-52cf-49da-9f47-b7ac6fd22d70 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:46.309125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:46.310074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:46.310574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:46.311187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/8f9973f4c02947efb78de75f7208f262` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:46.312996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f9973f4c02947efb78de75f7208f262)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:46.316652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:46.440508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9973f4c02947efb78de75f7208f262', 'request_id': 'req-ff04355a-aaa7-4b07-99a1-57acd72ea736'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.449731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9973f4c02947efb78de75f7208f262', 'request_id': 'req-ff04355a-aaa7-4b07-99a1-57acd72ea736'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.462882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9973f4c02947efb78de75f7208f262', 'request_id': 'req-ff04355a-aaa7-4b07-99a1-57acd72ea736'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.482793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] The token cache is being invalidate because project 8f9973f4c02947efb78de75f7208f262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:46.483316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.484173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff04355a-aaa7-4b07-99a1-57acd72ea736 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:46.486439 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1149/2321] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:46 2022] DELETE /identity/v3/projects/8f9973f4c02947efb78de75f7208f262 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:46.595770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:46.597377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:46.626323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:46.710574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c07fbd-a185-4bbb-bcdb-dc154c925a25 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:46.814996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:46.815641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:46.815922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:46.819756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:46.821740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:46.910595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:46.913675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:46.943855 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1173/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:46.953365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8e057-27fa-401f-9325-242feecdc85c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:46.953985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8e057-27fa-401f-9325-242feecdc85c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:46.954186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8e057-27fa-401f-9325-242feecdc85c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:46.955962 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1150/2323] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:46.971669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:46.975997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:47.000221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:47.004101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:47.075316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:47.100966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294f800-4587-4f19-b03b-f097d1d1b28a service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:47.107140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:47.107998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:47.108630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:47.109129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:47.110659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2977b55a0f14c47b9e62a0c162f64d0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:47.113758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:47.133247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1174/2324] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:46 2022] GET /identity/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0 => generated 375 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:47.160094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8e43e-7f11-4aae-9650-06f14738c409 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:47.160764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8e43e-7f11-4aae-9650-06f14738c409 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:47.161855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8e43e-7f11-4aae-9650-06f14738c409 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:47.163963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1151/2325] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:47.169907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:47.195450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:47.215422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea3322-f3ba-4c33-8138-75e428df3bcb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:47.220834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:47.222970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:47.223255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:47.223532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:47.225233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2977b55a0f14c47b9e62a0c162f64d0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:47.228020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:47.230185 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1175/2326] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:47 2022] GET /identity/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0 => generated 375 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:48.003321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca56ae-abc6-40d0-a249-b5558031c5ae None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:48.004218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca56ae-abc6-40d0-a249-b5558031c5ae None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:48.004689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca56ae-abc6-40d0-a249-b5558031c5ae None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:48.006881 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1152/2327] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:13:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:13:48.021101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:13:48.053465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:48.083980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb651-9386-4b02-9718-cbc030ef94bb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:48.084260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb651-9386-4b02-9718-cbc030ef94bb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:48.084536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb651-9386-4b02-9718-cbc030ef94bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:48.087623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5dcc-42f7-45d3-905f-a540d5e43064 tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:48.101466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e5d44f1d564ea28bc7d252ab70585f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6ce4316e540f4a8565239260181dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:48.105478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:48.107365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:48.107875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] PATH_INFO: `/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:48.115024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2977b55a0f14c47b9e62a0c162f64d0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:48.121756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:48.127562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-832eb651-9386-4b02-9718-cbc030ef94bb None None] MFA Rules not processed for user `06e506f335f845a18332a4cd5047f3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:48.128661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-832eb651-9386-4b02-9718-cbc030ef94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:48.146766 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1176/2328] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:13:48 2022] GET /identity/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0 => generated 375 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:48.227425 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1153/2329] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:48.679446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:48.681841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:48.776946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9800-f70a-4378-beff-0c871d5483cb tempest-QuotasAdminTestJSON-609188091 tempest-QuotasAdminTestJSON-609188091-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:48.782318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:48.783248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:48.784338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:48.784792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] PATH_INFO: `/v3/users/f5d6d011906e42a29d4226d65776908d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:48.786693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d6d011906e42a29d4226d65776908d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:48.789181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:48.878783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d6d011906e42a29d4226d65776908d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:48.912603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d6d011906e42a29d4226d65776908d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:48.915500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d6d011906e42a29d4226d65776908d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:48.916218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d6d011906e42a29d4226d65776908d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:48.928110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d6d011906e42a29d4226d65776908d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:48.989115 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1177/2330] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:48 2022] DELETE /identity/v3/users/f5d6d011906e42a29d4226d65776908d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:48.990021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:48.990021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:48.990021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:49.025937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:49.027917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:49.112734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:49.206913 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1154/2331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:49.215043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:49.216647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:49.311941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c3ab0-1718-4431-8875-a0318b49428d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:49.327624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:49.327624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:49.327624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:49.327624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:49.341813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:49.361182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:49.361182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:49.379245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1178/2332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:50.400877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:50.404921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:50.455374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc760a-7dee-4689-ac86-412cf9d17985 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:50.464339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:50.465110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:50.465460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:50.465812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] PATH_INFO: `/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:50.467102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2977b55a0f14c47b9e62a0c162f64d0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:50.469360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:50.534079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2977b55a0f14c47b9e62a0c162f64d0', 'request_id': 'req-c68624e9-4091-4029-a777-c2e336db1912'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.547479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2977b55a0f14c47b9e62a0c162f64d0', 'request_id': 'req-c68624e9-4091-4029-a777-c2e336db1912'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.562095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2977b55a0f14c47b9e62a0c162f64d0', 'request_id': 'req-c68624e9-4091-4029-a777-c2e336db1912'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.582893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] The token cache is being invalidate because project e2977b55a0f14c47b9e62a0c162f64d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:50.583394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.585419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c68624e9-4091-4029-a777-c2e336db1912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.587335 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1155/2333] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:50 2022] DELETE /identity/v3/projects/e2977b55a0f14c47b9e62a0c162f64d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:50.591369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:50.603963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0823-68ee-44e5-a615-5f296a896f40 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:50.741676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:50.742535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:50.742942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:50.743938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] PATH_INFO: `/v3/users/78e5d44f1d564ea28bc7d252ab70585f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:50.745846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e5d44f1d564ea28bc7d252ab70585f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:50.751712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:50.845789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e5d44f1d564ea28bc7d252ab70585f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.902948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e5d44f1d564ea28bc7d252ab70585f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.908450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e5d44f1d564ea28bc7d252ab70585f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.909271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e5d44f1d564ea28bc7d252ab70585f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.935204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e5d44f1d564ea28bc7d252ab70585f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:50.974584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1179/2334] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:50 2022] DELETE /identity/v3/users/78e5d44f1d564ea28bc7d252ab70585f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:51.492202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:51.493352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:51.494691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:51.584056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] MFA Rules not processed for user `614a5366d0d14df6b7ab4530882646f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:51.585272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:51.813810 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1156/2335] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:51.814340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:51.816793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:52.054602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7d01d-66a5-4b9d-84c1-f9e799061c29 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.098175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.100029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.100545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.101320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.102472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.106258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.124026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.125803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:52.164753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588207-e0e1-4e7f-b021-520786eed25a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.168259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:52.177715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.179544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.180609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.182729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] PATH_INFO: `/v3/projects/67c6ce4316e540f4a8565239260181dc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.187395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c6ce4316e540f4a8565239260181dc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.195104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1180/2336] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:51 2022] POST /identity/v3/projects => generated 369 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:52.195877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.201255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.293880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:52.302572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c6ce4316e540f4a8565239260181dc', 'request_id': 'req-7c25385c-040e-4c3b-95ae-0657e7a31ef3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:52.314350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c6ce4316e540f4a8565239260181dc', 'request_id': 'req-7c25385c-040e-4c3b-95ae-0657e7a31ef3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:52.327447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c6ce4316e540f4a8565239260181dc', 'request_id': 'req-7c25385c-040e-4c3b-95ae-0657e7a31ef3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:52.340915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] The token cache is being invalidate because project 67c6ce4316e540f4a8565239260181dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:52.341246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:52.342601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c25385c-040e-4c3b-95ae-0657e7a31ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:52.345527 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1157/2337] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:52 2022] DELETE /identity/v3/projects/67c6ce4316e540f4a8565239260181dc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:52.352159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72006a-671b-41c2-9539-456ae66eae1a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.352897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71e82b-89e2-4308-b733-87793464646e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.353113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72006a-671b-41c2-9539-456ae66eae1a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.353495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72006a-671b-41c2-9539-456ae66eae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.383160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ff72006a-671b-41c2-9539-456ae66eae1a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:52.384900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ff72006a-671b-41c2-9539-456ae66eae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:52.456126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.457569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.458121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.458616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.459650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.461971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.501600 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1181/2338] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:52 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:52.506737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.508731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:52.511192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1158/2339] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:52.521330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.521628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.521911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.549757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f046e79-e21b-459f-b171-c08b4bbfde1a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.567123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.569374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.569817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.570294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.572305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.575336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.576032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:52.577979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:52.593723 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1159/2340] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:52.597916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.601379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1182/2341] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:52.602516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.624150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c8967-1f43-4a46-8138-c1191078d6cf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.628127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9161d-fc31-4368-a3fd-cfdf940b481e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.652240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.653092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.653372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.653647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] PATH_INFO: `/v3/projects/66e3b251713f44a894575c0a4cebdff1/users/29811b1de60e41a2a6091d57ef6fa736/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.665347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.668544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.671127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.672696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.677422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e3b251713f44a894575c0a4cebdff1, user_id=29811b1de60e41a2a6091d57ef6fa736, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.678291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:52.679099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.680835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.682519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bba2e-089f-48a4-b10f-47dd2ce65d6d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.704991 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1160/2342] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:52.706851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.707375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.708555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.710316 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1183/2343] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:52 2022] PUT /identity/v3/projects/66e3b251713f44a894575c0a4cebdff1/users/29811b1de60e41a2a6091d57ef6fa736/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:52.713190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.777300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:52.781231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:52.817606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5aa9-bc46-4633-8191-630726c8092a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:52.850098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:52.852836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:52.854177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:52.855789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:52.858403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:52.866977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:52.894839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:52.941058 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1161/2344] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:52.964139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.980103 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1184/2345] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:52 2022] POST /identity/v3/projects => generated 393 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:52.991192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:52.996140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b4ee-4af5-4f54-b35f-087587fafc04 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.197617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:53.221910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.222578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.222861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.225446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.226131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.233341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ef93-8cea-416a-8549-3c35d4d562d0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.234903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:53.251660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.252521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.252954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.253602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.257145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.267578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:53.275233 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1162/2346] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:53.276509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:53.315673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7189efb-9aa9-48f7-ba08-678770ed9616 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.346631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.347546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.347981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.348407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] PATH_INFO: `/v3/projects/66e3b251713f44a894575c0a4cebdff1/users/29811b1de60e41a2a6091d57ef6fa736/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.350136 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1185/2347] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:52 2022] POST /identity/v3/users => generated 297 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:53.352406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:53.354258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e3b251713f44a894575c0a4cebdff1, user_id=29811b1de60e41a2a6091d57ef6fa736, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.363047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:53.374749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899062-5e9f-4705-b25a-46d68f98686f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.387822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1163/2348] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:53 2022] PUT /identity/v3/projects/66e3b251713f44a894575c0a4cebdff1/users/29811b1de60e41a2a6091d57ef6fa736/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:53.489937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.490605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.491819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.491819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.491819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.498001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:53.518818 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1186/2349] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:53.523581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:53.542308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca099fdd-9543-458b-a7f2-10f81ab19083 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.561381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90336c-8902-4077-8bcf-08f7462c6219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.562015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90336c-8902-4077-8bcf-08f7462c6219 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.562325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90336c-8902-4077-8bcf-08f7462c6219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.562605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90336c-8902-4077-8bcf-08f7462c6219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.563600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90336c-8902-4077-8bcf-08f7462c6219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.565752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90336c-8902-4077-8bcf-08f7462c6219 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:53.595723 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1164/2350] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:53.601232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:53.638291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b871-fb8d-4ce1-af79-7524fe40bdf3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.649812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.650899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.651361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.651869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] PATH_INFO: `/v3/projects/15b333afd18442e9835ff8e44169dd07/users/4af8198b05964e2abb831af1631950a1/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.690644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b333afd18442e9835ff8e44169dd07, user_id=4af8198b05964e2abb831af1631950a1, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.696663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:53.719920 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1187/2351] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:53 2022] PUT /identity/v3/projects/15b333afd18442e9835ff8e44169dd07/users/4af8198b05964e2abb831af1631950a1/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:53.732206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.732742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.733190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.780182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:53.781992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:53.798423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] MFA Rules not processed for user `4af8198b05964e2abb831af1631950a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:53.799862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:53.891551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:53.920758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc6d8-8958-4d6c-9fd1-d8019b4f6563 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:53.943900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:53.944086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:53.944314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:53.944585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] PATH_INFO: `/v3/users/c79d1907e3b34a5ab2fc4f3b86b2eb33` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:53.946625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79d1907e3b34a5ab2fc4f3b86b2eb33)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:53.953118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:54.040062 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1165/2352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:54.048306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:54.082559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839646f-5d54-498c-ad7a-41ea12be77fc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:54.090863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:54.091505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.091810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.092052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.092872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:54.095145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:54.100035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79d1907e3b34a5ab2fc4f3b86b2eb33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:54.124845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79d1907e3b34a5ab2fc4f3b86b2eb33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:54.126940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79d1907e3b34a5ab2fc4f3b86b2eb33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:54.128388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79d1907e3b34a5ab2fc4f3b86b2eb33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:54.142979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-917da881-4e06-4ff0-be8f-709568ac6a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79d1907e3b34a5ab2fc4f3b86b2eb33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:54.164445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1166/2353] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:54 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:54.165646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:54.169255 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1188/2354] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:53 2022] DELETE /identity/v3/users/c79d1907e3b34a5ab2fc4f3b86b2eb33 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:54.175128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.175710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.176002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.176905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:54.205394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:54.206906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:54.327642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3892c-7a2d-4d86-bc74-9f9fdf397a8a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:54.394524 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1189/2355] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:54.438426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:54.446973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:54.448342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:54.470747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:54.471498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.471847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.472191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.473113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:54.475488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:54.562562 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1167/2356] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:54 2022] POST /identity/v3/users => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:54.566559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:54.591143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656191-d3bb-46bf-b48b-e9b6f135e7da admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:54.593456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba042-d763-49f8-911d-fa53e9338fcc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:54.603025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:54.603911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.604101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.604203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:54.604326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.604687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.606123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.606440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.607110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:54.612695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:54.629089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:54.631549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:54.635943 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1168/2357] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:54.641544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:54.652117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1190/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:13:54.658391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92928-e0cd-4fdc-a2b2-ce9461f3d036 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:54.668388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:54.669127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.669415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.681983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] PATH_INFO: `/v3/projects/a7687e8d324645f7896d2851947792bf/users/afb69ed8675c45a7bedd34291f0af96e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.728265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7687e8d324645f7896d2851947792bf, user_id=afb69ed8675c45a7bedd34291f0af96e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:54.737995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:54.795488 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1169/2359] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:54 2022] PUT /identity/v3/projects/a7687e8d324645f7896d2851947792bf/users/afb69ed8675c45a7bedd34291f0af96e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:54.796724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:54.807786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fad1f-00a5-42e9-a037-75811e69a814 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:54.813436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:54.946983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acb4b2-3aa5-4531-97ce-bbe1434d64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:54.950762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acb4b2-3aa5-4531-97ce-bbe1434d64aa admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:54.951310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acb4b2-3aa5-4531-97ce-bbe1434d64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:54.967432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acb4b2-3aa5-4531-97ce-bbe1434d64aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:54.969949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acb4b2-3aa5-4531-97ce-bbe1434d64aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:54.976204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acb4b2-3aa5-4531-97ce-bbe1434d64aa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:55.014781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1191/2360] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:55.018702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:55.045850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff00e2-bcca-4567-8c93-edf3027f796d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:55.063562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:55.065099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:55.066412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:55.066863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] PATH_INFO: `/v3/projects/a7687e8d324645f7896d2851947792bf/users/afb69ed8675c45a7bedd34291f0af96e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:55.072837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7687e8d324645f7896d2851947792bf, user_id=afb69ed8675c45a7bedd34291f0af96e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:55.077402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:55.106759 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1170/2361] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:55 2022] PUT /identity/v3/projects/a7687e8d324645f7896d2851947792bf/users/afb69ed8675c45a7bedd34291f0af96e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:55.118137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:55.118589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:55.118999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:55.203414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] MFA Rules not processed for user `afb69ed8675c45a7bedd34291f0af96e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:55.208126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:55.265284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:55.267423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:55.367936 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1192/2362] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:55.380432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:55.382803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:55.459206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace4e1e-da6a-4891-818d-4477754eadc6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:55.473755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:55.474447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:55.474776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:55.475057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] PATH_INFO: `/v3/projects/9f6309881d2341128d2ce5f3e2ee0f25` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:55.477166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6309881d2341128d2ce5f3e2ee0f25)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:55.480275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:55.602192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6309881d2341128d2ce5f3e2ee0f25', 'request_id': 'req-5b5907dc-290f-4c6d-aa39-28bc31b11769'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:55.612857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dd175-74b1-4d21-b4c7-c57805789e2c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:55.640795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6309881d2341128d2ce5f3e2ee0f25', 'request_id': 'req-5b5907dc-290f-4c6d-aa39-28bc31b11769'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:55.658917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6309881d2341128d2ce5f3e2ee0f25', 'request_id': 'req-5b5907dc-290f-4c6d-aa39-28bc31b11769'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:55.676326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] The token cache is being invalidate because project 9f6309881d2341128d2ce5f3e2ee0f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:55.677664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:55.678833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:55.680972 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1171/2363] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:55 2022] DELETE /identity/v3/projects/9f6309881d2341128d2ce5f3e2ee0f25 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:55.686940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:55.689420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:55.690472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:55.735147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:55.787041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:55.788112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:55.788615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:55.789106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:55.793978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:55.856933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5907dc-290f-4c6d-aa39-28bc31b11769 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:55.884977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:55.887250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:55.888213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:55.889590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] PATH_INFO: `/v3/users/58b0d8e8f945436292bc8fa3221dbec6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:55.892638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b0d8e8f945436292bc8fa3221dbec6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:55.895207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:55.915280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:55.923194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:55.968604 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1193/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:55.990456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b0d8e8f945436292bc8fa3221dbec6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:56.008731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b0d8e8f945436292bc8fa3221dbec6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:56.009533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b0d8e8f945436292bc8fa3221dbec6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:56.010390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b0d8e8f945436292bc8fa3221dbec6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:56.026944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b0d8e8f945436292bc8fa3221dbec6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:56.064148 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1172/2365] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:55 2022] DELETE /identity/v3/users/58b0d8e8f945436292bc8fa3221dbec6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:57.091152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:57.092614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:57.126483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40f1f6-dc31-4255-ba26-e34f1f986094 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:57.313418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:57.314639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:57.314942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:57.315223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:57.317801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:57.497668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:57.502487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:57.511936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:57.527794 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1194/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:57.565277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:57.566740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:57.679787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:57.681949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:57.784685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6379-1a54-4f26-bb8d-8e5d5f2e67a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:57.811600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:57.812897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:57.813186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:57.813499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] PATH_INFO: `/v3/users/4af8198b05964e2abb831af1631950a1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:57.815224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af8198b05964e2abb831af1631950a1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:57.818516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:57.873683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc00411-9e08-4497-8ce7-a901b7413a7b service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:57.891177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:57.891882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:57.892168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:57.902403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] PATH_INFO: `/v3/projects/7f9f66c2a8074fea9a585e2030093775` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:57.907410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9f66c2a8074fea9a585e2030093775)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:57.911441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:57.915566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:57.946254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af8198b05964e2abb831af1631950a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:57.987483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af8198b05964e2abb831af1631950a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:57.988103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af8198b05964e2abb831af1631950a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:57.990402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af8198b05964e2abb831af1631950a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.020909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c2d91c-1547-481c-a6c6-905d8bcdd973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af8198b05964e2abb831af1631950a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.097013 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1173/2367] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:57 2022] DELETE /identity/v3/users/4af8198b05964e2abb831af1631950a1 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:58.105961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.107223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.107415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.120607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9f66c2a8074fea9a585e2030093775', 'request_id': 'req-53b9b259-91ec-425c-ae89-9ee7f636f9bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.138534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9f66c2a8074fea9a585e2030093775', 'request_id': 'req-53b9b259-91ec-425c-ae89-9ee7f636f9bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.158580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9f66c2a8074fea9a585e2030093775', 'request_id': 'req-53b9b259-91ec-425c-ae89-9ee7f636f9bf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.164659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:58.167380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:58.190743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] The token cache is being invalidate because project 7f9f66c2a8074fea9a585e2030093775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:58.191033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.193469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53b9b259-91ec-425c-ae89-9ee7f636f9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:58.205670 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1195/2368] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:57 2022] DELETE /identity/v3/projects/7f9f66c2a8074fea9a585e2030093775 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:58.210553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c5b2-2fb0-49b9-b137-d12eece0b7e6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.211799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c5b2-2fb0-49b9-b137-d12eece0b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.212436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c5b2-2fb0-49b9-b137-d12eece0b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.281981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8650c5b2-2fb0-49b9-b137-d12eece0b7e6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:58.283689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8650c5b2-2fb0-49b9-b137-d12eece0b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:58.374220 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1174/2369] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:58.431005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:58.432899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:58.453528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1196/2370] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:58.463374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.464354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.464354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.534932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:58.536319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:58.545797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec015a05-beb1-4365-9cbb-1e58a3004937 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:58.549932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:58.550605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.550908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.551372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.564885 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1197/2371] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:13:58.568689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:58.576172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:58.577824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:58.599315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ffb1e-2489-42f7-a933-14662999b5b6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:58.615044 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1175/2372] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:13:58.617530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:58.618754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.622181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.622480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.623349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:13:58.626125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:58.627868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:58.656655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1198/2373] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:13:58.661176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:58.676422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5b5f-6020-43e8-8bee-ee17506fa52d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:58.684451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:58.685367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.685711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.686294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.687136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:58.690245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:58.753017 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1176/2374] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:13:58 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:58.757950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:58.772086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972da9-4560-4d92-a854-38a5716998ec admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:58.784387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:58.895404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:58.896565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:58.897077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:58.897799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:58.899327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:58.903374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:58.974006 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1199/2375] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:13:58 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:13:58.976345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:58.987434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fe9dd-9001-46e5-8d79-e36e8ea07591 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:59.000974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:59.001661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:59.003773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:59.004067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:59.007070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:59.012294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:59.033817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1177/2376] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:59.040660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:59.054320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40c2cf-4048-46b7-8a55-74640c8e1b03 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:59.069413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdad2c-ca49-4480-ad33-209d3080199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:59.070047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdad2c-ca49-4480-ad33-209d3080199e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:59.070358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdad2c-ca49-4480-ad33-209d3080199e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:59.070635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdad2c-ca49-4480-ad33-209d3080199e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:59.071293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdad2c-ca49-4480-ad33-209d3080199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:59.073069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdad2c-ca49-4480-ad33-209d3080199e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:59.109221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1200/2377] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:13:59.113404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:59.126792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060b42-b62b-44ee-9eaf-cce49ecb54c2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:59.143021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:59.143719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:59.144004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:59.144430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] PATH_INFO: `/v3/projects/56ea783448444694b81e03919127269a/users/e4e7e76f22554a3da4be7b2770b5a319/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:59.187901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ea783448444694b81e03919127269a, user_id=e4e7e76f22554a3da4be7b2770b5a319, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:59.191431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:59.222227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:13:59.243398 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1178/2378] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:13:59 2022] PUT /identity/v3/projects/56ea783448444694b81e03919127269a/users/e4e7e76f22554a3da4be7b2770b5a319/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:13:59.248574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:59.249453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:59.249910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:59.295022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:13:59.300067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:59.467274 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1201/2379] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:13:59.488501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:59.607600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:59.613033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:13:59.671752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a9cb-1fb5-4204-aa09-98cc8ec280dd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:59.710750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:59.712852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:59.713145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:59.713430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] PATH_INFO: `/v3/projects/15b333afd18442e9835ff8e44169dd07` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:59.717187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b333afd18442e9835ff8e44169dd07)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:59.725810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:59.749133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8453a-0f82-4aef-be76-dd1c81eb78e1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:13:59.774378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:13:59.774378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:13:59.774378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:13:59.774378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:13:59.803593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:13:59.805064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:13:59.844319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1179/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:13:59.869647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b333afd18442e9835ff8e44169dd07', 'request_id': 'req-8d94bdda-62e1-458d-8940-8d12210e9565'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:59.889860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b333afd18442e9835ff8e44169dd07', 'request_id': 'req-8d94bdda-62e1-458d-8940-8d12210e9565'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:59.903632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b333afd18442e9835ff8e44169dd07', 'request_id': 'req-8d94bdda-62e1-458d-8940-8d12210e9565'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:59.927267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] The token cache is being invalidate because project 15b333afd18442e9835ff8e44169dd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:13:59.927676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:59.930488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d94bdda-62e1-458d-8940-8d12210e9565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:13:59.937657 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1202/2381] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:13:59 2022] DELETE /identity/v3/projects/15b333afd18442e9835ff8e44169dd07 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:13:59.942651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:13:59.966090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d8fe-e6cb-41ab-b178-35bccfcbe39e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:00.136200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:00.137579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:00.138087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:00.138506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] PATH_INFO: `/v3/users/afb69ed8675c45a7bedd34291f0af96e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:00.140306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb69ed8675c45a7bedd34291f0af96e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:00.143401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:00.283864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb69ed8675c45a7bedd34291f0af96e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:00.306485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb69ed8675c45a7bedd34291f0af96e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:00.307155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb69ed8675c45a7bedd34291f0af96e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:00.308757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb69ed8675c45a7bedd34291f0af96e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:00.335965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb69ed8675c45a7bedd34291f0af96e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:00.415049 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1180/2382] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:13:59 2022] DELETE /identity/v3/users/afb69ed8675c45a7bedd34291f0af96e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:14:01.122622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da030fca-2a16-4bca-8dc8-bd5a04070097 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:01.123186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da030fca-2a16-4bca-8dc8-bd5a04070097 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:01.123470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da030fca-2a16-4bca-8dc8-bd5a04070097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:01.149396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-da030fca-2a16-4bca-8dc8-bd5a04070097 None None] MFA Rules not processed for user `e478de82935c4f9b93a698e3fa3c6d78`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:01.150747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da030fca-2a16-4bca-8dc8-bd5a04070097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:01.158614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:01.249392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1203/2383] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:01.653090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:01.659334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:01.770787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:01.972083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f485da6-bc0a-4736-b789-f8a85b39ad3d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:01.992651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:01.993330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:01.994881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:01.995170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] PATH_INFO: `/v3/projects/a7687e8d324645f7896d2851947792bf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:01.997259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7687e8d324645f7896d2851947792bf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:02.000039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:02.134286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7687e8d324645f7896d2851947792bf', 'request_id': 'req-1112853a-24dc-47bc-8f03-34cad63d3a3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:02.143066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7687e8d324645f7896d2851947792bf', 'request_id': 'req-1112853a-24dc-47bc-8f03-34cad63d3a3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:02.170311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7687e8d324645f7896d2851947792bf', 'request_id': 'req-1112853a-24dc-47bc-8f03-34cad63d3a3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:02.231026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] The token cache is being invalidate because project a7687e8d324645f7896d2851947792bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:14:02.234735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:02.236253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1112853a-24dc-47bc-8f03-34cad63d3a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:02.242055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1181/2384] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:14:01 2022] DELETE /identity/v3/projects/a7687e8d324645f7896d2851947792bf => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:14:02.248836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:02.249310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:02.249603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:02.319892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:02.323686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:02.463134 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1204/2385] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:02.472996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:02.473349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:02.474160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:02.501247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:02.503423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:02.526063 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1182/2386] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:02.530990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:02.546701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391382b-30db-4f05-a30d-ac708f3bccd5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:02.571865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:02.572522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:02.576234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:02.576472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:02.577178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:14:02.578294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:02.586858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:02.627287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1205/2387] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:14:02.632994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:02.654907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054e88-9893-47fd-a760-f2e87fed3fb8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:02.670721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:02.671271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:02.671552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:02.671825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:02.674509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:02.676560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:02.758977 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1183/2388] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:14:02 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:14:02.763322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:02.778917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c087d56-0190-4633-a13c-780d847a3c71 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:02.990032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:02.993430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:02.993746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:02.994048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:02.994902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:03.001201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:03.093354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:03.103411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1206/2389] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:14:02 2022] POST /identity/v3/users => generated 283 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:14:03.110837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fc50-3b51-4448-a25e-1214ed6bc163 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:03.130638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:03.132444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:03.132739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:03.134273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:03.134970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:03.140669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:03.170666 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1184/2390] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:14:03.174813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:03.191242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72044df-823a-4b0d-b849-3a43b294a779 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:03.202729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a6054-dbd3-43b4-b179-fb311b2d199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:03.203359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a6054-dbd3-43b4-b179-fb311b2d199e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:03.203641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a6054-dbd3-43b4-b179-fb311b2d199e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:03.216542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a6054-dbd3-43b4-b179-fb311b2d199e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:03.219263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a6054-dbd3-43b4-b179-fb311b2d199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:03.227090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a6054-dbd3-43b4-b179-fb311b2d199e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:03.256790 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1207/2391] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:14:03.263884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:03.284337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0832a-9764-4f86-b275-32d6b794c326 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:03.301050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:03.307056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:03.307352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:03.307641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] PATH_INFO: `/v3/projects/2881e8fc2fcf49329a1172830a492f38/users/fe99b1f63def414e80be31b284e08def/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:03.397230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2881e8fc2fcf49329a1172830a492f38, user_id=fe99b1f63def414e80be31b284e08def, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:03.400061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:03.460034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1185/2392] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:14:03 2022] PUT /identity/v3/projects/2881e8fc2fcf49329a1172830a492f38/users/fe99b1f63def414e80be31b284e08def/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:14:03.465329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041fc1-d5c0-4452-b54b-3db817afe1c5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:03.465617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041fc1-d5c0-4452-b54b-3db817afe1c5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:03.465890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041fc1-d5c0-4452-b54b-3db817afe1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:03.514698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cf041fc1-d5c0-4452-b54b-3db817afe1c5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:03.517642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf041fc1-d5c0-4452-b54b-3db817afe1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:03.554773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:03.650949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1208/2393] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:03.668409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:03.672525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:03.787202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:03.796613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f306d00-93bd-434f-9dd6-d879cf8e1ee4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:03.806896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007e6c0-dce9-49c6-b412-1adc1e0b9efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:03.807876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e6c0-dce9-49c6-b412-1adc1e0b9efe service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:03.810533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e6c0-dce9-49c6-b412-1adc1e0b9efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:03.811015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e6c0-dce9-49c6-b412-1adc1e0b9efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:03.846919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007e6c0-dce9-49c6-b412-1adc1e0b9efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:03.851630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007e6c0-dce9-49c6-b412-1adc1e0b9efe service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:03.889854 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1186/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:08.492116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:08.492604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:08.492702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:08.547663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] MFA Rules not processed for user `29811b1de60e41a2a6091d57ef6fa736`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:08.552397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:08.700547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:08.701534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:08.701969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:08.704364 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1209/2395] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:08.736935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] MFA Rules not processed for user `614a5366d0d14df6b7ab4530882646f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:08.738802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:08.847240 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1187/2396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:09.277670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:09.290786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:09.450567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3686-11cf-43f9-85c9-9d3cbf5bd47b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:09.479759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:09.480760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:09.481050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:09.481394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:09.484541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:09.500881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:09.502873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e883f35-6f4c-487d-b135-a2ef9c8f1ab9 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:09.518821 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1210/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:12.494691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:12.496204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:12.679399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e7119-aece-43dc-b777-fb32bc41c46e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:12.686643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:12.691499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:12.692655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:12.693932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:12.699274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:12.713365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:12.715391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20950103-ad8f-4c63-bffa-0f3b12b5249d service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:12.731173 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1188/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:12.816709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:12.817741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:12.817741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:12.851335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:12.856942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:12.937404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:13.014742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1211/2399] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:16.028840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f25b-9437-41b8-a364-09c1dc904565 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:16.029662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f25b-9437-41b8-a364-09c1dc904565 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:16.030013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f25b-9437-41b8-a364-09c1dc904565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:16.137859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6629f25b-9437-41b8-a364-09c1dc904565 None None] MFA Rules not processed for user `e4e7e76f22554a3da4be7b2770b5a319`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:16.153086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6629f25b-9437-41b8-a364-09c1dc904565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:16.335586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1189/2400] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:16.451462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:16.492938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4cdae-c9f7-41a3-ab5c-d8e074d20861 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:16.506786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7c828-49a1-4b19-b359-2acdc79e88b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:16.507710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7c828-49a1-4b19-b359-2acdc79e88b1 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:16.508185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7c828-49a1-4b19-b359-2acdc79e88b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:16.508679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7c828-49a1-4b19-b359-2acdc79e88b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:16.528368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7c828-49a1-4b19-b359-2acdc79e88b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:16.531804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7c828-49a1-4b19-b359-2acdc79e88b1 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:16.545348 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1212/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:16.938137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:16.938446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:16.938905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:17.009780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:17.012665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:17.015422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:17.200104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1190/2402] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:17.207217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1f63-c0ed-4d15-8551-9ae222f82e21 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:17.207531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1f63-c0ed-4d15-8551-9ae222f82e21 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:17.207948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1f63-c0ed-4d15-8551-9ae222f82e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:17.253453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-09ad1f63-c0ed-4d15-8551-9ae222f82e21 None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:17.259496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09ad1f63-c0ed-4d15-8551-9ae222f82e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:17.279916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1213/2403] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:14:17.368462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:17.369840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:17.405438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2125df-5dec-437c-bc15-c23d0c346982 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:17.420855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:17.421747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:17.422219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:17.422662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:17.438542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:17.440393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:17.471966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1191/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:18.022438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:18.022919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:18.023009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:18.067508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] MFA Rules not processed for user `e4e7e76f22554a3da4be7b2770b5a319`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:18.068754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:18.080956 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1214/2405] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:23.076868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:23.079201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:23.141310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b5e1c-ebb7-4614-83a8-710c9679af65 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:23.166237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:23.167157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:23.167434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:23.168844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:23.171410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:23.185600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:23.187255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df7c27-7fe8-4278-93a8-ea58bb1e1897 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:23.210273 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1192/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:28.049590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=22 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:31.246310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:31.269413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e3c5a-3084-4eba-b64c-a68ff6c9a675 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:31.276917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254910f-7b46-461b-b8da-4721cf76817f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:31.277641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254910f-7b46-461b-b8da-4721cf76817f service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:31.277984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254910f-7b46-461b-b8da-4721cf76817f service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:31.278526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254910f-7b46-461b-b8da-4721cf76817f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:31.288660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254910f-7b46-461b-b8da-4721cf76817f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:31.290447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254910f-7b46-461b-b8da-4721cf76817f service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:31.310335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1215/2407] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:14:33.194879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=38 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:34.132041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:34.132642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:34.133078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:34.156392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] MFA Rules not processed for user `c5c42a5f4ca54a25b6e39ba9857295b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:34.158181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:34.166794 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1193/2408] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:41.296519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:43.861270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5880-2423-4b91-a815-57e5035baf11 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:43.862326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5880-2423-4b91-a815-57e5035baf11 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:43.862812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5880-2423-4b91-a815-57e5035baf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:43.894087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4d0b5880-2423-4b91-a815-57e5035baf11 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:43.897275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d0b5880-2423-4b91-a815-57e5035baf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:44.031546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1216/2409] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:14:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:44.097563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:44.100393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:44.248786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91b01e-d4a8-4836-8b60-d85e7d6be745 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:44.257489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4f84-681a-4be7-96c9-6b338258d799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:44.258433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4f84-681a-4be7-96c9-6b338258d799 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:44.259401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4f84-681a-4be7-96c9-6b338258d799 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:44.260942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4f84-681a-4be7-96c9-6b338258d799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:44.278407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4f84-681a-4be7-96c9-6b338258d799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:44.281777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4f84-681a-4be7-96c9-6b338258d799 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:44.293698 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1194/2410] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:14:52.530328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b728-8421-4d12-a00e-b82b21e97b75 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:52.530959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b728-8421-4d12-a00e-b82b21e97b75 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:52.530959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b728-8421-4d12-a00e-b82b21e97b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:52.584646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b5e3b728-8421-4d12-a00e-b82b21e97b75 None None] MFA Rules not processed for user `e4e7e76f22554a3da4be7b2770b5a319`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:52.595705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b5e3b728-8421-4d12-a00e-b82b21e97b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:52.611500 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1217/2411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:54.289078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=35 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:14:58.397163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eac34-cf5e-4a00-877b-7287c56a1b0f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:58.398009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eac34-cf5e-4a00-877b-7287c56a1b0f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:58.398588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eac34-cf5e-4a00-877b-7287c56a1b0f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:58.401708 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1195/2412] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:14:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:14:58.414243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:58.415273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:58.415815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:58.449462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eac34-cf5e-4a00-877b-7287c56a1b0f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:58.452392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2e1eac34-cf5e-4a00-877b-7287c56a1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:58.505617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:58.512012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1eac34-cf5e-4a00-877b-7287c56a1b0f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:58.514365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:58.525627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:58.526906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:58.528260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:58.529667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] PATH_INFO: `/v3/users/ba045fd5be9d482b8205237ddee4d5f3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:58.532707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba045fd5be9d482b8205237ddee4d5f3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:58.539044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:58.543112 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1218/2413] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:14:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:58.607365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:58.628484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983395-a085-495a-870f-7a835ab57d31 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:58.657667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbe266-5b52-4203-ba61-a232347b414e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:58.659731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe266-5b52-4203-ba61-a232347b414e service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:58.660005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe266-5b52-4203-ba61-a232347b414e service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:58.661538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe266-5b52-4203-ba61-a232347b414e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:58.700869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbe266-5b52-4203-ba61-a232347b414e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:58.704729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbe266-5b52-4203-ba61-a232347b414e service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:58.710459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba045fd5be9d482b8205237ddee4d5f3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:58.728755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba045fd5be9d482b8205237ddee4d5f3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:58.730063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba045fd5be9d482b8205237ddee4d5f3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:58.731375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba045fd5be9d482b8205237ddee4d5f3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:58.740390 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1219/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:14:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:14:58.743062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba045fd5be9d482b8205237ddee4d5f3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:58.780781 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1196/2415] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:14:58 2022] DELETE /identity/v3/users/ba045fd5be9d482b8205237ddee4d5f3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:14:59.328374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:59.328664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:59.328941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:59.360499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] MFA Rules not processed for user `614a5366d0d14df6b7ab4530882646f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:14:59.361751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:59.502828 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1220/2416] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:14:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:14:59.679718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:59.682074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:14:59.794569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94715-1e0c-4582-a03b-d53b85f31c3f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:14:59.800440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:14:59.801482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:14:59.801674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:14:59.801887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] PATH_INFO: `/v3/projects/ff1e0a67d2af41adaa924326838401ab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:14:59.804077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1e0a67d2af41adaa924326838401ab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:14:59.807418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:14:59.914111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1e0a67d2af41adaa924326838401ab', 'request_id': 'req-4afd09cf-22ea-4b29-a5d4-c26b94454162'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:59.922794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1e0a67d2af41adaa924326838401ab', 'request_id': 'req-4afd09cf-22ea-4b29-a5d4-c26b94454162'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:59.933217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1e0a67d2af41adaa924326838401ab', 'request_id': 'req-4afd09cf-22ea-4b29-a5d4-c26b94454162'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:59.948926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] The token cache is being invalidate because project ff1e0a67d2af41adaa924326838401ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:14:59.949365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:59.950058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:14:59.954404 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1197/2417] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:14:59 2022] DELETE /identity/v3/projects/ff1e0a67d2af41adaa924326838401ab => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:14:59.955656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:14:59.975711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739916-c5a0-441f-97bb-c235aaf80a94 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:00.145823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:00.147388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:00.147864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:00.148737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] PATH_INFO: `/v3/users/97aed18524bd45c0b922286a6373e634` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:00.152898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=97aed18524bd45c0b922286a6373e634)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:00.158210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:00.213462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:00.245811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97aed18524bd45c0b922286a6373e634'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:00.275538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97aed18524bd45c0b922286a6373e634'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:00.277875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97aed18524bd45c0b922286a6373e634'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:00.278975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97aed18524bd45c0b922286a6373e634'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:00.295475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4370d24f-d757-4e6c-8c5f-dd628630c5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97aed18524bd45c0b922286a6373e634'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:00.319359 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1221/2418] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:14:59 2022] DELETE /identity/v3/users/97aed18524bd45c0b922286a6373e634 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:00.584652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:00.586285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:00.598241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:00.613976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd09cf-22ea-4b29-a5d4-c26b94454162 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:00.846906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:00.855755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:00.856281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:00.857376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] PATH_INFO: `/v3/projects/e899c3206c0f4dff94b64da5404cb8ea` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:00.865296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e899c3206c0f4dff94b64da5404cb8ea)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:00.871022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:01.020464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e899c3206c0f4dff94b64da5404cb8ea', 'request_id': 'req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:01.027286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e899c3206c0f4dff94b64da5404cb8ea', 'request_id': 'req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:01.038074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e899c3206c0f4dff94b64da5404cb8ea', 'request_id': 'req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:01.055433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] The token cache is being invalidate because project e899c3206c0f4dff94b64da5404cb8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:01.055871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:01.056736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9c47f889-1107-4a6c-a69a-bc3f59e7ec8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:01.061829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1198/2419] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:00 2022] DELETE /identity/v3/projects/e899c3206c0f4dff94b64da5404cb8ea => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:01.063564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.064637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.067993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.104898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:01.106219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:01.308831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.309213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.309569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.324125 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1222/2420] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:01.362648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:01.371968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:01.406566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:01.408122 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1199/2421] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:01.429508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbf92e-5339-4649-9af5-e54e12969c94 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:01.443024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:01.443674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.443966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.444236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.444909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:01.445217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:01.450004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:01.503000 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1223/2422] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:01.509912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:01.541655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcea8c-2cdd-4630-a186-9e08861576b7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:01.555631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:01.556558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.556558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.556805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.557452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:01.564285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:01.641699 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1200/2423] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:01 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:01.642525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:01.657046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2127f-81f4-4782-9fa3-a2862446cb72 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:01.787687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:01.788744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.789205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.789673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.790560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:01.793470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:01.827802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1224/2424] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:01 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:01.831711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:01.845659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea359cb-d3bb-4f0f-a73d-27bca2028d86 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:01.851257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:01.851873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.852325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.852760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.853655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:01.855451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:01.870728 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1201/2425] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:01.875284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:01.899369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7648b-b2aa-4d9f-8ebf-663535fb7102 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:01.917815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a0126-cfa2-450b-903a-cb8ea4b23b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:01.918771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0126-cfa2-450b-903a-cb8ea4b23b16 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:01.919385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0126-cfa2-450b-903a-cb8ea4b23b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:01.919873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0126-cfa2-450b-903a-cb8ea4b23b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:01.922017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a0126-cfa2-450b-903a-cb8ea4b23b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:01.923881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a0126-cfa2-450b-903a-cb8ea4b23b16 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:01.958104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1225/2426] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:15:01.962467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:01.981352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7715c4-9c2b-4be7-a95a-b58b9f7536cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:02.037477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:02.038220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:02.038507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:02.038799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] PATH_INFO: `/v3/projects/5d0661802c6a4ad4a2ae9b9274015cdc/users/436a4bb3cf604093bb2354b956de58fc/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:02.067740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0661802c6a4ad4a2ae9b9274015cdc, user_id=436a4bb3cf604093bb2354b956de58fc, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:02.071687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:02.105283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1202/2427] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:01 2022] PUT /identity/v3/projects/5d0661802c6a4ad4a2ae9b9274015cdc/users/436a4bb3cf604093bb2354b956de58fc/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:02.116734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:02.117673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:02.118173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:02.145978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:02.174459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] MFA Rules not processed for user `436a4bb3cf604093bb2354b956de58fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:02.176202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:02.281985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1226/2428] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:02.290178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:02.336822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:02.412343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0d4b3-44cb-48aa-b6cd-7555a4a3e3af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:02.431016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:02.431999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:02.432302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:02.432585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:02.433260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:02.435233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:02.526272 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1203/2429] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:02 2022] POST /identity/v3/projects => generated 403 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:02.527775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:02.546322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b3c5-3290-4587-a208-dca89a09d336 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:02.631398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:02.632484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:02.632839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:02.633197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:02.633904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:02.636625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:02.669873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1227/2430] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:02 2022] POST /identity/v3/users => generated 308 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:02.674751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:02.690417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8102d-b0e5-4ab7-b2ac-b536cfb1f694 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:02.697328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:02.698931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:02.699690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:02.700041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:02.700914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:02.702663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:02.720563 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1204/2431] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:02.725662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:02.757772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad24b4-3c38-44b2-a102-fe9403bc4014 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:02.768545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:02.769586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:02.770065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:02.770386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] PATH_INFO: `/v3/projects/a627a471b7cd4dd0a831bb3f25609abd/users/cea4ec29cf124f598630631123ebb592/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:02.821154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a627a471b7cd4dd0a831bb3f25609abd, user_id=cea4ec29cf124f598630631123ebb592, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:02.824091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:02.853846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1228/2432] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:02 2022] PUT /identity/v3/projects/a627a471b7cd4dd0a831bb3f25609abd/users/cea4ec29cf124f598630631123ebb592/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:02.857637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:02.877963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd42d1c-a144-472b-8c92-52dd6a43e042 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:03.006054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c34f4-df04-4375-b4ac-fe074d829a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:03.006908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c34f4-df04-4375-b4ac-fe074d829a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.007652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c34f4-df04-4375-b4ac-fe074d829a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.007948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c34f4-df04-4375-b4ac-fe074d829a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.008610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c34f4-df04-4375-b4ac-fe074d829a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:03.011377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c34f4-df04-4375-b4ac-fe074d829a6b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:03.058082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1205/2433] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:03.062331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:03.087136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e5456-b9c2-4629-9aa7-10e7c879963a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:03.124221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72da0c-7a76-4911-a9b6-483449b10089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:03.127294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72da0c-7a76-4911-a9b6-483449b10089 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.128969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72da0c-7a76-4911-a9b6-483449b10089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.129371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72da0c-7a76-4911-a9b6-483449b10089 admin admin] PATH_INFO: `/v3/projects/a627a471b7cd4dd0a831bb3f25609abd/users/cea4ec29cf124f598630631123ebb592/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.132450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72da0c-7a76-4911-a9b6-483449b10089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a627a471b7cd4dd0a831bb3f25609abd, user_id=cea4ec29cf124f598630631123ebb592, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:03.148083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72da0c-7a76-4911-a9b6-483449b10089 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:03.162084 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1229/2434] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:03 2022] PUT /identity/v3/projects/a627a471b7cd4dd0a831bb3f25609abd/users/cea4ec29cf124f598630631123ebb592/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:03.173590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.173866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.174238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.216573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] MFA Rules not processed for user `cea4ec29cf124f598630631123ebb592`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:03.217877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:03.302331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1206/2435] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:03.384623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.384956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.385390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.392256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:03.393718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:03.435394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:03.436952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:03.460516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:03.526601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61582-0fcc-4e04-ad02-cf546860fd14 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:03.540858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:03.541803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.542312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.543812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.550337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:03.553788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:03.555569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:03.575608 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1230/2436] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:15:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:03.577277 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1207/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:03 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:15:03.592003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:03.593609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:03.693316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98830baf-4c31-45df-b7e6-d657e1bf6c56 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:03.703975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc796730-b21d-4ed8-95bf-eb2e739d6cc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:03.704642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc796730-b21d-4ed8-95bf-eb2e739d6cc2 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.704930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc796730-b21d-4ed8-95bf-eb2e739d6cc2 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.705210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc796730-b21d-4ed8-95bf-eb2e739d6cc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.719178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc796730-b21d-4ed8-95bf-eb2e739d6cc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:03.720897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc796730-b21d-4ed8-95bf-eb2e739d6cc2 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:03.729944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1231/2438] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:15:03.774327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:03.786389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd6b8f-7ddb-44fa-82cf-080471e7be8d service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:03.792210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:03.792856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:03.793126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:03.793400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:03.859571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:03.861273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:03.871622 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1208/2439] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:03 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:04.406232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027f7cb-1b55-4e6c-87f6-5c355e3787da None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:04.406739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027f7cb-1b55-4e6c-87f6-5c355e3787da None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:04.406828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027f7cb-1b55-4e6c-87f6-5c355e3787da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:04.452474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9027f7cb-1b55-4e6c-87f6-5c355e3787da None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:04.454208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9027f7cb-1b55-4e6c-87f6-5c355e3787da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:04.536591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1232/2440] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:05.451009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:05.528850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4bcb-8f82-4c1b-a415-ff37289b74a4 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:05.533926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:05.534643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:05.534931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:05.535265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] PATH_INFO: `/v3/users/436a4bb3cf604093bb2354b956de58fc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:05.537465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436a4bb3cf604093bb2354b956de58fc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:05.539604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:05.611153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436a4bb3cf604093bb2354b956de58fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:05.616381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:05.627226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436a4bb3cf604093bb2354b956de58fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:05.630265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436a4bb3cf604093bb2354b956de58fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:05.632457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436a4bb3cf604093bb2354b956de58fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:05.644990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436a4bb3cf604093bb2354b956de58fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:05.667308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1209/2441] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:05 2022] DELETE /identity/v3/users/436a4bb3cf604093bb2354b956de58fc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:05.672835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:05.673324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:05.673421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:05.698845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:05.700210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:05.780441 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1233/2442] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:05.790806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:05.792232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:05.861529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394577ca-f20e-4c6f-b0c9-0f3699613f25 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:05.869003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:05.869986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:05.870435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:05.871001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:05.882773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:05.884329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:05.902242 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1210/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:06.385225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:06.387957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:06.410740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f84dab-f967-4c93-9bf2-4b1b3aab4528 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:06.436197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:06.436890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:06.437170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:06.437442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] PATH_INFO: `/v3/projects/5d0661802c6a4ad4a2ae9b9274015cdc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:06.439130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0661802c6a4ad4a2ae9b9274015cdc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:06.441210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:06.514453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:06.538130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0661802c6a4ad4a2ae9b9274015cdc', 'request_id': 'req-232f73dd-2294-42bc-a97c-c5bf840551e6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.558552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0661802c6a4ad4a2ae9b9274015cdc', 'request_id': 'req-232f73dd-2294-42bc-a97c-c5bf840551e6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.564975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0661802c6a4ad4a2ae9b9274015cdc', 'request_id': 'req-232f73dd-2294-42bc-a97c-c5bf840551e6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.583423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] The token cache is being invalidate because project 5d0661802c6a4ad4a2ae9b9274015cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:06.583921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.585603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.587366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1234/2444] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:06 2022] DELETE /identity/v3/projects/5d0661802c6a4ad4a2ae9b9274015cdc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:06.591442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:06.602994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31df4-d0f9-48c1-afe7-11a18a345de0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:06.669599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:06.670382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:06.670692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:06.671118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] PATH_INFO: `/v3/users/cea4ec29cf124f598630631123ebb592` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:06.672434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea4ec29cf124f598630631123ebb592)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:06.674556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:06.735011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea4ec29cf124f598630631123ebb592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.743651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea4ec29cf124f598630631123ebb592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.744319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea4ec29cf124f598630631123ebb592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.744934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea4ec29cf124f598630631123ebb592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.751927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0f73c09-a94e-4394-a018-38e94f0fc9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea4ec29cf124f598630631123ebb592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:06.759772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:06.780534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1211/2445] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:06 2022] DELETE /identity/v3/users/cea4ec29cf124f598630631123ebb592 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:08.157181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:08.159458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:08.187203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f73dd-2294-42bc-a97c-c5bf840551e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:08.352813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:08.353541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:08.355294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:08.355693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] PATH_INFO: `/v3/projects/a627a471b7cd4dd0a831bb3f25609abd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:08.357737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a627a471b7cd4dd0a831bb3f25609abd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:08.359484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:08.481672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a627a471b7cd4dd0a831bb3f25609abd', 'request_id': 'req-66db1346-34b8-4e0e-9926-e1637fb8bacc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:08.495803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a627a471b7cd4dd0a831bb3f25609abd', 'request_id': 'req-66db1346-34b8-4e0e-9926-e1637fb8bacc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:08.513756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a627a471b7cd4dd0a831bb3f25609abd', 'request_id': 'req-66db1346-34b8-4e0e-9926-e1637fb8bacc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:08.537232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] The token cache is being invalidate because project a627a471b7cd4dd0a831bb3f25609abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:08.537572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:08.540109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-66db1346-34b8-4e0e-9926-e1637fb8bacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:08.542787 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1235/2446] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:08 2022] DELETE /identity/v3/projects/a627a471b7cd4dd0a831bb3f25609abd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:08.547993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:08.548868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:08.549339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:08.601361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:08.602822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:08.763361 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1212/2447] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:08.772199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:08.772490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:08.772761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:08.796358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:08.797693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:08.811704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:08.818610 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1236/2448] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:08.823301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250bd37-1db0-4a76-995c-3ecab29edf3d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:08.828430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:08.829255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:08.829640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:08.830013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:08.830820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:08.831262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:08.833077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:08.853978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:08.868619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47a05-5a35-4048-b69d-ebbbaa72f69d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:08.869284 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1213/2449] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:08.874664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:08.875427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:08.875841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:08.876218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:08.876965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:08.879815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:08.944109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:08.951872 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1237/2450] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:08 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:08.969745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1bc6-9d5f-464b-8571-9992e618eca2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:09.124987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:09.124987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:09.124987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:09.124987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:09.125799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:09.136971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:09.230820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:09.259976 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1214/2451] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:08 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:09.264106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff664-ddb1-4948-85e8-a28f4a382722 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:09.275652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:09.276563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:09.276975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:09.277262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:09.278203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:09.281638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:09.312910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:09.324701 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1238/2452] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:09.344629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796587-53cc-43fc-ab77-bcb3be015947 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:09.360225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859d951-d383-4500-91cc-cf99a83ec84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:09.361086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d951-d383-4500-91cc-cf99a83ec84f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:09.361688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d951-d383-4500-91cc-cf99a83ec84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:09.362116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d951-d383-4500-91cc-cf99a83ec84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:09.362961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859d951-d383-4500-91cc-cf99a83ec84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:09.384101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859d951-d383-4500-91cc-cf99a83ec84f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:09.420253 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1215/2453] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:09.425167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:09.436892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:09.460492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203d2c-02f4-49dc-b05e-4aeec68ecb77 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:09.480745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:09.482470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:09.484210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:09.485136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] PATH_INFO: `/v3/projects/c72f052ead764d0595c01b8ff4b45c85/users/6d0e98a18dd04b928af62eaf6fce1fd0/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:09.531123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72f052ead764d0595c01b8ff4b45c85, user_id=6d0e98a18dd04b928af62eaf6fce1fd0, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:09.538193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:09.604707 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1239/2454] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:09 2022] PUT /identity/v3/projects/c72f052ead764d0595c01b8ff4b45c85/users/6d0e98a18dd04b928af62eaf6fce1fd0/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:09.616284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:09.616823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:09.617064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:09.670925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] MFA Rules not processed for user `6d0e98a18dd04b928af62eaf6fce1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:09.676797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:09.765939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:09.838521 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1216/2455] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:09.844798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:09.939973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b6c16-f712-4c36-adda-8617727e7f58 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:09.947112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:09.947948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:09.948232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:09.948511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:09.949210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:09.951409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.015890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1240/2456] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:09 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:10.017820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:10.040575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b648f-aca1-4fd6-bc43-1367243b486e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:10.196978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:10.197676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.197960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.198263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.199665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:10.202811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.243772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:10.248267 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1217/2457] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:10 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:10.259857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4cbb-824c-4d76-a251-cd65b9e7a03b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:10.266882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:10.267865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.268519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.269006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.271483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:10.273882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.288559 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1241/2458] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:10.293146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:10.319868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e6f0e-52e2-4a5f-88e5-d6e56e79e321 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:10.328561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:10.329573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.330081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.330625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] PATH_INFO: `/v3/projects/76c625f38b2c4eed8b54e87f703f55aa/users/c8a4cc06e90a48ad8fb9e3bc5019df9f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.354076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c625f38b2c4eed8b54e87f703f55aa, user_id=c8a4cc06e90a48ad8fb9e3bc5019df9f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:10.357602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.409797 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1218/2459] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:10 2022] PUT /identity/v3/projects/76c625f38b2c4eed8b54e87f703f55aa/users/c8a4cc06e90a48ad8fb9e3bc5019df9f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:10.414770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:10.429332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a1f2a-034f-411c-a13a-077883b964a0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:10.584464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf72856-d01c-4eed-aa41-9663cb9657c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:10.584464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72856-d01c-4eed-aa41-9663cb9657c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.584464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72856-d01c-4eed-aa41-9663cb9657c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.584464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72856-d01c-4eed-aa41-9663cb9657c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.584888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf72856-d01c-4eed-aa41-9663cb9657c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:10.586451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf72856-d01c-4eed-aa41-9663cb9657c7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.606195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1242/2460] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:10.608819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:10.624761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d38f7-5f41-46e9-82ac-327e865c4e72 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:10.636669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:10.637366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.637645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.640089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] PATH_INFO: `/v3/projects/76c625f38b2c4eed8b54e87f703f55aa/users/c8a4cc06e90a48ad8fb9e3bc5019df9f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.645842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c625f38b2c4eed8b54e87f703f55aa, user_id=c8a4cc06e90a48ad8fb9e3bc5019df9f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:10.652308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.666898 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1219/2461] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:10 2022] PUT /identity/v3/projects/76c625f38b2c4eed8b54e87f703f55aa/users/c8a4cc06e90a48ad8fb9e3bc5019df9f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:10.680700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.681409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.681695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.716541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] MFA Rules not processed for user `c8a4cc06e90a48ad8fb9e3bc5019df9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:10.717752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:10.782417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:10.822395 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1243/2462] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:10.833310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:10.835009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:10.936172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeccaf-1c2e-42f7-bdc4-47e583d9f678 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:10.942204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d75c8-d5e0-4e8a-be2d-b7db6e36d307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:10.942832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d75c8-d5e0-4e8a-be2d-b7db6e36d307 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:10.943159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d75c8-d5e0-4e8a-be2d-b7db6e36d307 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:10.943555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d75c8-d5e0-4e8a-be2d-b7db6e36d307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:10.953945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d75c8-d5e0-4e8a-be2d-b7db6e36d307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:10.955893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d75c8-d5e0-4e8a-be2d-b7db6e36d307 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:10.966713 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1220/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:11.983850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:12.117722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f670-a7e8-4148-9bfa-6f220f7d9acf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:12.123607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:12.124933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:12.125372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:12.125801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] PATH_INFO: `/v3/users/6d0e98a18dd04b928af62eaf6fce1fd0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:12.130511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0e98a18dd04b928af62eaf6fce1fd0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:12.135136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:12.235402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0e98a18dd04b928af62eaf6fce1fd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:12.271089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0e98a18dd04b928af62eaf6fce1fd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:12.275166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0e98a18dd04b928af62eaf6fce1fd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:12.276294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0e98a18dd04b928af62eaf6fce1fd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:12.290780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0e98a18dd04b928af62eaf6fce1fd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:12.325320 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1244/2464] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:11 2022] DELETE /identity/v3/users/6d0e98a18dd04b928af62eaf6fce1fd0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:12.330069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:12.330602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:12.330690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:12.352339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:12.353964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:12.384729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:12.450209 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1221/2465] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:12.461592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:12.463384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:12.559290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819a13-2ecb-4b1a-9686-c33697fb1fa7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:12.564921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:12.566927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:12.567212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:12.567489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:12.578708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:12.581319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:12.586740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:12.598240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1245/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:12.937808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:12.939292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:12.978977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cfc57-275b-411d-9f99-fcc5c2a8d164 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:12.984222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:12.985231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:12.985592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:12.985944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] PATH_INFO: `/v3/projects/c72f052ead764d0595c01b8ff4b45c85` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:12.987201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72f052ead764d0595c01b8ff4b45c85)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:12.990258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:13.053308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72f052ead764d0595c01b8ff4b45c85', 'request_id': 'req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.063091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72f052ead764d0595c01b8ff4b45c85', 'request_id': 'req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.074121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72f052ead764d0595c01b8ff4b45c85', 'request_id': 'req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.108482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] The token cache is being invalidate because project c72f052ead764d0595c01b8ff4b45c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:13.108482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.109677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.117565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1222/2467] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:12 2022] DELETE /identity/v3/projects/c72f052ead764d0595c01b8ff4b45c85 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:13.120272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:13.148845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd5c1-d604-4240-84af-ec57ce14a14b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:13.233178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:13.233740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:13.234026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:13.234342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] PATH_INFO: `/v3/users/c8a4cc06e90a48ad8fb9e3bc5019df9f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:13.235504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a4cc06e90a48ad8fb9e3bc5019df9f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:13.237466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:13.334019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a4cc06e90a48ad8fb9e3bc5019df9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.354671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a4cc06e90a48ad8fb9e3bc5019df9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.355743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a4cc06e90a48ad8fb9e3bc5019df9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.356623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a4cc06e90a48ad8fb9e3bc5019df9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.366549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8756582b-76c6-4e5f-97b4-846509053ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a4cc06e90a48ad8fb9e3bc5019df9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:13.421882 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1246/2468] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:13 2022] DELETE /identity/v3/users/c8a4cc06e90a48ad8fb9e3bc5019df9f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:14.575986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:14.578060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:14.596913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ecbfb-ae25-4130-b423-1dd5b9e3973f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:14.672469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:14.673137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:14.673419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:14.673698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] PATH_INFO: `/v3/projects/76c625f38b2c4eed8b54e87f703f55aa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:14.675079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c625f38b2c4eed8b54e87f703f55aa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:14.677791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:14.751022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:14.753514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c625f38b2c4eed8b54e87f703f55aa', 'request_id': 'req-88c79069-db20-4bf8-a7fa-92949ce5f03b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:14.767867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c625f38b2c4eed8b54e87f703f55aa', 'request_id': 'req-88c79069-db20-4bf8-a7fa-92949ce5f03b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:14.785945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c625f38b2c4eed8b54e87f703f55aa', 'request_id': 'req-88c79069-db20-4bf8-a7fa-92949ce5f03b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:14.814052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] The token cache is being invalidate because project 76c625f38b2c4eed8b54e87f703f55aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:14.814634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:14.815525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c79069-db20-4bf8-a7fa-92949ce5f03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:14.817992 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1223/2469] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:14 2022] DELETE /identity/v3/projects/76c625f38b2c4eed8b54e87f703f55aa => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:14.823433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:14.825105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:14.825586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:14.849617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:14.851190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:14.934003 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1247/2470] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:14.944353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:14.944710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:14.945059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:14.968770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:14.970000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:14.982867 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1224/2471] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:14.986709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.000534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d37bf-9148-4630-9d17-be00cf7cde5a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.008422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.009958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.010489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.011052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.012237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:15.012702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.015261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.033789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1248/2472] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:15.037906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.048384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5be53-b920-4859-a739-3cdfa7dde82f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.056775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.057418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.057712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.057982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.058746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.061242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.097538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1225/2473] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:15 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:15.102167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.111312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:15.117441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4b9de-cff0-48dc-8763-9caee8f56e4f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.186541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.187400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.187604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.188140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.188785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.190769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.214187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1249/2474] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:15 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:15.217064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.229814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df10e0-c3a9-4681-91b7-9023b1124d93 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.237144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.237904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.238337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.238680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.239804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.241780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.260472 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1226/2475] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:15.267293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.293130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05a4c-7f53-44a2-954f-0b79b3eccfaa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.299867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa358d-ac73-49d7-9e40-66ef8816c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.301719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa358d-ac73-49d7-9e40-66ef8816c124 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.301719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa358d-ac73-49d7-9e40-66ef8816c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.301719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa358d-ac73-49d7-9e40-66ef8816c124 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.302616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa358d-ac73-49d7-9e40-66ef8816c124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.303944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa358d-ac73-49d7-9e40-66ef8816c124 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.317866 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1250/2476] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:15.322236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.333789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c480-23f7-4550-b8c0-bc06d6491645 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.338487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.339151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.339435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.339713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] PATH_INFO: `/v3/projects/bf5f314c8ba74fd2bd66ebe39a9c7717/users/f1a5648821b84f40a9dcb303664976e3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.355681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5f314c8ba74fd2bd66ebe39a9c7717, user_id=f1a5648821b84f40a9dcb303664976e3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.358371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.372156 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1227/2477] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:15 2022] PUT /identity/v3/projects/bf5f314c8ba74fd2bd66ebe39a9c7717/users/f1a5648821b84f40a9dcb303664976e3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:15.385347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.385690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.386068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.432563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] MFA Rules not processed for user `f1a5648821b84f40a9dcb303664976e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:15.435976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:15.518193 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1251/2478] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:15.522274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.596141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be30c5-b7db-4c1c-bf10-289cc076c221 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.602956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.603824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.604115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.604392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.605039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.607190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.645902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1228/2479] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:15 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:15.647130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.662556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e065b-52cf-4554-9a90-5896c5266090 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.731027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.731674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.731957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.732238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.732885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.734929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.758366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1252/2480] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:15 2022] POST /identity/v3/users => generated 308 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:15.762442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.774202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd33bf-dbf0-448b-800e-f795d0b764e1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.779137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.779758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.780178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.780462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.781112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.782740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.795131 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1229/2481] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:15.799211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.805296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:15.811161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcb6e-382b-44d4-a4af-dd4f563befba admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.818876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.819550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.819830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.820100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] PATH_INFO: `/v3/projects/966f9c54300c469194e426da4fe53bf7/users/94346436de784a7faad8888155bb45d5/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.839870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966f9c54300c469194e426da4fe53bf7, user_id=94346436de784a7faad8888155bb45d5, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.842856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.865266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.865717 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1253/2482] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:15 2022] PUT /identity/v3/projects/966f9c54300c469194e426da4fe53bf7/users/94346436de784a7faad8888155bb45d5/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:15.875613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb92558-1890-4e13-a127-be25a73300f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.934911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:15.950955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311730-0f73-47ec-9c4d-5cfd03ef830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.951771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311730-0f73-47ec-9c4d-5cfd03ef830a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.952056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311730-0f73-47ec-9c4d-5cfd03ef830a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.952324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311730-0f73-47ec-9c4d-5cfd03ef830a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.952972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311730-0f73-47ec-9c4d-5cfd03ef830a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.954606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311730-0f73-47ec-9c4d-5cfd03ef830a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:15.969103 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1230/2483] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:15.970539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:15.982629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd690a-8795-4b0d-ae06-c31033dff085 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:15.987287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:15.987952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:15.988380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:15.989265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] PATH_INFO: `/v3/projects/966f9c54300c469194e426da4fe53bf7/users/94346436de784a7faad8888155bb45d5/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:15.991834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966f9c54300c469194e426da4fe53bf7, user_id=94346436de784a7faad8888155bb45d5, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:15.994600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:16.010733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1254/2484] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:15 2022] PUT /identity/v3/projects/966f9c54300c469194e426da4fe53bf7/users/94346436de784a7faad8888155bb45d5/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:16.021609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:16.021908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:16.022275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:16.052527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] MFA Rules not processed for user `94346436de784a7faad8888155bb45d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:16.053875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:16.140078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1231/2485] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:16.153063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:16.156237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:16.252831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2320a-62c4-4dff-8bed-09badef1a8f4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:16.262087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:16.262087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:16.262087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:16.262087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:16.271549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:16.273135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:16.283195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1255/2486] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:16 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:16.672281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:16.685594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258ae1-9b5a-4288-a5da-692c2d9bb4b5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:16.692578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0d402-5df5-4e55-b12a-f2eff6ddc6f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:16.693344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d402-5df5-4e55-b12a-f2eff6ddc6f7 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:16.693729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d402-5df5-4e55-b12a-f2eff6ddc6f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:16.694105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d402-5df5-4e55-b12a-f2eff6ddc6f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:16.755387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0d402-5df5-4e55-b12a-f2eff6ddc6f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:16.756928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0d402-5df5-4e55-b12a-f2eff6ddc6f7 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:16.766995 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1232/2487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:16 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:16.789075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:16.892109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bced506-9e87-4066-8efa-864e093cdd93 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:16.903292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:16.904492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:16.905035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:16.905569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] PATH_INFO: `/v3/users/f1a5648821b84f40a9dcb303664976e3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:16.907041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a5648821b84f40a9dcb303664976e3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:16.909228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:16.978884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a5648821b84f40a9dcb303664976e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:16.985160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:17.008884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a5648821b84f40a9dcb303664976e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:17.011641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a5648821b84f40a9dcb303664976e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:17.012717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a5648821b84f40a9dcb303664976e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:17.026565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a5648821b84f40a9dcb303664976e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:17.068171 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1256/2488] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:16 2022] DELETE /identity/v3/users/f1a5648821b84f40a9dcb303664976e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:17.072960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:17.074618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:17.074902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:17.118812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:17.120354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:17.200797 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1233/2489] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:17.224114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:17.227124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:17.346168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1e32-b1ac-418d-838e-6a6900dce3f8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:17.353168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:17.353877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:17.354190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:17.354622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:17.381411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:17.383679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:17.404419 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1257/2490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:18.147590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:18.150483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:18.174595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82ee7a-8d1f-4a83-b031-0b291b237efc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:18.180416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:18.181073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:18.181382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:18.181629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] PATH_INFO: `/v3/projects/bf5f314c8ba74fd2bd66ebe39a9c7717` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:18.182798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5f314c8ba74fd2bd66ebe39a9c7717)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:18.184716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:18.186822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:18.251475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5f314c8ba74fd2bd66ebe39a9c7717', 'request_id': 'req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.265651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5f314c8ba74fd2bd66ebe39a9c7717', 'request_id': 'req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.283969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5f314c8ba74fd2bd66ebe39a9c7717', 'request_id': 'req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.298089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] The token cache is being invalidate because project bf5f314c8ba74fd2bd66ebe39a9c7717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:18.299205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.300386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.303268 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1234/2491] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:18 2022] DELETE /identity/v3/projects/bf5f314c8ba74fd2bd66ebe39a9c7717 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:18.307044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:18.320012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62261e08-c567-4d3a-9049-23eb0c4aa045 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:18.465832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:18.467172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:18.468351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:18.468784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] PATH_INFO: `/v3/users/94346436de784a7faad8888155bb45d5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:18.471035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=94346436de784a7faad8888155bb45d5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:18.476990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:18.590036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94346436de784a7faad8888155bb45d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.616086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94346436de784a7faad8888155bb45d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.617796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94346436de784a7faad8888155bb45d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.618656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94346436de784a7faad8888155bb45d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.628003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a910888-ceec-457c-a139-b6f514d23ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94346436de784a7faad8888155bb45d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:18.630679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:18.658750 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1258/2492] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:18 2022] DELETE /identity/v3/users/94346436de784a7faad8888155bb45d5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:19.278097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.279584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:19.297069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a70a8e-59e3-4400-8df6-594d73e4b3fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.385964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.386650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.387112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.387559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] PATH_INFO: `/v3/projects/966f9c54300c469194e426da4fe53bf7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.388874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966f9c54300c469194e426da4fe53bf7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.390942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.448843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966f9c54300c469194e426da4fe53bf7', 'request_id': 'req-feb551d7-3244-4362-9c28-8aa2133e1e31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:19.454941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966f9c54300c469194e426da4fe53bf7', 'request_id': 'req-feb551d7-3244-4362-9c28-8aa2133e1e31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:19.464521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966f9c54300c469194e426da4fe53bf7', 'request_id': 'req-feb551d7-3244-4362-9c28-8aa2133e1e31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:19.486160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] The token cache is being invalidate because project 966f9c54300c469194e426da4fe53bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:19.486483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:19.487123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-feb551d7-3244-4362-9c28-8aa2133e1e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:19.491017 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1235/2493] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:19 2022] DELETE /identity/v3/projects/966f9c54300c469194e426da4fe53bf7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:19.495557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.496032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.496129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.519935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:19.521442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:19.590556 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1259/2494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:19.598478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.598770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.599049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.620176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:19.621417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:19.629791 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1236/2495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:19.634081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.643853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77be3-b7ad-4b30-be4c-432fe942d7ba None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.649644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.650281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.650566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.650842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.651491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:19.651798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.653403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.665825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1260/2496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:19.670083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.679517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bd950-ceac-4c9f-b6e1-0509fca6d03a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.684134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.684735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.685020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.685294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.685940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.687866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.699084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:19.717865 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1237/2497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:19 2022] POST /identity/v3/projects => generated 395 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:19.722215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.732945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e02dde-f880-4999-99cf-5afa627698d3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.790013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.790650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.790930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.791202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.791835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.793736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.817773 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1261/2498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:19 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:19.819079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.829252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26169c-9787-4755-922f-0eb457fe146e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.834417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.835019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.835298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.835570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.836207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.837783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.848829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1238/2499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:15:19.852540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.862756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053583-d63a-459b-9160-0bb1fe08de2f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.868297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fcb9e-4fec-489a-ab3a-242a027a2f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.868906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fcb9e-4fec-489a-ab3a-242a027a2f9c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.869196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fcb9e-4fec-489a-ab3a-242a027a2f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.869458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fcb9e-4fec-489a-ab3a-242a027a2f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.870103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fcb9e-4fec-489a-ab3a-242a027a2f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.871726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fcb9e-4fec-489a-ab3a-242a027a2f9c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.883922 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1262/2500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:19.887890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:19.898561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe4e7a-9298-4f1c-8e77-f5915e393288 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:19.903345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:19.904101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.904421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.904768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] PATH_INFO: `/v3/projects/8bb8e41503614bc3862acc564ad8b9d4/users/4c0cd21c3d004a3ab401df687c4c6a3e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.921482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e41503614bc3862acc564ad8b9d4, user_id=4c0cd21c3d004a3ab401df687c4c6a3e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:19.924431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:19.946066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1239/2501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:19 2022] PUT /identity/v3/projects/8bb8e41503614bc3862acc564ad8b9d4/users/4c0cd21c3d004a3ab401df687c4c6a3e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:19.951125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:19.951408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:19.951678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:19.977819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:19.979217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:20.052728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:20.071567 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1263/2502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:15:20.083044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:20.085256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:20.205348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2b85e-6ee3-4aee-afd9-ffa6ffffdf1f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:20.221563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd9490-fd0e-48e2-bbf5-da92cde7ea29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:20.222726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd9490-fd0e-48e2-bbf5-da92cde7ea29 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:20.223205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd9490-fd0e-48e2-bbf5-da92cde7ea29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:20.223750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd9490-fd0e-48e2-bbf5-da92cde7ea29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:20.238681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd9490-fd0e-48e2-bbf5-da92cde7ea29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:20.240568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd9490-fd0e-48e2-bbf5-da92cde7ea29 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:20.251685 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1240/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:25.663507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:25.664984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:25.693372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518734b-f878-48ec-b472-1e8640a89cf7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:25.718991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:25.719771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:25.720062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:25.720338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] PATH_INFO: `/v3/users/f2b462c4a7e54fe29b3a88ca2996f851` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:25.729287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b462c4a7e54fe29b3a88ca2996f851)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:25.731304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:25.909046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b462c4a7e54fe29b3a88ca2996f851'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:25.966377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b462c4a7e54fe29b3a88ca2996f851'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:25.967360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b462c4a7e54fe29b3a88ca2996f851'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:25.968156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b462c4a7e54fe29b3a88ca2996f851'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:25.993178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b462c4a7e54fe29b3a88ca2996f851'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:26.027520 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1264/2504] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:25 2022] DELETE /identity/v3/users/f2b462c4a7e54fe29b3a88ca2996f851 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:26.032417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:26.036791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:26.037275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:26.105753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:26.107747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:26.292111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1241/2505] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:26.301940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:26.303854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:26.493069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6fc22-c97e-43e2-a811-473da83f3522 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:26.504449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:26.505373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:26.505853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:26.506384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:26.534442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:26.536651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:26.569784 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1265/2506] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:27.338630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:27.340376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:27.374221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b2c4-d403-467d-bfc8-f9e0239b65fa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:27.392891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:27.393577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:27.395826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:27.396125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] PATH_INFO: `/v3/projects/fbbb4865e18c4263a900558df96e5441` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:27.405215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbb4865e18c4263a900558df96e5441)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:27.407207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:27.502683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbb4865e18c4263a900558df96e5441', 'request_id': 'req-6cc906fc-38ae-4fac-b428-344593ee0dbf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.511227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:27.514784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbb4865e18c4263a900558df96e5441', 'request_id': 'req-6cc906fc-38ae-4fac-b428-344593ee0dbf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.530878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbb4865e18c4263a900558df96e5441', 'request_id': 'req-6cc906fc-38ae-4fac-b428-344593ee0dbf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.547219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] The token cache is being invalidate because project fbbb4865e18c4263a900558df96e5441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:27.547583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.548468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.550972 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1242/2507] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:27 2022] DELETE /identity/v3/projects/fbbb4865e18c4263a900558df96e5441 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:27.554693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:27.572861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852ce1f-749d-4dd2-b196-9a96c10b6cc4 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:27.716441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:27.717137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:27.717423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:27.717703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] PATH_INFO: `/v3/users/b48ea9d84eed48b1803bbc5d7f667d83` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:27.719203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48ea9d84eed48b1803bbc5d7f667d83)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:27.721165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:27.741499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:27.827103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48ea9d84eed48b1803bbc5d7f667d83'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.850845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48ea9d84eed48b1803bbc5d7f667d83'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.851199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48ea9d84eed48b1803bbc5d7f667d83'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.851824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48ea9d84eed48b1803bbc5d7f667d83'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.867163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e52cdf9d-cdc8-4784-9255-6b0553f93392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48ea9d84eed48b1803bbc5d7f667d83'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:27.917781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1266/2508] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:27 2022] DELETE /identity/v3/users/b48ea9d84eed48b1803bbc5d7f667d83 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:28.818015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:28.820149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:28.842725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc906fc-38ae-4fac-b428-344593ee0dbf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:28.993214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:28.994016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:28.994403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:28.995050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] PATH_INFO: `/v3/projects/abd6677a34454cb38a877b6045ec50ef` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:28.996591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd6677a34454cb38a877b6045ec50ef)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:28.998751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:29.078389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd6677a34454cb38a877b6045ec50ef', 'request_id': 'req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:29.090601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd6677a34454cb38a877b6045ec50ef', 'request_id': 'req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:29.106558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd6677a34454cb38a877b6045ec50ef', 'request_id': 'req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:29.132044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] The token cache is being invalidate because project abd6677a34454cb38a877b6045ec50ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:29.132784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:29.134488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2fd58e3-6d36-46d0-b4be-2fff95d4caae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:29.137053 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1243/2509] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:28 2022] DELETE /identity/v3/projects/abd6677a34454cb38a877b6045ec50ef => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:29.142045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.142902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.143337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.172474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:29.174259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:29.285880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.286075 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1267/2510] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:29.286715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.287140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.321343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:29.322994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:29.346289 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1244/2511] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:29.350521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:29.362399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a1771-6375-4d28-9e3a-86d0044da41e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:29.368832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:29.369477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.369765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.370047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.370818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:29.371130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:29.372779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:29.386813 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1268/2512] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:29.391259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:29.418218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97e0d8-52e9-4a1d-999c-0ae912f699c8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:29.423118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:29.423754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.424043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.424323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.427145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:29.427785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:29.484230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:29.507445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1245/2513] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:29 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:29.516529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a124ca-2d66-4831-80c1-007f7bc08fdc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:29.670499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:29.672567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.676359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.677814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.683184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:29.695070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:29.734381 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1269/2514] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:29 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:29.737731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:29.776524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f387a-edf6-4ba5-9477-a62396695fbd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:29.792978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:29.793983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.794537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.794971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.797109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:29.800754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:29.843816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:29.851122 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1246/2515] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:29.861015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8f3c9-858d-44cd-8b76-a490a4b5754d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:29.872135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1941155-28ef-4b19-b63a-f36267c665af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:29.874079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941155-28ef-4b19-b63a-f36267c665af admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.874397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941155-28ef-4b19-b63a-f36267c665af admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.876536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1941155-28ef-4b19-b63a-f36267c665af admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.877925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1941155-28ef-4b19-b63a-f36267c665af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:29.881291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1941155-28ef-4b19-b63a-f36267c665af admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:29.887135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:29.919693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:29.920477 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1270/2516] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:29.944561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373efeb2-b126-47a4-b637-a5dea60211fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:29.960541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:29.961241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:29.961719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:29.962165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] PATH_INFO: `/v3/projects/296101d21aa942d482ea4252c06c52da/users/c66c59c103a148be8a9a0cb772c6438d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:29.994221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296101d21aa942d482ea4252c06c52da, user_id=c66c59c103a148be8a9a0cb772c6438d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:29.997343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:30.055175 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1247/2517] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:29 2022] PUT /identity/v3/projects/296101d21aa942d482ea4252c06c52da/users/c66c59c103a148be8a9a0cb772c6438d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:30.057738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:30.058033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:30.058415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:30.172863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] MFA Rules not processed for user `c66c59c103a148be8a9a0cb772c6438d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:30.177716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:30.356418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:30.361240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1271/2518] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:30.374423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:30.541743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea598c5-ed59-4d04-a690-d33ecc9381d1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:30.555361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:30.556013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:30.556300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:30.556578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:30.557233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:30.559907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:30.606881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:30.618773 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1248/2519] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:30 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:30.622076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c890fb-e534-47ea-b721-b9d0e238007f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:30.740527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c058799-8e38-41ac-a17f-ed5ad5e9da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:30.741443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058799-8e38-41ac-a17f-ed5ad5e9da00 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:30.741443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058799-8e38-41ac-a17f-ed5ad5e9da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:30.741745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058799-8e38-41ac-a17f-ed5ad5e9da00 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:30.742392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c058799-8e38-41ac-a17f-ed5ad5e9da00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:30.744369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c058799-8e38-41ac-a17f-ed5ad5e9da00 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:30.809989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:30.817785 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1272/2520] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:30 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:30.821875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c85d3-0e51-4ae5-afa5-639b512ac04f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:30.836763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:30.838401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:30.838891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:30.839426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:30.840320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:30.842502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:30.867504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1249/2521] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:30.875942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad0c7-9810-438e-9c4b-23cf76c7beb8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:30.876254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad0c7-9810-438e-9c4b-23cf76c7beb8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:30.876674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad0c7-9810-438e-9c4b-23cf76c7beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:30.881492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:30.908291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac556f-01a8-408b-8c65-abc85470abb4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:30.919875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:30.920897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:30.921400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:30.921892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] PATH_INFO: `/v3/projects/c16818f58f0849cf9eb8f6fb75413a56/users/dcbedb83d8e047009f4b42905ebe33a0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:30.936849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b56ad0c7-9810-438e-9c4b-23cf76c7beb8 None None] MFA Rules not processed for user `4c0cd21c3d004a3ab401df687c4c6a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:30.938838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b56ad0c7-9810-438e-9c4b-23cf76c7beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:30.944473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16818f58f0849cf9eb8f6fb75413a56, user_id=dcbedb83d8e047009f4b42905ebe33a0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:30.947585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:30.970995 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1250/2522] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:30 2022] PUT /identity/v3/projects/c16818f58f0849cf9eb8f6fb75413a56/users/dcbedb83d8e047009f4b42905ebe33a0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:30.975021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:31.051338 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1273/2523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:31.062056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366c195-0cc4-4b21-94e9-7dad7dff425f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:31.063675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.064082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.064686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.069186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:31.070011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.070492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.070932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.071590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:31.073348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:31.087338 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1251/2524] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:31.091659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:31.101341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:31.104818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f11c89-636d-4517-901a-24a238d86d1a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:31.109483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] MFA Rules not processed for user `4c0cd21c3d004a3ab401df687c4c6a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:31.111466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:31.111785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a90550-c7a8-4b16-aa52-313f087773d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:31.112497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90550-c7a8-4b16-aa52-313f087773d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.113123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90550-c7a8-4b16-aa52-313f087773d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.113289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90550-c7a8-4b16-aa52-313f087773d9 admin admin] PATH_INFO: `/v3/projects/c16818f58f0849cf9eb8f6fb75413a56/users/dcbedb83d8e047009f4b42905ebe33a0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.115913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a90550-c7a8-4b16-aa52-313f087773d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16818f58f0849cf9eb8f6fb75413a56, user_id=dcbedb83d8e047009f4b42905ebe33a0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:31.118820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a90550-c7a8-4b16-aa52-313f087773d9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:31.134014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1252/2525] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:31 2022] PUT /identity/v3/projects/c16818f58f0849cf9eb8f6fb75413a56/users/dcbedb83d8e047009f4b42905ebe33a0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:31.144998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e0e0-5e6b-431e-864a-e385cd38057a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.145231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e0e0-5e6b-431e-864a-e385cd38057a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.145497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e0e0-5e6b-431e-864a-e385cd38057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.192584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1274/2526] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:31.204117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:31.205552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:31.212389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2a99e0e0-5e6b-431e-864a-e385cd38057a None None] MFA Rules not processed for user `dcbedb83d8e047009f4b42905ebe33a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:31.214001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a99e0e0-5e6b-431e-864a-e385cd38057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:31.265481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:31.336913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78cc7a-ccf7-4fb7-8879-f0104c0db7de None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:31.338527 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1253/2527] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:31.352644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.352932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.353209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.392905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] MFA Rules not processed for user `c66c59c103a148be8a9a0cb772c6438d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:31.394368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:31.483864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f027ca-e1e5-4751-825c-4ad4246d54df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:31.484983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f027ca-e1e5-4751-825c-4ad4246d54df service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.485420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f027ca-e1e5-4751-825c-4ad4246d54df service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.485879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f027ca-e1e5-4751-825c-4ad4246d54df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.494967 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1254/2528] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:15:31.554710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:31.571289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f027ca-e1e5-4751-825c-4ad4246d54df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:31.573216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f027ca-e1e5-4751-825c-4ad4246d54df service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:31.590206 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1275/2529] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:31 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:15:31.631539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:31.633458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:31.666117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5c02f-a872-4961-a88e-18bbe5a665de None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:31.674684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee6cb2-8a0f-43e9-9e25-27dbc72577a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:31.676162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee6cb2-8a0f-43e9-9e25-27dbc72577a4 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:31.676713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee6cb2-8a0f-43e9-9e25-27dbc72577a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:31.677218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee6cb2-8a0f-43e9-9e25-27dbc72577a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:31.687392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee6cb2-8a0f-43e9-9e25-27dbc72577a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:31.691177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee6cb2-8a0f-43e9-9e25-27dbc72577a4 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:31.702460 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1255/2530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:34.854959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:34.856670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:34.856670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:34.898857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] MFA Rules not processed for user `e478de82935c4f9b93a698e3fa3c6d78`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:34.900215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:34.992661 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1276/2531] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:41.698228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=46 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:44.979228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=31 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:46.424596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f00a20-1efe-457b-b155-c83438b40559 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:46.425814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f00a20-1efe-457b-b155-c83438b40559 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:46.425814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f00a20-1efe-457b-b155-c83438b40559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:46.445593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-36f00a20-1efe-457b-b155-c83438b40559 None None] MFA Rules not processed for user `4c0cd21c3d004a3ab401df687c4c6a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:46.446880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-36f00a20-1efe-457b-b155-c83438b40559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:46.453940 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1256/2532] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:47.033348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:47.034368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:47.132238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceeeb1b-a573-4819-b10a-16c77b27da9d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:47.138884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:47.139819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:47.140259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:47.140850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] PATH_INFO: `/v3/users/c5c42a5f4ca54a25b6e39ba9857295b8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:47.142671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c42a5f4ca54a25b6e39ba9857295b8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:47.147898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:47.240572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c42a5f4ca54a25b6e39ba9857295b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:47.267312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c42a5f4ca54a25b6e39ba9857295b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:47.269396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c42a5f4ca54a25b6e39ba9857295b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:47.271149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c42a5f4ca54a25b6e39ba9857295b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:47.294747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c42a5f4ca54a25b6e39ba9857295b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:47.328997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1277/2533] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:47 2022] DELETE /identity/v3/users/c5c42a5f4ca54a25b6e39ba9857295b8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:47.334602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:47.334954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:47.335236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:47.374324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:47.375849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:47.494511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1257/2534] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:47.507037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:47.508699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:47.587179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aa7cc-9603-41a4-9b29-10d0f9e4ace7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:47.591395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:47.592404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:47.592872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:47.593359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:47.610499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:47.612303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:47.625914 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1278/2535] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:48.130291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:48.131875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:48.146267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad975e10-6c5c-433b-a49e-dea4ec1b3811 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:48.180438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:48.181449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:48.181734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:48.182015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] PATH_INFO: `/v3/projects/5b589c02db3f41d486cb86a55bfab2bc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:48.186064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b589c02db3f41d486cb86a55bfab2bc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:48.189458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:48.316673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b589c02db3f41d486cb86a55bfab2bc', 'request_id': 'req-a8ed1887-315f-44f9-aafe-a559849a3570'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.332011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b589c02db3f41d486cb86a55bfab2bc', 'request_id': 'req-a8ed1887-315f-44f9-aafe-a559849a3570'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.347353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b589c02db3f41d486cb86a55bfab2bc', 'request_id': 'req-a8ed1887-315f-44f9-aafe-a559849a3570'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.377175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] The token cache is being invalidate because project 5b589c02db3f41d486cb86a55bfab2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:48.382522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.384372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.391125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:48.392921 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1258/2536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:48 2022] DELETE /identity/v3/projects/5b589c02db3f41d486cb86a55bfab2bc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:48.410067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9fe27-6a51-4060-a868-0a229aa97993 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:48.451278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:48.505416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:48.506128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:48.506594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:48.506993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] PATH_INFO: `/v3/users/b876ba682a714ca89a35b989e04745b0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:48.508278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b876ba682a714ca89a35b989e04745b0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:48.510298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:48.576079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b876ba682a714ca89a35b989e04745b0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.596332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b876ba682a714ca89a35b989e04745b0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.598375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b876ba682a714ca89a35b989e04745b0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.599152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b876ba682a714ca89a35b989e04745b0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.614546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac4ad325-a0e1-452f-9ab5-9441e2ccc7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b876ba682a714ca89a35b989e04745b0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:48.643000 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1279/2537] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:48 2022] DELETE /identity/v3/users/b876ba682a714ca89a35b989e04745b0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:48.885093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:48.887292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:48.902930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1887-315f-44f9-aafe-a559849a3570 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.011140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.012441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.012922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.013520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] PATH_INFO: `/v3/projects/fb5c670be8544923987e02e1cd3ed7bd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.016324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5c670be8544923987e02e1cd3ed7bd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.020670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.053138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:49.087136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5c670be8544923987e02e1cd3ed7bd', 'request_id': 'req-d0e686c6-c32c-4d52-a7da-6419c6807feb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:49.093609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5c670be8544923987e02e1cd3ed7bd', 'request_id': 'req-d0e686c6-c32c-4d52-a7da-6419c6807feb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:49.102056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5c670be8544923987e02e1cd3ed7bd', 'request_id': 'req-d0e686c6-c32c-4d52-a7da-6419c6807feb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:49.118405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] The token cache is being invalidate because project fb5c670be8544923987e02e1cd3ed7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:49.118689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:49.119591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e686c6-c32c-4d52-a7da-6419c6807feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:49.121902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1259/2538] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:48 2022] DELETE /identity/v3/projects/fb5c670be8544923987e02e1cd3ed7bd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:49.126765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.127022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.127428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.153438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:49.154786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:49.241370 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1280/2539] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:49.248886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.249412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.249840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.296831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:49.298426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:49.313754 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1260/2540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:49.318019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:49.335033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86371-1e43-46b8-ab13-75e996d74d5a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.341169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.341913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.342339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.342714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.343510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:49.343998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.345855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.362183 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1281/2541] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:49.368515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:49.389713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675049f7-0c79-4256-9b50-db3871d173ce None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.395697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.396627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.397098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.397588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.399144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.401290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.444948 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1261/2542] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:49 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:49.448525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:49.464505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bde518-7126-4e3a-bec8-9246cf22884d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.519593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:49.568603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.569649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.570196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.570666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.571757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.574460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.606204 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1282/2543] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:49 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:49.609963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:49.638517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f009-3d6a-4f31-8b91-fdf2bbcbd27d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.645721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.646543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.646909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.647460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.648367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.654795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.677075 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1262/2544] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:49.680710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:49.695333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2651bc1-4c72-4f39-b27c-ef60e451bf3a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.703017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844879-2207-4fcb-b0d0-a1f335a89462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.703668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844879-2207-4fcb-b0d0-a1f335a89462 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.703952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844879-2207-4fcb-b0d0-a1f335a89462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.704230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844879-2207-4fcb-b0d0-a1f335a89462 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.705593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844879-2207-4fcb-b0d0-a1f335a89462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.708015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844879-2207-4fcb-b0d0-a1f335a89462 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.726460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1283/2545] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:49.730979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:49.747387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1866b-10b5-4661-a6d2-651d735cdb13 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:49.754490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:49.755385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.755852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.756829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] PATH_INFO: `/v3/projects/1d80968809a84715a7d8cb6abc8e6b49/users/c2fd2abad1824b79b27bb419d8656150/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.820203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d80968809a84715a7d8cb6abc8e6b49, user_id=c2fd2abad1824b79b27bb419d8656150, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:49.822061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:49.854194 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1263/2546] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:49 2022] PUT /identity/v3/projects/1d80968809a84715a7d8cb6abc8e6b49/users/c2fd2abad1824b79b27bb419d8656150/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:49.863444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:49.863735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:49.864612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:49.931735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] MFA Rules not processed for user `c2fd2abad1824b79b27bb419d8656150`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:49.934074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:50.053838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:50.054350 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1284/2547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:50.163019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4251b-4ea0-4a5f-941e-97c3abb099dd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:50.168815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:50.169645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.169995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.170361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.171519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:50.174112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:50.215755 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1264/2548] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:50 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:50.223400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:50.259656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf97db9-740f-4dbf-8d23-fad7c417ac7c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:50.365242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:50.366013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.366402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.366748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.368277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:50.371342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:50.424564 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1285/2549] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:50 2022] POST /identity/v3/users => generated 303 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:50.430603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:50.447473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e823f-b67d-4c7b-9690-01a0d09c9963 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:50.455502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:50.457383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.457383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.457916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.458918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:50.462204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:50.477047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1265/2550] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:50.481113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:50.495696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37785-c8da-4d49-ba9b-62eb0b911333 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:50.503487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5965e7-51a9-4c59-84c1-a695ff249c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:50.504187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5965e7-51a9-4c59-84c1-a695ff249c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.504471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5965e7-51a9-4c59-84c1-a695ff249c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.504752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5965e7-51a9-4c59-84c1-a695ff249c3d admin admin] PATH_INFO: `/v3/projects/5f302b498abd4d5e87b308668fcc4c56/users/b30d5c5fc0704d6ea0079f48af5ab617/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.529515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5965e7-51a9-4c59-84c1-a695ff249c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f302b498abd4d5e87b308668fcc4c56, user_id=b30d5c5fc0704d6ea0079f48af5ab617, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:50.534032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5965e7-51a9-4c59-84c1-a695ff249c3d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:50.559070 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1286/2551] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:50 2022] PUT /identity/v3/projects/5f302b498abd4d5e87b308668fcc4c56/users/b30d5c5fc0704d6ea0079f48af5ab617/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:50.563982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:50.586690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0bf0-ebec-4c5b-8a38-a71f0070893b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:50.598000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9bd71-457c-43f0-803c-decff837ffe8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.598340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9bd71-457c-43f0-803c-decff837ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.598659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9bd71-457c-43f0-803c-decff837ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.612409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:50.615891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:50.644507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a5b9bd71-457c-43f0-803c-decff837ffe8 None None] MFA Rules not processed for user `614a5366d0d14df6b7ab4530882646f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:50.647908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a5b9bd71-457c-43f0-803c-decff837ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:50.693870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:50.694781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.694959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.695266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.696008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:50.697709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:50.755133 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1266/2552] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:50.756242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:50.775770 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1287/2553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:15:50.799245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2308-edad-46a6-bad3-ee8aed98b9a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:50.816239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410046-1cef-42ce-8728-12fd6b3a073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:50.817850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410046-1cef-42ce-8728-12fd6b3a073a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.818973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410046-1cef-42ce-8728-12fd6b3a073a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.819706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410046-1cef-42ce-8728-12fd6b3a073a admin admin] PATH_INFO: `/v3/projects/5f302b498abd4d5e87b308668fcc4c56/users/b30d5c5fc0704d6ea0079f48af5ab617/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.838589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410046-1cef-42ce-8728-12fd6b3a073a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f302b498abd4d5e87b308668fcc4c56, user_id=b30d5c5fc0704d6ea0079f48af5ab617, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:50.849951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37410046-1cef-42ce-8728-12fd6b3a073a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:50.881198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1267/2554] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:50 2022] PUT /identity/v3/projects/5f302b498abd4d5e87b308668fcc4c56/users/b30d5c5fc0704d6ea0079f48af5ab617/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:50.891483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:50.891962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:50.892323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:50.965937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] MFA Rules not processed for user `b30d5c5fc0704d6ea0079f48af5ab617`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:50.967743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:51.080602 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1288/2555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:51.170605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:51.171579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:51.172071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:51.214231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] MFA Rules not processed for user `c2fd2abad1824b79b27bb419d8656150`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:51.215570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:51.364301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1268/2556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:15:52.019402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:52.021037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:52.169318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83923863-bbf9-4e99-8559-8b53cd1ee062 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:52.177984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192d3f-d7dc-4839-995c-ab15dd2dc221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:52.178659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192d3f-d7dc-4839-995c-ab15dd2dc221 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:52.178944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192d3f-d7dc-4839-995c-ab15dd2dc221 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:52.179223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192d3f-d7dc-4839-995c-ab15dd2dc221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:52.189893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192d3f-d7dc-4839-995c-ab15dd2dc221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:52.195189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192d3f-d7dc-4839-995c-ab15dd2dc221 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:52.243636 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1289/2557] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:53.171180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:53.172804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:53.197929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70b712-0dec-4c7a-8d01-6abcb76d5800 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:53.216865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:53.217539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:53.217851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:53.218178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:53.224442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:53.341771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:53.343504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:53.356566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1269/2558] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:53.395582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:53.396972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:53.397440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:53.439013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] MFA Rules not processed for user `c66c59c103a148be8a9a0cb772c6438d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:53.442922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:53.480814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:53.567117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1290/2559] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:54.198670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:54.201134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:54.321071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:54.393556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853133c7-2bf5-49f9-92ea-4f1c34256bae service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:54.408541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:54.409260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:54.410323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:54.410828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] PATH_INFO: `/v3/users/e4e7e76f22554a3da4be7b2770b5a319` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:54.415414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e7e76f22554a3da4be7b2770b5a319)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:54.417568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:54.542600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e7e76f22554a3da4be7b2770b5a319'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:54.557319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e7e76f22554a3da4be7b2770b5a319'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:54.558443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e7e76f22554a3da4be7b2770b5a319'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:54.559220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e7e76f22554a3da4be7b2770b5a319'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:54.573132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96007104-3a15-4a2f-9bfc-fea7af54f5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e7e76f22554a3da4be7b2770b5a319'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:54.601157 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1270/2560] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:54 2022] DELETE /identity/v3/users/e4e7e76f22554a3da4be7b2770b5a319 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:54.950525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:54.966387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c7c8-1adb-42dd-9069-b74decba1442 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.068904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.069844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.070183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.070564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] PATH_INFO: `/v3/projects/56ea783448444694b81e03919127269a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.075210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ea783448444694b81e03919127269a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.077342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.141578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ea783448444694b81e03919127269a', 'request_id': 'req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:55.150464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ea783448444694b81e03919127269a', 'request_id': 'req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:55.159010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ea783448444694b81e03919127269a', 'request_id': 'req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:55.176755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] The token cache is being invalidate because project 56ea783448444694b81e03919127269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:55.177314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:55.178351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4fff6fc5-d15d-4bdd-8e8d-e63aeba30677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:55.180744 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1291/2561] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:54 2022] DELETE /identity/v3/projects/56ea783448444694b81e03919127269a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:55.187095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.187095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.187390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.211746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:55.213670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:55.311072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1271/2562] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:55.320295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.320584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.320947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.343149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:55.344461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:55.357521 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1292/2563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:55.358916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.370184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb58e-be82-466a-b019-81b79adc4061 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.375719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.376492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.376837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.377118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.377813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:55.378695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.380916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.393479 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1272/2564] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:15:55.398488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.408070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb71aa-5cae-4e57-99c6-4aa2f4cff38e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.413207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.413816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.414095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.414403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.415038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.417170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.469411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1293/2565] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:55 2022] POST /identity/v3/projects => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:55.474021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.485100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed390-38ed-4bd7-87ff-3ce0a863b19b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.533950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:55.549307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.550457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.550766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.551044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.551854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.553822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.583255 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1273/2566] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:55 2022] POST /identity/v3/users => generated 281 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:15:55.586809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.600840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee8b25-e3de-4db9-8abd-c8f360807b2a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.606418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.607027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.607367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.609066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.609066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.610063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.622254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1294/2567] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:55.631587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.643464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243cc6-2f95-4c5f-8d50-d02f38b2a183 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.649888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2fba-500d-42e4-86a0-c96afac88582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.650900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2fba-500d-42e4-86a0-c96afac88582 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.651353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2fba-500d-42e4-86a0-c96afac88582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.651783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2fba-500d-42e4-86a0-c96afac88582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.652600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c2fba-500d-42e4-86a0-c96afac88582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.654574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c2fba-500d-42e4-86a0-c96afac88582 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.670311 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1274/2568] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:55.672781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.685875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354626d9-82ce-4584-a200-515ebc6a8fe4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.692285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.693475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.694128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.695415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] PATH_INFO: `/v3/projects/9c6dcad86c8344f19dbe8b4e5217ff6c/users/5a030c315abe4020922e7de907bbcc3a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.710929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:55.717036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6dcad86c8344f19dbe8b4e5217ff6c, user_id=5a030c315abe4020922e7de907bbcc3a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.720032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.735705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1295/2569] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:55 2022] PUT /identity/v3/projects/9c6dcad86c8344f19dbe8b4e5217ff6c/users/5a030c315abe4020922e7de907bbcc3a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:55.747694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.747987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.748267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.777343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] MFA Rules not processed for user `5a030c315abe4020922e7de907bbcc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:55.778598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:55.846372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1275/2570] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:55.861148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:55.863044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:55.944155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db090dc1-304d-4f97-b61b-4a0c476aff2c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:55.949722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c664a-982a-4c66-92d9-18aeba31e5ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:55.950360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c664a-982a-4c66-92d9-18aeba31e5ed service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:55.950646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c664a-982a-4c66-92d9-18aeba31e5ed service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:55.951177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c664a-982a-4c66-92d9-18aeba31e5ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:55.959476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c664a-982a-4c66-92d9-18aeba31e5ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:55.961182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c664a-982a-4c66-92d9-18aeba31e5ed service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:55.972916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1296/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:15:56.021310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:56.144622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549656b1-5ade-4558-931f-ce4ebc6bbdeb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:56.153824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:56.153824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:56.153824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:56.153824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] PATH_INFO: `/v3/users/5a030c315abe4020922e7de907bbcc3a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:56.155784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a030c315abe4020922e7de907bbcc3a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:56.157264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:56.262172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a030c315abe4020922e7de907bbcc3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:56.292384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a030c315abe4020922e7de907bbcc3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:56.294077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a030c315abe4020922e7de907bbcc3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:56.295514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a030c315abe4020922e7de907bbcc3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:56.301594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:56.313542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a030c315abe4020922e7de907bbcc3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:56.344088 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1276/2572] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:15:56 2022] DELETE /identity/v3/users/5a030c315abe4020922e7de907bbcc3a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:56.348822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:56.349098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:56.349595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:56.371630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:56.372936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:56.433460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1297/2573] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:56.444223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:56.445642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:56.510318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba11dbb-f26f-49ce-b4d2-2cb54e16360c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:56.514019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c074010-1a65-49de-994d-ff3976807da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:56.514666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c074010-1a65-49de-994d-ff3976807da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:56.514942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c074010-1a65-49de-994d-ff3976807da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:56.515213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c074010-1a65-49de-994d-ff3976807da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:56.527128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c074010-1a65-49de-994d-ff3976807da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:56.528620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c074010-1a65-49de-994d-ff3976807da9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:56.546311 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1277/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:57.122520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.122520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:57.129707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8801fc-a97e-4bdd-a4ce-3aaf7102df43 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.135958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.136881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.137402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.137884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] PATH_INFO: `/v3/projects/9c6dcad86c8344f19dbe8b4e5217ff6c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.140627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6dcad86c8344f19dbe8b4e5217ff6c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.143501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.244686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6dcad86c8344f19dbe8b4e5217ff6c', 'request_id': 'req-b7346ed0-c201-4e75-aded-b4d6c7c44231'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:57.270941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6dcad86c8344f19dbe8b4e5217ff6c', 'request_id': 'req-b7346ed0-c201-4e75-aded-b4d6c7c44231'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:57.279411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6dcad86c8344f19dbe8b4e5217ff6c', 'request_id': 'req-b7346ed0-c201-4e75-aded-b4d6c7c44231'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:57.302511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:57.310831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] The token cache is being invalidate because project 9c6dcad86c8344f19dbe8b4e5217ff6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:15:57.311658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:57.312930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7346ed0-c201-4e75-aded-b4d6c7c44231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:15:57.315346 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1298/2575] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:15:57 2022] DELETE /identity/v3/projects/9c6dcad86c8344f19dbe8b4e5217ff6c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:15:57.321303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.321858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.321858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.363338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:57.369606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:57.490704 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1278/2576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:15:57.492618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.493075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.493364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.517082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:57.518351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:57.530016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1299/2577] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:15:57.531122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.542125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33964f-0d4d-4f01-b08d-7f578ed1523a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.547014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.547642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.547946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.548233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.549137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:15:57.549259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.551633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.566820 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1279/2578] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:15:57.571351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.581420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1177-8e82-4f7b-92b3-1924910f2107 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.587261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.588103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.588543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.588963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.589765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.592242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.628847 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1300/2579] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:15:57 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:57.633187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.651391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb2b6-4b57-4df6-832e-d2e8951b8c8f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.735907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.736734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.738213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.738592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.739437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.743776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.755105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:15:57.789621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1280/2580] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:15:57 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:15:57.790935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.815725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3a4a-eb59-4318-b785-e0bb2c5224d4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.829624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.831124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.832381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.832768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.833683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.835660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.855563 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1301/2581] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:15:57.860011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.881237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc069-94b9-4c7e-9532-75ecb8a5424c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.887823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68a3d7-73a1-4ba6-afc2-8c20f3695675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.888505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a3d7-73a1-4ba6-afc2-8c20f3695675 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.888871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a3d7-73a1-4ba6-afc2-8c20f3695675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.889151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a3d7-73a1-4ba6-afc2-8c20f3695675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.889891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68a3d7-73a1-4ba6-afc2-8c20f3695675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.891752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68a3d7-73a1-4ba6-afc2-8c20f3695675 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.910071 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1281/2582] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:15:57.911859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:57.924442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527b754-761b-487d-8342-dfe6b50ffbc9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:57.931946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:57.932633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.932919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.933174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] PATH_INFO: `/v3/projects/7c554b46f5c24a34a3edab02daeb9784/users/9f4787f2bbef478b833f2f4613879578/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:57.953923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c554b46f5c24a34a3edab02daeb9784, user_id=9f4787f2bbef478b833f2f4613879578, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:57.957237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:57.976941 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1302/2583] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:15:57 2022] PUT /identity/v3/projects/7c554b46f5c24a34a3edab02daeb9784/users/9f4787f2bbef478b833f2f4613879578/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:15:57.982250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:57.983057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:57.983338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:58.029050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:15:58.030428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:58.130845 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1282/2584] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:15:58.162681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:58.164437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:58.304699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4252a-0d2d-4e33-8e52-ee61b6b5ee18 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:15:58.313154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01206-fe6f-4e20-b851-723b3da9d204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:15:58.313802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01206-fe6f-4e20-b851-723b3da9d204 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:15:58.314094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01206-fe6f-4e20-b851-723b3da9d204 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:15:58.314397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01206-fe6f-4e20-b851-723b3da9d204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:15:58.378046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba01206-fe6f-4e20-b851-723b3da9d204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:15:58.385468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba01206-fe6f-4e20-b851-723b3da9d204 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:15:58.426579 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1303/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:15:59.817772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:15:59.820172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:15:59.987996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace46a-8061-46af-9285-95cc4f012701 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:00.017877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:00.020594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:00.021103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:00.021828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:00.025773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:00.229043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:00.231315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:00.302181 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1283/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:15:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:08.408438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:08.725862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718204-007b-4e44-ac2b-6d5b6d2a8bcd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:08.726164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718204-007b-4e44-ac2b-6d5b6d2a8bcd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:08.726629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718204-007b-4e44-ac2b-6d5b6d2a8bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:08.768134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-99718204-007b-4e44-ac2b-6d5b6d2a8bcd None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:08.771267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99718204-007b-4e44-ac2b-6d5b6d2a8bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:08.906867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1304/2587] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:16:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:09.005727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:09.008082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:09.046774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:09.147663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a314-e6ba-4ace-baa9-574c86a05f79 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:09.153854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:09.154666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:09.155042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:09.155609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:09.180726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:09.182767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:09.200145 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1284/2588] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:16:13.672659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:13.673529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:13.673966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:13.708274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] MFA Rules not processed for user `9f4787f2bbef478b833f2f4613879578`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:13.709780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:13.795941 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1305/2589] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:13.958880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:13.961553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:14.023424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37752a-1da3-4522-855c-d730c8d7c1c9 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:14.060853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3d395-c41d-463f-a3bb-6fa140119a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:14.060853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3d395-c41d-463f-a3bb-6fa140119a7c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:14.060853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3d395-c41d-463f-a3bb-6fa140119a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:14.060853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3d395-c41d-463f-a3bb-6fa140119a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:14.077085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3d395-c41d-463f-a3bb-6fa140119a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:14.084754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3d395-c41d-463f-a3bb-6fa140119a7c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:14.106990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1285/2590] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:18.517019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:18.536873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9853f6-7dd6-4372-97ec-6ff0007d8df8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:18.548056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:18.548846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:18.551359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:18.551589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:18.558361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:18.626125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:18.626125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:18.629579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:18.630058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:18.630058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:18.666562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1306/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:18.684405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] MFA Rules not processed for user `9f4787f2bbef478b833f2f4613879578`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:18.692760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:18.725920 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1286/2592] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:19.113345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:19.115057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:19.205140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5818c72-d553-4e6a-844e-bd7496c2dc80 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:19.212783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:19.213451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:19.213736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:19.214061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:19.216758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:19.235432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:19.238942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:19.279172 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1307/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:20.391919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:20.394598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:20.512263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875b345-5110-4f0c-82f4-14500e5a24c3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:20.520548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:20.521194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:20.521632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:20.522361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:20.526356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:20.568834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:20.571536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d7dc9-0b42-47d6-bf61-c750628ba7b2 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:20.600900 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1287/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:27.052014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:27.053642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:27.090974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf802d-589b-4307-98ab-6db29a4e989a service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:27.111373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:27.111998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:27.112410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:27.112790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:27.115127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:27.133485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:27.136634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:27.154997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1308/2595] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:29.367284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171fcc-6146-4cca-bb9d-18823b53d2d5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:29.367840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171fcc-6146-4cca-bb9d-18823b53d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:29.368061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7171fcc-6146-4cca-bb9d-18823b53d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:29.393466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d7171fcc-6146-4cca-bb9d-18823b53d2d5 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:29.394944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d7171fcc-6146-4cca-bb9d-18823b53d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:29.403519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1288/2596] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:16:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:29.417827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:29.432598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba3d8-4e5d-4db4-98c5-3301b052dc61 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:29.438917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:29.439566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:29.440038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:29.441246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:29.454973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:29.457127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:29.460972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:29.473774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1309/2597] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:16:30.326705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2ead5-37f7-4dbd-b107-5ecad1914e91 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:30.326989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2ead5-37f7-4dbd-b107-5ecad1914e91 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:30.327501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2ead5-37f7-4dbd-b107-5ecad1914e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:30.353102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5ce2ead5-37f7-4dbd-b107-5ecad1914e91 None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:30.354828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5ce2ead5-37f7-4dbd-b107-5ecad1914e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:30.448552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1289/2598] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:34.462432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:34.475694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441bbcb-cbe4-4d3e-a650-b93e16d03c1a service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:34.482395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:34.483096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:34.483668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:34.484247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:34.486748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:34.505567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:34.507878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:34.543642 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1310/2599] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:35.950892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:35.954474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:35.954776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:36.016719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:36.034430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:36.059380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1290/2600] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:16:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:36.087123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:36.104621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a931d-9f39-48c2-abd1-7daa66c1ba5d service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:36.112952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaebc5b-b935-42ff-87fb-2c051a74562d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:36.114234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaebc5b-b935-42ff-87fb-2c051a74562d service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:36.114719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaebc5b-b935-42ff-87fb-2c051a74562d service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:36.115232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaebc5b-b935-42ff-87fb-2c051a74562d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:36.128382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaebc5b-b935-42ff-87fb-2c051a74562d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:36.132021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaebc5b-b935-42ff-87fb-2c051a74562d service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:36.152943 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1311/2601] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:16:37.904069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:37.907263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:37.977629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d952d3-d702-485d-a6da-da16467b1145 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:37.993277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:37.994053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:37.995006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:37.995310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] PATH_INFO: `/v3/users/c66c59c103a148be8a9a0cb772c6438d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:37.998005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66c59c103a148be8a9a0cb772c6438d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:38.000208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:38.008165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:38.127099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66c59c103a148be8a9a0cb772c6438d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:38.141897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66c59c103a148be8a9a0cb772c6438d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:38.148237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66c59c103a148be8a9a0cb772c6438d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:38.151360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66c59c103a148be8a9a0cb772c6438d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:38.166409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66c59c103a148be8a9a0cb772c6438d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:38.214740 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1291/2602] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:37 2022] DELETE /identity/v3/users/c66c59c103a148be8a9a0cb772c6438d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:38.215609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:38.216096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:38.216219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:38.267382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:38.269123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:38.421709 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1312/2603] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:16:38.467947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:38.470109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:38.579443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dbd15-09a1-419f-82bf-f8f821f791fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:38.585184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:38.586069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:38.586713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:38.587219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:38.601982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:38.604798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:38.629210 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1292/2604] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:40.317264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:40.319347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:40.342632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac590b9-06d0-4c28-a66c-f71f3b998156 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:40.373394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:40.374516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:40.375010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:40.375522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] PATH_INFO: `/v3/projects/296101d21aa942d482ea4252c06c52da` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:40.377108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296101d21aa942d482ea4252c06c52da)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:40.380263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:40.494630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296101d21aa942d482ea4252c06c52da', 'request_id': 'req-05e095d1-856a-48a5-b39b-30a5e9146256'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.502264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296101d21aa942d482ea4252c06c52da', 'request_id': 'req-05e095d1-856a-48a5-b39b-30a5e9146256'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.512237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296101d21aa942d482ea4252c06c52da', 'request_id': 'req-05e095d1-856a-48a5-b39b-30a5e9146256'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.540938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] The token cache is being invalidate because project 296101d21aa942d482ea4252c06c52da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:16:40.541855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.543235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.546380 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1313/2605] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:16:40 2022] DELETE /identity/v3/projects/296101d21aa942d482ea4252c06c52da => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:16:40.550977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:40.564326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00611-638d-4222-9140-49621ca3ee0a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:40.701728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:40.702679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:40.703137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:40.703556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] PATH_INFO: `/v3/users/dcbedb83d8e047009f4b42905ebe33a0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:40.706612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbedb83d8e047009f4b42905ebe33a0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:40.708771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:40.767542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:40.863015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbedb83d8e047009f4b42905ebe33a0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.877989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbedb83d8e047009f4b42905ebe33a0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.881603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbedb83d8e047009f4b42905ebe33a0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.883291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbedb83d8e047009f4b42905ebe33a0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.898342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a27750f0-912d-48ba-8940-c78f1e5eb120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbedb83d8e047009f4b42905ebe33a0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:40.924397 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1293/2606] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:40 2022] DELETE /identity/v3/users/dcbedb83d8e047009f4b42905ebe33a0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:41.199420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:41.201105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:41.233701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e095d1-856a-48a5-b39b-30a5e9146256 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:41.348764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:41.363784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:41.365281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:41.366089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:41.366607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] PATH_INFO: `/v3/projects/c16818f58f0849cf9eb8f6fb75413a56` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:41.371130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16818f58f0849cf9eb8f6fb75413a56)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:41.375360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:41.477843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16818f58f0849cf9eb8f6fb75413a56', 'request_id': 'req-8238aceb-e04d-4474-9c77-0db41bbbc02f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:41.486049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16818f58f0849cf9eb8f6fb75413a56', 'request_id': 'req-8238aceb-e04d-4474-9c77-0db41bbbc02f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:41.493417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16818f58f0849cf9eb8f6fb75413a56', 'request_id': 'req-8238aceb-e04d-4474-9c77-0db41bbbc02f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:41.543019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] The token cache is being invalidate because project c16818f58f0849cf9eb8f6fb75413a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:16:41.547847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:41.551290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8238aceb-e04d-4474-9c77-0db41bbbc02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:41.556308 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1314/2607] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:16:41 2022] DELETE /identity/v3/projects/c16818f58f0849cf9eb8f6fb75413a56 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:41.562227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:41.562737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:41.562823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:41.601404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:41.602676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:41.751038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1294/2608] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:41.759291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:41.759575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:41.759848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:41.788781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:41.789998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:41.803132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1315/2609] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:16:41.807279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:41.819093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68637e-0840-4635-8f6f-52c23896494c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:41.829197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:41.830283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:41.831782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:41.832331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:41.833385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:16:41.833925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:41.835915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:41.866372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:41.867355 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1295/2610] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:16:41.878281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c25e8c-9948-4ffd-8dd5-e01ac1245052 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:41.886732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:41.887708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:41.888100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:41.888460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:41.889222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:41.891435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:41.935186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:41.947869 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1316/2611] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:16:41 2022] POST /identity/v3/projects => generated 397 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:41.961388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d58c4e-f609-47d2-a6bb-d8d1b4bb6dd9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:42.058951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:42.059783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:42.060166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:42.060541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:42.061338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:42.066679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:42.116099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1296/2612] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:16:41 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:42.116874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:42.139609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09643a-e557-424a-9061-c0c8f1653810 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:42.149187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:42.158427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:42.158697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:42.159056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:42.160071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:42.181359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:42.234446 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1317/2613] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:42.241919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:42.261358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e80d8-e61e-4edb-b79d-5926dbdcde6a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:42.291072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987a9dc-b55b-40fa-8d66-f21ae2368a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:42.291896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a9dc-b55b-40fa-8d66-f21ae2368a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:42.292398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a9dc-b55b-40fa-8d66-f21ae2368a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:42.292931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a9dc-b55b-40fa-8d66-f21ae2368a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:42.293763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987a9dc-b55b-40fa-8d66-f21ae2368a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:42.298482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987a9dc-b55b-40fa-8d66-f21ae2368a95 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:42.335042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:42.336011 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1297/2614] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:42.355194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b56ede-bdca-476d-83da-54cb78211a45 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:42.364950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:42.366374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:42.372556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:42.373229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] PATH_INFO: `/v3/projects/f430ad212fd74d5eb5a8bdd6c4e3e4e7/users/e088727f7a4f49279330899d68f272d7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:42.393129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f430ad212fd74d5eb5a8bdd6c4e3e4e7, user_id=e088727f7a4f49279330899d68f272d7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:42.398681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:42.442166 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1318/2615] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:16:42 2022] PUT /identity/v3/projects/f430ad212fd74d5eb5a8bdd6c4e3e4e7/users/e088727f7a4f49279330899d68f272d7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:42.450804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:42.451094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:42.451395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:42.477519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:42.533465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] MFA Rules not processed for user `e088727f7a4f49279330899d68f272d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:42.535404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:42.708300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:42.710503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:42.720434 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1298/2616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:42.899568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27135-a9f6-482c-b513-838428c07dae admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:42.905723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:42.906613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:42.906957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:42.907310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:42.909617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:42.924061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:42.926684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:42.943650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1319/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:43.090387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:43.092985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:43.126955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f5af3-91a4-412e-81b0-c6be18d5c308 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:43.145159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc13ae-7420-4b3a-b310-616f734928ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:43.145820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc13ae-7420-4b3a-b310-616f734928ce service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:43.146286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc13ae-7420-4b3a-b310-616f734928ce service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:43.146569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc13ae-7420-4b3a-b310-616f734928ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:43.177482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc13ae-7420-4b3a-b310-616f734928ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:43.179129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc13ae-7420-4b3a-b310-616f734928ce service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:43.219228 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1299/2618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:44.019635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:44.040722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:44.226980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac40b7-a3ef-4847-90bc-79255ad7fe4a service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:44.243995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:44.244934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:44.245398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:44.245827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] PATH_INFO: `/v3/users/e088727f7a4f49279330899d68f272d7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:44.250514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e088727f7a4f49279330899d68f272d7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:44.257098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:44.416665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e088727f7a4f49279330899d68f272d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:44.455332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e088727f7a4f49279330899d68f272d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:44.458320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e088727f7a4f49279330899d68f272d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:44.460228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e088727f7a4f49279330899d68f272d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:44.478855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e088727f7a4f49279330899d68f272d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:44.515624 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1320/2619] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:44 2022] DELETE /identity/v3/users/e088727f7a4f49279330899d68f272d7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:44.520894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:44.521445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:44.521445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:44.601129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:44.610937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:44.791151 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1300/2620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:44.850744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:44.853972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:44.997557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222910a-2530-4296-9126-7ec57894718f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:45.004550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f39ff2-84d1-4bf9-9517-3892f3e38994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:45.006772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f39ff2-84d1-4bf9-9517-3892f3e38994 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:45.007845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f39ff2-84d1-4bf9-9517-3892f3e38994 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:45.008355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f39ff2-84d1-4bf9-9517-3892f3e38994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:45.056353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f39ff2-84d1-4bf9-9517-3892f3e38994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:45.059511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f39ff2-84d1-4bf9-9517-3892f3e38994 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:45.091046 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1321/2621] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:46.033352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:46.036604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:46.069684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568828-4062-4291-a5bc-b3aa27c13ac9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:46.089971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:46.092348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:46.092630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:46.092909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] PATH_INFO: `/v3/projects/f430ad212fd74d5eb5a8bdd6c4e3e4e7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:46.100171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f430ad212fd74d5eb5a8bdd6c4e3e4e7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:46.106017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:46.250380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f430ad212fd74d5eb5a8bdd6c4e3e4e7', 'request_id': 'req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:46.279912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f430ad212fd74d5eb5a8bdd6c4e3e4e7', 'request_id': 'req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:46.305733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f430ad212fd74d5eb5a8bdd6c4e3e4e7', 'request_id': 'req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:46.335905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] The token cache is being invalidate because project f430ad212fd74d5eb5a8bdd6c4e3e4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:16:46.337268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:46.338661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15e0eb5a-81d3-4bc7-8d15-d1aac844f556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:46.346676 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1301/2622] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:16:46 2022] DELETE /identity/v3/projects/f430ad212fd74d5eb5a8bdd6c4e3e4e7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:46.348415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:46.349320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:46.349789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:46.385035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:46.390212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:46.424945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:46.488514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1322/2623] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:46.497476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:46.498013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:46.498490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:46.526374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:46.539895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:46.545862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:46.571912 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1302/2624] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:46.573267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:46.587563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470ef0-c80d-4d71-9a14-89bb7cd317a1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:46.609369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:46.610937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:46.611713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:46.611713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:46.612714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:16:46.612911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:46.614780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:46.647824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1323/2625] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:16:46.649770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:46.667046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb8e72-3bca-47d7-a341-4ea12d78b068 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:46.686485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e80d43-d638-4024-b29a-183e5132668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:46.689980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e80d43-d638-4024-b29a-183e5132668e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:46.692616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e80d43-d638-4024-b29a-183e5132668e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:46.695567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e80d43-d638-4024-b29a-183e5132668e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:46.696525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e80d43-d638-4024-b29a-183e5132668e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:46.698694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e80d43-d638-4024-b29a-183e5132668e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:46.792563 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1303/2626] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:16:46 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:46.797534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:46.820499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:46.820997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:46.821285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:46.833312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b671-33f6-45ec-a6fa-e41fe770ff3c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:46.871428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] MFA Rules not processed for user `e478de82935c4f9b93a698e3fa3c6d78`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:46.902092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:47.029102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:47.030272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:47.032474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:47.033008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:47.033931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:47.040052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:47.063976 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1304/2627] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:47.128633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:47.137491 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1324/2628] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:16:46 2022] POST /identity/v3/users => generated 287 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:47.148129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f4c3-1e25-444e-bb45-89026622abe9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:47.167885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:47.168355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:47.171174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:47.172222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:47.173388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:47.191238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:47.225337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1305/2629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:47.229144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:47.247414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9498f-4b22-4f22-8ee6-b7f08a388668 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:47.272651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b88eb9-9e41-4311-8755-b7023beb8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:47.273286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b88eb9-9e41-4311-8755-b7023beb8f60 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:47.273564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b88eb9-9e41-4311-8755-b7023beb8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:47.273837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b88eb9-9e41-4311-8755-b7023beb8f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:47.274965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b88eb9-9e41-4311-8755-b7023beb8f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:47.276850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b88eb9-9e41-4311-8755-b7023beb8f60 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:47.310004 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1325/2630] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:47.310302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:47.327285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d6ba-950c-4871-9590-bf596f353ee4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:47.342972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:47.344083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:47.344519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:47.344934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] PATH_INFO: `/v3/projects/c7a7d97c97414ef2935cfad1b333f999/users/b818fed434d8452c9bd451c229def595/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:47.375755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a7d97c97414ef2935cfad1b333f999, user_id=b818fed434d8452c9bd451c229def595, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:47.379975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:47.410402 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1306/2631] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:16:47 2022] PUT /identity/v3/projects/c7a7d97c97414ef2935cfad1b333f999/users/b818fed434d8452c9bd451c229def595/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:47.410849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:47.411647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:47.412092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:47.474256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] MFA Rules not processed for user `b818fed434d8452c9bd451c229def595`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:47.475751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:47.592995 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1326/2632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:47.608146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:47.609994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:47.713530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e916a-5fd5-47b3-a252-194315b7c2c3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:47.720137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:47.720710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:47.720949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:47.721945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:47.757952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:47.761178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:47.785835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1307/2633] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:48.321834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:48.323400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:48.369740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:48.460061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6dea-4fd9-48b0-adbd-4c9d92f2654f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:48.469965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:48.471000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:48.472313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:48.472654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] PATH_INFO: `/v3/users/4c0cd21c3d004a3ab401df687c4c6a3e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:48.474428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0cd21c3d004a3ab401df687c4c6a3e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:48.477807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:48.586138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0cd21c3d004a3ab401df687c4c6a3e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:48.601613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0cd21c3d004a3ab401df687c4c6a3e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:48.602768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0cd21c3d004a3ab401df687c4c6a3e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:48.603658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0cd21c3d004a3ab401df687c4c6a3e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:48.623530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0cd21c3d004a3ab401df687c4c6a3e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:48.655125 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1327/2634] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:48 2022] DELETE /identity/v3/users/4c0cd21c3d004a3ab401df687c4c6a3e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:49.030125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:49.045653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434b14-4b10-47ce-b5a5-2aaca2e263d4 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:49.162395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:49.245173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:49.245992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:49.246541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:49.246769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] PATH_INFO: `/v3/projects/8bb8e41503614bc3862acc564ad8b9d4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:49.248510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb8e41503614bc3862acc564ad8b9d4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:49.250708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:49.278042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:49.280408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:49.316150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc916fb4-18e7-43c1-8385-954715f07401 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:49.326629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:49.327901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:49.328477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:49.329017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] PATH_INFO: `/v3/users/b818fed434d8452c9bd451c229def595` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:49.331396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b818fed434d8452c9bd451c229def595)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:49.339035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:49.398973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb8e41503614bc3862acc564ad8b9d4', 'request_id': 'req-cd3e4071-9b84-4c30-800f-73b8843f4608'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.411941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb8e41503614bc3862acc564ad8b9d4', 'request_id': 'req-cd3e4071-9b84-4c30-800f-73b8843f4608'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.432461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb8e41503614bc3862acc564ad8b9d4', 'request_id': 'req-cd3e4071-9b84-4c30-800f-73b8843f4608'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.470935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] The token cache is being invalidate because project 8bb8e41503614bc3862acc564ad8b9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:16:49.471301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.472161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.474135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1308/2635] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:16:49 2022] DELETE /identity/v3/projects/8bb8e41503614bc3862acc564ad8b9d4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:49.474650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:49.486665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:49.527860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b818fed434d8452c9bd451c229def595'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.562703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b818fed434d8452c9bd451c229def595'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.564190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b818fed434d8452c9bd451c229def595'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.566484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b818fed434d8452c9bd451c229def595'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.591299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-529eeec0-3a2f-4a4e-a31d-b0dcda08b7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b818fed434d8452c9bd451c229def595'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:49.621444 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1328/2636] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:49 2022] DELETE /identity/v3/users/b818fed434d8452c9bd451c229def595 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:49.624894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31833-7d1b-4091-bc09-535f43d53f46 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:49.625198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31833-7d1b-4091-bc09-535f43d53f46 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:49.625499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31833-7d1b-4091-bc09-535f43d53f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:49.669471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bab31833-7d1b-4091-bc09-535f43d53f46 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:49.670738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bab31833-7d1b-4091-bc09-535f43d53f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:49.684001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e4071-9b84-4c30-800f-73b8843f4608 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:49.691849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:49.829055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:49.856149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:49.856826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:49.857132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:49.857417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:49.861294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1329/2637] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:49.863506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:49.863988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:49.864613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:49.867130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:49.895603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:49.897233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61228555-78df-4eed-96a7-54c229f84ad2 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:49.906375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:49.908363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:49.912934 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1309/2638] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:49.914772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:49.915484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:49.915484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:49.964776 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1330/2639] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:49.977365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:49.979112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:49.988739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:49.994094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:50.011849 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1310/2640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:50.017777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.031459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdcb5a-d0a8-4081-bbe9-288712d3cd3b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.040093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.041508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.042017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.042472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.043470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:16:50.043860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.046099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.080258 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1311/2641] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:16:50.087789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.169449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4c239-1ed9-49fb-8b4b-daec8b6a5b6a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.192896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbceea-f9fd-405c-9e1d-0b635b2f0033 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.204293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.205032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.205325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.206650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.217135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.217853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.218137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.218473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.220208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.226273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.230448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.234164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.268395 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1331/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:50.304165 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1312/2643] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:16:50 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:50.306772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.318491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb70db-dc96-4448-a6fb-3b8827fc9eaa service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.415805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.416725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.417220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.418531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.419516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.426331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.467975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.470449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1332/2644] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:16:50 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:50.482323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705204f1-f62f-4e6f-b16b-d2a00c9797b6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.500610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.501552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.502053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.504482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.505381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.508067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.540640 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1313/2645] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:50.544827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.561518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a28732-1b80-4eb1-8b9c-3102cb9e4725 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.575448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6490-d701-47fe-8859-f02573fea62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.576863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6490-d701-47fe-8859-f02573fea62b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.578603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6490-d701-47fe-8859-f02573fea62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.579001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6490-d701-47fe-8859-f02573fea62b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.580158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff6490-d701-47fe-8859-f02573fea62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.584870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff6490-d701-47fe-8859-f02573fea62b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.621514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1333/2646] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:50.622637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.640319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395660c-20d1-4ccd-a218-09de7fd61f1f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:50.654405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:50.655217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.655559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.656047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] PATH_INFO: `/v3/projects/ddf4b949b04249c894b7398b48bdd279/users/39201673a4e84ababac690a17cca85bc/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.686802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf4b949b04249c894b7398b48bdd279, user_id=39201673a4e84ababac690a17cca85bc, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:50.690750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:50.738654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1314/2647] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:16:50 2022] PUT /identity/v3/projects/ddf4b949b04249c894b7398b48bdd279/users/39201673a4e84ababac690a17cca85bc/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:50.744701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d869-4482-4506-be78-95badde87364 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:50.745063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d869-4482-4506-be78-95badde87364 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:50.745491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d869-4482-4506-be78-95badde87364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:50.787116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f6c4d869-4482-4506-be78-95badde87364 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:50.787116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6c4d869-4482-4506-be78-95badde87364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:50.858508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:50.914536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1334/2648] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:50.935658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:50.938738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:51.200123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4d869-4482-4506-be78-95badde87364 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:51.202497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6c4d869-4482-4506-be78-95badde87364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:51.236509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4d869-4482-4506-be78-95badde87364 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:51.259619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:51.260746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:51.261883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:51.262480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] PATH_INFO: `/v3/projects/c7a7d97c97414ef2935cfad1b333f999` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:51.267789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef86e5-3de2-4a85-98be-54f68d7321a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:51.269155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a7d97c97414ef2935cfad1b333f999)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:51.271532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:51.272676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3d239-950c-42fa-bcf1-510a9e7d8748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:51.273366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d239-950c-42fa-bcf1-510a9e7d8748 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:51.273650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d239-950c-42fa-bcf1-510a9e7d8748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:51.273923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d239-950c-42fa-bcf1-510a9e7d8748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:51.294441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d239-950c-42fa-bcf1-510a9e7d8748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:51.297349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3d239-950c-42fa-bcf1-510a9e7d8748 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:51.319319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1315/2649] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:51.401906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a7d97c97414ef2935cfad1b333f999', 'request_id': 'req-ff64db1c-d7a1-457a-b142-04d6730e0e03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:51.416729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a7d97c97414ef2935cfad1b333f999', 'request_id': 'req-ff64db1c-d7a1-457a-b142-04d6730e0e03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:51.433658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a7d97c97414ef2935cfad1b333f999', 'request_id': 'req-ff64db1c-d7a1-457a-b142-04d6730e0e03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:51.467521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] The token cache is being invalidate because project c7a7d97c97414ef2935cfad1b333f999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:16:51.468520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:51.470499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff64db1c-d7a1-457a-b142-04d6730e0e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:51.474904 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1335/2650] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:16:51 2022] DELETE /identity/v3/projects/c7a7d97c97414ef2935cfad1b333f999 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:51.479802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:51.480117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:51.480365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:51.531350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:51.548791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:51.709494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:51.710121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:51.710558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:51.718568 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1316/2651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:51.733606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:51.735296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:51.749630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:51.756245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1336/2652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:16:51.762552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b85e-7921-4ea3-a511-5f9ae89fbc6d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:51.768890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:51.769943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:51.770676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:51.771879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:51.772783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:16:51.773633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:51.775505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:51.790528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:51.801656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:51.827639 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1317/2653] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:16:51.829277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188b1f3-8ddc-4a2c-87b0-fc1a57a04d2a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:51.838509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:51.839271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:51.839729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:51.840013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:51.840797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:51.844110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:51.905341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:51.912384 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1337/2654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:16:51 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:51.919666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84f5c-2166-45f2-a5d4-86ee090ce143 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:52.088387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:52.088387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:52.090603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:52.098282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:52.098282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:52.098282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:52.139975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1318/2655] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:16:51 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:52.144538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:52.160463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeff4a4-98d6-479b-9b4f-f5576c759852 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:52.178748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:52.179399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:52.179676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:52.179946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:52.180606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:52.188075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:52.214476 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1338/2656] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:16:52.215604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:52.238109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a88d39-1469-4ed7-97a1-21def120de74 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:52.266176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c611e-6431-4769-9e06-f615f87a4d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:52.269628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c611e-6431-4769-9e06-f615f87a4d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:52.270258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c611e-6431-4769-9e06-f615f87a4d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:52.273438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c611e-6431-4769-9e06-f615f87a4d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:52.279729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c611e-6431-4769-9e06-f615f87a4d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:52.296840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c611e-6431-4769-9e06-f615f87a4d00 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:52.318011 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1319/2657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:16:52.320623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:52.337967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5006db-3eb0-463b-bbe8-8a0fbed0751c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:52.351600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:52.352313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:52.352569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:52.352850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] PATH_INFO: `/v3/projects/dc62e9b30464443aa0ee06f41a689eb3/users/0bb37aa4f2684d87833d97acd437df82/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:52.394010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc62e9b30464443aa0ee06f41a689eb3, user_id=0bb37aa4f2684d87833d97acd437df82, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:52.397027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:52.435487 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1339/2658] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:16:52 2022] PUT /identity/v3/projects/dc62e9b30464443aa0ee06f41a689eb3/users/0bb37aa4f2684d87833d97acd437df82/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:52.451859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:52.452379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:52.452834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:52.522650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] MFA Rules not processed for user `0bb37aa4f2684d87833d97acd437df82`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:52.528914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:52.710055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1320/2659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:52.726678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:52.729021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:52.843031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:52.878692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875bd6-1ca3-4a96-9bd5-829243081fa9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:52.891191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d90886-7906-4bc5-aa77-8a4075d4fd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:52.891860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d90886-7906-4bc5-aa77-8a4075d4fd89 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:52.892152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d90886-7906-4bc5-aa77-8a4075d4fd89 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:52.892427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d90886-7906-4bc5-aa77-8a4075d4fd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:52.921689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d90886-7906-4bc5-aa77-8a4075d4fd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:52.926369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d90886-7906-4bc5-aa77-8a4075d4fd89 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:52.947474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1340/2660] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:55.629355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:55.804196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ec06a-5562-4b2c-b6c6-db3725171af3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:55.809250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:55.809931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:55.810536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:55.810823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] PATH_INFO: `/v3/users/0bb37aa4f2684d87833d97acd437df82` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:55.812183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb37aa4f2684d87833d97acd437df82)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:55.814237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:55.828577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:55.890704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb37aa4f2684d87833d97acd437df82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:55.905393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb37aa4f2684d87833d97acd437df82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:55.906602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb37aa4f2684d87833d97acd437df82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:55.907899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb37aa4f2684d87833d97acd437df82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:55.927369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb37aa4f2684d87833d97acd437df82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:56.011806 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1321/2661] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:55 2022] DELETE /identity/v3/users/0bb37aa4f2684d87833d97acd437df82 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:56.013341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:56.013826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:56.014028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:56.055179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:56.057275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:56.267229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1341/2662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:56.278381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:56.279865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:56.414291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009772-6593-4518-b7d9-be65c019c165 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:56.419303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:56.420198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:56.420586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:56.421917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:56.446935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:56.454277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:56.497096 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1322/2663] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:57.135135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:57.138929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:57.385117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d281d7-2d53-464f-8daf-5cbfce78c853 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:57.393466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:57.394711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:57.395409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:57.396043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:57.401093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:57.575249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:57.579656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e392-5f8b-4d15-a700-7c599e1c2c34 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:57.621938 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1342/2664] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:57.731700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:57.733252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:57.750003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca53b6-59e7-42ff-a641-49cd9f169825 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:57.756708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:57.757372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:57.757658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:57.757928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] PATH_INFO: `/v3/projects/dc62e9b30464443aa0ee06f41a689eb3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:57.759274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc62e9b30464443aa0ee06f41a689eb3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:57.761440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:57.855680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc62e9b30464443aa0ee06f41a689eb3', 'request_id': 'req-ca498b5f-41e0-4165-b6ab-f9b107decfae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:57.874901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc62e9b30464443aa0ee06f41a689eb3', 'request_id': 'req-ca498b5f-41e0-4165-b6ab-f9b107decfae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:57.894716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc62e9b30464443aa0ee06f41a689eb3', 'request_id': 'req-ca498b5f-41e0-4165-b6ab-f9b107decfae'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:57.914966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] The token cache is being invalidate because project dc62e9b30464443aa0ee06f41a689eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:16:57.915316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:57.917311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca498b5f-41e0-4165-b6ab-f9b107decfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:57.921223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1323/2665] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:16:57 2022] DELETE /identity/v3/projects/dc62e9b30464443aa0ee06f41a689eb3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:57.927273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:57.927752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:57.928083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:57.978959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:57.983888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:58.015987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:58.172320 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1343/2666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:58.180225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:58.180763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:58.181198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:58.266194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:58.267619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:58.332373 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1324/2667] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:58.335596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:58.352706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad6bb-cce4-4db4-88d0-99210afed24d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:58.373244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:58.374312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:58.374790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:58.375274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:58.376319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:16:58.378963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:58.381330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:58.423569 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1344/2668] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:16:58.428042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:58.441729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df43fa9-33d0-4edd-b0db-68d4a17013b0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:58.448163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:58.448864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:58.449204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:58.449542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:58.450289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:58.453466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:58.483484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:58.528849 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1325/2669] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:16:58 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:16:58.534126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:58.550304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b320-82e7-48df-a184-e49b1d9897eb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:58.723034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:58.726465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:58.727687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:58.728136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:58.729498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:58.736430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:58.790890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1345/2670] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:16:58 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:16:58.791845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:58.807162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2dc9-a106-40ce-87fd-1fdefb454e4b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:58.819762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:58.820403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:58.820796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:58.821086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:58.821809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:58.829812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:58.863523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:58.864842 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1326/2671] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:16:58.882173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d3d2-3220-4971-83bf-7f18bc6b1180 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:58.902361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0265d15-1d27-421e-81ee-7fba1e6954ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:58.905040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265d15-1d27-421e-81ee-7fba1e6954ae admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:58.905647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265d15-1d27-421e-81ee-7fba1e6954ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:58.906301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265d15-1d27-421e-81ee-7fba1e6954ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:58.914130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0265d15-1d27-421e-81ee-7fba1e6954ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:58.918265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0265d15-1d27-421e-81ee-7fba1e6954ae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:58.990550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:58.993820 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1346/2672] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:16:59.006290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa82975-e13c-49dd-a738-c2ae0939b390 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:59.016243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:59.019359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:59.019657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:59.020949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] PATH_INFO: `/v3/projects/bf42f045a6b94b5a856c2c560e4660ac/users/81f93814d51145c7a83a7777c84f15d5/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:59.058381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf42f045a6b94b5a856c2c560e4660ac, user_id=81f93814d51145c7a83a7777c84f15d5, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:59.064028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:59.093745 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1327/2673] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:16:58 2022] PUT /identity/v3/projects/bf42f045a6b94b5a856c2c560e4660ac/users/81f93814d51145c7a83a7777c84f15d5/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:16:59.107722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22292-32f1-46b4-9378-32086626b58b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:59.108005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22292-32f1-46b4-9378-32086626b58b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:59.108286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22292-32f1-46b4-9378-32086626b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:59.180865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-acd22292-32f1-46b4-9378-32086626b58b None None] MFA Rules not processed for user `81f93814d51145c7a83a7777c84f15d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:16:59.182161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-acd22292-32f1-46b4-9378-32086626b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:59.297973 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1347/2674] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:16:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:16:59.397494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:59.400576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:16:59.542344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d86a07-1b42-47c6-aada-1105932d199f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:59.559025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725cf0-039c-419f-ab17-faf0f34ee1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:59.560367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725cf0-039c-419f-ab17-faf0f34ee1e4 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:59.561094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725cf0-039c-419f-ab17-faf0f34ee1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:59.561575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725cf0-039c-419f-ab17-faf0f34ee1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:59.585189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49725cf0-039c-419f-ab17-faf0f34ee1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:59.589078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49725cf0-039c-419f-ab17-faf0f34ee1e4 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:59.615467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1328/2675] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:16:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:16:59.717186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22292-32f1-46b4-9378-32086626b58b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:16:59.746925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:16:59.854091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22292-32f1-46b4-9378-32086626b58b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:16:59.861469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:16:59.862918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:16:59.863362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:16:59.863819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] PATH_INFO: `/v3/users/81f93814d51145c7a83a7777c84f15d5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:16:59.868122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f93814d51145c7a83a7777c84f15d5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:16:59.870795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:16:59.967027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f93814d51145c7a83a7777c84f15d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:59.998794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f93814d51145c7a83a7777c84f15d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:16:59.999569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f93814d51145c7a83a7777c84f15d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:00.000197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f93814d51145c7a83a7777c84f15d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:00.016514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f93814d51145c7a83a7777c84f15d5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:00.044674 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1348/2676] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:16:59 2022] DELETE /identity/v3/users/81f93814d51145c7a83a7777c84f15d5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:00.049850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:00.050603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:00.050959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:00.118095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:00.122882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:00.245423 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1329/2677] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:00.255099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:00.257866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:00.344063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10772-61ef-4da2-ab7f-c0f2706be976 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:00.348805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1a6c0-d7bd-47af-90a8-48fa33699421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:00.349792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a6c0-d7bd-47af-90a8-48fa33699421 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:00.350864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a6c0-d7bd-47af-90a8-48fa33699421 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:00.351358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1a6c0-d7bd-47af-90a8-48fa33699421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:00.363093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a6c0-d7bd-47af-90a8-48fa33699421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:00.365206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1a6c0-d7bd-47af-90a8-48fa33699421 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:00.402111 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1349/2678] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:01.035524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:01.037471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:01.068840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cccb1-9eda-4853-a8fd-b6b3942ae03e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:01.082915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:01.083589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.083875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.084156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] PATH_INFO: `/v3/projects/bf42f045a6b94b5a856c2c560e4660ac` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.086898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf42f045a6b94b5a856c2c560e4660ac)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:01.089476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:01.178871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:01.202474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf42f045a6b94b5a856c2c560e4660ac', 'request_id': 'req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:01.209706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf42f045a6b94b5a856c2c560e4660ac', 'request_id': 'req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:01.223380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf42f045a6b94b5a856c2c560e4660ac', 'request_id': 'req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:01.242748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] The token cache is being invalidate because project bf42f045a6b94b5a856c2c560e4660ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:17:01.243231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:01.245855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa4c0081-a36e-4e81-a9ad-fe5eaf0ea951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:01.248978 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1330/2679] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:17:01 2022] DELETE /identity/v3/projects/bf42f045a6b94b5a856c2c560e4660ac => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:17:01.256375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.257304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.257768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.298889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:01.300424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:01.333089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:01.382543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1350/2680] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:01.385038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.385952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.386417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.416018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:01.417348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:01.427664 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1331/2681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:17:01.432144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:01.461194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a4df-937e-46ac-aa5a-d198789118cd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:01.483100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:01.483790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.484080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.484363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.485034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:17:01.485343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:01.492196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:01.522208 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1351/2682] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:17:01.524780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:01.535369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb3a6-482a-4ad1-9c86-c94a06d37559 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:01.541160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:01.542245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.542692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.543171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.544198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:01.546620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:01.609834 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1332/2683] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:17:01 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:17:01.610716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:01.623810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec61726-391e-4f9c-a02f-8d9cf7443454 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:01.806657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:01.807479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.807812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.808170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.809974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:01.825876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:01.885669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:01.887554 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1352/2684] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:17:01 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:17:01.907865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfaad9-11d2-41a4-85ff-3d326569cc68 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:01.915096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:01.916165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.916562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.916949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.917719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:01.919504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:01.938778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:01.949442 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1333/2685] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:01.955621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded27d4-e11f-496f-9317-17b72e4a8f3b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:01.966137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1213-1574-4abf-beff-e0998a8dfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:01.968240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1213-1574-4abf-beff-e0998a8dfe21 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:01.968902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1213-1574-4abf-beff-e0998a8dfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:01.969216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1213-1574-4abf-beff-e0998a8dfe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:01.970050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1213-1574-4abf-beff-e0998a8dfe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:01.976014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1213-1574-4abf-beff-e0998a8dfe21 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:01.994203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1353/2686] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:01.999150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:02.026838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11a4b4-d70f-4f41-9395-bc5e98629781 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:02.040100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:02.042361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:02.042964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:02.044038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] PATH_INFO: `/v3/projects/77b1a7a296014f3da1c148eb88c81401/users/db3b759dfd6c4536acb5dbf786811ef4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:02.073848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b1a7a296014f3da1c148eb88c81401, user_id=db3b759dfd6c4536acb5dbf786811ef4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:02.079196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:02.148557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1334/2687] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:17:01 2022] PUT /identity/v3/projects/77b1a7a296014f3da1c148eb88c81401/users/db3b759dfd6c4536acb5dbf786811ef4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:02.150331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:02.150626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:02.150920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:02.192305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:02.193591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:02.369496 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1354/2688] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:02.397622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:02.400086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:02.563812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb771-3ca5-460b-9bf3-7d46cb88ae11 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:02.569276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9ff6e-9809-4b23-9734-3bc41af27847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:02.570317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9ff6e-9809-4b23-9734-3bc41af27847 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:02.570763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9ff6e-9809-4b23-9734-3bc41af27847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:02.571212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9ff6e-9809-4b23-9734-3bc41af27847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:02.582447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9ff6e-9809-4b23-9734-3bc41af27847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:02.584900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9ff6e-9809-4b23-9734-3bc41af27847 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:02.599272 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1335/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:02.772325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:02.773711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:02.792885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f62fd-3115-41b6-ba38-dab8245e5f03 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:02.806751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:02.807391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:02.807678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:02.807958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:02.810726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:02.840192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:02.841696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:02.845554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:02.845850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:02.846296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:02.864921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1355/2690] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:02.908030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] MFA Rules not processed for user `39201673a4e84ababac690a17cca85bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:02.911298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:03.010723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:03.079776 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1336/2691] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:03.092405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:03.094379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:03.175792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:03.306388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a47479-daf6-452c-ba1a-ba4bfd0853da service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:03.327629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230c03c-2fb0-4622-a63c-89a1f887dde2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:03.328502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c03c-2fb0-4622-a63c-89a1f887dde2 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:03.328953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c03c-2fb0-4622-a63c-89a1f887dde2 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:03.333289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230c03c-2fb0-4622-a63c-89a1f887dde2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:03.361141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230c03c-2fb0-4622-a63c-89a1f887dde2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:03.363601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230c03c-2fb0-4622-a63c-89a1f887dde2 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:03.387672 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1356/2692] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:04.984346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:04.987466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:05.184931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6ca7-af4f-4cad-83b6-9d073987b9cf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:05.201307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:05.202401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:05.202791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:05.203176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:05.212334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:05.238667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:05.240398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:05.268724 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1337/2693] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:05.812305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c2ab-fb79-49df-85a3-98c6f78e5437 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:05.812863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c2ab-fb79-49df-85a3-98c6f78e5437 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:05.812863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c2ab-fb79-49df-85a3-98c6f78e5437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:05.862596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a284c2ab-fb79-49df-85a3-98c6f78e5437 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:05.864790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a284c2ab-fb79-49df-85a3-98c6f78e5437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:06.028400 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1357/2694] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:17:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:06.055916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:06.057579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:06.291304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44793e02-17c0-4f72-8b35-c617a21c74ec service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:06.313109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3260-6058-4706-a726-763fec5edcda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:06.313652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3260-6058-4706-a726-763fec5edcda service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:06.313948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3260-6058-4706-a726-763fec5edcda service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:06.314292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3260-6058-4706-a726-763fec5edcda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:06.346035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3260-6058-4706-a726-763fec5edcda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:06.347955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3260-6058-4706-a726-763fec5edcda service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:06.392415 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1338/2695] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:17:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:17:06.607457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f85ccd-adc1-4733-945b-903b1a32bb5c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:06.608183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f85ccd-adc1-4733-945b-903b1a32bb5c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:06.608895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f85ccd-adc1-4733-945b-903b1a32bb5c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:06.610819 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1358/2696] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 05:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:17:06.619931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e928c-4d2b-4356-a860-473d2537c3b7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:06.620119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e928c-4d2b-4356-a860-473d2537c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:06.620404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e928c-4d2b-4356-a860-473d2537c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:06.659603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-db0e928c-4d2b-4356-a860-473d2537c3b7 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:06.662283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db0e928c-4d2b-4356-a860-473d2537c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:06.677535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1339/2697] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 05:17:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:06.801948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f85ccd-adc1-4733-945b-903b1a32bb5c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:06.817475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f85ccd-adc1-4733-945b-903b1a32bb5c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:06.823994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:06.825017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:06.825581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:06.826346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:06.843569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:06.845516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:06.870477 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1359/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:08.338861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ddbf-8ffd-4e0c-8643-b11a98db5250 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:08.339353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ddbf-8ffd-4e0c-8643-b11a98db5250 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:08.339444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ddbf-8ffd-4e0c-8643-b11a98db5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:08.402453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d4e8ddbf-8ffd-4e0c-8643-b11a98db5250 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:08.405819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4e8ddbf-8ffd-4e0c-8643-b11a98db5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:08.438817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1340/2699] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:08.494476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:08.514007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf7491-e0fc-4db6-947c-5e643c56bb32 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:08.544646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:08.544798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:08.545002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:08.545555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:08.576644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:08.578177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:08.607893 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1360/2700] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:17:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:17:17.943851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:17.944498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:17.945766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:18.035133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] MFA Rules not processed for user `db3b759dfd6c4536acb5dbf786811ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:18.040515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:18.160544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:18.334650 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1341/2701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:18.594570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=60 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:20.043456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:20.045895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:20.065578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c40df9-45be-4ea9-bd52-6ddf769b16bb service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:20.074480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:20.075331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:20.075773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:20.076230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:20.091389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:20.094993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:20.129443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1361/2702] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:21.979343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:22.000201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33577-edbe-447a-bcf0-688f620de09b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:22.011677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:22.012704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:22.013141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:22.013618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:22.018317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:22.062501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:22.068376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1753020-bef8-4d57-b251-10121b963610 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:22.121141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1342/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:25.765402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:25.767755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:25.784810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa5f77-b7ab-4d3b-b25b-0dcfa9ac4ce2 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:25.791421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:25.792230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:25.793167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:25.793167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:25.794905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:25.809505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:25.812462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:25.826937 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1362/2704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:26.811239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6d3d3-ec9c-4eb8-8d82-2e232eda0d8b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:26.811825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6d3d3-ec9c-4eb8-8d82-2e232eda0d8b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:26.811825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6d3d3-ec9c-4eb8-8d82-2e232eda0d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:26.832459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-54d6d3d3-ec9c-4eb8-8d82-2e232eda0d8b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:26.833673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-54d6d3d3-ec9c-4eb8-8d82-2e232eda0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:26.841078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1343/2705] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:26.858344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:26.871336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141a76f-983a-428b-9a0c-f427441f7f97 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:26.876852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:26.878189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:26.878475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:26.878823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:26.896060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:26.898614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:26.918229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1363/2706] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:17:28.450590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:28.451575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:28.452057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:28.495735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:28.497961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:28.582534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1344/2707] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:29.988716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:30.002819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe0d1-145b-47f5-af98-a86f4f64a06d service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:30.008733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:30.009624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:30.010292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:30.010581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:30.013832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:30.033051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:30.037588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:30.050048 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1364/2708] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:30.076493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:30.087476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce53d0a-b938-4bd3-bcf8-237e0aeb18c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:30.091458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:30.092296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:30.092745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:30.093176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:30.095179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:30.110530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:30.116961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:30.134106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1345/2709] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:30.209581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:30.219147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119ee15-bb02-4291-997b-215b6d50a740 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:30.223383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:30.223999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:30.224474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:30.224739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:30.226944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:30.253810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:30.255387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b22cb-05d1-4f59-a7ea-320a63c4a4b2 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:30.299401 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1365/2710] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:30.447658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:30.451081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:30.468612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe68f1-3101-41d3-9c93-e508c13ad042 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:30.474071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:30.474759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:30.475043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:30.475314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] PATH_INFO: `/v3/users/39201673a4e84ababac690a17cca85bc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:30.476682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39201673a4e84ababac690a17cca85bc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:30.478681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:30.538195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39201673a4e84ababac690a17cca85bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:30.547669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39201673a4e84ababac690a17cca85bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:30.548588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39201673a4e84ababac690a17cca85bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:30.549570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39201673a4e84ababac690a17cca85bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:30.557404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39201673a4e84ababac690a17cca85bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:30.581603 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1346/2711] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:17:30 2022] DELETE /identity/v3/users/39201673a4e84ababac690a17cca85bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:30.962535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:30.962907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:30.963102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:31.004896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:31.006235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:31.094717 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1366/2712] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:17:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:31.111140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:31.114602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:31.182201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:31.308652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:31.312504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:31.365858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1aae-e34b-42b1-9875-c934d1c9bcc4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:31.389951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9286a5-6c14-4a57-9146-e420d2a1b105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:31.390630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9286a5-6c14-4a57-9146-e420d2a1b105 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:31.390911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9286a5-6c14-4a57-9146-e420d2a1b105 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:31.391187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9286a5-6c14-4a57-9146-e420d2a1b105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:31.422170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9286a5-6c14-4a57-9146-e420d2a1b105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:31.430162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9286a5-6c14-4a57-9146-e420d2a1b105 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:31.479776 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1347/2713] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:17:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:17:31.517230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eeae8-7177-4dd5-9478-a707144ca431 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:31.518287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eeae8-7177-4dd5-9478-a707144ca431 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:31.518826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eeae8-7177-4dd5-9478-a707144ca431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:31.561658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-464eeae8-7177-4dd5-9478-a707144ca431 None None] MFA Rules not processed for user `06e506f335f845a18332a4cd5047f3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:31.565874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-464eeae8-7177-4dd5-9478-a707144ca431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:31.575344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d5118-bbf0-4273-9b12-068e5a36d8f0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:31.623339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:31.628467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:31.629656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:31.630557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] PATH_INFO: `/v3/projects/ddf4b949b04249c894b7398b48bdd279` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:31.634533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf4b949b04249c894b7398b48bdd279)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:31.645273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:31.702226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1348/2714] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:31.745249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:31.766178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf4b949b04249c894b7398b48bdd279', 'request_id': 'req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:31.794557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf4b949b04249c894b7398b48bdd279', 'request_id': 'req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:31.813393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf4b949b04249c894b7398b48bdd279', 'request_id': 'req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:31.833634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] The token cache is being invalidate because project ddf4b949b04249c894b7398b48bdd279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:17:31.834366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:31.835364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-02fe61a9-f7fa-4c78-b58a-8c0f2b78a327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:31.838002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1367/2715] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:17:31 2022] DELETE /identity/v3/projects/ddf4b949b04249c894b7398b48bdd279 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:31.842835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:31.843150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:31.843424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:31.882966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:31.887163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:32.141041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1349/2716] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:32.144492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.144952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.145054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:32.209899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:32.213582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:32.248209 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1368/2717] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:32.252937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:32.274401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80b4f-2d58-4d39-abfa-0a34b1ab200b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:32.290335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:32.294179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.297036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.297800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:32.301398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:17:32.301963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:32.306209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:32.333411 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1350/2718] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:17:32.338443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:32.354826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c528-601c-4844-bb5b-a409675cec70 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:32.371201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:32.371838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.372122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.372644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:32.373371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:32.376400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:32.436377 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1369/2719] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:17:32 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:17:32.440928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:32.458703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c110ca-7969-4bf2-bb17-ac702a734b3a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:32.613808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:32.700617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:32.702541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.703206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.703777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:32.704652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:32.708676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:32.750078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1351/2720] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:17:32 2022] POST /identity/v3/users => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:17:32.755092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:32.770937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458107-3d3e-43ac-980c-4abc02dd8e47 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:32.792605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:32.796815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.802859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.804983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:32.805894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:32.814029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:32.865692 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1370/2721] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:32.867935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:32.883400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced856-781e-4287-9fe2-72c8dde06c13 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:32.912232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f1dcb-6e5a-42a8-a246-98c960007d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:32.916227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1dcb-6e5a-42a8-a246-98c960007d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.916690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1dcb-6e5a-42a8-a246-98c960007d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.916990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1dcb-6e5a-42a8-a246-98c960007d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:32.917757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f1dcb-6e5a-42a8-a246-98c960007d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:32.922450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f1dcb-6e5a-42a8-a246-98c960007d33 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:32.950098 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1352/2722] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:32.953863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:32.966655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2574e23-5d9a-4c6c-890d-5636f46f5fd9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:32.983213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:32.984104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:32.985016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:32.985582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] PATH_INFO: `/v3/projects/d237752126f043208e50b229c481b1a0/users/76db24e099184aed9f1fa3b55ea28116/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:33.043565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d237752126f043208e50b229c481b1a0, user_id=76db24e099184aed9f1fa3b55ea28116, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:33.053425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:33.091029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1371/2723] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:17:32 2022] PUT /identity/v3/projects/d237752126f043208e50b229c481b1a0/users/76db24e099184aed9f1fa3b55ea28116/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:33.101514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:33.101912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:33.102348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:33.180244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:33.198671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:33.380923 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1353/2724] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:33.389902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:33.391967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:33.487358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4134-f8fd-41a3-94a7-018f096e4e0b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:33.496594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:33.499970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:33.500255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:33.503019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:33.531362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:33.532845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:33.547417 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1372/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:40.994561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:41.016563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bb8ef-b5ae-497b-86cc-af5f647f8284 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:41.027954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:41.030251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:41.031330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:41.032375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:41.040687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:41.213448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:41.215106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:41.245337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1354/2726] 10.222.0.23 () {60 vars in 1396 bytes} [Mon Oct 31 05:17:40 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:43.540000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=62,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:51.235712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:53.481299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:53.490011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:53.512076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c5103-7af5-4698-a4d9-59e9fb22a59b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:53.518238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:53.519145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:53.519431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:53.519734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] PATH_INFO: `/v3/users/db3b759dfd6c4536acb5dbf786811ef4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:53.521277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3b759dfd6c4536acb5dbf786811ef4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:53.523326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:53.593402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3b759dfd6c4536acb5dbf786811ef4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.615379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3b759dfd6c4536acb5dbf786811ef4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.617397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3b759dfd6c4536acb5dbf786811ef4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.619105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3b759dfd6c4536acb5dbf786811ef4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.639147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3b759dfd6c4536acb5dbf786811ef4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.676926 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1373/2727] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:17:53 2022] DELETE /identity/v3/users/db3b759dfd6c4536acb5dbf786811ef4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:53.708758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:53.711038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:53.736803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cca7cc-5f9d-489b-980e-b9ce359aac57 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:53.877985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:53.879869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:53.880371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:53.880857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] PATH_INFO: `/v3/users/9f4787f2bbef478b833f2f4613879578` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:53.883039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4787f2bbef478b833f2f4613879578)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:53.886031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:53.955062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4787f2bbef478b833f2f4613879578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.964758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4787f2bbef478b833f2f4613879578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.965745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4787f2bbef478b833f2f4613879578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.966787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4787f2bbef478b833f2f4613879578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:53.979920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88c4cb57-7973-4d26-9707-ec45bf616971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4787f2bbef478b833f2f4613879578'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:54.004192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1355/2728] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:17:53 2022] DELETE /identity/v3/users/9f4787f2bbef478b833f2f4613879578 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:54.057941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:54.059431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:54.074182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec413ac-9013-4931-9b0a-bd5e7f3cdf91 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:54.190462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:54.191668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:54.192157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:54.192644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] PATH_INFO: `/v3/projects/77b1a7a296014f3da1c148eb88c81401` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:54.194338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b1a7a296014f3da1c148eb88c81401)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:54.197195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:54.278488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b1a7a296014f3da1c148eb88c81401', 'request_id': 'req-a19645bb-ffff-4524-8cdb-7877f76df3ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:54.288374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b1a7a296014f3da1c148eb88c81401', 'request_id': 'req-a19645bb-ffff-4524-8cdb-7877f76df3ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:54.303926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b1a7a296014f3da1c148eb88c81401', 'request_id': 'req-a19645bb-ffff-4524-8cdb-7877f76df3ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:54.331874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] The token cache is being invalidate because project 77b1a7a296014f3da1c148eb88c81401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:17:54.332176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:54.333037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a19645bb-ffff-4524-8cdb-7877f76df3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:54.341274 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1374/2729] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:17:54 2022] DELETE /identity/v3/projects/77b1a7a296014f3da1c148eb88c81401 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:54.341633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:54.342088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:54.342427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:54.407763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:54.410815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:54.555907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1356/2730] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:17:54.557654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:54.558063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:54.558319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:54.583215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:54.629671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:54.631318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:54.670097 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1375/2731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:54.671626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:54.690358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c214-178b-47c5-bec6-1d1fffbe8200 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:54.719619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:54.720317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:54.721572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:54.721889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:54.724302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:17:54.724681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:54.731029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4b26-934f-4f7d-9189-493a8210be0b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:54.768216 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1357/2732] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:17:54.772577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:54.807094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:54.807483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:54.818613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:54.834617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727c1b-756e-448a-a907-30a290afdee6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:54.864901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:54.868504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:54.871050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:54.871448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:54.874660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:54.877266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:54.880989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:54.924268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] MFA Rules not processed for user `76db24e099184aed9f1fa3b55ea28116`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:54.926529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:54.941492 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1376/2733] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:17:54 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:17:54.943346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:54.951791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.122894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635623a-2fdb-4771-bb64-b6217ff2b1f9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.135105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.137571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.137927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.138950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] PATH_INFO: `/v3/projects/7c554b46f5c24a34a3edab02daeb9784` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.141512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c554b46f5c24a34a3edab02daeb9784)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.148135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.191247 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1358/2734] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:55.192253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.221896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e075a-430f-4995-bdf4-b14e75ba48f0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.269526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c554b46f5c24a34a3edab02daeb9784', 'request_id': 'req-85462426-823c-40cf-8789-4da6e8217732'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:55.277335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c554b46f5c24a34a3edab02daeb9784', 'request_id': 'req-85462426-823c-40cf-8789-4da6e8217732'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:55.289680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c554b46f5c24a34a3edab02daeb9784', 'request_id': 'req-85462426-823c-40cf-8789-4da6e8217732'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:55.314964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] The token cache is being invalidate because project 7c554b46f5c24a34a3edab02daeb9784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:17:55.315380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:55.317255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85462426-823c-40cf-8789-4da6e8217732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:17:55.322837 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1377/2735] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:17:54 2022] DELETE /identity/v3/projects/7c554b46f5c24a34a3edab02daeb9784 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:55.324354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.324648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.326259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.369694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1085d-7ae4-4f79-9ce4-e7e276915d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.370354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1085d-7ae4-4f79-9ce4-e7e276915d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.370640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1085d-7ae4-4f79-9ce4-e7e276915d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.370917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1085d-7ae4-4f79-9ce4-e7e276915d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.376218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1085d-7ae4-4f79-9ce4-e7e276915d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.376218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1085d-7ae4-4f79-9ce4-e7e276915d76 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.409609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:55.411569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.416758 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1359/2736] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:17:55 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:17:55.416758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.416758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.418426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.455139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:55.456394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.466748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1360/2737] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:55.475975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.477392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.496687 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1378/2738] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:17:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:55.497773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.500222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.529539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c951-c56a-4bb0-8e74-54c6a7a6b035 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.537390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21187aaa-88cd-4178-a549-f24b6ad7eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.538343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187aaa-88cd-4178-a549-f24b6ad7eecb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.538692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187aaa-88cd-4178-a549-f24b6ad7eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.539027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187aaa-88cd-4178-a549-f24b6ad7eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.540072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21187aaa-88cd-4178-a549-f24b6ad7eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.543250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21187aaa-88cd-4178-a549-f24b6ad7eecb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.546926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:55.565503 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1379/2739] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:55.568069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.568787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.569466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.601239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:55.603301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.634915 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1380/2740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:55.635873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.639598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.646252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb97405-73c6-4b90-8528-5d6b117ab488 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.659692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.660347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.660633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.660910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.662836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:55.705381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:55.811123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac270-aee4-403b-b9b9-ad15e3259133 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.836715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.837797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.838338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.838830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.841904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.844712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.873678 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1361/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:55.876031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.877272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.880329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.904611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2aa16-26f3-49ff-bedf-ef44e7004c79 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.909759 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1381/2742] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:17:55.912276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.926920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.928577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.929320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.930126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.932163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.936954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.953220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55878-8979-4936-ae30-a64c043718aa service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:55.966909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:55.967856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:55.968304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:55.968752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:55.969808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:17:55.970861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:55.975169 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1362/2743] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:55.979875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:55.980784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:55.993781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc849ee-3d0b-477d-9c00-dea29863b613 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.002170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbfdf1-d775-41b9-b002-3d0dce85fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.002170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfdf1-d775-41b9-b002-3d0dce85fdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.002170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfdf1-d775-41b9-b002-3d0dce85fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.002170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfdf1-d775-41b9-b002-3d0dce85fdb4 admin admin] PATH_INFO: `/v3/projects/42a10fcdbd9c42518b28ca8a2d9b7c1a/users/98da4b117139423aa99f3597de54c56b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.010051 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1382/2744] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:17:56.011113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:56.045623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30592d-5e74-4632-a2f2-202e211da592 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.057506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.058140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.058449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.058722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.059357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.061277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.086449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfdf1-d775-41b9-b002-3d0dce85fdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a10fcdbd9c42518b28ca8a2d9b7c1a, user_id=98da4b117139423aa99f3597de54c56b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.089397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfdf1-d775-41b9-b002-3d0dce85fdb4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.128532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1383/2745] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:17:56 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:17:56.130044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:56.138123 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1363/2746] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:17:55 2022] PUT /identity/v3/projects/42a10fcdbd9c42518b28ca8a2d9b7c1a/users/98da4b117139423aa99f3597de54c56b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:17:56.141371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.141548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.141811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.196651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:56.201649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:56.360982 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1364/2747] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:56.369030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d9c6-dce9-4f9d-af53-0b1264c3bafa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.385432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.386413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.386879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.387340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.388358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.390560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.436351 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1384/2748] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:17:56 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:17:56.444122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:56.465550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:56.467014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190fe6f-6c90-435c-9cd0-d2e27bff5819 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.467862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:56.481952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.483425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.484541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.484692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.488339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.489249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.508577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1365/2749] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:56.530838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:56.586290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd83b5-568d-409e-bfb9-b93a97e76fdc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.588677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:56.599193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.599862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.600147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.601899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.602613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.607016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.642490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1349-1406-4a3d-9f42-6f75a1252001 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.661742 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1366/2750] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:17:56.665567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:56.668819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a7b64-6839-4fa0-b46d-4fcd7003360e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.669461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a7b64-6839-4fa0-b46d-4fcd7003360e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.669746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a7b64-6839-4fa0-b46d-4fcd7003360e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.670025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a7b64-6839-4fa0-b46d-4fcd7003360e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.697706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbcd9-c604-463e-99bd-c4198ba16807 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:56.703508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a7b64-6839-4fa0-b46d-4fcd7003360e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.704661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a7b64-6839-4fa0-b46d-4fcd7003360e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.718824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:56.722852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.724498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.724894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] PATH_INFO: `/v3/projects/887866504aae4c5cb785afff8e63e3ab/users/4adcdf3712b443c18ff496cf5ff735ca/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.745050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1385/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:17:56.780078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887866504aae4c5cb785afff8e63e3ab, user_id=4adcdf3712b443c18ff496cf5ff735ca, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:56.786036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:56.828924 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1367/2752] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:17:56 2022] PUT /identity/v3/projects/887866504aae4c5cb785afff8e63e3ab/users/4adcdf3712b443c18ff496cf5ff735ca/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:17:56.834076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e00ce-cad7-413c-92f2-8ec4bfbe2e81 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:56.834408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e00ce-cad7-413c-92f2-8ec4bfbe2e81 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:56.834691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e00ce-cad7-413c-92f2-8ec4bfbe2e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:56.884676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e60e00ce-cad7-413c-92f2-8ec4bfbe2e81 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:17:56.890843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e60e00ce-cad7-413c-92f2-8ec4bfbe2e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:57.068842 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1386/2753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:17:57.128291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:17:57.130727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:17:57.249602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:17:57.302296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673208-5db1-40c1-b2b1-e36dccd1c4a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:17:57.313850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:17:57.315121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:17:57.315276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:17:57.315541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:17:57.335117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:17:57.336570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:17:57.364475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1368/2754] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:07.051278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=37 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:07.352015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:09.879783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5e9bb-0e0d-4495-89be-434abef6fed2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:09.880264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5e9bb-0e0d-4495-89be-434abef6fed2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:09.880398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5e9bb-0e0d-4495-89be-434abef6fed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:09.936400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-36e5e9bb-0e0d-4495-89be-434abef6fed2 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:09.941756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-36e5e9bb-0e0d-4495-89be-434abef6fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:10.162135 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1387/2755] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:18:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:10.163137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:10.428208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92567ee-26b1-4bad-a808-9fdc4d50a4b2 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:10.446076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:10.448834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:10.449406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:10.449753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:10.471996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:10.475915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:10.493796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1369/2756] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:18:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:18:14.213549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:14.214216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:14.214327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:14.368296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] MFA Rules not processed for user `4adcdf3712b443c18ff496cf5ff735ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:14.372754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:14.794754 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1388/2757] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 586 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:16.870081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:17.151900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b208-3f09-42aa-a304-6fddf3f74209 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:17.171203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:17.174163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:17.175205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:17.175992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:17.200452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:17.202558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:17.242120 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1370/2758] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:18.481627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:18.483125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:18.531495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc994c6-3e46-48fb-896b-a8aa99b1306d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:18.567005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:18.567725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:18.568011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:18.568289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] PATH_INFO: `/v3/users/76db24e099184aed9f1fa3b55ea28116` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:18.574471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76db24e099184aed9f1fa3b55ea28116)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:18.582356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:18.910347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76db24e099184aed9f1fa3b55ea28116'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:19.021914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76db24e099184aed9f1fa3b55ea28116'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:19.025031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76db24e099184aed9f1fa3b55ea28116'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:19.029356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76db24e099184aed9f1fa3b55ea28116'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:19.097269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dba1a3db-bbc2-4803-9eb4-07fe7ade4916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76db24e099184aed9f1fa3b55ea28116'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:19.189119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1389/2759] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:18:18 2022] DELETE /identity/v3/users/76db24e099184aed9f1fa3b55ea28116 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:18:22.114620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:22.138412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2352c2-cbfe-4141-86c0-e0b10a1e816c service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:22.370773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:22.371305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:22.371590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:22.374660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] PATH_INFO: `/v3/projects/d237752126f043208e50b229c481b1a0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:22.383713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d237752126f043208e50b229c481b1a0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:22.396064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:22.464393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:22.591137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd237752126f043208e50b229c481b1a0', 'request_id': 'req-2521e510-b053-4547-859e-3203c637a53b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:22.620861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd237752126f043208e50b229c481b1a0', 'request_id': 'req-2521e510-b053-4547-859e-3203c637a53b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:22.644683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd237752126f043208e50b229c481b1a0', 'request_id': 'req-2521e510-b053-4547-859e-3203c637a53b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:22.676319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] The token cache is being invalidate because project d237752126f043208e50b229c481b1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:18:22.676541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:22.677184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2521e510-b053-4547-859e-3203c637a53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:22.685445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1371/2760] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:18:22 2022] DELETE /identity/v3/projects/d237752126f043208e50b229c481b1a0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:18:22.687430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:22.687891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:22.687990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:22.710201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:22.743752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:22.745002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:22.992942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:22.993311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:22.993504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:22.994340 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1390/2761] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:23.062599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:23.074635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:23.097769 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1372/2762] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:23.099478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:23.116765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720e852-20f0-4ce5-990a-5020541ebf51 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:23.143454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:23.145338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.145819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.146322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.150327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:18:23.152961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:23.159037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:23.200042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:23.210980 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1391/2763] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:18:23.212396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80940768-eb96-49bd-b05b-3ba15e6a0342 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:23.238877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:23.241193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.241897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.245203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.246358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:23.253158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:23.329852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:23.340326 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1373/2764] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:18:23 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:18:23.353521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584df49-f846-404d-8887-29f4336d1202 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:23.525585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:23.530422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.530741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.531030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.532028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:23.541479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:23.604296 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1392/2765] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:18:23 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:18:23.607546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:23.625153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1e8c-fcb4-4104-b1eb-3d25a1d3dffe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:23.636715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:23.637359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.638845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.639885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.641214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:23.645020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:23.675127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1374/2766] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:18:23.678841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:23.695127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21891be4-6964-4abc-80a2-6714506d41fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:23.717727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01352c5a-36ba-4a83-89ae-5180fab99763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:23.718409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01352c5a-36ba-4a83-89ae-5180fab99763 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.718691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01352c5a-36ba-4a83-89ae-5180fab99763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.718968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01352c5a-36ba-4a83-89ae-5180fab99763 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.719627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01352c5a-36ba-4a83-89ae-5180fab99763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:23.731172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01352c5a-36ba-4a83-89ae-5180fab99763 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:23.765192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:23.771713 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1393/2767] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:18:23.778292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef04d7-c328-4a69-ae2c-d0d4c7148ec8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:23.786563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:23.788751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.789059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.789342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] PATH_INFO: `/v3/projects/26679ed16267414baeb79fd77703a82f/users/32107fb54d6c4073b18b0cc9860abe32/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.840663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26679ed16267414baeb79fd77703a82f, user_id=32107fb54d6c4073b18b0cc9860abe32, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:23.846330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:23.874114 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1375/2768] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:18:23 2022] PUT /identity/v3/projects/26679ed16267414baeb79fd77703a82f/users/32107fb54d6c4073b18b0cc9860abe32/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:18:23.879683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d33f20-e2a0-420c-b208-329c8e246466 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:23.879970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d33f20-e2a0-420c-b208-329c8e246466 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:23.880458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d33f20-e2a0-420c-b208-329c8e246466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:23.928851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-93d33f20-e2a0-420c-b208-329c8e246466 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:23.932404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-93d33f20-e2a0-420c-b208-329c8e246466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:24.081511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1394/2769] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:24.228713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:24.232581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:24.387540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca67cfe-93e6-4fd6-81df-828158ead86d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:24.401027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9801fbd-c605-4523-b97d-30e698a10974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:24.402384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801fbd-c605-4523-b97d-30e698a10974 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:24.402974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801fbd-c605-4523-b97d-30e698a10974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:24.404476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801fbd-c605-4523-b97d-30e698a10974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:24.444145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801fbd-c605-4523-b97d-30e698a10974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:24.449277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801fbd-c605-4523-b97d-30e698a10974 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:24.498454 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1376/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:25.714877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae04cfb-e79b-420a-afc4-07e9c4dd8564 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:25.715497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae04cfb-e79b-420a-afc4-07e9c4dd8564 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:25.715497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae04cfb-e79b-420a-afc4-07e9c4dd8564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:25.784623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cae04cfb-e79b-420a-afc4-07e9c4dd8564 None None] MFA Rules not processed for user `4adcdf3712b443c18ff496cf5ff735ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:25.786591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cae04cfb-e79b-420a-afc4-07e9c4dd8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:25.813419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:25.953668 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1395/2771] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:26.324117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:26.324585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:26.324688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:26.435564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:26.439465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:26.615994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:26.784934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:26.785515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:26.785621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1377/2772] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:26.785757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:26.871328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:26.875619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:26.887874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1396/2773] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:18:27.755821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:27.764956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:28.003149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb816-afc0-44ee-aca0-dfe0ee7a0d51 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:28.035911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:28.039217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:28.039751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:28.040255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:28.065960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:28.067962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:28.114510 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1378/2774] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:33.801608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:33.803728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:33.993051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f6a2-6f9c-4ccd-b911-7d85b85b207d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:34.001850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:34.004252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:34.004808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:34.005323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:34.010447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:34.056393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:34.058421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873884f-f1eb-4fda-a2a1-e4c585d78c11 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:34.107833 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1397/2775] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:34.268559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:34.275889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:34.301806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96805a51-bafa-4d71-a773-63c0e8cfe966 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:34.319149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:34.319873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:34.320268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:34.320898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:34.332061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:34.368187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:34.373140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:34.404106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1379/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:38.465210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0e60a-651d-449e-9bc6-1534908009af None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:38.466627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0e60a-651d-449e-9bc6-1534908009af None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:38.467214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0e60a-651d-449e-9bc6-1534908009af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:38.503111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-55e0e60a-651d-449e-9bc6-1534908009af None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:38.504703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-55e0e60a-651d-449e-9bc6-1534908009af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:38.713206 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1398/2777] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:18:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:38.717785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:38.720817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:38.880122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582ea1-c3dd-44a3-8f5e-0eabb90acb1d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:38.887910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cd4ff-0207-4a93-b68e-f359cb948e08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:38.888978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cd4ff-0207-4a93-b68e-f359cb948e08 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:38.889490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cd4ff-0207-4a93-b68e-f359cb948e08 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:38.890426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cd4ff-0207-4a93-b68e-f359cb948e08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:38.905891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cd4ff-0207-4a93-b68e-f359cb948e08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:38.908164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cd4ff-0207-4a93-b68e-f359cb948e08 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:38.918899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1380/2778] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:18:40.280512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:40.281514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:40.282277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:40.331434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] MFA Rules not processed for user `614a5366d0d14df6b7ab4530882646f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:40.333145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:40.467708 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1399/2779] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:41.686569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d00aaa-6a7e-44d8-9314-9199fd99678f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:41.688312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d00aaa-6a7e-44d8-9314-9199fd99678f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:41.689034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d00aaa-6a7e-44d8-9314-9199fd99678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:41.750087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-32d00aaa-6a7e-44d8-9314-9199fd99678f None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:41.753987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-32d00aaa-6a7e-44d8-9314-9199fd99678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:41.827555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:41.885303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1381/2780] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:44.925401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:44.930423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:44.951799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:44.967242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110908-e7e0-4c0b-af78-ff2e78e4992d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:44.981364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:44.983310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:44.983596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:44.983878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] PATH_INFO: `/v3/users/e478de82935c4f9b93a698e3fa3c6d78` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:44.986442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e478de82935c4f9b93a698e3fa3c6d78)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:44.988438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:45.090437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edcb42-1b8e-4442-ae4a-7fa7b956fc0e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:45.091353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edcb42-1b8e-4442-ae4a-7fa7b956fc0e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:45.092487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edcb42-1b8e-4442-ae4a-7fa7b956fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:45.173941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e478de82935c4f9b93a698e3fa3c6d78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:45.193257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c0edcb42-1b8e-4442-ae4a-7fa7b956fc0e None None] MFA Rules not processed for user `32107fb54d6c4073b18b0cc9860abe32`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:45.198387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c0edcb42-1b8e-4442-ae4a-7fa7b956fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:45.219648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e478de82935c4f9b93a698e3fa3c6d78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:45.229747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e478de82935c4f9b93a698e3fa3c6d78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:45.247537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e478de82935c4f9b93a698e3fa3c6d78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:45.301419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76708022-7fe9-4432-a232-f5c0256d7a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e478de82935c4f9b93a698e3fa3c6d78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:45.345249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1400/2781] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:18:44 2022] DELETE /identity/v3/users/e478de82935c4f9b93a698e3fa3c6d78 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:18:45.353754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:45.354259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:45.354752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:45.409265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:45.417528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:45.538337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1382/2782] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:45.547949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:45.551151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:45.551620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:45.650083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] MFA Rules not processed for user `32107fb54d6c4073b18b0cc9860abe32`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:45.652474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1401/2783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:45.654092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:45.877062 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1383/2784] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:46.085958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:46.087611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:46.316861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234f86-0d01-4365-b287-bf57d1cd977c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:46.330922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:46.332963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:46.333456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:46.335668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:46.355357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:46.358445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:46.371499 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1402/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:46.689344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:46.691075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:46.895155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ca33b-b769-412b-9850-b98d2954c43d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:46.904896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:46.905646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:46.906241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:46.906666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:46.919437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:46.920705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:46.920929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:46.923550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:46.931925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:46.957555 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1384/2786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:46.971542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4db2b-0552-492b-943a-7b8d67b9e55e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:46.994402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:46.995398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:46.995398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:46.995637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:47.003272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:47.061614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:47.167802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:47.170136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:47.206532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1403/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:18:47.905403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:47.908772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:47.961841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91e36b-17ce-43f9-a1f6-9186b8a5d9b1 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:47.986847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:47.987524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:47.991390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:47.993191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] PATH_INFO: `/v3/projects/11ed857b7c084a1b96573501c47be1f5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:48.002498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ed857b7c084a1b96573501c47be1f5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:48.006926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:48.151496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ed857b7c084a1b96573501c47be1f5', 'request_id': 'req-f976d56e-7209-4b6b-b480-8c4d026c1dc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.171128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ed857b7c084a1b96573501c47be1f5', 'request_id': 'req-f976d56e-7209-4b6b-b480-8c4d026c1dc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.191496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ed857b7c084a1b96573501c47be1f5', 'request_id': 'req-f976d56e-7209-4b6b-b480-8c4d026c1dc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.229218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] The token cache is being invalidate because project 11ed857b7c084a1b96573501c47be1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:18:48.229518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.232616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.239328 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1385/2788] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:18:47 2022] DELETE /identity/v3/projects/11ed857b7c084a1b96573501c47be1f5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:18:48.243937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:48.262709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dba78-3fba-4fb7-b5a2-57509a627d89 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:48.444900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:48.446059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:48.446659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:48.448134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] PATH_INFO: `/v3/users/7b8a99bedd9d4f99a70445ffe7462b84` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:48.451330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8a99bedd9d4f99a70445ffe7462b84)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:48.455106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:48.574869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8a99bedd9d4f99a70445ffe7462b84'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.630486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8a99bedd9d4f99a70445ffe7462b84'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.632335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8a99bedd9d4f99a70445ffe7462b84'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.632335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8a99bedd9d4f99a70445ffe7462b84'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.644639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-674e0060-9d66-4826-8abf-a9923b537a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8a99bedd9d4f99a70445ffe7462b84'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:48.692656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1404/2789] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:18:48 2022] DELETE /identity/v3/users/7b8a99bedd9d4f99a70445ffe7462b84 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:18:49.284474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:49.288014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:49.334793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976d56e-7209-4b6b-b480-8c4d026c1dc4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:49.554299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:49.555354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:49.555816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:49.557614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] PATH_INFO: `/v3/projects/41628f6a7a2d4d71a150109f875c618e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:49.561223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41628f6a7a2d4d71a150109f875c618e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:49.563679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:49.748646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41628f6a7a2d4d71a150109f875c618e', 'request_id': 'req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:49.766340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41628f6a7a2d4d71a150109f875c618e', 'request_id': 'req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:49.783057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41628f6a7a2d4d71a150109f875c618e', 'request_id': 'req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:49.804171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] The token cache is being invalidate because project 41628f6a7a2d4d71a150109f875c618e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:18:49.804531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:49.805959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b13fe0cc-12ec-4fb1-b589-946d51dd00c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:18:49.813219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1386/2790] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:18:49 2022] DELETE /identity/v3/projects/41628f6a7a2d4d71a150109f875c618e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:18:49.820444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:49.821058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:49.821058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:49.879858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:49.881524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:49.957221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:50.057857 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1405/2791] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:50.066659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.066931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.067295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.128209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:50.133709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:50.183155 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1387/2792] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:50.186969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:50.209740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599d6a-7604-42a3-9263-853cfaf901ff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:50.254780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:50.257435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.257926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.258426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.259314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:18:50.259825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:50.263181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:50.280074 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1406/2793] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:18:50.284473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:50.297303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d0e12-5b71-44a1-8db9-6d0d856a0fc1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:50.309201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:50.310546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.311119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.311677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.312685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:50.316497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:50.322958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:50.386317 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1388/2794] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:18:50 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:18:50.390303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:50.425452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450c3d-e5e8-4c9e-badc-4bdd64e5778c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:50.613705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:50.615871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.618129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.619430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.622379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:50.624788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:50.710952 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1407/2795] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:18:50 2022] POST /identity/v3/users => generated 289 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:18:50.715057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:50.731762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633139-7ced-44dc-a005-7fdcd76bfa7c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:50.752788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:50.753753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.754290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.754831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.755730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:50.760258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:50.792920 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1389/2796] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:18:50.796730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:50.810020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6fa98-6113-426a-aa84-8be04b4012e2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:50.816860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87eb42-1562-462d-a9f9-7671afe17590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:50.817963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87eb42-1562-462d-a9f9-7671afe17590 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.818434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87eb42-1562-462d-a9f9-7671afe17590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.818879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87eb42-1562-462d-a9f9-7671afe17590 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.819718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87eb42-1562-462d-a9f9-7671afe17590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:50.823642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87eb42-1562-462d-a9f9-7671afe17590 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:50.874004 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1408/2797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:18:50.874865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:50.889727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ed9e3-36a3-4211-addd-89218114af63 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:50.896379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:50.897209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:50.897523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:50.897909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] PATH_INFO: `/v3/projects/492c6aa065944fb1afb7bd55c4eb319c/users/ae41d5fce51446109297de8e12b376ed/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:50.946733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492c6aa065944fb1afb7bd55c4eb319c, user_id=ae41d5fce51446109297de8e12b376ed, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:50.950372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:51.002657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45a96-dfc2-46a9-b0c8-eac9fe3e9cc0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:51.003421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45a96-dfc2-46a9-b0c8-eac9fe3e9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:51.003947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45a96-dfc2-46a9-b0c8-eac9fe3e9cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:51.007807 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1390/2798] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:18:50 2022] PUT /identity/v3/projects/492c6aa065944fb1afb7bd55c4eb319c/users/ae41d5fce51446109297de8e12b376ed/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:18:51.071345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4ed45a96-dfc2-46a9-b0c8-eac9fe3e9cc0 None None] MFA Rules not processed for user `ae41d5fce51446109297de8e12b376ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:51.075071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ed45a96-dfc2-46a9-b0c8-eac9fe3e9cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:51.269436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1409/2799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:55.145686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:55.151809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:55.256779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2fa3b-fef6-4875-8180-85ea16863281 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:55.269541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:55.270328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:55.270697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:55.271041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:55.279874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:55.281640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:55.294217 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1391/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:18:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:18:55.494667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d42f3-2371-45e9-8fef-398e3488246e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:55.495255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d42f3-2371-45e9-8fef-398e3488246e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:55.495513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d42f3-2371-45e9-8fef-398e3488246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:55.520568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-135d42f3-2371-45e9-8fef-398e3488246e None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:55.522335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-135d42f3-2371-45e9-8fef-398e3488246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:55.554446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:18:55.608944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1410/2801] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:18:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:55.623038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:55.628638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:55.743754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c59e3c-d57d-4809-84ca-84c7c8facdef service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:55.751633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25078b-d6d3-4144-b6fe-3b4d55112b23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:55.753880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25078b-d6d3-4144-b6fe-3b4d55112b23 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:55.753880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25078b-d6d3-4144-b6fe-3b4d55112b23 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:55.753880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25078b-d6d3-4144-b6fe-3b4d55112b23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:55.764643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25078b-d6d3-4144-b6fe-3b4d55112b23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:55.766384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25078b-d6d3-4144-b6fe-3b4d55112b23 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:55.789497 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1392/2802] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:18:56.015514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:56.015843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:56.016118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:56.038794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] MFA Rules not processed for user `ae41d5fce51446109297de8e12b376ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:56.040365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:56.049569 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1411/2803] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:18:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:56.127724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106eb08-017f-44b2-94ff-2c606bf23fea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:56.128013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106eb08-017f-44b2-94ff-2c606bf23fea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:56.128293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106eb08-017f-44b2-94ff-2c606bf23fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:56.168576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f106eb08-017f-44b2-94ff-2c606bf23fea None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:18:56.172244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f106eb08-017f-44b2-94ff-2c606bf23fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:18:56.202489 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1393/2804] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:18:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:18:56.217661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:18:56.245392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424e1de-9e21-4965-8921-613f3b795aae None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:18:56.256444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:18:56.257357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:18:56.257646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:18:56.259132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:18:56.274810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:18:56.279825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:18:56.318088 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1412/2805] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:19:00.086911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:00.088166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:00.088316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:00.139101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:00.187722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:00.189340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:00.247831 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1394/2806] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:19:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:00.270565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:00.356307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889f498-ef93-4633-a68e-83c4b4b79e1a service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:00.362099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a121a6-366d-4c55-bcf7-fae3ad55b527 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:00.363060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a121a6-366d-4c55-bcf7-fae3ad55b527 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:00.363534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a121a6-366d-4c55-bcf7-fae3ad55b527 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:00.363847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a121a6-366d-4c55-bcf7-fae3ad55b527 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:00.373267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a121a6-366d-4c55-bcf7-fae3ad55b527 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:00.375131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a121a6-366d-4c55-bcf7-fae3ad55b527 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:00.386527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1413/2807] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:19:00.610854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:00.774164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0bedd-67d8-4910-a427-797e71054742 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:00.779161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:00.781925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:00.781925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:00.782922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] PATH_INFO: `/v3/users/ae41d5fce51446109297de8e12b376ed` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:00.794184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae41d5fce51446109297de8e12b376ed)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:00.800570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:00.930706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae41d5fce51446109297de8e12b376ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:00.942607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae41d5fce51446109297de8e12b376ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:00.943307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae41d5fce51446109297de8e12b376ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:00.944090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae41d5fce51446109297de8e12b376ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:00.952882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae41d5fce51446109297de8e12b376ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:00.989473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1395/2808] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:19:00 2022] DELETE /identity/v3/users/ae41d5fce51446109297de8e12b376ed => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:00.994599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:00.994968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:00.995305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:01.033267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:01.036901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:01.185128 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1414/2809] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:01.196905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:01.201580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:01.365150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5338-e063-42b9-8ab9-c29dddae2f57 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:01.369641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbaf8-6c03-4c92-88c5-a0557c7093f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:01.370303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbaf8-6c03-4c92-88c5-a0557c7093f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:01.370586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbaf8-6c03-4c92-88c5-a0557c7093f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:01.370866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbaf8-6c03-4c92-88c5-a0557c7093f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:01.380400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:01.390277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fbaf8-6c03-4c92-88c5-a0557c7093f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:01.392082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fbaf8-6c03-4c92-88c5-a0557c7093f3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:01.404303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1396/2810] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:02.153828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:02.156160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:02.194267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa635125-0a15-4d1f-86f9-a7dd67e66fbc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:02.209110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:02.210183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:02.210648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:02.211082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] PATH_INFO: `/v3/projects/492c6aa065944fb1afb7bd55c4eb319c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:02.212542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492c6aa065944fb1afb7bd55c4eb319c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:02.214698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:02.327483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492c6aa065944fb1afb7bd55c4eb319c', 'request_id': 'req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:02.343334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492c6aa065944fb1afb7bd55c4eb319c', 'request_id': 'req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:02.360725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492c6aa065944fb1afb7bd55c4eb319c', 'request_id': 'req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:02.364624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:02.382706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] The token cache is being invalidate because project 492c6aa065944fb1afb7bd55c4eb319c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:19:02.383298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:02.384284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c72308ba-8c3c-4b5b-861c-ff8e3b1b47c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:02.386967 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1415/2811] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:19:02 2022] DELETE /identity/v3/projects/492c6aa065944fb1afb7bd55c4eb319c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:02.392809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:02.393702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:02.394165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:02.458093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:02.459567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:02.588664 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1397/2812] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:02.597074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:02.597607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:02.598056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:02.643331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:02.644821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:02.665770 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1416/2813] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:02.670108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:02.682726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad30a6f-a6e1-449e-90be-994dc845dbcc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:02.689585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:02.690801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:02.691318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:02.691826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:02.692663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:19:02.693182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:02.695161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:02.714806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:02.719400 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1398/2814] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:19:02.728662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16ca2-6092-44e4-ba80-b5af8df3e16e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:02.765351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:02.775009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:02.775009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:02.775009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:02.775009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:02.790987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:03.003485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1417/2815] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:19:02 2022] POST /identity/v3/projects => generated 411 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:03.007818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:03.039298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae9d5-6ff2-4cb9-915d-49d2841af8c8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:03.189490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:03.190458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:03.190851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:03.191226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:03.191971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:03.194193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:03.236759 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1399/2816] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:19:03 2022] POST /identity/v3/users => generated 306 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:03.237655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:03.253729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3a6b-a47b-4eb1-a565-0018e28ed698 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:03.269033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:03.269690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:03.269974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:03.270283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:03.271507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:03.274320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:03.291051 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1418/2817] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:03.294946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:03.306653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b76e5a-a39a-4862-8f0b-2da80d261be1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:03.312354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544cba-97f0-42a4-8556-c0f4ed650942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:03.312976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544cba-97f0-42a4-8556-c0f4ed650942 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:03.313292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544cba-97f0-42a4-8556-c0f4ed650942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:03.313678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544cba-97f0-42a4-8556-c0f4ed650942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:03.314476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3544cba-97f0-42a4-8556-c0f4ed650942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:03.316070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3544cba-97f0-42a4-8556-c0f4ed650942 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:03.330248 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1400/2818] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:03.334407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:03.345601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801e1c-059d-49f3-a7d5-20171b02a2cc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:03.350962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:03.351637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:03.351916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:03.352190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] PATH_INFO: `/v3/projects/2fa8944f919b484e9a366271744acd71/users/09b213bfb6a64ce68ef442d462242ff6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:03.373044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa8944f919b484e9a366271744acd71, user_id=09b213bfb6a64ce68ef442d462242ff6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:03.377568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:03.399065 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1419/2819] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:19:03 2022] PUT /identity/v3/projects/2fa8944f919b484e9a366271744acd71/users/09b213bfb6a64ce68ef442d462242ff6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:03.401418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:03.401944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:03.402781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:03.426449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:03.426449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:03.488229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:03.503464 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1401/2820] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:03.513060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:03.514951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:03.583639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c1d1d-a25a-41ff-96a7-1d0c8c4cd5ed admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:03.587353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a869ff-e2d5-44f2-a718-eb15c80a9d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:03.588042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a869ff-e2d5-44f2-a718-eb15c80a9d56 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:03.588389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a869ff-e2d5-44f2-a718-eb15c80a9d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:03.588733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a869ff-e2d5-44f2-a718-eb15c80a9d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:03.599814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a869ff-e2d5-44f2-a718-eb15c80a9d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:03.601355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a869ff-e2d5-44f2-a718-eb15c80a9d56 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:03.622507 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1420/2821] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:09.434089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:09.435758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:09.694090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea38c3-91ad-49c5-b339-d48161cb696f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:09.708987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:09.708987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:09.708987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:09.708987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:09.712993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:09.894763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:09.901574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f917f-b889-40c4-9f41-434867702d20 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:09.921321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1402/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:10.103074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534e968-c32c-4a14-98c3-e08917927ca0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:10.104643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534e968-c32c-4a14-98c3-e08917927ca0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:10.106587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534e968-c32c-4a14-98c3-e08917927ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:10.154602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d534e968-c32c-4a14-98c3-e08917927ca0 None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:10.158664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d534e968-c32c-4a14-98c3-e08917927ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:10.350927 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1421/2823] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:11.851313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:11.851983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:11.852101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:11.920243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] MFA Rules not processed for user `09b213bfb6a64ce68ef442d462242ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:11.921967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:12.124040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1403/2824] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:11 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:12.136134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:12.136737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:12.136737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:12.179724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] MFA Rules not processed for user `09b213bfb6a64ce68ef442d462242ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:12.181088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:12.207305 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1422/2825] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:12 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:12.478968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:12.481868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:12.520984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:12.706991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa886bd-9949-4da0-8a4c-416b50e38554 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:12.724140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af85975-7f02-41ea-ace9-24713ab3f88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:12.725944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af85975-7f02-41ea-ace9-24713ab3f88f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:12.727001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af85975-7f02-41ea-ace9-24713ab3f88f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:12.727790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af85975-7f02-41ea-ace9-24713ab3f88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:12.752255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af85975-7f02-41ea-ace9-24713ab3f88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:12.756219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af85975-7f02-41ea-ace9-24713ab3f88f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:12.787800 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1404/2826] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:12 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:13.174732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:13.180976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:13.247440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:13.383112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a110-e65c-42fd-8ca8-37f90503dedf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:13.398269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:13.398956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:13.399235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:13.399513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:13.405718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:13.419545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:13.421486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:13.439768 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1423/2827] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:15.020836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:15.022499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:15.023026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:15.109709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:15.120240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:15.352236 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1405/2828] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:15.398623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:15.400384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:15.626615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edeee0-3771-4fa2-af4f-062a8c6b71f5 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:15.640777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:15.641611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:15.641993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:15.642397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:15.681064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:15.686744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:15.711224 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1424/2829] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:19:17.807010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:17.808530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:17.849118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766ad4-d88f-493e-b5b5-c8cab63b8247 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:17.855726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:17.856578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:17.857054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:17.858123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:17.863038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:18.003492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:18.007275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:18.034310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1406/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:22.847986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:22.851261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:22.873848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5275ce-8ecf-420b-b311-aba1c0eac3df service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:22.881992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:22.882827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:22.883267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:22.883726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:22.885870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:22.902576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:22.904548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5c42a-8911-4d73-8908-fcf7175df56f service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:22.927675 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1425/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:26.824303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:26.826260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:26.850745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e48ef-6ff7-4d95-8f3e-cf2771f98744 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:26.861706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:26.862412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:26.862760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:26.863104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] PATH_INFO: `/v3/users/c2fd2abad1824b79b27bb419d8656150` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:26.864204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fd2abad1824b79b27bb419d8656150)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:26.866426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:26.957850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:26.967099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fd2abad1824b79b27bb419d8656150'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:26.985096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fd2abad1824b79b27bb419d8656150'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:26.986849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fd2abad1824b79b27bb419d8656150'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:26.987874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fd2abad1824b79b27bb419d8656150'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:26.997674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fd2abad1824b79b27bb419d8656150'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:27.026619 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1407/2832] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:19:26 2022] DELETE /identity/v3/users/c2fd2abad1824b79b27bb419d8656150 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:27.027371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:27.027884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:27.027991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:27.060532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:27.062226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:27.151566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1426/2833] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:27.177443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:27.185912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:27.349948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd12ae-d125-441a-a4ee-6cf37c1b8310 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:27.357738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:27.358866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:27.359158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:27.359436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:27.378740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:27.380207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:27.401817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1408/2834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:29.246207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:29.248649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:29.286442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475916ea-f43a-4e21-8b4e-f35bf40b2fc3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:29.306623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:29.307491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:29.307964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:29.308489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] PATH_INFO: `/v3/users/32107fb54d6c4073b18b0cc9860abe32` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:29.310098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32107fb54d6c4073b18b0cc9860abe32)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:29.313668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:29.339171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:29.411402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32107fb54d6c4073b18b0cc9860abe32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.441522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32107fb54d6c4073b18b0cc9860abe32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.443436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32107fb54d6c4073b18b0cc9860abe32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.445143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32107fb54d6c4073b18b0cc9860abe32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.476330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32107fb54d6c4073b18b0cc9860abe32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.507170 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1427/2835] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:19:29 2022] DELETE /identity/v3/users/32107fb54d6c4073b18b0cc9860abe32 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:29.537014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:29.539041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:29.583496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ecac-1227-4db7-ba91-cc7e8b11c0d5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:29.772840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:29.773521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:29.773804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:29.774081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] PATH_INFO: `/v3/projects/1d80968809a84715a7d8cb6abc8e6b49` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:29.775320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d80968809a84715a7d8cb6abc8e6b49)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:29.777294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:29.905876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d80968809a84715a7d8cb6abc8e6b49', 'request_id': 'req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.937486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d80968809a84715a7d8cb6abc8e6b49', 'request_id': 'req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.950116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:29.961193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d80968809a84715a7d8cb6abc8e6b49', 'request_id': 'req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.992082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] The token cache is being invalidate because project 1d80968809a84715a7d8cb6abc8e6b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:19:29.992724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.994674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:29.998073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1409/2836] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:19:29 2022] DELETE /identity/v3/projects/1d80968809a84715a7d8cb6abc8e6b49 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:30.004947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.008405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:30.038909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923eb40-963d-419c-82fd-e3fcd3cab92a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:30.133389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.135497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:30.161897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:30.163304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.163707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.164317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] PATH_INFO: `/v3/users/b30d5c5fc0704d6ea0079f48af5ab617` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.165914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30d5c5fc0704d6ea0079f48af5ab617)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:30.168432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:30.282350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30d5c5fc0704d6ea0079f48af5ab617'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.303560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30d5c5fc0704d6ea0079f48af5ab617'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.304677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30d5c5fc0704d6ea0079f48af5ab617'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.305853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30d5c5fc0704d6ea0079f48af5ab617'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.315808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad9e88-c971-40e0-a093-b9ba17f8b2a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:30.317021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e394d87-b73f-4a66-92a3-9c90d0e14262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30d5c5fc0704d6ea0079f48af5ab617'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.322786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:30.323699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.324187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.324484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] PATH_INFO: `/v3/projects/26679ed16267414baeb79fd77703a82f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.325910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26679ed16267414baeb79fd77703a82f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:30.328304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:30.335694 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1428/2837] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:19:30 2022] DELETE /identity/v3/users/b30d5c5fc0704d6ea0079f48af5ab617 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:30.390675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26679ed16267414baeb79fd77703a82f', 'request_id': 'req-7f563562-3eec-4d44-ab7e-4f1b0073679f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.400986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26679ed16267414baeb79fd77703a82f', 'request_id': 'req-7f563562-3eec-4d44-ab7e-4f1b0073679f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.411618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26679ed16267414baeb79fd77703a82f', 'request_id': 'req-7f563562-3eec-4d44-ab7e-4f1b0073679f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.430289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] The token cache is being invalidate because project 26679ed16267414baeb79fd77703a82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:19:30.431202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.431538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f563562-3eec-4d44-ab7e-4f1b0073679f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:30.433908 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1410/2838] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:19:30 2022] DELETE /identity/v3/projects/26679ed16267414baeb79fd77703a82f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:30.440521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.440925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.441222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.466928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:30.468299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:30.474419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:30.595320 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1429/2839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:30.597306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.597794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.597889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.630428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:30.632039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:30.647068 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1411/2840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:30.651589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.663731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b452f4-262e-4ecc-bdab-d6307e6bc157 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:30.670577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:30.671372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.671706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.673357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.674119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:19:30.674926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:30.678590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:30.706348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.706563 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1430/2841] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:19:30.718929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217a9c5-c7f5-4751-b17a-c8e92652b659 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:30.727138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:30.727946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.728231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.728564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.729211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:30.731827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:30.776445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1412/2842] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:19:30 2022] POST /identity/v3/projects => generated 395 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:30.778755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.790411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05453ca9-b747-45a9-9086-8676246cba94 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:30.837262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.839638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:30.928472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:30.929304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:30.930516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:30.931078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:30.933943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:30.936298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:30.983334 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1431/2843] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:19:30 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:30.986920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:30.995004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:31.002268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f993fb9-4412-4184-938e-c1a396d5df37 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.009029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.009794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.011077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.011712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.012477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.017024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.017726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec9d6-317c-4078-aa44-35fb37243ac7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.028367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.030047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.030527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.031041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] PATH_INFO: `/v3/projects/5f302b498abd4d5e87b308668fcc4c56` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.032936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f302b498abd4d5e87b308668fcc4c56)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.034214 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1432/2844] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:19:31.038979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.039573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.055171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5083-5f3a-406a-81b1-5b5e0c36981f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.082582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.083679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.084059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.084305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.085310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.087735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.105034 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1433/2845] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:31.109095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.113599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f302b498abd4d5e87b308668fcc4c56', 'request_id': 'req-113a34ee-8529-4518-ac76-502cd49a45b1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:31.121243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b1b35-ea07-4377-affe-4d496c68c308 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.122793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f302b498abd4d5e87b308668fcc4c56', 'request_id': 'req-113a34ee-8529-4518-ac76-502cd49a45b1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:31.133885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f302b498abd4d5e87b308668fcc4c56', 'request_id': 'req-113a34ee-8529-4518-ac76-502cd49a45b1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:31.157590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] The token cache is being invalidate because project 5f302b498abd4d5e87b308668fcc4c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:19:31.158330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:31.159182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-113a34ee-8529-4518-ac76-502cd49a45b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:31.161663 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1413/2846] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:19:30 2022] DELETE /identity/v3/projects/5f302b498abd4d5e87b308668fcc4c56 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:31.169000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73e392-a87a-44f1-96a7-a580c692df9e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.169485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73e392-a87a-44f1-96a7-a580c692df9e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.169993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73e392-a87a-44f1-96a7-a580c692df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.199640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6c73e392-a87a-44f1-96a7-a580c692df9e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:31.202000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6c73e392-a87a-44f1-96a7-a580c692df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.206191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf7f5a-c288-4404-8902-bdcb40b8acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.207136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7f5a-c288-4404-8902-bdcb40b8acc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.207528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7f5a-c288-4404-8902-bdcb40b8acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.207994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7f5a-c288-4404-8902-bdcb40b8acc2 admin admin] PATH_INFO: `/v3/projects/4246d2264e594cfdad879fed341df731/users/cbc7f4f8fce340bd9450d40f9896b418/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.221874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:31.233279 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1414/2847] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:19:31.235793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df6337-6718-4338-b35c-92a11447f496 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.236091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df6337-6718-4338-b35c-92a11447f496 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.237114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df6337-6718-4338-b35c-92a11447f496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.237664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7f5a-c288-4404-8902-bdcb40b8acc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4246d2264e594cfdad879fed341df731, user_id=cbc7f4f8fce340bd9450d40f9896b418, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.241813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf7f5a-c288-4404-8902-bdcb40b8acc2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.277826 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1434/2848] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:19:31 2022] PUT /identity/v3/projects/4246d2264e594cfdad879fed341df731/users/cbc7f4f8fce340bd9450d40f9896b418/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:31.278049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-93df6337-6718-4338-b35c-92a11447f496 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:31.278049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93df6337-6718-4338-b35c-92a11447f496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.281416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.282422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.283606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.344035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] MFA Rules not processed for user `cbc7f4f8fce340bd9450d40f9896b418`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:31.346761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.409841 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1415/2849] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:31.409841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df6337-6718-4338-b35c-92a11447f496 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.425825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df6337-6718-4338-b35c-92a11447f496 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.439509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.440156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.440446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.440709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.441376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:19:31.441698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.443481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca12000-d655-43e0-8dcc-eb23da378a86 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.484028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1416/2850] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:19:31.486419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.486715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.486995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.495613 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1435/2851] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:31.496839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.520317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3277d-25c5-4688-9493-7e504e061663 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.525552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.526210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.526563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.526758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.527073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:31.527456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.528406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.529391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.564332 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1436/2852] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:31.566292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.568696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.599653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1417/2853] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:31.600559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.612710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b477b-ca0a-4b6f-b5fe-23c1404d4abb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.617736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:31.659244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043245-ab09-4f55-a44a-f03fd5043a8b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.665221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.665856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.666170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.666480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.680125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.680842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.681122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.681398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.682076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.684030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.707577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1418/2854] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:31.708063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.711791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.725367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:31.735866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.738670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.749742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1437/2855] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:31 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:31.751206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.761900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36cc77-f678-4891-963a-8a387308ebe5 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.767887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.768716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.769164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.769625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.770488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.772272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.784246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1438/2856] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:31.788039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.799279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac762ec-51c0-4409-b968-c77664f6d94d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.803572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfad8ed-07d5-4ebb-888c-d2421b80b265 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.809332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4974d-cf32-4487-8760-f9793fa8f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.809878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.810009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4974d-cf32-4487-8760-f9793fa8f484 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.810323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4974d-cf32-4487-8760-f9793fa8f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.810607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4974d-cf32-4487-8760-f9793fa8f484 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.810940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.811319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4974d-cf32-4487-8760-f9793fa8f484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.811447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.811819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.813253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4974d-cf32-4487-8760-f9793fa8f484 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.826644 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1439/2857] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:19:31.829158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.829475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.829720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.853282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] MFA Rules not processed for user `cbc7f4f8fce340bd9450d40f9896b418`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:31.854834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:31.863295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1440/2858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:31.864179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:31.878396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d7aa5-46bf-4ab9-a16c-056d6f74a5e6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:31.883493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e4989-dbec-4256-9f69-d697e249e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:31.884167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e4989-dbec-4256-9f69-d697e249e42f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.884453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e4989-dbec-4256-9f69-d697e249e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.884738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e4989-dbec-4256-9f69-d697e249e42f admin admin] PATH_INFO: `/v3/projects/949abf73cc0645608be7c1e74fb921b5/users/b1f9ad9d7865468db71bf585c03881a2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.903823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e4989-dbec-4256-9f69-d697e249e42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=949abf73cc0645608be7c1e74fb921b5, user_id=b1f9ad9d7865468db71bf585c03881a2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.907082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e4989-dbec-4256-9f69-d697e249e42f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.925837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:31.926452 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1441/2859] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:19:31 2022] PUT /identity/v3/projects/949abf73cc0645608be7c1e74fb921b5/users/b1f9ad9d7865468db71bf585c03881a2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:31.928777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:31.931325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:31.931692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:31.932037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:31.946388 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1419/2860] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:19:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:19:31.972794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:31.973737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:32.053588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1442/2861] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:32.064873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:32.066402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:32.118207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:32.137045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c849b73-8f09-41b6-ab83-ef6ec9d1db2a service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:32.211402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9b73e-1301-47fb-8b14-69b60284f530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:32.212524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9b73e-1301-47fb-8b14-69b60284f530 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:32.215430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9b73e-1301-47fb-8b14-69b60284f530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:32.215999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9b73e-1301-47fb-8b14-69b60284f530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:32.231246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9b73e-1301-47fb-8b14-69b60284f530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:32.236801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9b73e-1301-47fb-8b14-69b60284f530 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:32.251069 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1420/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:32.277464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:32.279251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:32.303453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39921532-c3cf-4a36-9c16-eb38419d208b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:32.308723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:32.309386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:32.309666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:32.310214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] PATH_INFO: `/v3/users/cbc7f4f8fce340bd9450d40f9896b418` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:32.311372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc7f4f8fce340bd9450d40f9896b418)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:32.314185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:32.389902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc7f4f8fce340bd9450d40f9896b418'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:32.437140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc7f4f8fce340bd9450d40f9896b418'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:32.437946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc7f4f8fce340bd9450d40f9896b418'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:32.439213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc7f4f8fce340bd9450d40f9896b418'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:32.457038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc7f4f8fce340bd9450d40f9896b418'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:32.490367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1443/2863] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:19:32 2022] DELETE /identity/v3/users/cbc7f4f8fce340bd9450d40f9896b418 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:32.494935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cefdb5-fcc6-4b4b-a7bc-256e6a0fecc1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:32.495686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cefdb5-fcc6-4b4b-a7bc-256e6a0fecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:32.495686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cefdb5-fcc6-4b4b-a7bc-256e6a0fecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:32.525966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5cefdb5-fcc6-4b4b-a7bc-256e6a0fecc1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:32.528503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5cefdb5-fcc6-4b4b-a7bc-256e6a0fecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:32.635225 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1421/2864] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:19:32.641565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:32.643914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:32.671293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:32.736063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b586-b7fa-4b2d-906f-da039b50ac4c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:32.740750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:32.741374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:32.741653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:32.741943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:32.753633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:32.755149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:32.766813 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1444/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:33.209279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb817a7-220e-4ff7-9e09-5bba78cf3e5d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:33.209572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb817a7-220e-4ff7-9e09-5bba78cf3e5d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:33.209850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb817a7-220e-4ff7-9e09-5bba78cf3e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:33.232056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-afb817a7-220e-4ff7-9e09-5bba78cf3e5d None None] MFA Rules not processed for user `fe99b1f63def414e80be31b284e08def`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:33.234107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afb817a7-220e-4ff7-9e09-5bba78cf3e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:33.305966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1422/2866] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:33.864205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:33.867295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:33.956079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30ddba-be5f-4ac5-82ad-59aa29daa73d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:33.978386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:33.981346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:33.981633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:33.986216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] PATH_INFO: `/v3/projects/4246d2264e594cfdad879fed341df731` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.002779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4246d2264e594cfdad879fed341df731)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.012205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:34.146214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4246d2264e594cfdad879fed341df731', 'request_id': 'req-d750a8df-17f7-40a9-9e30-33475f09a264'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:34.154958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4246d2264e594cfdad879fed341df731', 'request_id': 'req-d750a8df-17f7-40a9-9e30-33475f09a264'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:34.163954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4246d2264e594cfdad879fed341df731', 'request_id': 'req-d750a8df-17f7-40a9-9e30-33475f09a264'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:34.181778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] The token cache is being invalidate because project 4246d2264e594cfdad879fed341df731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:19:34.182131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:34.182848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d750a8df-17f7-40a9-9e30-33475f09a264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:34.189494 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1445/2867] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:19:33 2022] DELETE /identity/v3/projects/4246d2264e594cfdad879fed341df731 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:34.191369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.191858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.191968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.220949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:34.223473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:34.291540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:34.320656 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1423/2868] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:34.331874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.332210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.332430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.380848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:34.383663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:34.411396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1446/2869] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:34.412516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:34.429025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769ab53-5aac-411e-a870-f11c238de054 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:34.433969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:34.436189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.436574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.436945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.439345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:19:34.439815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.441753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:34.465091 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1424/2870] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:19:34.466482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:34.478674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae497-5b7e-4a1f-a10c-e7b2614080b6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:34.489667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:34.490535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.491911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.492384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.493199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.496896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:34.548467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:34.560494 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1447/2871] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:19:34 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:34.564049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b3879-3d6f-4300-940e-c999916092cc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:34.746043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:34.746720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.747007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.747284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.747935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.755886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:34.812628 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1425/2872] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:19:34 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:34.817199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:34.840662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151abc-47e6-47e5-9bf7-8704c891766f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:34.855630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:34.855630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.855630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.855630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.857022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.857022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:34.886656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1448/2873] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:34.890813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:34.907985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1cf04-8d70-4a8f-84cb-c75427ff77df admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:34.913188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c1fbd-083c-438f-9026-fe98689c6f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:34.914020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c1fbd-083c-438f-9026-fe98689c6f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.914522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c1fbd-083c-438f-9026-fe98689c6f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.914985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c1fbd-083c-438f-9026-fe98689c6f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.916158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c1fbd-083c-438f-9026-fe98689c6f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.917921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c1fbd-083c-438f-9026-fe98689c6f25 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:34.942298 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1426/2874] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:34.946187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:34.962505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948c78b-ef47-4811-96de-0fd1d3804e0e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:34.968040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:34.969107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:34.969766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:34.970289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] PATH_INFO: `/v3/projects/e0cc199dfb244316b75aec3469cb40f2/users/017fa19f316a47a198abd6205860c931/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:34.993486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cc199dfb244316b75aec3469cb40f2, user_id=017fa19f316a47a198abd6205860c931, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:34.999537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:35.026317 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1449/2875] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:19:34 2022] PUT /identity/v3/projects/e0cc199dfb244316b75aec3469cb40f2/users/017fa19f316a47a198abd6205860c931/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:35.029548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774655-5d5a-4a2c-b1e8-9731d379a329 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:35.029548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774655-5d5a-4a2c-b1e8-9731d379a329 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:35.029548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774655-5d5a-4a2c-b1e8-9731d379a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:35.085195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e8774655-5d5a-4a2c-b1e8-9731d379a329 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:35.088237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e8774655-5d5a-4a2c-b1e8-9731d379a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:35.247995 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1427/2876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:35.266589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:35.268474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:35.327793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:35.385730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee60604-9de4-4e4d-b976-75a6054fbcc6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:35.413861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:35.415038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:35.415431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:35.415783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:35.429368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:35.431022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:35.446271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1450/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:41.775353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:41.776474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:41.776926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:41.862179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] MFA Rules not processed for user `b1f9ad9d7865468db71bf585c03881a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:41.864949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:41.997094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:42.094209 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1428/2878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:43.096708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:43.098839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:43.348234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739dd11-b39f-4b99-b116-82e0b593b249 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:43.357294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5523-5e05-4696-9ddb-f67523a87315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:43.358019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5523-5e05-4696-9ddb-f67523a87315 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:43.358399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5523-5e05-4696-9ddb-f67523a87315 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:43.358748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5523-5e05-4696-9ddb-f67523a87315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:43.377098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5523-5e05-4696-9ddb-f67523a87315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:43.378789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5523-5e05-4696-9ddb-f67523a87315 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:43.418589 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1451/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:48.543783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:48.559776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf5ecf-332d-4c12-a823-d670f8e994dc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:48.567215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:48.568106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:48.568551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:48.568985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:48.570970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:48.720379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:48.722367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:48.751461 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1429/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:52.026204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:52.027001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:52.027445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:52.066653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] MFA Rules not processed for user `017fa19f316a47a198abd6205860c931`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:52.068675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:52.225262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1452/2881] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:53.873715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:53.879269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:53.963429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:53.988692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f66ca-5dd7-4677-8844-f716987c0347 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:54.007480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:54.009639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:54.010407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:54.010925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:54.025108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:54.027687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:54.035423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe95fc-4629-46e1-9c10-1c22c37cffa1 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:54.039830 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1453/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:54.040408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:54.041128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:54.041415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:54.041783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] PATH_INFO: `/v3/users/b1f9ad9d7865468db71bf585c03881a2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:54.043294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f9ad9d7865468db71bf585c03881a2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:54.045062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:54.151025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f9ad9d7865468db71bf585c03881a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:54.174200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f9ad9d7865468db71bf585c03881a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:54.175122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f9ad9d7865468db71bf585c03881a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:54.176281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f9ad9d7865468db71bf585c03881a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:54.192443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2a7dd511-1ac3-490d-a9d8-567c7a34a16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f9ad9d7865468db71bf585c03881a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:54.228471 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1430/2883] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:19:53 2022] DELETE /identity/v3/users/b1f9ad9d7865468db71bf585c03881a2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:54.982819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:54.999179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60cb16-468f-4094-81e7-8fb8beabed5b service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:55.017772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:55.144985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:55.145834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.146745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.147167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] PATH_INFO: `/v3/projects/949abf73cc0645608be7c1e74fb921b5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.148571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949abf73cc0645608be7c1e74fb921b5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:55.153599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:55.232641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949abf73cc0645608be7c1e74fb921b5', 'request_id': 'req-55c29c94-93a0-47d8-9234-3a7897a3faa9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:55.242589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949abf73cc0645608be7c1e74fb921b5', 'request_id': 'req-55c29c94-93a0-47d8-9234-3a7897a3faa9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:55.251677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949abf73cc0645608be7c1e74fb921b5', 'request_id': 'req-55c29c94-93a0-47d8-9234-3a7897a3faa9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:55.296667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] The token cache is being invalidate because project 949abf73cc0645608be7c1e74fb921b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:19:55.297707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:55.298426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55c29c94-93a0-47d8-9234-3a7897a3faa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:19:55.300195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1454/2884] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:19:54 2022] DELETE /identity/v3/projects/949abf73cc0645608be7c1e74fb921b5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:19:55.304975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.305411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.305530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.344410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:55.386122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:55.387522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:55.495779 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1431/2885] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:55.505873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.506180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.506467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.529050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:55.530322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:55.545887 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1455/2886] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:55.546402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:55.561846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e709-8789-4065-8380-11a51f529ae0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:55.572757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:55.573241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.573675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.574049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.574846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:19:55.575250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:55.579366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:55.599732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:55.606365 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1432/2887] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:19:55.611932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121b01-ac55-4959-bd4d-ef2e5de4b8a8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:55.617407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:55.618237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.619356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.619750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.620744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:55.622841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:55.669166 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1456/2888] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:19:55 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:19:55.670966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:55.687649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83796f-c76f-4e65-9270-d3c4d2932e7e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:55.839276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:55.840346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.841078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.841506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.842926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:55.847784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:55.897327 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1433/2889] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:19:55 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:19:55.899178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:55.919902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e871d70-ba28-4788-bccb-4ce3bcfff1c4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:55.927674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:55.928434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.928814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.929269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.942392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:55.944183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:55.966557 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1457/2890] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:55.971297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:55.982667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f59d1-e924-432b-bfc1-00ec240779ef admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:55.993365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fe60e-5885-4052-95a7-152133f4c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:55.994756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe60e-5885-4052-95a7-152133f4c2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:55.995234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe60e-5885-4052-95a7-152133f4c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:55.995728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fe60e-5885-4052-95a7-152133f4c2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:55.996559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe60e-5885-4052-95a7-152133f4c2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:55.998737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fe60e-5885-4052-95a7-152133f4c2a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:56.178194 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1434/2891] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:19:56.181241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:56.193348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8374-895a-49c6-a519-7cf66638882b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:56.199208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:56.200368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:56.200655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:56.201131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] PATH_INFO: `/v3/projects/23703a6af26e4baa91264e7a7babdd6f/users/571b2014495846b0925315e22531363a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:56.222321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23703a6af26e4baa91264e7a7babdd6f, user_id=571b2014495846b0925315e22531363a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:56.226650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:56.247313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1458/2892] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:19:56 2022] PUT /identity/v3/projects/23703a6af26e4baa91264e7a7babdd6f/users/571b2014495846b0925315e22531363a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:19:56.259876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce95191-564c-4df9-a341-5010503f66c3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:56.260269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce95191-564c-4df9-a341-5010503f66c3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:56.260632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce95191-564c-4df9-a341-5010503f66c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:56.309632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3ce95191-564c-4df9-a341-5010503f66c3 None None] MFA Rules not processed for user `571b2014495846b0925315e22531363a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:56.312479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3ce95191-564c-4df9-a341-5010503f66c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:56.380804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:56.406467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1435/2893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:19:56.424845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:56.429235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:56.519908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:19:56.561635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb13706-ac60-46d0-bfd4-de9baa01a89c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:56.566752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:56.567341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:56.567624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:56.567900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:56.579251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:56.580701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:56.591549 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1459/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:19:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:19:56.779636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db2f9-c25b-4fc8-b7f2-6a4a4ffbb217 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:56.779937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db2f9-c25b-4fc8-b7f2-6a4a4ffbb217 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:56.780225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678db2f9-c25b-4fc8-b7f2-6a4a4ffbb217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:56.815606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-678db2f9-c25b-4fc8-b7f2-6a4a4ffbb217 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:56.816852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-678db2f9-c25b-4fc8-b7f2-6a4a4ffbb217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:56.965585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1436/2895] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:19:56.994289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:19:56.996859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:57.107504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cd5f8-2b46-4383-b38d-0147e9da5469 service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:19:57.115242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede4df-d805-4a2e-a292-2135113d0176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:19:57.116354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede4df-d805-4a2e-a292-2135113d0176 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:57.116999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede4df-d805-4a2e-a292-2135113d0176 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:57.116999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede4df-d805-4a2e-a292-2135113d0176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:57.127935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede4df-d805-4a2e-a292-2135113d0176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:19:57.129618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede4df-d805-4a2e-a292-2135113d0176 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:19:57.150684 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1460/2896] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:19:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:19:57.492911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:19:57.493307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:19:57.493745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:19:57.513951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] MFA Rules not processed for user `017fa19f316a47a198abd6205860c931`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:19:57.515326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:19:57.578263 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1437/2897] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:05.956976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:05.958015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:05.958340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:05.988971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:05.990584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:06.005486 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1461/2898] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:20:06.013162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:06.035250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dba6aa-97a3-47f7-ab79-9a3cffab5dd3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:06.041974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a77958-0f07-482e-9d6b-dba3e12d6e6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:06.042635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a77958-0f07-482e-9d6b-dba3e12d6e6c service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:06.042911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a77958-0f07-482e-9d6b-dba3e12d6e6c service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:06.043323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a77958-0f07-482e-9d6b-dba3e12d6e6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:06.056436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a77958-0f07-482e-9d6b-dba3e12d6e6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:06.058648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a77958-0f07-482e-9d6b-dba3e12d6e6c service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:06.068804 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1438/2899] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:20:06.241151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:06.393312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7f722-7bde-4d41-8597-f65ca502c16a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:06.401009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:06.401914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:06.402509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:06.402798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] PATH_INFO: `/v3/users/571b2014495846b0925315e22531363a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:06.405023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571b2014495846b0925315e22531363a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:06.409658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:06.528875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571b2014495846b0925315e22531363a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:06.555980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571b2014495846b0925315e22531363a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:06.556993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571b2014495846b0925315e22531363a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:06.557643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571b2014495846b0925315e22531363a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:06.563659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:06.575457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571b2014495846b0925315e22531363a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:06.604321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1462/2900] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:20:06 2022] DELETE /identity/v3/users/571b2014495846b0925315e22531363a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:06.610670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:06.611123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:06.611512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:06.633803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:06.635538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:06.747691 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1439/2901] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:06.757043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:06.758545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:06.924570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252a26-a2ae-47f9-b0a9-290702c46829 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:06.931508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6a121-2b75-42d0-9ae9-8bcd7fcfa0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:06.933401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a121-2b75-42d0-9ae9-8bcd7fcfa0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:06.934660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a121-2b75-42d0-9ae9-8bcd7fcfa0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:06.934780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a121-2b75-42d0-9ae9-8bcd7fcfa0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:06.955372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6a121-2b75-42d0-9ae9-8bcd7fcfa0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:06.956912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6a121-2b75-42d0-9ae9-8bcd7fcfa0a1 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:06.968754 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1463/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:07.297843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:07.299887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:07.340895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51918f-62af-4050-b74b-7a92e8d261c6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:07.361133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:07.362636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:07.363200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:07.363665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] PATH_INFO: `/v3/projects/23703a6af26e4baa91264e7a7babdd6f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:07.365304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23703a6af26e4baa91264e7a7babdd6f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:07.368019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:07.408085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:07.440625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23703a6af26e4baa91264e7a7babdd6f', 'request_id': 'req-8561d49f-ccea-49f4-817c-bf24f4e950c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:07.448413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23703a6af26e4baa91264e7a7babdd6f', 'request_id': 'req-8561d49f-ccea-49f4-817c-bf24f4e950c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:07.460875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23703a6af26e4baa91264e7a7babdd6f', 'request_id': 'req-8561d49f-ccea-49f4-817c-bf24f4e950c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:07.480053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] The token cache is being invalidate because project 23703a6af26e4baa91264e7a7babdd6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:20:07.480359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:07.481059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8561d49f-ccea-49f4-817c-bf24f4e950c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:07.501939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1440/2903] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:20:07 2022] DELETE /identity/v3/projects/23703a6af26e4baa91264e7a7babdd6f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:07.502840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:07.502840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:07.502840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:07.568376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:07.569614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:07.674939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1464/2904] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:07.677352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:07.677905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:07.678448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:07.717860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:07.719482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:07.746606 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1441/2905] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:07.752348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:07.766813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832a4df-cc43-4604-9d5f-db89fc8b3546 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:07.779677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:07.781963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:07.782581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:07.783210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:07.784027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:20:07.784399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:07.787966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:07.808884 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1465/2906] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:20:07.813485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:07.827868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83fce5-fa43-4d1b-b79a-9765fe03f2c7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:07.849609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:07.850560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:07.850920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:07.851296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:07.852086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:07.854467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:07.907914 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1442/2907] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:20:07 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:07.909549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:07.929569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4388b-3843-4361-ad04-b1fe900cf38d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:08.020345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:08.043868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:08.044798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.045131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.045589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.047988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:08.051958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:08.083988 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1466/2908] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:20:07 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:08.088034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:08.104458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f696d-37ca-4a9d-8f5c-ae20a7f9badb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:08.110168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:08.110813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.111667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.111667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.112308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:08.114322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:08.131628 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1443/2909] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:08.132950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:08.144024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adee7b-eae5-4781-a169-003445ca1608 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:08.148785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9efc0f-1faf-4e97-a375-4767ac81a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:08.149401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9efc0f-1faf-4e97-a375-4767ac81a699 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.149799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9efc0f-1faf-4e97-a375-4767ac81a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.150082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9efc0f-1faf-4e97-a375-4767ac81a699 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.150778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9efc0f-1faf-4e97-a375-4767ac81a699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:08.152387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9efc0f-1faf-4e97-a375-4767ac81a699 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:08.166813 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1467/2910] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:08.168024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:08.179366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d8fa-ce9c-49e8-8b23-fb51efd5d532 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:08.185033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650edb15-79b0-4db8-b27d-0f851532ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:08.186019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650edb15-79b0-4db8-b27d-0f851532ad7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.186221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650edb15-79b0-4db8-b27d-0f851532ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.186597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650edb15-79b0-4db8-b27d-0f851532ad7d admin admin] PATH_INFO: `/v3/projects/4fd79ee58a2d4f198bb98667352d1580/users/66c783b9e7e040e0b18447f229453a47/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.205232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650edb15-79b0-4db8-b27d-0f851532ad7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd79ee58a2d4f198bb98667352d1580, user_id=66c783b9e7e040e0b18447f229453a47, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:08.208153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650edb15-79b0-4db8-b27d-0f851532ad7d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:08.245710 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1444/2911] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:20:08 2022] PUT /identity/v3/projects/4fd79ee58a2d4f198bb98667352d1580/users/66c783b9e7e040e0b18447f229453a47/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:08.259840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.260341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.260668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.295494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] MFA Rules not processed for user `66c783b9e7e040e0b18447f229453a47`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:08.297008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:08.375106 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1468/2912] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:08.385371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.386616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.387052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.411502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] MFA Rules not processed for user `66c783b9e7e040e0b18447f229453a47`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:08.412798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:08.420652 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1445/2913] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:20:08.431933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:08.433527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:08.522885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f736d5-7268-42b2-88e3-0116c94be504 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:08.529594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:08.530493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:08.531479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:08.531764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:08.546429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:08.548714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:08.560382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1469/2914] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:14.539197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:14.541475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:14.684378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a713f0b-4a3e-4e2c-a1e1-5b4b5339378a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:14.688984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:14.690581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:14.691083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:14.692160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:14.695150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:14.824961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:14.857940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:14.864167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:14.915007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1446/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:20:15.480170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:15.485035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:15.587564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:15.623805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1df16-6a30-4bc5-93e6-53445dd8587d service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:15.631913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:15.632751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:15.633039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:15.633430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:15.636575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:15.651665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:15.653284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:15.666014 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1470/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:15.752675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:15.761267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:15.789652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682524d-3599-401e-8f20-b9145124fc3e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:15.806847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:15.807945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:15.808226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:15.808632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] PATH_INFO: `/v3/users/09b213bfb6a64ce68ef442d462242ff6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:15.810106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b213bfb6a64ce68ef442d462242ff6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:15.813909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:15.945864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b213bfb6a64ce68ef442d462242ff6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:15.970736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b213bfb6a64ce68ef442d462242ff6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:15.973840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b213bfb6a64ce68ef442d462242ff6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:15.974591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b213bfb6a64ce68ef442d462242ff6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:15.994814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5b212fa0-6400-4740-9f36-5ebc10255293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b213bfb6a64ce68ef442d462242ff6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:16.060266 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1447/2917] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:20:15 2022] DELETE /identity/v3/users/09b213bfb6a64ce68ef442d462242ff6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:17.236559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:17.267526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b1b62-1217-4467-9dbe-8d2b79597d0e service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:17.439907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:17.440582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:17.440859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:17.449123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] PATH_INFO: `/v3/projects/2fa8944f919b484e9a366271744acd71` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:17.450932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa8944f919b484e9a366271744acd71)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:17.454448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:17.592290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa8944f919b484e9a366271744acd71', 'request_id': 'req-25630852-196f-4c04-96b6-2834e6a966b4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:17.611729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa8944f919b484e9a366271744acd71', 'request_id': 'req-25630852-196f-4c04-96b6-2834e6a966b4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:17.636606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa8944f919b484e9a366271744acd71', 'request_id': 'req-25630852-196f-4c04-96b6-2834e6a966b4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:17.677667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] The token cache is being invalidate because project 2fa8944f919b484e9a366271744acd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:20:17.678848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:17.680600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25630852-196f-4c04-96b6-2834e6a966b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:17.684340 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1471/2918] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:20:17 2022] DELETE /identity/v3/projects/2fa8944f919b484e9a366271744acd71 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:17.690754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:17.691777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:17.692258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:17.716328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:17.718812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:17.813686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1448/2919] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:17.816492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:17.816797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:17.817078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:17.855680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:17.857176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:17.866366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1472/2920] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:17.870670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:17.881500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549c00-b2f6-4bcf-9bf7-58a95288ded8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:17.886068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:17.886868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:17.887154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:17.887432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:17.888092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:20:17.888398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:17.890078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:17.903135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1449/2921] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:20:17.909852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:17.922958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71648a79-d229-47a5-b2d1-1089e8f40ef5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:17.975069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:17.977377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:17.979868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:17.980165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:17.983092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:17.989000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:18.041439 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1473/2922] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:20:17 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:20:18.045542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:18.061418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc137e-05b4-4ae7-9480-623a616537ea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:18.233975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:18.262792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:18.263699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:18.264065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:18.265017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:18.265717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:18.268035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:18.332031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1450/2923] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:20:18 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:18.335793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:18.352170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4cbf8-24ee-4861-9d0c-b1afa1a18549 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:18.399091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:18.399741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:18.405994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:18.408295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:18.410656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:18.413811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:18.452086 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1474/2924] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:18.455742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:18.500446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474e941-a693-4038-a6d2-fd2ced81b0af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:18.511079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3494-2c8d-4627-869a-68e04421a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:18.511767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3494-2c8d-4627-869a-68e04421a22d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:18.512057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3494-2c8d-4627-869a-68e04421a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:18.512339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3494-2c8d-4627-869a-68e04421a22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:18.513004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3494-2c8d-4627-869a-68e04421a22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:18.514805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3494-2c8d-4627-869a-68e04421a22d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:18.548654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1451/2925] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:18.552979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:18.576665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3ed92-40ed-43b6-be8e-14b8e6ca4a63 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:18.619875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:18.622683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:18.629687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:18.630259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] PATH_INFO: `/v3/projects/62f60f877f1c44e5a91c4d93260ae290/users/abcb43d11ffc4520a8f10ac121c04fdf/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:18.722289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f60f877f1c44e5a91c4d93260ae290, user_id=abcb43d11ffc4520a8f10ac121c04fdf, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:18.744083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:18.809286 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1475/2926] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:20:18 2022] PUT /identity/v3/projects/62f60f877f1c44e5a91c4d93260ae290/users/abcb43d11ffc4520a8f10ac121c04fdf/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:18.825859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f4f50-c00d-4324-b034-50052b10103d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:18.826447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f4f50-c00d-4324-b034-50052b10103d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:18.826640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f4f50-c00d-4324-b034-50052b10103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:18.951577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a64f4f50-c00d-4324-b034-50052b10103d None None] MFA Rules not processed for user `abcb43d11ffc4520a8f10ac121c04fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:18.953696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a64f4f50-c00d-4324-b034-50052b10103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:19.142856 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1452/2927] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:19.727394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:19.729804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:19.740722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:19.860959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:19.862340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:19.862812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:19.890762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:19.892718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:19.991147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc0b44-24f2-465a-87fc-99166687eb4d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:20.018010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce249-8c2d-40b6-a7f1-4ed9a6b4f33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:20.018701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce249-8c2d-40b6-a7f1-4ed9a6b4f33e service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:20.022779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce249-8c2d-40b6-a7f1-4ed9a6b4f33e service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:20.023331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce249-8c2d-40b6-a7f1-4ed9a6b4f33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:20.043236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce249-8c2d-40b6-a7f1-4ed9a6b4f33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:20.060002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce249-8c2d-40b6-a7f1-4ed9a6b4f33e service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:20.072092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1453/2928] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:20.084720 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1476/2929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:20.471061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:20.644562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ecee3-8a90-4bec-b427-ad5be8d815a4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:20.658911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:20.659763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:20.660048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:20.660379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] PATH_INFO: `/v3/users/abcb43d11ffc4520a8f10ac121c04fdf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:20.662779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcb43d11ffc4520a8f10ac121c04fdf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:20.665195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:20.677331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:20.788307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcb43d11ffc4520a8f10ac121c04fdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:20.801648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcb43d11ffc4520a8f10ac121c04fdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:20.802354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcb43d11ffc4520a8f10ac121c04fdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:20.803712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcb43d11ffc4520a8f10ac121c04fdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:20.819228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcb43d11ffc4520a8f10ac121c04fdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:20.862411 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1454/2930] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:20:20 2022] DELETE /identity/v3/users/abcb43d11ffc4520a8f10ac121c04fdf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:20.868067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:20.869362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:20.869821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:20.911548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:20.912821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:21.043616 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1477/2931] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:21.087778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:21.089341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:21.302758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c42c7-2caf-433d-a5c0-cd2406a78690 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:21.307632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8364-0dce-4720-882e-645242b75914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:21.308672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8364-0dce-4720-882e-645242b75914 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:21.312730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8364-0dce-4720-882e-645242b75914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:21.313282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8364-0dce-4720-882e-645242b75914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:21.344626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8364-0dce-4720-882e-645242b75914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:21.346741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8364-0dce-4720-882e-645242b75914 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:21.373002 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1455/2932] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:22.454010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:22.456630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:22.482853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49750bad-b1f8-4780-8788-b95df7bc1d70 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:22.490780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:22.491718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:22.492246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:22.492732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] PATH_INFO: `/v3/projects/62f60f877f1c44e5a91c4d93260ae290` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:22.496178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f60f877f1c44e5a91c4d93260ae290)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:22.500418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:22.783685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f60f877f1c44e5a91c4d93260ae290', 'request_id': 'req-2e97087b-67f3-42c2-b18e-878667da0526'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:22.830057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f60f877f1c44e5a91c4d93260ae290', 'request_id': 'req-2e97087b-67f3-42c2-b18e-878667da0526'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:22.873042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f60f877f1c44e5a91c4d93260ae290', 'request_id': 'req-2e97087b-67f3-42c2-b18e-878667da0526'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:22.962752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] The token cache is being invalidate because project 62f60f877f1c44e5a91c4d93260ae290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:20:22.966075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:22.970728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:22.978726 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1478/2933] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:20:22 2022] DELETE /identity/v3/projects/62f60f877f1c44e5a91c4d93260ae290 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:22.985540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566757a-7c40-41c8-a0e5-e91b92f42fca None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:22.986174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566757a-7c40-41c8-a0e5-e91b92f42fca None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:22.986561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566757a-7c40-41c8-a0e5-e91b92f42fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.029754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5566757a-7c40-41c8-a0e5-e91b92f42fca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:23.032383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5566757a-7c40-41c8-a0e5-e91b92f42fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:23.110505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:23.112944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:23.141927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:23.275719 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1456/2934] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:23.278847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:23.278975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:23.279164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.319498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97087b-67f3-42c2-b18e-878667da0526 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:23.335222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:23.336107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:23.336764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:23.337254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.343944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:23.345684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:23.348713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:23.373085 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1457/2935] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:23.375070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:23.376849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:23.379199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:23.398596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85734-4c8c-4566-b1c5-52831d793085 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:23.405009 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1479/2936] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:20:23.414258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:23.415215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:23.415714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:23.416160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.417216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:20:23.417778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:23.423279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:23.452734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1458/2937] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:20:23.457744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:23.475803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720312fc-f447-4e15-913d-3c5d7c0003c3 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:23.495229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964e26-735b-4322-96d6-3dfb4424bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:23.510284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964e26-735b-4322-96d6-3dfb4424bc64 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:23.515296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964e26-735b-4322-96d6-3dfb4424bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:23.515803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964e26-735b-4322-96d6-3dfb4424bc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.517555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964e26-735b-4322-96d6-3dfb4424bc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:23.529809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964e26-735b-4322-96d6-3dfb4424bc64 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:23.666207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1480/2938] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:20:23 2022] POST /identity/v3/projects => generated 399 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:23.671393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:23.688156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128e67-9baf-49cc-a687-febf7ba65307 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:23.700120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:23.721096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:23.721395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:23.721674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.779263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:23.784381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:23.901529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:23.903253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:23.903842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:23.904348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:23.906288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:23.908878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:23.935543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1481/2939] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:23.981681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1459/2940] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:20:23 2022] POST /identity/v3/users => generated 300 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:23.983719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:23.999596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd493f4-1f1f-4881-ae48-7529cf60849e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:24.007268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:24.008154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:24.008592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:24.009008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:24.009950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:24.055272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:24.103706 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1482/2941] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:24.108563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:24.141771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35560b01-f280-4b62-8f02-d4505ea05904 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:24.167640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c896-66d2-4ebf-9e42-1b54e7c61f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:24.174854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c896-66d2-4ebf-9e42-1b54e7c61f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:24.178248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c896-66d2-4ebf-9e42-1b54e7c61f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:24.178736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c896-66d2-4ebf-9e42-1b54e7c61f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:24.180015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c896-66d2-4ebf-9e42-1b54e7c61f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:24.190314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c896-66d2-4ebf-9e42-1b54e7c61f7c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:24.222530 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1460/2942] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:24.227365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:24.243642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641184-ac37-41ca-b1cc-23ca7f70b28c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:24.276552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:24.277311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:24.277635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:24.277895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] PATH_INFO: `/v3/projects/4134b17547fc4df1a99234ffe50fa89c/users/e411cd3e75bf4a01a8470a52ae23c639/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:24.307587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4134b17547fc4df1a99234ffe50fa89c, user_id=e411cd3e75bf4a01a8470a52ae23c639, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:24.310481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:24.341985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1483/2943] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:20:24 2022] PUT /identity/v3/projects/4134b17547fc4df1a99234ffe50fa89c/users/e411cd3e75bf4a01a8470a52ae23c639/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:24.357488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:24.358092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:24.358622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:24.423351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] MFA Rules not processed for user `e411cd3e75bf4a01a8470a52ae23c639`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:24.424697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:24.550247 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1461/2944] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:24.556775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:24.559363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:24.640685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:24.719033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768bd2b-29f1-46a9-9fc8-58a40554de1b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:24.725964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1293a0-5c61-4d2c-8ed9-21bc5e3d4ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:24.726875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1293a0-5c61-4d2c-8ed9-21bc5e3d4ad8 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:24.727321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1293a0-5c61-4d2c-8ed9-21bc5e3d4ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:24.727747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1293a0-5c61-4d2c-8ed9-21bc5e3d4ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:24.744294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1293a0-5c61-4d2c-8ed9-21bc5e3d4ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:24.745918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1293a0-5c61-4d2c-8ed9-21bc5e3d4ad8 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:24.769564 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1484/2945] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:24.830806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:24.978774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78597dba-7da5-4900-abe0-0c3e605f556f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:24.991253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:24.991923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:24.992209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:24.992483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] PATH_INFO: `/v3/users/e411cd3e75bf4a01a8470a52ae23c639` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:24.993904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e411cd3e75bf4a01a8470a52ae23c639)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:24.995865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:25.034307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:25.108729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e411cd3e75bf4a01a8470a52ae23c639'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:25.137999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e411cd3e75bf4a01a8470a52ae23c639'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:25.138824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e411cd3e75bf4a01a8470a52ae23c639'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:25.140308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e411cd3e75bf4a01a8470a52ae23c639'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:25.154483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e411cd3e75bf4a01a8470a52ae23c639'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:25.199475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1462/2946] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:20:24 2022] DELETE /identity/v3/users/e411cd3e75bf4a01a8470a52ae23c639 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:25.201971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:25.202383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:25.202628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:25.244033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:25.245560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:25.386228 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1485/2947] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:25.398896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:25.400707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:25.624706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86363636-f17c-4b06-9df5-062b222b274a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:25.637322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0d151-0655-4c13-bf30-0cfee4b2baf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:25.638054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0d151-0655-4c13-bf30-0cfee4b2baf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:25.638535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0d151-0655-4c13-bf30-0cfee4b2baf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:25.638882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0d151-0655-4c13-bf30-0cfee4b2baf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:25.650755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0d151-0655-4c13-bf30-0cfee4b2baf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:25.652451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0d151-0655-4c13-bf30-0cfee4b2baf8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:25.667086 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1463/2948] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:26.657479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:26.659798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:26.702867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8285c5-c915-4227-8c3f-cfcbea946db4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:26.718852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:26.719934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:26.720409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:26.721091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] PATH_INFO: `/v3/projects/4134b17547fc4df1a99234ffe50fa89c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:26.722516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4134b17547fc4df1a99234ffe50fa89c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:26.724667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:26.824009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4134b17547fc4df1a99234ffe50fa89c', 'request_id': 'req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:26.830922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4134b17547fc4df1a99234ffe50fa89c', 'request_id': 'req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:26.837750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4134b17547fc4df1a99234ffe50fa89c', 'request_id': 'req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:26.863400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] The token cache is being invalidate because project 4134b17547fc4df1a99234ffe50fa89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:20:26.863400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:26.864212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e56d0d6a-6e51-4c87-b0ca-942a74312ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:26.871154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1486/2949] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:20:26 2022] DELETE /identity/v3/projects/4134b17547fc4df1a99234ffe50fa89c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:26.872902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:26.873372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:26.873482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:26.909606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:26.910901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:26.994546 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1464/2950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:27.003163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.003457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.003742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.025535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:27.027314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:27.037288 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1487/2951] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:20:27.041559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.052335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf416ef-70fc-45ab-a57c-6623ff734c18 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.065769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.067094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.067673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.068192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.070058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:20:27.070430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.072128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.089304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1465/2952] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:20:27.094991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.111841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205d155-aac3-437d-8c7c-10969f7c0dc3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.132027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.133258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.133565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.133901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.134923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.137580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.183754 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1488/2953] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:20:27 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:27.184984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.196779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca78151-0c5d-4a3d-9edf-1833db4fdb96 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.225379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:27.318192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.319061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.319373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.319653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.320556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.322832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.361352 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1466/2954] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:20:27 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:20:27.365536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.388986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6010a25-e1f4-42a9-be15-d67e830fe9df admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.407824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.408945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.410490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:27.421220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.423050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.423676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.426487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.429489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.454011 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1489/2955] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:27.456880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.484425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df405fb-b116-4574-ac69-6403b5779c79 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.514591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.516986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.518527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.520485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.521396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.547104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.585553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1490/2956] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:27.588174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.593834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:27.618583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c520d2-8fce-4d0a-82c3-b07ce8575e71 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.625010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.625458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.625737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.626013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.628771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:27.631195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23689-6b22-4d03-80a3-365465aaa505 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.643281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.645040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.645350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.646117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.646550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.647170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] PATH_INFO: `/v3/users/fe99b1f63def414e80be31b284e08def` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.649276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe99b1f63def414e80be31b284e08def)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.651339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.653415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:27.690221 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1467/2957] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:20:27.699295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.724768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcedb27-9d3c-4057-ad69-c4f683846664 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:27.737649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9565c4a-085c-4da6-9e82-3e0dcb494586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:27.738861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565c4a-085c-4da6-9e82-3e0dcb494586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.739745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565c4a-085c-4da6-9e82-3e0dcb494586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.740025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565c4a-085c-4da6-9e82-3e0dcb494586 admin admin] PATH_INFO: `/v3/projects/bfde8dc9802942758704ce9992bd8437/users/c7eabd93a4524aa4a9f0ba3b3bef29c4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.765361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe99b1f63def414e80be31b284e08def'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:27.781602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9565c4a-085c-4da6-9e82-3e0dcb494586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfde8dc9802942758704ce9992bd8437, user_id=c7eabd93a4524aa4a9f0ba3b3bef29c4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:27.784394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9565c4a-085c-4da6-9e82-3e0dcb494586 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:27.797682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe99b1f63def414e80be31b284e08def'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:27.800806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe99b1f63def414e80be31b284e08def'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:27.802050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe99b1f63def414e80be31b284e08def'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:27.816005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe99b1f63def414e80be31b284e08def'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:27.828256 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1468/2958] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:20:27 2022] PUT /identity/v3/projects/bfde8dc9802942758704ce9992bd8437/users/c7eabd93a4524aa4a9f0ba3b3bef29c4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:27.831268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:27.831268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:27.831553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:27.836482 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1491/2959] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:20:27 2022] DELETE /identity/v3/users/fe99b1f63def414e80be31b284e08def => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:27.859098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:27.861156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:27.945242 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1469/2960] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:20:27.958622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:27.960150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:28.046894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86b283-8615-46bd-9319-0dd8f7c59c4b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:28.051727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75b1f8-6145-4c6d-962f-daf596c6cb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:28.052553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75b1f8-6145-4c6d-962f-daf596c6cb61 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:28.053048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75b1f8-6145-4c6d-962f-daf596c6cb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:28.053357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75b1f8-6145-4c6d-962f-daf596c6cb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:28.068967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75b1f8-6145-4c6d-962f-daf596c6cb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:28.070248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75b1f8-6145-4c6d-962f-daf596c6cb61 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:28.083706 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1492/2961] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:28.572104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:28.573657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:28.599076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235c5a5-2e9e-4038-95f6-39576a6a5d77 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:28.619345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:28.620080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:28.620561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:28.620849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] PATH_INFO: `/v3/projects/2881e8fc2fcf49329a1172830a492f38` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:28.623227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2881e8fc2fcf49329a1172830a492f38)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:28.628784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:28.692836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:28.772361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2881e8fc2fcf49329a1172830a492f38', 'request_id': 'req-79798079-08f8-46d2-978f-0dd95701f106'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:28.790286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2881e8fc2fcf49329a1172830a492f38', 'request_id': 'req-79798079-08f8-46d2-978f-0dd95701f106'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:28.810419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2881e8fc2fcf49329a1172830a492f38', 'request_id': 'req-79798079-08f8-46d2-978f-0dd95701f106'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:28.838794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] The token cache is being invalidate because project 2881e8fc2fcf49329a1172830a492f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:20:28.839277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:28.841976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79798079-08f8-46d2-978f-0dd95701f106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:20:28.854060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1470/2962] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:20:28 2022] DELETE /identity/v3/projects/2881e8fc2fcf49329a1172830a492f38 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:20:28.860142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:28.861687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:28.862202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:28.924620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:28.926228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:29.080355 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1493/2963] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:29.080910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.081352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.082255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.148395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:29.164468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:29.199557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1471/2964] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:29.204700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:29.219139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc682f1-770c-450d-b4cd-f124df391015 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:29.240293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:29.240903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.241190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.241471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.242415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:20:29.242725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:29.244634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:29.281656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1494/2965] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:20:29.286199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:29.298228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be173af-9e43-49e4-96d4-186e10b281a5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:29.325034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:29.325899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.326317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.327313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.328134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:29.333464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:29.410178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1472/2966] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:20:29 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:29.414527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:29.430249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985916-3e49-4b56-ac59-33a7070dc5e9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:29.451372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:29.666673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:29.669879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.670358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.670798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.673524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:29.681016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:29.742711 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1495/2967] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:20:29 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:20:29.747335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:29.774566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ffdc5-858c-4dc3-a53b-5e5c911a1ecb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:29.783330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:29.786106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.786106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.786106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.786106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:29.797692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:29.819565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1473/2968] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:20:29.824305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:29.837004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d706f4-56e3-4d7c-9dd1-059161350c52 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:29.844606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a648-33ca-4517-8aa9-a05dadccf039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:29.845782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a648-33ca-4517-8aa9-a05dadccf039 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.846250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a648-33ca-4517-8aa9-a05dadccf039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.846888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a648-33ca-4517-8aa9-a05dadccf039 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.848046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320a648-33ca-4517-8aa9-a05dadccf039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:29.850183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320a648-33ca-4517-8aa9-a05dadccf039 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:29.870221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1496/2969] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:20:29.875531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:29.889934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb410d-a4f3-450b-8961-9e9aeed50f35 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:29.898521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746dffb-b2c6-4c4e-b4dd-c09bd7772abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:29.899637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746dffb-b2c6-4c4e-b4dd-c09bd7772abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:29.900142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746dffb-b2c6-4c4e-b4dd-c09bd7772abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:29.900528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746dffb-b2c6-4c4e-b4dd-c09bd7772abb admin admin] PATH_INFO: `/v3/projects/985e72d73d4c4c00a228d0802aadf499/users/d2808f585afe41ed94e5cf42bee5ee66/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:29.921922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746dffb-b2c6-4c4e-b4dd-c09bd7772abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=985e72d73d4c4c00a228d0802aadf499, user_id=d2808f585afe41ed94e5cf42bee5ee66, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:29.926835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746dffb-b2c6-4c4e-b4dd-c09bd7772abb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:29.984453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1474/2970] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:20:29 2022] PUT /identity/v3/projects/985e72d73d4c4c00a228d0802aadf499/users/d2808f585afe41ed94e5cf42bee5ee66/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:20:30.011957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:30.012365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:30.015493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:30.110856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] MFA Rules not processed for user `d2808f585afe41ed94e5cf42bee5ee66`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:30.112760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:30.258211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:30.258763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:30.258763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:30.297190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:30.298681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:30.304709 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1497/2971] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:30.318520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:30.320233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:30.394947 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1475/2972] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:20:30.423651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:30.425499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:30.439274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3a0c-97e4-4bc7-9c3d-7cc7c0dfe680 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:30.444551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0b7a-b50c-4265-a03c-60bf1ec2aa02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:30.445515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0b7a-b50c-4265-a03c-60bf1ec2aa02 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:30.446165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0b7a-b50c-4265-a03c-60bf1ec2aa02 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:30.446882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0b7a-b50c-4265-a03c-60bf1ec2aa02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:30.460602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0b7a-b50c-4265-a03c-60bf1ec2aa02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:30.462860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0b7a-b50c-4265-a03c-60bf1ec2aa02 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:30.475559 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1498/2973] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:20:30.552698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:30.601439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02efc-6ff8-4802-9f98-2c932996dde0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:30.617830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:30.618885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:30.619274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:30.619659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:30.645139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:30.651947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:30.671524 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1476/2974] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:20:31.833125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff8d9-5868-4e60-b5ba-4e5571c3dad9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:31.834017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff8d9-5868-4e60-b5ba-4e5571c3dad9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:31.834351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff8d9-5868-4e60-b5ba-4e5571c3dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:31.874781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aa1ff8d9-5868-4e60-b5ba-4e5571c3dad9 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:31.878952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa1ff8d9-5868-4e60-b5ba-4e5571c3dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:31.897143 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1499/2975] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:20:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:31.910726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:31.927266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a7d66-8575-4612-8d14-46c3dc31ed4a service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:31.944524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:31.944797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:31.945046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:31.945317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:31.962253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:31.966897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:31.981749 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1477/2976] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:20:34.035438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defffac-42ee-44d6-9ac6-9c689cab5a1f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:34.035936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defffac-42ee-44d6-9ac6-9c689cab5a1f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:34.036076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defffac-42ee-44d6-9ac6-9c689cab5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:34.069382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9defffac-42ee-44d6-9ac6-9c689cab5a1f None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:34.071208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9defffac-42ee-44d6-9ac6-9c689cab5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:34.091050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1500/2977] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:20:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:34.105676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:34.126989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff581b-1318-44a3-94f0-9f3bd6dee911 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:34.144059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:34.144984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:34.146309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:34.146768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:34.169908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:34.177198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:34.204538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1478/2978] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:20:35.933201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed0847-220f-42c7-ba3e-85aea19ab510 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:35.934110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed0847-220f-42c7-ba3e-85aea19ab510 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:35.934600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed0847-220f-42c7-ba3e-85aea19ab510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:35.958578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:35.974724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fbed0847-220f-42c7-ba3e-85aea19ab510 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:35.976270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fbed0847-220f-42c7-ba3e-85aea19ab510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:35.995641 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1501/2979] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:20:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:36.024304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:36.042950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d811566-42c5-40c6-bba5-de899ca47176 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:36.053759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921008-fe9b-48a5-ab14-1575ebeb95c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:36.055066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921008-fe9b-48a5-ab14-1575ebeb95c3 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:36.056262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921008-fe9b-48a5-ab14-1575ebeb95c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:36.057895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921008-fe9b-48a5-ab14-1575ebeb95c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:36.080232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921008-fe9b-48a5-ab14-1575ebeb95c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:36.084381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921008-fe9b-48a5-ab14-1575ebeb95c3 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:36.106798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1479/2980] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:20:36.658770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a81f7-d985-4777-8333-6b0e41aba7ef None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:36.659061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a81f7-d985-4777-8333-6b0e41aba7ef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:36.659341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a81f7-d985-4777-8333-6b0e41aba7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:36.711912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eb3a81f7-d985-4777-8333-6b0e41aba7ef None None] MFA Rules not processed for user `d2808f585afe41ed94e5cf42bee5ee66`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:36.718002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eb3a81f7-d985-4777-8333-6b0e41aba7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:36.754898 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1502/2981] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:38.076090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda85-691c-475d-b05b-4d625287e129 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:38.076831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda85-691c-475d-b05b-4d625287e129 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:38.076831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda85-691c-475d-b05b-4d625287e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:38.111387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-25afda85-691c-475d-b05b-4d625287e129 None None] MFA Rules not processed for user `d2808f585afe41ed94e5cf42bee5ee66`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:38.112548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-25afda85-691c-475d-b05b-4d625287e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:38.139618 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1480/2982] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:42.431074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a110b-db3f-42e2-9f70-af0b5ee68f64 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:42.431950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a110b-db3f-42e2-9f70-af0b5ee68f64 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:42.432373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a110b-db3f-42e2-9f70-af0b5ee68f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:42.462687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-379a110b-db3f-42e2-9f70-af0b5ee68f64 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:42.464419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-379a110b-db3f-42e2-9f70-af0b5ee68f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:42.478671 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1503/2983] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:20:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:42.502799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afda85-691c-475d-b05b-4d625287e129 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:42.525464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afda85-691c-475d-b05b-4d625287e129 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:42.547459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5ba6-ce8a-4765-b6b3-c3de71fb0637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:42.549140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5ba6-ce8a-4765-b6b3-c3de71fb0637 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:42.549885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5ba6-ce8a-4765-b6b3-c3de71fb0637 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:42.550473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5ba6-ce8a-4765-b6b3-c3de71fb0637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:42.587111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5ba6-ce8a-4765-b6b3-c3de71fb0637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:42.588819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5ba6-ce8a-4765-b6b3-c3de71fb0637 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:42.614477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1481/2984] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:20:42.709548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:42.709843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:42.710185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:42.787919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] MFA Rules not processed for user `c7eabd93a4524aa4a9f0ba3b3bef29c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:42.789548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:43.036834 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1504/2985] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:43.050995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:43.051285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:43.051573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:43.098424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] MFA Rules not processed for user `c7eabd93a4524aa4a9f0ba3b3bef29c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:43.099725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:43.125892 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1482/2986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:20:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:44.487261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:44.489388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:44.774304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cc839-5aa9-49d6-8f1c-272b40807b3c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:44.789855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0920e2-5ee4-4319-8601-da114cff7375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:44.791373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0920e2-5ee4-4319-8601-da114cff7375 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:44.791373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0920e2-5ee4-4319-8601-da114cff7375 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:44.791552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0920e2-5ee4-4319-8601-da114cff7375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:44.815124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0920e2-5ee4-4319-8601-da114cff7375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:44.816767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0920e2-5ee4-4319-8601-da114cff7375 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:44.845436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1505/2987] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:52.109822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:52.111522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:52.225723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f2fef-eb6e-4fe0-9268-4a7fd8237c58 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:52.229891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:52.230625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:52.230970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:52.231452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:52.234630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:52.376526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:52.377981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:52.390805 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1483/2988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:20:54.839273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=72 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:20:55.414624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06ac66-cbbd-446d-99ca-3fa80ad58072 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:55.415361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06ac66-cbbd-446d-99ca-3fa80ad58072 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:55.415777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06ac66-cbbd-446d-99ca-3fa80ad58072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:55.459116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3f06ac66-cbbd-446d-99ca-3fa80ad58072 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:20:55.460758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3f06ac66-cbbd-446d-99ca-3fa80ad58072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:20:55.499993 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1506/2989] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:20:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:20:55.507341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:20:55.529817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aab77-17ae-4442-a622-3128b3f48c0c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:20:55.545416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:20:55.546339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:20:55.546770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:20:55.547192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:20:55.565524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:20:55.567460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:20:55.594528 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1484/2990] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:21:03.681770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f7886-3861-4434-be35-7e4a0c734801 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:03.682344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f7886-3861-4434-be35-7e4a0c734801 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:03.682447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f7886-3861-4434-be35-7e4a0c734801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:03.757300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c94f7886-3861-4434-be35-7e4a0c734801 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:03.761949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c94f7886-3861-4434-be35-7e4a0c734801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:03.792104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1507/2991] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:21:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:03.827879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:03.840683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:03.864139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91267d39-847e-4094-ae64-d84bad44dfa5 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:03.884571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7710d-32f9-43e5-b4c6-68860fb643c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:03.885422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7710d-32f9-43e5-b4c6-68860fb643c3 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:03.886006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7710d-32f9-43e5-b4c6-68860fb643c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:03.886489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7710d-32f9-43e5-b4c6-68860fb643c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:03.911776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7710d-32f9-43e5-b4c6-68860fb643c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:03.915107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7710d-32f9-43e5-b4c6-68860fb643c3 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:03.973940 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1485/2992] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:21:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:21:06.576650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:06.577595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:06.578025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:06.629857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:06.632839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:06.797714 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1508/2993] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:11.607307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:11.608321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:11.609295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:11.639244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:11.641411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:11.656067 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1486/2994] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:21:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:11.663408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:11.678340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa6be-4b09-47b5-ba77-10464b751a3a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:11.686766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:11.687511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:11.687888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:11.688389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:11.700204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:11.704036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:11.716538 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1509/2995] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:21:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:21:18.408168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:18.409594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:18.457752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab696-3eb3-4386-a807-5e46bc62e6ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:18.465415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:18.466624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:18.466905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:18.467364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] PATH_INFO: `/v3/users/06e506f335f845a18332a4cd5047f3d4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:18.469136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e506f335f845a18332a4cd5047f3d4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:18.490166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:18.591742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e506f335f845a18332a4cd5047f3d4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:18.614711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e506f335f845a18332a4cd5047f3d4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:18.615516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e506f335f845a18332a4cd5047f3d4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:18.616300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e506f335f845a18332a4cd5047f3d4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:18.634841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e506f335f845a18332a4cd5047f3d4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:18.682433 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1487/2996] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:18 2022] DELETE /identity/v3/users/06e506f335f845a18332a4cd5047f3d4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:21:19.106239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:19.134238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c98bc4-55bb-4dad-af74-f7c087a71260 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:19.352275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:19.353568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:19.355129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:19.355563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] PATH_INFO: `/v3/projects/d0b208b5920a4ddcb3a200cdbd6fa6f7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:19.360644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b208b5920a4ddcb3a200cdbd6fa6f7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:19.364061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:19.496183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b208b5920a4ddcb3a200cdbd6fa6f7', 'request_id': 'req-b50723e7-f0b1-46e2-a639-dac61fc7fb97'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.517566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b208b5920a4ddcb3a200cdbd6fa6f7', 'request_id': 'req-b50723e7-f0b1-46e2-a639-dac61fc7fb97'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.532254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b208b5920a4ddcb3a200cdbd6fa6f7', 'request_id': 'req-b50723e7-f0b1-46e2-a639-dac61fc7fb97'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.562771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] The token cache is being invalidate because project d0b208b5920a4ddcb3a200cdbd6fa6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:19.563956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.568142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.572571 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1510/2997] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:19 2022] DELETE /identity/v3/projects/d0b208b5920a4ddcb3a200cdbd6fa6f7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:19.576513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:19.580126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:19.599141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99d4e5-4569-4157-adc5-716db6ca40f5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:19.736210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:19.736877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:19.737154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:19.737427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] PATH_INFO: `/v3/users/ef4bb4c935814adc80197aaef07d30a8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:19.739892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4bb4c935814adc80197aaef07d30a8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:19.741824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:19.858165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4bb4c935814adc80197aaef07d30a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.902076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4bb4c935814adc80197aaef07d30a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.903839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4bb4c935814adc80197aaef07d30a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.905812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4bb4c935814adc80197aaef07d30a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.908780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:19.931623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-273d9bf4-8a1b-4d90-84a4-a145daecff4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4bb4c935814adc80197aaef07d30a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:19.986405 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1488/2998] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:19 2022] DELETE /identity/v3/users/ef4bb4c935814adc80197aaef07d30a8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:20.360383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:20.362386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:20.400679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50723e7-f0b1-46e2-a639-dac61fc7fb97 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:20.427516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:20.583099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:20.585859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:20.586140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:20.586449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] PATH_INFO: `/v3/projects/2de7c3b7f19c4f7f8d73015b0497bddc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:20.589498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de7c3b7f19c4f7f8d73015b0497bddc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:20.594669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:20.733575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de7c3b7f19c4f7f8d73015b0497bddc', 'request_id': 'req-2253b93b-2d7c-418d-adcd-841943d65f27'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:20.755320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de7c3b7f19c4f7f8d73015b0497bddc', 'request_id': 'req-2253b93b-2d7c-418d-adcd-841943d65f27'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:20.776021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de7c3b7f19c4f7f8d73015b0497bddc', 'request_id': 'req-2253b93b-2d7c-418d-adcd-841943d65f27'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:20.809860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] The token cache is being invalidate because project 2de7c3b7f19c4f7f8d73015b0497bddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:20.810230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:20.810898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2253b93b-2d7c-418d-adcd-841943d65f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:20.817491 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1511/2999] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:20 2022] DELETE /identity/v3/projects/2de7c3b7f19c4f7f8d73015b0497bddc => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:20.819346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:20.819804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:20.819981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:20.863282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:20.864458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:21.036637 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1489/3000] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:21.045260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.045572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.045821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.091469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:21.092996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:21.119643 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1512/3001] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:21.120805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:21.142563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf56fa3-29f9-476d-a755-bc0b0af8679c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:21.157320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:21.157964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.158269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.158544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.165183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:21.165489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:21.169797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:21.208432 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1490/3002] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:21:21.209544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:21.221982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361e1b-9faf-4073-911f-3f6cbcc458eb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:21.236545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:21.237054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.237297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.237576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.240529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:21.242562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:21.356472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1513/3003] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:21 2022] POST /identity/v3/projects => generated 359 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:21.360354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:21.377212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ccfd-f65d-4229-a2db-34c7ffc1c796 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:21.505898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:21.506602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.506859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.507115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.507783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:21.510384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:21.566525 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1491/3004] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:21 2022] POST /identity/v3/users => generated 280 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:21.570159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:21.590137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67c16-70ba-4b8a-9a51-803ceebde8d4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:21.604061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:21.605140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.605244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.606205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.609850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:21.614446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:21.657894 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1514/3005] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:21.659321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:21.692993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f475f-bdf1-4d3b-a908-401c8d625b91 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:21.708690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3e625-51e7-4ccf-ac51-fdc0e459c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:21.708690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3e625-51e7-4ccf-ac51-fdc0e459c98a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.708690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3e625-51e7-4ccf-ac51-fdc0e459c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.709292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3e625-51e7-4ccf-ac51-fdc0e459c98a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.710034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3e625-51e7-4ccf-ac51-fdc0e459c98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:21.715902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3e625-51e7-4ccf-ac51-fdc0e459c98a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:21.747836 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1492/3006] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:21.753195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:21.767894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d55a-e204-49b1-993e-2508f7e7a7d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:21.785087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:21.785087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.785087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.785087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] PATH_INFO: `/v3/projects/cef5dffc26994836917fcce5547f9024/users/6a5c21c09b52446984afa937a8fb0824/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.826197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef5dffc26994836917fcce5547f9024, user_id=6a5c21c09b52446984afa937a8fb0824, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:21.831039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:21.874321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1515/3007] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:21 2022] PUT /identity/v3/projects/cef5dffc26994836917fcce5547f9024/users/6a5c21c09b52446984afa937a8fb0824/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:21.886195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:21.886753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:21.886753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:21.982543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] MFA Rules not processed for user `6a5c21c09b52446984afa937a8fb0824`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:21.984572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:22.058989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:22.179899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1493/3008] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:21:22.185095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:22.253725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:22.358337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ed48-f6e8-4478-8231-423106d53220 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:22.365229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:22.365229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:22.365229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:22.365591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:22.366427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:22.368567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:22.408197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1516/3009] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:22 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:22.412079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:22.431353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42031adc-371d-467a-85c9-bbbba3d1b2e3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:22.573906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:22.575006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:22.575669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:22.575669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:22.578815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:22.580877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:22.630894 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1494/3010] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:22 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:22.632229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:22.645445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56dfbf-180e-403a-b051-1dc07faac610 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:22.652023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:22.652872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:22.655878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:22.656354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:22.657937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:22.662684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:22.697705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1517/3011] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:22.702727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:22.719174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f3c26-a1b6-48f6-937b-de754f9381f8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:22.730822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:22.732114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:22.732541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:22.732823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] PATH_INFO: `/v3/projects/4c3f0860b61d41c5a7b9049271c6fbdc/users/01361a84ab9c40d5b620393f0319d125/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:22.767751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3f0860b61d41c5a7b9049271c6fbdc, user_id=01361a84ab9c40d5b620393f0319d125, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:22.771538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:22.809087 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1495/3012] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:22 2022] PUT /identity/v3/projects/4c3f0860b61d41c5a7b9049271c6fbdc/users/01361a84ab9c40d5b620393f0319d125/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:22.813993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:22.826992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0479b-1f83-44eb-8a38-83603bb712ff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:22.927422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc0ce-44b5-4f6e-93fd-1df76858ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:22.928120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc0ce-44b5-4f6e-93fd-1df76858ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:22.928449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc0ce-44b5-4f6e-93fd-1df76858ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:22.928718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc0ce-44b5-4f6e-93fd-1df76858ed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:22.931124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc0ce-44b5-4f6e-93fd-1df76858ed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:22.932820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc0ce-44b5-4f6e-93fd-1df76858ed1c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:22.977986 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1518/3013] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:22.979003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:22.994514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd593-ec39-47b4-9da3-3a6c6d03daf2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:23.020264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:23.020995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:23.021257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:23.021539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] PATH_INFO: `/v3/projects/4c3f0860b61d41c5a7b9049271c6fbdc/users/01361a84ab9c40d5b620393f0319d125/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:23.043486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3f0860b61d41c5a7b9049271c6fbdc, user_id=01361a84ab9c40d5b620393f0319d125, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:23.046314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:23.108581 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1496/3014] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:22 2022] PUT /identity/v3/projects/4c3f0860b61d41c5a7b9049271c6fbdc/users/01361a84ab9c40d5b620393f0319d125/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:23.111669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:23.111959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:23.112235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:23.191272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] MFA Rules not processed for user `01361a84ab9c40d5b620393f0319d125`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:23.192784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:23.348524 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1519/3015] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:23.462323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:23.467601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:23.571535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5c3f0-94d1-4b55-b813-3404442c2cdd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:23.577834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:23.578623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:23.579017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:23.579358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] PATH_INFO: `/v3/users/017fa19f316a47a198abd6205860c931` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:23.580848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017fa19f316a47a198abd6205860c931)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:23.583559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:23.621281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:23.666285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017fa19f316a47a198abd6205860c931'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:23.680483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017fa19f316a47a198abd6205860c931'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:23.681368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017fa19f316a47a198abd6205860c931'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:23.681976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017fa19f316a47a198abd6205860c931'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:23.692038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:23.692553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017fa19f316a47a198abd6205860c931'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:23.694174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:23.714289 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1497/3016] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:23 2022] DELETE /identity/v3/users/017fa19f316a47a198abd6205860c931 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:23.728573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:23.801851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09351ac3-16cd-4bf0-b38f-8cce9b397e28 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:23.863764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:23.864447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:23.864730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:23.865002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:23.866878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:23.967604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:23.969400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:23.993813 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1520/3017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:24.010566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:24.012224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.035579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:24.037196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.055135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63243f-b09c-4e80-8937-ea688d9f2e03 service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:24.062530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:24.063214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.063563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.063934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.066042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.082556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:24.084066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaa27b-e224-45a7-b2b8-30ee167ba42f service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:24.099705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1521/3018] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:21:24.126652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0dcc-715c-45b7-805c-8ec238f7bac0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:24.132028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:24.132696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.132979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.133417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] PATH_INFO: `/v3/projects/e0cc199dfb244316b75aec3469cb40f2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.134582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cc199dfb244316b75aec3469cb40f2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:24.138917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:24.199684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cc199dfb244316b75aec3469cb40f2', 'request_id': 'req-7f601a65-209f-494a-a3af-9a862b4b62f1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:24.207483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cc199dfb244316b75aec3469cb40f2', 'request_id': 'req-7f601a65-209f-494a-a3af-9a862b4b62f1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:24.226373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cc199dfb244316b75aec3469cb40f2', 'request_id': 'req-7f601a65-209f-494a-a3af-9a862b4b62f1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:24.251256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] The token cache is being invalidate because project e0cc199dfb244316b75aec3469cb40f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:24.251793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:24.253622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7f601a65-209f-494a-a3af-9a862b4b62f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:24.261603 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1498/3019] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:24 2022] DELETE /identity/v3/projects/e0cc199dfb244316b75aec3469cb40f2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:24.267099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.268501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.269135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.297394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:24.299199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.412101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:24.466658 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1522/3020] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:24.466786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.466786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.466786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.493989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:24.495420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.508752 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1499/3021] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:24.510894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:24.527585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4683e1-0492-4711-8ef2-cd0a74882fa5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:24.539820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:24.540455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.540743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.542039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.542752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:24.543061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:24.545596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:24.564458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1523/3022] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:21:24.565894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:24.577714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2638-710d-431f-a115-8e9f396966f0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:24.586195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:24.587075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.587667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.588036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.588859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:24.591082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:24.619086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:24.622493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.640649 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1500/3023] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:24 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:24.643431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:24.654504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:24.847420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2be0a-3627-4b64-8f13-4ac5ffc049bb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:24.847970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484a77-0d87-490d-93bd-f9d2addae511 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:24.859744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a71d4-d6cf-4835-a208-3cff796a5fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:24.862402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a71d4-d6cf-4835-a208-3cff796a5fad admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.862402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a71d4-d6cf-4835-a208-3cff796a5fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.862402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a71d4-d6cf-4835-a208-3cff796a5fad admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.862402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a71d4-d6cf-4835-a208-3cff796a5fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:24.864256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a71d4-d6cf-4835-a208-3cff796a5fad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:24.910358 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1501/3024] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:24 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:24.912518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.913007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.913480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.974468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:24.975096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:24.975378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:24.975654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:24.977476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:24.986041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:24.987317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:25.075223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1502/3025] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:21:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:25.076936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:25.099277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91432244-1216-491a-8bc5-1058f3e18a3b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:25.104889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:25.105706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:25.105857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:25.106025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:25.106542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:25.107212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:25.107830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:25.108841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:25.120926 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1503/3026] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:25.120926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:25.123595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:25.123912 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1524/3027] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:25.125404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:25.136641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:25.142647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f2f3-2146-4c8c-a807-a1a6f8185bd8 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:25.150356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:25.151102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:25.151480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:25.151853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:25.153384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:25.155837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:25.177722 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1525/3028] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:21:25.181522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:25.193990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48533-c556-4efe-95a6-d3b2b62f7c0a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:25.199277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74483510-d5f7-4c47-84ac-3693649cab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:25.201730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483510-d5f7-4c47-84ac-3693649cab1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:25.202118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483510-d5f7-4c47-84ac-3693649cab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:25.202518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483510-d5f7-4c47-84ac-3693649cab1c admin admin] PATH_INFO: `/v3/projects/3510dfcab8bd4c338c220dcad8387e13/users/185c3a9cfe614351bd1909c9eb271564/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:25.228988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74483510-d5f7-4c47-84ac-3693649cab1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3510dfcab8bd4c338c220dcad8387e13, user_id=185c3a9cfe614351bd1909c9eb271564, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:25.237107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74483510-d5f7-4c47-84ac-3693649cab1c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:25.241580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:25.277279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1526/3029] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:25 2022] PUT /identity/v3/projects/3510dfcab8bd4c338c220dcad8387e13/users/185c3a9cfe614351bd1909c9eb271564/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:25.280100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:25.280388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:25.280660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:25.315282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:25.316875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:25.317355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bb9f-e584-4552-a2c4-ca4adfdf5616 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:25.464539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1527/3030] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:25.480904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:25.486911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:25.510039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:25.510700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:25.510978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:25.511249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:25.623226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e977324-15fd-4be5-9069-4cbe5f1f34cb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:25.628782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14920207-0aab-4672-89e2-7612b5df1184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:25.629582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14920207-0aab-4672-89e2-7612b5df1184 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:25.629833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14920207-0aab-4672-89e2-7612b5df1184 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:25.630363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14920207-0aab-4672-89e2-7612b5df1184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:25.647015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:25.648601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:25.658586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14920207-0aab-4672-89e2-7612b5df1184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:25.660930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14920207-0aab-4672-89e2-7612b5df1184 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:25.673077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1504/3031] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:21:25.681014 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1528/3032] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:31.904934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:31.908186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:31.936145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41c93-a4a6-4ca7-9ec9-467b36e8db1d service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:31.941116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:31.941769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:31.942057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:31.942744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] PATH_INFO: `/v3/users/6a5c21c09b52446984afa937a8fb0824` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:31.944134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5c21c09b52446984afa937a8fb0824)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:31.946300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:32.032177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5c21c09b52446984afa937a8fb0824'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:32.046317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5c21c09b52446984afa937a8fb0824'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:32.049378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5c21c09b52446984afa937a8fb0824'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:32.051063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5c21c09b52446984afa937a8fb0824'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:32.077057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5c21c09b52446984afa937a8fb0824'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:32.096022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:32.120598 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1505/3033] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:31 2022] DELETE /identity/v3/users/6a5c21c09b52446984afa937a8fb0824 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:32.124434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9731f-fcb8-4abb-81cc-2cf30a34114b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:32.125202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9731f-fcb8-4abb-81cc-2cf30a34114b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:32.125202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9731f-fcb8-4abb-81cc-2cf30a34114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:32.158990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5da9731f-fcb8-4abb-81cc-2cf30a34114b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:32.160350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5da9731f-fcb8-4abb-81cc-2cf30a34114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:32.293024 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1529/3034] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:32.326623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:32.328468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:32.493045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed33941-fa4a-4995-a8a5-7bf5dc671cd2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:32.499909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:32.500201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:32.500480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:32.516028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:32.516673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:32.516955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:32.517233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:32.536719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:32.538195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:32.542712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:32.554402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:32.562714 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1506/3035] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:32.569668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:32.696501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1530/3036] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:21:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:21:32.733119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:32.738562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:32.906028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00d4a8-3c99-4eca-b3e9-4d2376b505b5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:32.920395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:32.921738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:32.922317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:32.922873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:32.939446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:32.941363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:32.954919 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1507/3037] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:21:34.397065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:34.398554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:34.445512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7130-1ce3-4533-8aa1-607d84bf263e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:34.465652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:34.466351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:34.466769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:34.466872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] PATH_INFO: `/v3/projects/cef5dffc26994836917fcce5547f9024` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:34.477685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef5dffc26994836917fcce5547f9024)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:34.491675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:34.574420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef5dffc26994836917fcce5547f9024', 'request_id': 'req-b89c13c3-0650-455d-954b-855350002989'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:34.583781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef5dffc26994836917fcce5547f9024', 'request_id': 'req-b89c13c3-0650-455d-954b-855350002989'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:34.591192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef5dffc26994836917fcce5547f9024', 'request_id': 'req-b89c13c3-0650-455d-954b-855350002989'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:34.651853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] The token cache is being invalidate because project cef5dffc26994836917fcce5547f9024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:34.653620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:34.654729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b89c13c3-0650-455d-954b-855350002989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:34.664437 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1531/3038] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:34 2022] DELETE /identity/v3/projects/cef5dffc26994836917fcce5547f9024 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:34.665645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:34.688880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969714a5-6bcd-4267-adcd-244f6a981321 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:34.831233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:34.832446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:34.833007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:34.833481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] PATH_INFO: `/v3/users/01361a84ab9c40d5b620393f0319d125` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:34.837482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01361a84ab9c40d5b620393f0319d125)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:34.856615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:34.930866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:34.992002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01361a84ab9c40d5b620393f0319d125'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:35.026880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01361a84ab9c40d5b620393f0319d125'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:35.028774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01361a84ab9c40d5b620393f0319d125'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:35.029662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01361a84ab9c40d5b620393f0319d125'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:35.055027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01361a84ab9c40d5b620393f0319d125'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:35.153226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1508/3039] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:34 2022] DELETE /identity/v3/users/01361a84ab9c40d5b620393f0319d125 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:35.740256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:35.741066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:35.741534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:35.805899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] MFA Rules not processed for user `185c3a9cfe614351bd1909c9eb271564`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:35.807159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:35.991919 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1532/3040] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:36.013673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:36.015171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:36.016225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:36.020167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:36.064219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:36.146881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cee3f1-a28f-405b-a148-b5220b97063a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:36.151372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4590a37-3eb0-4873-aeb2-748ca01e8f39 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:36.153372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc4a1-0b27-4064-81aa-ef604f6d973c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:36.154366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc4a1-0b27-4064-81aa-ef604f6d973c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:36.154746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc4a1-0b27-4064-81aa-ef604f6d973c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:36.155152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc4a1-0b27-4064-81aa-ef604f6d973c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:36.166511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:36.166726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc4a1-0b27-4064-81aa-ef604f6d973c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:36.167583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:36.168027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:36.168985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] PATH_INFO: `/v3/projects/4c3f0860b61d41c5a7b9049271c6fbdc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:36.171371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3f0860b61d41c5a7b9049271c6fbdc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:36.172265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc4a1-0b27-4064-81aa-ef604f6d973c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:36.177481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:36.183571 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1509/3041] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:36.272178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3f0860b61d41c5a7b9049271c6fbdc', 'request_id': 'req-d956b7fe-77a7-4d20-8a66-f1e06ac10916'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:36.281718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3f0860b61d41c5a7b9049271c6fbdc', 'request_id': 'req-d956b7fe-77a7-4d20-8a66-f1e06ac10916'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:36.294772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3f0860b61d41c5a7b9049271c6fbdc', 'request_id': 'req-d956b7fe-77a7-4d20-8a66-f1e06ac10916'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:36.321234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] The token cache is being invalidate because project 4c3f0860b61d41c5a7b9049271c6fbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:36.321400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:36.325983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d956b7fe-77a7-4d20-8a66-f1e06ac10916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:36.329833 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1533/3042] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:36 2022] DELETE /identity/v3/projects/4c3f0860b61d41c5a7b9049271c6fbdc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:36.335419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:36.335739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:36.336023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:36.400663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:36.402333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:36.544835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1510/3043] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:36.552586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:36.553300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:36.553590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:36.593015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:36.597061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:36.613957 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1534/3044] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:36.618699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:36.631113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ae65b-6b94-40d8-9f91-edc1c6df9f1d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:36.637905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:36.638535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:36.638818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:36.639547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:36.640207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:36.640516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:36.643065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:36.673202 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1511/3045] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:21:36.682573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:36.719528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc7c7-5f5d-4fc5-b0a8-786ea216a4b4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:36.744272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:36.746060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:36.747105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:36.747538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:36.748761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:36.751278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:36.818822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1535/3046] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:36 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:21:36.822848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:36.837869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ce76-b384-4818-bf4b-616893ded728 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:36.858429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:37.030363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:37.031621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.032060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.040079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:37.041210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:37.045170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:37.050830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:37.052927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:37.089630 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1512/3047] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:36 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:37.096675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:37.127297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63cbff-ba95-436b-ada8-bf53211e3bdf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:37.144621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:37.145272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.145563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.145846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:37.146536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:37.148570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:37.200946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1513/3048] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:37.202637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:37.215767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7655-8fba-4263-9dda-57fd65ae998b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:37.221693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:37.222704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.223058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.223409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:37.225609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:37.257585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:37.259573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:37.264767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd884-4087-4250-8562-c97e5d5f860c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:37.278921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1536/3049] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:37.280150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208dee9-7de9-41ae-9ff6-b9aeefd8a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:37.281189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208dee9-7de9-41ae-9ff6-b9aeefd8a345 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.281473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208dee9-7de9-41ae-9ff6-b9aeefd8a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.282218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208dee9-7de9-41ae-9ff6-b9aeefd8a345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:37.282669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208dee9-7de9-41ae-9ff6-b9aeefd8a345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:37.285468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208dee9-7de9-41ae-9ff6-b9aeefd8a345 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:37.306136 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1514/3050] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:37.307371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:37.334919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065e09-7942-48c6-84a6-c917397bb170 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:37.350671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:37.354999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.355887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.356391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] PATH_INFO: `/v3/projects/def86a9c1f1848da8dabd6ebe2f19fff/users/7e72a7a31ff34ef58937bec9e91d0d08/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:37.413293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def86a9c1f1848da8dabd6ebe2f19fff, user_id=7e72a7a31ff34ef58937bec9e91d0d08, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:37.416355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:37.453232 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1537/3051] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:37 2022] PUT /identity/v3/projects/def86a9c1f1848da8dabd6ebe2f19fff/users/7e72a7a31ff34ef58937bec9e91d0d08/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:21:37.467194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d13d2-1795-486d-ac7c-6fba371a9d66 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.467580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d13d2-1795-486d-ac7c-6fba371a9d66 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.468278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d13d2-1795-486d-ac7c-6fba371a9d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:37.569235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-630d13d2-1795-486d-ac7c-6fba371a9d66 None None] MFA Rules not processed for user `7e72a7a31ff34ef58937bec9e91d0d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:37.598654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-630d13d2-1795-486d-ac7c-6fba371a9d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:37.845042 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1515/3052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:37.848676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:37.870457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:37.946032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:37.946679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:37.947756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.004591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21171a2d-3869-43ff-8ba2-da94c2f377f0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:38.011361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:38.013310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:38.014573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:38.015637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.016171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] MFA Rules not processed for user `185c3a9cfe614351bd1909c9eb271564`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:38.016647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:38.017572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:38.019341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:38.092169 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1538/3053] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:37 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:38.093435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:38.172343 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1516/3054] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:21:38.333889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a86dc4-aaeb-4cad-a0e3-0543300364cd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:38.346449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:38.347681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:38.349186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:38.350037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.350977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:38.357116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:38.419715 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1539/3055] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:38 2022] POST /identity/v3/users => generated 294 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:38.423746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:38.461567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2cf2f-b21c-4853-9afa-d7c7b0080ba6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:38.467336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:38.467968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:38.468253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:38.468572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.469186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:38.471800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:38.491198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1517/3056] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:38.492379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:38.521707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167647c9-003a-4a2e-820d-adc2284a2af0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:38.553118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:38.553828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:38.558625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:38.559958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] PATH_INFO: `/v3/projects/3671eb45b37e41448e1670e555761fbb/users/3b4afcb41f9f4174998e48c0774ee0be/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.604952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3671eb45b37e41448e1670e555761fbb, user_id=3b4afcb41f9f4174998e48c0774ee0be, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:38.608206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:38.652508 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1540/3057] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:38 2022] PUT /identity/v3/projects/3671eb45b37e41448e1670e555761fbb/users/3b4afcb41f9f4174998e48c0774ee0be/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:21:38.658098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:38.666726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:38.677730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dca383-6d91-458d-9c82-b977192e3476 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:38.839568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cc04d-34d8-49c5-88fc-3437aa2aa4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:38.840150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cc04d-34d8-49c5-88fc-3437aa2aa4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:38.842165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cc04d-34d8-49c5-88fc-3437aa2aa4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:38.842471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cc04d-34d8-49c5-88fc-3437aa2aa4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.843148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cc04d-34d8-49c5-88fc-3437aa2aa4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:38.844880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cc04d-34d8-49c5-88fc-3437aa2aa4b9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:38.861803 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1518/3058] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:38.862830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:38.883461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f2af9-fc70-417f-a892-4beb88721826 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:38.932545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:38.937964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:38.938283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:38.945273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] PATH_INFO: `/v3/projects/3671eb45b37e41448e1670e555761fbb/users/3b4afcb41f9f4174998e48c0774ee0be/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:38.954871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3671eb45b37e41448e1670e555761fbb, user_id=3b4afcb41f9f4174998e48c0774ee0be, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:38.957811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:39.026466 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1541/3059] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:38 2022] PUT /identity/v3/projects/3671eb45b37e41448e1670e555761fbb/users/3b4afcb41f9f4174998e48c0774ee0be/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:39.029979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:39.030316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:39.030599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:39.091942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] MFA Rules not processed for user `3b4afcb41f9f4174998e48c0774ee0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:39.093492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:39.316704 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1519/3060] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:39.500460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:39.502660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:39.695347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:39.784830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c88bc8-0f47-4b97-a371-83c6bdfaa83f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:39.804223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42730af-cbb8-44b4-bb2b-6642d05495c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:39.804866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42730af-cbb8-44b4-bb2b-6642d05495c1 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:39.805147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42730af-cbb8-44b4-bb2b-6642d05495c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:39.805417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42730af-cbb8-44b4-bb2b-6642d05495c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:39.912440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42730af-cbb8-44b4-bb2b-6642d05495c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:39.920771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42730af-cbb8-44b4-bb2b-6642d05495c1 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:40.023519 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1542/3061] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:40.500382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:40.502093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:40.586757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:40.587289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:40.588232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:40.638965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:40.640229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:40.727508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be42ab4-7e6f-4c1d-ad00-1aab210f036f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:40.752567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:40.753209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:40.753517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:40.753766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:40.767195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:40.802108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:40.805739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:40.829203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1543/3062] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:21:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:21:40.843263 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1520/3063] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:40.878801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:40.880269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:41.182621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dcf8f-9abb-488a-8247-be01e96b737b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:41.199885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:41.200548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:41.200838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:41.201114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:41.223421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:41.225065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:41.247593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1544/3064] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:21:42.064704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:42.068797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:42.136039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:42.201429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:42.509806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e95ab-f6a0-4640-b63c-223d47e3641c service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:42.556857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:42.561165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:42.561473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:42.568000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] PATH_INFO: `/v3/users/66c783b9e7e040e0b18447f229453a47` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:42.580461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c783b9e7e040e0b18447f229453a47)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:42.593579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:42.654503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84156e-d418-4505-9b80-01cfc07fbf1a service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:42.686316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:42.691636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:42.691984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:42.695026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] PATH_INFO: `/v3/users/7e72a7a31ff34ef58937bec9e91d0d08` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:42.705713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e72a7a31ff34ef58937bec9e91d0d08)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:42.716484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:42.792500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:42.868750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c783b9e7e040e0b18447f229453a47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:42.923462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c783b9e7e040e0b18447f229453a47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:42.924242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c783b9e7e040e0b18447f229453a47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:42.926493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c783b9e7e040e0b18447f229453a47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:42.960892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc003b15-1f61-4b4f-b6c1-e941385237d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c783b9e7e040e0b18447f229453a47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:42.994071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e72a7a31ff34ef58937bec9e91d0d08'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:43.110056 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1521/3065] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:42 2022] DELETE /identity/v3/users/66c783b9e7e040e0b18447f229453a47 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:43.114696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e72a7a31ff34ef58937bec9e91d0d08'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:43.119872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e72a7a31ff34ef58937bec9e91d0d08'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:43.120857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340034f-a713-4868-929c-1454a41806ea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:43.122519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e72a7a31ff34ef58937bec9e91d0d08'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:43.123069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340034f-a713-4868-929c-1454a41806ea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:43.123342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340034f-a713-4868-929c-1454a41806ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:43.197877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b615ad36-8810-49db-b1c4-372a3c4c72fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e72a7a31ff34ef58937bec9e91d0d08'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:43.268951 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1545/3066] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:42 2022] DELETE /identity/v3/users/7e72a7a31ff34ef58937bec9e91d0d08 => generated 0 bytes in 1069 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:21:43.279739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:43.280559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:43.281145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:43.281268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d340034f-a713-4868-929c-1454a41806ea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:43.282556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d340034f-a713-4868-929c-1454a41806ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:43.347361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:43.348646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:43.470942 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1522/3067] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:43.484616 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1546/3068] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:43.555696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340034f-a713-4868-929c-1454a41806ea None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:43.563190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:43.574995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:43.575343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d340034f-a713-4868-929c-1454a41806ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:43.763767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:43.842049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a03a-848d-4598-b409-7c3b45e3ee60 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:43.849363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340034f-a713-4868-929c-1454a41806ea None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:43.852879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:43.853632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:43.853915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:43.857867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:43.863800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874b6e-1b2a-42a2-a876-4bbb77008f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:43.864458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874b6e-1b2a-42a2-a876-4bbb77008f79 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:43.864743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874b6e-1b2a-42a2-a876-4bbb77008f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:43.865081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874b6e-1b2a-42a2-a876-4bbb77008f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:43.885650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:43.889338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:43.899522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874b6e-1b2a-42a2-a876-4bbb77008f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:43.906231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874b6e-1b2a-42a2-a876-4bbb77008f79 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:43.929981 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1547/3069] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:43.948091 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1523/3070] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:45.589883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:45.593492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:45.630202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300901-445f-42ea-ab9b-05f8c2a44054 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:45.656772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:45.657612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:45.658036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:45.658484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] PATH_INFO: `/v3/projects/4fd79ee58a2d4f198bb98667352d1580` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:45.659885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd79ee58a2d4f198bb98667352d1580)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:45.663072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:45.754788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:45.789465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd79ee58a2d4f198bb98667352d1580', 'request_id': 'req-7141af4e-1053-48b4-93b9-e1bd7d827ae7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:45.821301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd79ee58a2d4f198bb98667352d1580', 'request_id': 'req-7141af4e-1053-48b4-93b9-e1bd7d827ae7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:45.838718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd79ee58a2d4f198bb98667352d1580', 'request_id': 'req-7141af4e-1053-48b4-93b9-e1bd7d827ae7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:45.865643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] The token cache is being invalidate because project 4fd79ee58a2d4f198bb98667352d1580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:45.866332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:45.868678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7141af4e-1053-48b4-93b9-e1bd7d827ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:45.871506 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1548/3071] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:45 2022] DELETE /identity/v3/projects/4fd79ee58a2d4f198bb98667352d1580 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:45.876903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:45.876903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:45.877564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:45.982600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:45.985705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:46.152751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1524/3072] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:46.154483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:46.154771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:46.155071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:46.198558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:46.201973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:46.230230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1549/3073] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:46.236178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:46.248720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b409f-2cd2-4993-9dd0-098b366972a3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:46.254238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:46.254882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:46.255166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:46.255455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:46.256296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:46.268203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:46.270761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:46.322349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:46.336881 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1525/3074] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:21:46.338961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4d66-149d-48bd-ab4d-85d34adf7c19 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:46.349283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:46.349523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:46.349776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:46.350051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:46.350883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:46.352871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:46.494328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1550/3075] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:21:46.494628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:46.522444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73900a-c387-4389-8d9c-5e32762a5af6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:46.772635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:46.773290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:46.773576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:46.774343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:46.775009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:46.777030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:46.836960 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1526/3076] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:46 2022] POST /identity/v3/users => generated 287 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:46.838176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:46.854660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399037c8-399c-4c45-97b0-c1f259f9372f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:46.866182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:46.869755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:46.870077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:46.870682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:46.873782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:46.876839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:46.918561 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1551/3077] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:46.920998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:46.939317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a79d5-366b-45fc-b5aa-3b0e38203de2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:46.968201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931777-7da3-4a1e-bb89-db8f6941ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:46.975937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931777-7da3-4a1e-bb89-db8f6941ec09 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:46.976787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931777-7da3-4a1e-bb89-db8f6941ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:46.978075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931777-7da3-4a1e-bb89-db8f6941ec09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:46.979010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89931777-7da3-4a1e-bb89-db8f6941ec09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:46.984142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89931777-7da3-4a1e-bb89-db8f6941ec09 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:47.040550 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1527/3078] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:47.042601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:47.068648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15889b94-3491-43ef-ae24-92b25e4cd2eb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:47.085543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:47.086061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:47.086449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:47.086737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] PATH_INFO: `/v3/projects/267701b7e956491d80938267f232cdfd/users/478defc1c8794e91ab67672c14796e3b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:47.136949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267701b7e956491d80938267f232cdfd, user_id=478defc1c8794e91ab67672c14796e3b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:47.156191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:47.194284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1552/3079] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:47 2022] PUT /identity/v3/projects/267701b7e956491d80938267f232cdfd/users/478defc1c8794e91ab67672c14796e3b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:47.205135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:47.205429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:47.205734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:47.297586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] MFA Rules not processed for user `478defc1c8794e91ab67672c14796e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:47.299232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:47.381463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:47.459664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:47.461901 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1528/3080] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:47.462117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:47.479179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:47.482252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:47.725098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d0256-a61f-4978-90cf-562e584d0f36 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:47.741014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666b2c-d867-4bc7-9d15-e31ca96a715f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:47.743635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:47.744573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:47.744964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:47.745356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] PATH_INFO: `/v3/projects/def86a9c1f1848da8dabd6ebe2f19fff` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:47.746630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=def86a9c1f1848da8dabd6ebe2f19fff)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:47.748839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:47.749469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:47.749748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:47.750019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:47.755327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:47.769451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:47.771213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:47.801018 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1529/3081] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:47.907122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def86a9c1f1848da8dabd6ebe2f19fff', 'request_id': 'req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:47.910310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:47.923140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def86a9c1f1848da8dabd6ebe2f19fff', 'request_id': 'req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:47.937529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def86a9c1f1848da8dabd6ebe2f19fff', 'request_id': 'req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:47.978015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] The token cache is being invalidate because project def86a9c1f1848da8dabd6ebe2f19fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:47.978015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:47.978015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:47.981007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1553/3082] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:47 2022] DELETE /identity/v3/projects/def86a9c1f1848da8dabd6ebe2f19fff => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:21:47.985087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:48.034238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc931-2a2d-4c88-b7f8-c61d48498350 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:48.064172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:48.099393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:48.321158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:48.321826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:48.322103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:48.322407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] PATH_INFO: `/v3/users/3b4afcb41f9f4174998e48c0774ee0be` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:48.330258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4afcb41f9f4174998e48c0774ee0be)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:48.336046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:48.339315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d28ce0-2fde-410f-87d4-0fb1e5f33e7c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:48.358084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:48.358716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:48.358994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:48.359269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:48.369989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:48.404905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:48.406405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:48.455382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1554/3083] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:21:48.488849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4afcb41f9f4174998e48c0774ee0be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:48.516216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4afcb41f9f4174998e48c0774ee0be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:48.517072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4afcb41f9f4174998e48c0774ee0be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:48.517938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4afcb41f9f4174998e48c0774ee0be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:48.526812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:48.530032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d870647a-6ab6-4a6e-a823-577b83cc2d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4afcb41f9f4174998e48c0774ee0be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:48.590776 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1530/3084] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:47 2022] DELETE /identity/v3/users/3b4afcb41f9f4174998e48c0774ee0be => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:50.306969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:50.310766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:50.345025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a324d9-a06e-4af0-b8fe-02a4fbd381c6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:50.486672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:50.487321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:50.487604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:50.487886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] PATH_INFO: `/v3/projects/3671eb45b37e41448e1670e555761fbb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:50.489786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3671eb45b37e41448e1670e555761fbb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:50.491750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:50.578480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3671eb45b37e41448e1670e555761fbb', 'request_id': 'req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:50.595831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3671eb45b37e41448e1670e555761fbb', 'request_id': 'req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:50.622065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3671eb45b37e41448e1670e555761fbb', 'request_id': 'req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:50.677735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] The token cache is being invalidate because project 3671eb45b37e41448e1670e555761fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:50.677735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:50.691161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e863975c-c2f1-4a85-9cdd-a7b12f4390a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:50.698243 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1555/3085] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:50 2022] DELETE /identity/v3/projects/3671eb45b37e41448e1670e555761fbb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:50.704044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:50.704545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:50.704649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:50.747547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:50.748283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:50.874305 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1531/3086] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:50.881815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:50.882169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:50.882410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:50.921137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:50.923537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:50.947838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1556/3087] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:50.948365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:50.964517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a98027-3954-4a7a-97ac-590426106bc7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:50.971764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:50.973228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:50.973758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:50.974305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:50.975855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:50.976401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:50.979257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:51.000638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1532/3088] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:21:51.014389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.016392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008744bc-d949-4f3b-8d2b-dea0c8bd2b8b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:51.023851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:51.025907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:51.026215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:51.026494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:51.027721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:51.030657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:51.037500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:51.092571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.099825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1557/3089] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:51 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:51.104218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90631-6d5c-4e11-9df4-612d6a29630f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:51.224140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:51.224894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:51.225306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:51.225831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:51.226898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:51.229010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:51.298847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.319385 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1533/3090] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:51 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:51.322609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9b93f-5808-48fc-8aef-e8298481e21e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:51.341106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:51.341824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:51.342140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:51.342377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:51.342988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:51.351409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:51.401841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.416812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef2c1a-d786-4f2d-a464-3a48467b0603 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:51.417090 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1558/3091] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:51.451123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:51.451993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:51.452284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:51.452562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:51.453224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:51.454880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:51.489599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.491112 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1534/3092] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:51.502594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb58f9-9cc7-45c3-85a7-489e934af6da admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:51.505069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.508446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:51.514940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44b89-c9cd-4fe3-9d07-91057b4d8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:51.518795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44b89-c9cd-4fe3-9d07-91057b4d8bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:51.531871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44b89-c9cd-4fe3-9d07-91057b4d8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:51.533067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44b89-c9cd-4fe3-9d07-91057b4d8bb0 admin admin] PATH_INFO: `/v3/projects/aadf9e08ab6b4aa4a79ecde61d4870bf/users/a4ba7cd8a0064bad86c7892272a11726/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:51.580560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef44b89-c9cd-4fe3-9d07-91057b4d8bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadf9e08ab6b4aa4a79ecde61d4870bf, user_id=a4ba7cd8a0064bad86c7892272a11726, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:51.583782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef44b89-c9cd-4fe3-9d07-91057b4d8bb0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:51.624546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1559/3093] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:51 2022] PUT /identity/v3/projects/aadf9e08ab6b4aa4a79ecde61d4870bf/users/a4ba7cd8a0064bad86c7892272a11726/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:21:51.626353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:51.627573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:51.628898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:51.671894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:51.671894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:51.678006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:51.826937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8a3b-fd01-4ecf-876c-2b35268b9079 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:51.947483 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1560/3094] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:51.956623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:51.966487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.002840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44e73-da66-4c10-b3ef-e08e3bc485ea None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:52.015018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:52.015018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:52.015018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:52.017495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] PATH_INFO: `/v3/users/478defc1c8794e91ab67672c14796e3b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:52.020009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478defc1c8794e91ab67672c14796e3b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:52.023600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:52.044729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:52.045375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:52.045654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:52.045945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:52.050016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.082440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:52.085456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:52.114599 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1535/3095] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:21:52.115634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:52.117462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478defc1c8794e91ab67672c14796e3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.117841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.150372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478defc1c8794e91ab67672c14796e3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.151127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478defc1c8794e91ab67672c14796e3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.151836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478defc1c8794e91ab67672c14796e3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.167429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-594f2cf3-a657-477f-b676-4399c2132139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478defc1c8794e91ab67672c14796e3b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.191961 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1561/3096] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:51 2022] DELETE /identity/v3/users/478defc1c8794e91ab67672c14796e3b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:52.196152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:52.196445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:52.196721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:52.237179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:52.237670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.244771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c52e-3768-44fa-92ce-c0f268bc5cb8 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:52.276772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:52.381194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1562/3097] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:21:52.382091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:52.383480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.399550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:52.400765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:52.401270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:52.401749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:52.404265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.405165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1cb2-d3aa-4a59-85a4-965617f856c3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:52.417325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:52.418037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:52.418362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:52.418640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] PATH_INFO: `/v3/users/c7eabd93a4524aa4a9f0ba3b3bef29c4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:52.419816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eabd93a4524aa4a9f0ba3b3bef29c4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:52.421239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:52.421753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:52.423210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:52.443203 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1536/3098] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:52.444216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:52.448245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:52.461363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e0a1-c458-4be8-a5bf-76984e57f4a9 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:52.465597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:52.466569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:52.467092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:52.467580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:52.479020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:52.481640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:52.497388 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1537/3099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:52.534452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eabd93a4524aa4a9f0ba3b3bef29c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.553782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eabd93a4524aa4a9f0ba3b3bef29c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.554975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eabd93a4524aa4a9f0ba3b3bef29c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.555808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eabd93a4524aa4a9f0ba3b3bef29c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.564991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4cd8d9e-436a-49e5-a693-16b994dd5566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eabd93a4524aa4a9f0ba3b3bef29c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:52.638564 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1563/3100] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:21:52 2022] DELETE /identity/v3/users/c7eabd93a4524aa4a9f0ba3b3bef29c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:53.253311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:53.275259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531727d-2efa-41b0-8266-cf677dc1352a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:53.301931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:53.374478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:53.375226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:53.375571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:53.375910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] PATH_INFO: `/v3/projects/bfde8dc9802942758704ce9992bd8437` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:53.377185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfde8dc9802942758704ce9992bd8437)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:53.379763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:53.481470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfde8dc9802942758704ce9992bd8437', 'request_id': 'req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.501189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfde8dc9802942758704ce9992bd8437', 'request_id': 'req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.516749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfde8dc9802942758704ce9992bd8437', 'request_id': 'req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.543167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] The token cache is being invalidate because project bfde8dc9802942758704ce9992bd8437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:53.543815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.544710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.556065 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1538/3101] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:53 2022] DELETE /identity/v3/projects/bfde8dc9802942758704ce9992bd8437 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:53.556568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219c52b-1867-4598-8d1d-04afee618704 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:53.557087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219c52b-1867-4598-8d1d-04afee618704 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:53.557171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219c52b-1867-4598-8d1d-04afee618704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:53.591934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:53.594901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:53.618553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4219c52b-1867-4598-8d1d-04afee618704 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:53.622443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4219c52b-1867-4598-8d1d-04afee618704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:53.759090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb38f6-9ca9-43ae-ac1b-2206d2e71c59 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:53.768239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:53.769008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:53.769359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:53.769885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] PATH_INFO: `/v3/projects/267701b7e956491d80938267f232cdfd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:53.772168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267701b7e956491d80938267f232cdfd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:53.775064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:53.832484 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1564/3102] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:53.841229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:53.841544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:53.841798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:53.904903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:53.907537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:53.909137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:53.910936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267701b7e956491d80938267f232cdfd', 'request_id': 'req-e75c8a64-cbd1-45f4-9c6a-531976b7c055'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.923856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267701b7e956491d80938267f232cdfd', 'request_id': 'req-e75c8a64-cbd1-45f4-9c6a-531976b7c055'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.941755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267701b7e956491d80938267f232cdfd', 'request_id': 'req-e75c8a64-cbd1-45f4-9c6a-531976b7c055'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.961546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] The token cache is being invalidate because project 267701b7e956491d80938267f232cdfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:21:53.961884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.966473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e75c8a64-cbd1-45f4-9c6a-531976b7c055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:21:53.972440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1539/3103] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:21:53 2022] DELETE /identity/v3/projects/267701b7e956491d80938267f232cdfd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:53.978128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1434ab-e84f-4f0e-955e-1ddce8973d81 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:53.980590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1434ab-e84f-4f0e-955e-1ddce8973d81 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:53.980590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1434ab-e84f-4f0e-955e-1ddce8973d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:53.992260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:54.040727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d1434ab-e84f-4f0e-955e-1ddce8973d81 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:54.041914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d1434ab-e84f-4f0e-955e-1ddce8973d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:54.079433 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1565/3104] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:54.080546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.094887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00a4a-721b-41e5-ae4d-b6deacd3daef None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.103502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.104285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.104657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.105034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.106027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:54.106480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.108208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.143774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1566/3105] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:21:54.148312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.174557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9d25f-0631-46f2-bc09-b7c8ed475ab0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.188191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.188898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.189172 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1540/3106] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:54.189280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.190440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.193461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.195805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.196977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.197991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.199563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.245370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:54.247844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:54.262909 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1567/3107] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:21:54.264006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.266620 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1541/3108] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:54.267721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.280547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c05b7-dd69-4b6c-b281-b71158783cba None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.423154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b9f0-1aca-4704-bc61-a5aa7b457f6b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.427865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.428443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.429186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.429541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.429812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.429973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.430909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.431017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.431497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.434063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.434933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:21:54.436158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.440523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.476368 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1568/3109] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:54 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:21:54.479574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.484775 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1542/3110] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:21:54.489228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.506370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efc32-fed9-4181-b573-4dffb04fc85a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.509617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b662c-e692-4d0a-a89f-556ee7649181 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.516829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.517671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.518124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.519167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.519755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.520475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.520762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.521038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.521588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.521702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.524156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.525877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.559916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1569/3111] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:54.563260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.580688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6747d-b36e-4842-aec0-e94cd9bb1e47 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.582282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1543/3112] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:21:54 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:54.583515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.673873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.674682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.675018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.675311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.675957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.681510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.716179 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1570/3113] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:54.717329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.724577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:54.757174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ad5c-09d4-4ce2-b54c-eccf8ca2b93a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.760636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80097f6-babd-4ea3-a1d9-32c6b703c691 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.768666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.769472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.769772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.770172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.770916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.772510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21a35c-618a-43d6-a48e-7a5e30cb9122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.773511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21a35c-618a-43d6-a48e-7a5e30cb9122 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.774002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21a35c-618a-43d6-a48e-7a5e30cb9122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.774485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21a35c-618a-43d6-a48e-7a5e30cb9122 admin admin] PATH_INFO: `/v3/projects/0dac8ce9bd5a4524b5d68f523a7276ed/users/df490263853a477593fc98d754c7a2f7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.774592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.801996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:54.808391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21a35c-618a-43d6-a48e-7a5e30cb9122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dac8ce9bd5a4524b5d68f523a7276ed, user_id=df490263853a477593fc98d754c7a2f7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.815716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21a35c-618a-43d6-a48e-7a5e30cb9122 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.816647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1544/3114] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:21:54 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:21:54.824842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:54.841182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3d26-daa0-42ab-a0e0-e60b3146f3c2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:54.862924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1571/3115] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:54 2022] PUT /identity/v3/projects/0dac8ce9bd5a4524b5d68f523a7276ed/users/df490263853a477593fc98d754c7a2f7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:54.865035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.866578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.867072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.902189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:54.903813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:54.930908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:54.931848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:54.932133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:54.933882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:54.935994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:54.942837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:54.975587 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1545/3116] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:54.982092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:55.006976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077457-414f-45ef-b68f-92d4238bd87e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:55.019409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:55.020044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:55.021133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:55.021477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:55.022308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:55.024444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:55.043841 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1572/3117] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:55.047113 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1546/3118] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:21:55.048773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:55.063943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:55.068600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:55.081161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837beaf-5380-4042-bf69-7dd96bd0db52 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:55.091546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856390eb-b8cf-4c7e-a65c-9db0ae2a4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:55.092451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856390eb-b8cf-4c7e-a65c-9db0ae2a4c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:55.092895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856390eb-b8cf-4c7e-a65c-9db0ae2a4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:55.094543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856390eb-b8cf-4c7e-a65c-9db0ae2a4c67 admin admin] PATH_INFO: `/v3/projects/420e89d01aaf4e17860828d3bd9540da/users/d8dbe2b4010e41dc943e525c8453c7c2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:55.125907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856390eb-b8cf-4c7e-a65c-9db0ae2a4c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420e89d01aaf4e17860828d3bd9540da, user_id=d8dbe2b4010e41dc943e525c8453c7c2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:55.130269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856390eb-b8cf-4c7e-a65c-9db0ae2a4c67 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:55.152822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1573/3119] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:21:55 2022] PUT /identity/v3/projects/420e89d01aaf4e17860828d3bd9540da/users/d8dbe2b4010e41dc943e525c8453c7c2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:21:55.166453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:55.166883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:55.167453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:55.207863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:55.209679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:55.213405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c587-daab-47d2-bcbc-47d65fd43674 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:55.335197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:55.335976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:55.336112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:55.336368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:55.398935 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1574/3120] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:55.413123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:55.420597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:55.423367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:55.463937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08705-2f65-4b17-b5b1-459bfc04f03c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:55.472661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cb1bf-1184-44f5-9558-300d799a3ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:55.475603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb1bf-1184-44f5-9558-300d799a3ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:55.476820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb1bf-1184-44f5-9558-300d799a3ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:55.479414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cb1bf-1184-44f5-9558-300d799a3ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:55.497304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:55.498851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:55.520335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb1bf-1184-44f5-9558-300d799a3ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:55.525060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cb1bf-1184-44f5-9558-300d799a3ec0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:55.528949 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1547/3121] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:55.564268 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1575/3122] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:56.622057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:56.627088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:56.912317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a59f8-7884-4a70-a215-b8a01b7af9c3 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:57.012702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:57.013398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:57.013690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:57.013967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:57.020795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:57.079243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:57.080892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f34e-9204-4dc5-9a88-8734b077564a service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:57.106764 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1548/3123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:21:58.776533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd87e7-54f7-484c-9ab3-db025d8daff9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:58.778028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd87e7-54f7-484c-9ab3-db025d8daff9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:58.778485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd87e7-54f7-484c-9ab3-db025d8daff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:58.845322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-51dd87e7-54f7-484c-9ab3-db025d8daff9 None None] MFA Rules not processed for user `df490263853a477593fc98d754c7a2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:58.848297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51dd87e7-54f7-484c-9ab3-db025d8daff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:59.005564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:21:59.061596 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1576/3124] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:59.063897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:59.064584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:59.064773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:59.145876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] MFA Rules not processed for user `df490263853a477593fc98d754c7a2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:59.147315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:59.172966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1549/3125] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:21:59.175093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:59.175560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:59.175986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:59.207550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] MFA Rules not processed for user `df490263853a477593fc98d754c7a2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:21:59.209058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:21:59.223275 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1577/3126] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:21:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:21:59.231202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:21:59.249129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4ea48-502b-458e-afb7-d42e6f30f0e0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:21:59.266057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06f6c-759d-4855-9fca-20f0212258a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:21:59.267358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06f6c-759d-4855-9fca-20f0212258a5 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:21:59.267358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06f6c-759d-4855-9fca-20f0212258a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:21:59.269176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06f6c-759d-4855-9fca-20f0212258a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:21:59.291050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06f6c-759d-4855-9fca-20f0212258a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:21:59.293914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06f6c-759d-4855-9fca-20f0212258a5 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:21:59.309614 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1550/3127] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:21:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:01.310014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:01.311616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:01.343082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9e994-d131-44fe-bfad-030334d901de None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:01.356799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:01.369563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:01.371742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:01.374201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] PATH_INFO: `/v3/users/614a5366d0d14df6b7ab4530882646f3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:01.383293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=614a5366d0d14df6b7ab4530882646f3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:01.393647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:01.500564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614a5366d0d14df6b7ab4530882646f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:01.536131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614a5366d0d14df6b7ab4530882646f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:01.538830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614a5366d0d14df6b7ab4530882646f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:01.540891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614a5366d0d14df6b7ab4530882646f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:01.560142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614a5366d0d14df6b7ab4530882646f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:01.584277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:01.585377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:01.585902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:01.589676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1578/3128] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:01 2022] DELETE /identity/v3/users/614a5366d0d14df6b7ab4530882646f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:01.629953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] MFA Rules not processed for user `df490263853a477593fc98d754c7a2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:01.631385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:01.783288 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1551/3129] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:03.343303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:03.345206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:03.574780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:03.576827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:03.580293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f26e-4d1f-4073-beec-5bd4c46a0a2d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:03.597426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:03.599319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:03.599781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:03.600724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:03.604312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:03.648338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:03.650370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:03.684674 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1579/3130] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:03.685256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:03.738132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d52e83-389f-41c3-afe6-1fc8cd9ce879 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:03.743829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:03.744719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:03.745173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:03.747216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] PATH_INFO: `/v3/projects/e9f91db7e2d14e8ba3fe506f4c034c98` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:03.749098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f91db7e2d14e8ba3fe506f4c034c98)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:03.753146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:03.932958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f91db7e2d14e8ba3fe506f4c034c98', 'request_id': 'req-81584326-4a67-4dd5-9883-debd00006817'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:03.972157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f91db7e2d14e8ba3fe506f4c034c98', 'request_id': 'req-81584326-4a67-4dd5-9883-debd00006817'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:03.996488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f91db7e2d14e8ba3fe506f4c034c98', 'request_id': 'req-81584326-4a67-4dd5-9883-debd00006817'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.045464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] The token cache is being invalidate because project e9f91db7e2d14e8ba3fe506f4c034c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:04.048256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.049582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-81584326-4a67-4dd5-9883-debd00006817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.054795 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1552/3131] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:03 2022] DELETE /identity/v3/projects/e9f91db7e2d14e8ba3fe506f4c034c98 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:04.059245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:04.078716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb1bdf-055f-41b0-b15f-57e1f7ed4fe0 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:04.184342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:04.184792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:04.185075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:04.272887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:04.274179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:04.363425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:04.410604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:04.414485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:04.414786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:04.415064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] PATH_INFO: `/v3/users/29811b1de60e41a2a6091d57ef6fa736` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:04.424818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29811b1de60e41a2a6091d57ef6fa736)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:04.427753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:04.529376 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1553/3132] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:22:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:04.541657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29811b1de60e41a2a6091d57ef6fa736'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.551698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:04.553768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:04.583502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29811b1de60e41a2a6091d57ef6fa736'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.585446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29811b1de60e41a2a6091d57ef6fa736'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.586381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29811b1de60e41a2a6091d57ef6fa736'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.607178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5beb2b5-4443-4f7c-bb39-abd57205fb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29811b1de60e41a2a6091d57ef6fa736'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:04.638659 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1580/3133] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:04 2022] DELETE /identity/v3/users/29811b1de60e41a2a6091d57ef6fa736 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:04.768207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294595d1-2812-4c4d-bd1c-15698b274511 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:04.816421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:04.971604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:04.971895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:04.972225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:05.068942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] MFA Rules not processed for user `df490263853a477593fc98d754c7a2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:05.069908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:05.107416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:05.113718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:05.114092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:05.114901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:05.124386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:05.279130 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1581/3134] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:05.332478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:05.334776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ac5a6-718e-41c8-95ee-0f9003c60ae3 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:05.371696 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1554/3135] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:22:06.846189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:06.846189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:07.016816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36160c64-418f-45d3-b2eb-7594d8431b56 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:07.037010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:07.038064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:07.038442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:07.038858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] PATH_INFO: `/v3/projects/66e3b251713f44a894575c0a4cebdff1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:07.041580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e3b251713f44a894575c0a4cebdff1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:07.044299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:07.079420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:07.169043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e3b251713f44a894575c0a4cebdff1', 'request_id': 'req-89434deb-0833-43c1-a180-4bcf3aa784e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:07.193160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e3b251713f44a894575c0a4cebdff1', 'request_id': 'req-89434deb-0833-43c1-a180-4bcf3aa784e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:07.210077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e3b251713f44a894575c0a4cebdff1', 'request_id': 'req-89434deb-0833-43c1-a180-4bcf3aa784e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:07.245171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] The token cache is being invalidate because project 66e3b251713f44a894575c0a4cebdff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:07.249100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:07.250545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-89434deb-0833-43c1-a180-4bcf3aa784e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:07.270519 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1582/3136] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:06 2022] DELETE /identity/v3/projects/66e3b251713f44a894575c0a4cebdff1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:07.275465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:07.276499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:07.277630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:07.341420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:07.351842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:07.645459 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1555/3137] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:07.657965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:07.657965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:07.657965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:07.728693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:07.742413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:07.787753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1583/3138] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:07.788187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:07.816148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55a1b7-e53b-43b0-91ed-51ce18a2de89 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:07.836709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:07.846045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:07.848049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:07.848455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:07.850813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:07.851270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:07.854538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:07.892448 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1556/3139] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:07.893317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:07.914433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30425c-d5f5-41ae-9936-aa0dfacfb6b7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:07.928592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:07.931712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:07.931997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:07.936335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:07.937053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:07.947498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:08.033626 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1584/3140] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:08.037601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:08.060497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3d09-2897-4b21-821f-8a3e3b1863f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:08.128545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:08.165770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f03f9f-6c0c-4461-966f-c82e06a48e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:08.166639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f03f9f-6c0c-4461-966f-c82e06a48e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:08.167082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f03f9f-6c0c-4461-966f-c82e06a48e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:08.168200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f03f9f-6c0c-4461-966f-c82e06a48e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:08.169022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f03f9f-6c0c-4461-966f-c82e06a48e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:08.171216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f03f9f-6c0c-4461-966f-c82e06a48e37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:08.236310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:08.249214 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1557/3141] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:08 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:08.252717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ffbd9-389e-4d60-bab8-39cdb6cf01cd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:08.258864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5c73c-eee6-46d6-803d-abbaccb0fe62 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:08.259420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5c73c-eee6-46d6-803d-abbaccb0fe62 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:08.259860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5c73c-eee6-46d6-803d-abbaccb0fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:08.283490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:08.284524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:08.295330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:08.298393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:08.305744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:08.320559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:08.390604 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1585/3142] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:08.393432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:08.416960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7eb5c73c-eee6-46d6-803d-abbaccb0fe62 None None] MFA Rules not processed for user `a4ba7cd8a0064bad86c7892272a11726`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:08.423300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7eb5c73c-eee6-46d6-803d-abbaccb0fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:08.432397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf344a-bb71-4401-ba3a-0caa47718bf0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:08.451349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:08.453752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:08.454793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:08.456578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:08.458016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:08.461997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:08.514545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1586/3143] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:08.529510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:08.552772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8627-c089-4aaf-8c73-867ca30875bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:08.600545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:08.612292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:08.622543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:08.623114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] PATH_INFO: `/v3/projects/172156f658114aa59fac3e7394494228/users/d4f9798a4f3e42eebeb9ce026a6a9aed/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:08.764292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172156f658114aa59fac3e7394494228, user_id=d4f9798a4f3e42eebeb9ce026a6a9aed, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:08.775078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:08.817421 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1587/3144] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:08 2022] PUT /identity/v3/projects/172156f658114aa59fac3e7394494228/users/d4f9798a4f3e42eebeb9ce026a6a9aed/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:08.820233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:08.822333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:08.833527 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1558/3145] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:08.835150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:08.837921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:08.846600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:08.989796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaba0f-e851-4edd-89c0-20f048e9e6f3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:09.008258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:09.008969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:09.009352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:09.009636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:09.010571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] MFA Rules not processed for user `d4f9798a4f3e42eebeb9ce026a6a9aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:09.018628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:09.021936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:09.026211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:09.115160 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1588/3146] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:08 2022] POST /identity/v3/projects => generated 383 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:09.116617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.216343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:09.318929 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1559/3147] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:09.324239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.348345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f58b8-ca92-48b0-b600-786b2d8101b4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:09.403518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403f8ed-162c-43b8-bd69-db34e8b1bdf6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:09.427965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:09.434268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:09.437310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:09.437634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:09.444002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:09.459437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:09.461827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:09.502818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:09.503927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:09.504500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:09.505089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:09.508840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:09.512902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:09.559890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1589/3148] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:09 2022] POST /identity/v3/users => generated 298 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:09.563439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.585732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93446960-03d3-4822-9806-87f3f0c9092b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:09.597365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:09.598076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1560/3149] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:09 2022] POST /identity/v3/projects => generated 375 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:09.601824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:09.601824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:09.603022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:09.603547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:09.606513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:09.606951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.648310 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1590/3150] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:09.653141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.681861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8319dd-4d92-410e-98c7-25630dabaa54 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:09.804601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c05d69-9eaa-489c-808b-da3de27cb151 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:09.828763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:09.829414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:09.829695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:09.829972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:09.830748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:09.832748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:09.835406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:09.837049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:09.837340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:09.837623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] PATH_INFO: `/v3/projects/c2b2e352367c4038bff41c5d75cad0c2/users/740db9f913084aa59fd3e4e6f3f472de/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:09.876527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b2e352367c4038bff41c5d75cad0c2, user_id=740db9f913084aa59fd3e4e6f3f472de, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:09.881707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:09.890735 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1561/3151] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:09 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:09.895533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.921234 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1591/3152] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:09 2022] PUT /identity/v3/projects/c2b2e352367c4038bff41c5d75cad0c2/users/740db9f913084aa59fd3e4e6f3f472de/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:09.927352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:09.936080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce042d-7039-41ad-b860-a3818b8deb6b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:10.182499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:10.183601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.188337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.188794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:10.189623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:10.191839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:10.207071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febdf56-163d-4f85-a898-9ed09c92d44f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:10.212489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:10.213912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.215059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.215059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:10.216319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:10.218357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:10.220639 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1562/3153] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:22:10.221769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:10.237371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1592/3154] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:10.239463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:10.248632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27d53-59e3-43de-a74a-f0441c5ffa42 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:10.263461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:10.265828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.266304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5fab-3c42-4f6b-abbf-3a24c17944a7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:10.266716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.269391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] PATH_INFO: `/v3/projects/e29982d692bd4fcaa08f42adb163fa9f/users/4ba2e298ae0b4716b7dd111aa6857cbb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:10.278806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:10.279701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.279992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.280272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] PATH_INFO: `/v3/projects/c2b2e352367c4038bff41c5d75cad0c2/users/740db9f913084aa59fd3e4e6f3f472de/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:10.300470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b2e352367c4038bff41c5d75cad0c2, user_id=740db9f913084aa59fd3e4e6f3f472de, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:10.315485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:10.329058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29982d692bd4fcaa08f42adb163fa9f, user_id=4ba2e298ae0b4716b7dd111aa6857cbb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:10.335638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:10.384573 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1593/3155] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:10 2022] PUT /identity/v3/projects/c2b2e352367c4038bff41c5d75cad0c2/users/740db9f913084aa59fd3e4e6f3f472de/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:10.392456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1563/3156] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:10 2022] PUT /identity/v3/projects/e29982d692bd4fcaa08f42adb163fa9f/users/4ba2e298ae0b4716b7dd111aa6857cbb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:10.396939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:10.408688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:10.616018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0e868-6e9a-427c-8bdc-cfbe596a5dda admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:10.783265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971650c-8829-4406-a8b3-4c0fd39573ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:10.783956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971650c-8829-4406-a8b3-4c0fd39573ef admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.784244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971650c-8829-4406-a8b3-4c0fd39573ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.784521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971650c-8829-4406-a8b3-4c0fd39573ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:10.785177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971650c-8829-4406-a8b3-4c0fd39573ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:10.790226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971650c-8829-4406-a8b3-4c0fd39573ef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:10.820281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1594/3157] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:10.820910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:10.836319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50226708-c825-46e2-9889-fea95ab2059f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:10.869235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472296a2-c206-444c-b34f-1b9cc397b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:10.874523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472296a2-c206-444c-b34f-1b9cc397b5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.878352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472296a2-c206-444c-b34f-1b9cc397b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.880477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472296a2-c206-444c-b34f-1b9cc397b5a2 admin admin] PATH_INFO: `/v3/projects/e29982d692bd4fcaa08f42adb163fa9f/users/4ba2e298ae0b4716b7dd111aa6857cbb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:10.896526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472296a2-c206-444c-b34f-1b9cc397b5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29982d692bd4fcaa08f42adb163fa9f, user_id=4ba2e298ae0b4716b7dd111aa6857cbb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:10.908064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472296a2-c206-444c-b34f-1b9cc397b5a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:10.968131 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1564/3158] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:10 2022] PUT /identity/v3/projects/e29982d692bd4fcaa08f42adb163fa9f/users/4ba2e298ae0b4716b7dd111aa6857cbb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:22:10.977623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:10.977906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:10.978223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:11.064903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] MFA Rules not processed for user `4ba2e298ae0b4716b7dd111aa6857cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:11.066237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:11.110927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:11.111288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:11.111650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:11.205316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:11.207135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:11.273247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1595/3159] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:11.281364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:11.282040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:11.329055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfcc6b-5965-4126-bd0b-98b8af51af3e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:11.349686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:11.353018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:11.353434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:11.354544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:11.358560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:11.358976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:11.360758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:11.408967 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1596/3160] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:11.412010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:11.440655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6875686-995c-4892-8833-8e90a58729ba tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:11.456569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:11.457323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:11.457673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:11.458019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:11.458769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:11.461240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:11.514069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:11.532872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1565/3161] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:22:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:11.545001 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1597/3162] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:11 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:11.549384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:11.566463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:11.569058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:11.583799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9107b46-6d63-4be6-90c2-4deac02c8508 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:11.731115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462442b-1f06-4541-b871-03c6c3093865 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:11.739666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e952c1d-237d-4c0a-ba63-7dc7272a3f35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:11.739666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e952c1d-237d-4c0a-ba63-7dc7272a3f35 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:11.739666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e952c1d-237d-4c0a-ba63-7dc7272a3f35 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:11.740265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e952c1d-237d-4c0a-ba63-7dc7272a3f35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:11.844450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:11.845106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:11.845393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:11.847628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:11.848517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:11.849023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:11.850876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:11.878542 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1566/3163] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:11.887532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e952c1d-237d-4c0a-ba63-7dc7272a3f35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:11.893018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e952c1d-237d-4c0a-ba63-7dc7272a3f35 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:11.910341 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1598/3164] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:22:14.931225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:14.933259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:15.128854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bff1-2207-4ab5-b184-3c4c85cfccd8 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:15.145921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:15.146774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:15.146999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:15.147235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:15.168574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:15.171938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:15.199998 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1567/3165] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:15.237672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473f7a-f68d-4ba9-b75e-d3627c2c9461 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:15.238504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473f7a-f68d-4ba9-b75e-d3627c2c9461 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:15.238504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473f7a-f68d-4ba9-b75e-d3627c2c9461 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:15.242183 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1599/3166] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:22:15.255587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:22:15.271372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:15.296429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a958b5-a02d-4067-a89f-d1cd11547922 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:15.306010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2149-a2fc-407d-a417-474db0703ffc tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:15.309871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2149-a2fc-407d-a417-474db0703ffc tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:15.310179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2149-a2fc-407d-a417-474db0703ffc tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:15.310488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2149-a2fc-407d-a417-474db0703ffc tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:15.319916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc2149-a2fc-407d-a417-474db0703ffc tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:get_project(project_id=2ad34cbfdb3e45869f0919a4ddd8d309)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:15.324824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:15.325150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:15.325448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:15.337874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc2149-a2fc-407d-a417-474db0703ffc tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:15.351118 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1568/3167] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:22:15 2022] GET /identity/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309 => generated 369 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:15.391185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] MFA Rules not processed for user `d8dbe2b4010e41dc943e525c8453c7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:15.392510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:15.751651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1600/3168] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:17.457559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3c63-ea78-4965-9a6f-f185bf695ced None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:17.458101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3c63-ea78-4965-9a6f-f185bf695ced None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:17.458101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3c63-ea78-4965-9a6f-f185bf695ced None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:17.459755 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1569/3169] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:22:17.473232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:22:17.496831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:17.533600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a5448-f9af-4bc7-bb86-5281328c8f0b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:17.552856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:17.553834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:17.554303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:17.554737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:17.559869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:get_project(project_id=2ad34cbfdb3e45869f0919a4ddd8d309)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:17.568607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:17.576230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1601/3170] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:22:17 2022] GET /identity/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309 => generated 369 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:17.797777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3c63-ea78-4965-9a6f-f185bf695ced None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:17.824690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3c63-ea78-4965-9a6f-f185bf695ced None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:17.852875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:17.853804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:17.854347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:17.855729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:17.857091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:17.858125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:17.860032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:17.905507 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1570/3171] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:17.909245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:17.925692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55716a94-3ab1-4e3f-ad4b-a3aa077d455c tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:17.944804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:17.945635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:17.948156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:17.948156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:17.948156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:17.951900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:18.014844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:18.034017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:18.047553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0f6a-d2e0-42c8-b263-dfdacbfc1c11 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:18.057675 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1602/3172] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:17 2022] POST /identity/v3/users => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:18.058798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:18.077313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:18.081668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:18.082055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:18.082445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:18.084295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:18.086780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:18.088690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:18.122823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070201a5-f197-46d9-81cc-7fcb1eeb6e51 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:18.138263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a594833-d71c-4c52-b55c-cfd5847503e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:18.138263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594833-d71c-4c52-b55c-cfd5847503e3 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:18.138263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594833-d71c-4c52-b55c-cfd5847503e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:18.138263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594833-d71c-4c52-b55c-cfd5847503e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:18.143665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1571/3173] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:18.168192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a594833-d71c-4c52-b55c-cfd5847503e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:18.169985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a594833-d71c-4c52-b55c-cfd5847503e3 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:18.186888 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1603/3174] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:18.421347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:18.444777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1e83c-800e-4953-b85a-0c6f9df15982 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:18.466385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:18.468552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:18.469063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:18.469548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:18.492222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:18.545797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:18.553983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:18.555630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:18.588769 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1572/3175] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:21.129421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a32b1-2f99-47bd-9dbc-6a9a2340e1b6 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:21.130615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a32b1-2f99-47bd-9dbc-6a9a2340e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:21.131133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a32b1-2f99-47bd-9dbc-6a9a2340e1b6 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:21.133105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1604/3176] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:22:21.140622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:22:21.157213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:21.187024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57980-2d99-4519-b220-84243c0c6d73 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:21.200491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f282ab-4449-4e41-bc0d-fe94a7d9f3d2 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:21.201397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f282ab-4449-4e41-bc0d-fe94a7d9f3d2 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:21.201857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f282ab-4449-4e41-bc0d-fe94a7d9f3d2 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:21.202907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f282ab-4449-4e41-bc0d-fe94a7d9f3d2 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:21.209725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f282ab-4449-4e41-bc0d-fe94a7d9f3d2 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:get_project(project_id=2ad34cbfdb3e45869f0919a4ddd8d309)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:21.215996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f282ab-4449-4e41-bc0d-fe94a7d9f3d2 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:21.225909 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1573/3177] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:22:21 2022] GET /identity/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309 => generated 369 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:21.570035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a32b1-2f99-47bd-9dbc-6a9a2340e1b6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:21.572622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0f0a32b1-2f99-47bd-9dbc-6a9a2340e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:21.823973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a32b1-2f99-47bd-9dbc-6a9a2340e1b6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:21.836753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:21.837388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:21.837666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:21.837938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:21.846084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:21.883871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:21.893208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:21.925392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1605/3178] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:24.053313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692086a-43e3-4e4e-b0d4-2a660a4a7b72 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:24.053712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692086a-43e3-4e4e-b0d4-2a660a4a7b72 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:24.053854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692086a-43e3-4e4e-b0d4-2a660a4a7b72 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:24.056093 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1574/3179] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:22:24.063458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:22:24.092432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:24.128983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc55973-57ec-4ceb-b052-2176960e8be7 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:24.153878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:24.154675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:24.154959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:24.155233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:24.162746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:get_project(project_id=2ad34cbfdb3e45869f0919a4ddd8d309)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:24.175291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:24.183555 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1606/3180] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:22:24 2022] GET /identity/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309 => generated 369 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:24.256011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692086a-43e3-4e4e-b0d4-2a660a4a7b72 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:24.297942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692086a-43e3-4e4e-b0d4-2a660a4a7b72 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:24.310032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:24.311593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:24.312434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:24.314430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/users/537210dbbc9542648c4613f26fb2e7dc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:24.391957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:delete_user(user_id=537210dbbc9542648c4613f26fb2e7dc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:24.398025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:24.582518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537210dbbc9542648c4613f26fb2e7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:24.617148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537210dbbc9542648c4613f26fb2e7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:24.625950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537210dbbc9542648c4613f26fb2e7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:24.627548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537210dbbc9542648c4613f26fb2e7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:24.683662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537210dbbc9542648c4613f26fb2e7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:24.758202 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1575/3181] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:24 2022] DELETE /identity/v3/users/537210dbbc9542648c4613f26fb2e7dc => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:24.762465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:24.764734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:24.794900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5237f7-f981-48df-905d-f2c4d1fb13f3 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:24.970162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba2e298ae0b4716b7dd111aa6857cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29982d692bd4fcaa08f42adb163fa9f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:24.972104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:24.973244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:24.973589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] PATH_INFO: `/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:24.977653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ad34cbfdb3e45869f0919a4ddd8d309)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:24.983919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:25.102532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad34cbfdb3e45869f0919a4ddd8d309', 'request_id': 'req-e8de4f40-c5ab-49a4-adf8-03371de514c5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.114839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad34cbfdb3e45869f0919a4ddd8d309', 'request_id': 'req-e8de4f40-c5ab-49a4-adf8-03371de514c5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.135238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad34cbfdb3e45869f0919a4ddd8d309', 'request_id': 'req-e8de4f40-c5ab-49a4-adf8-03371de514c5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.163054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] The token cache is being invalidate because project 2ad34cbfdb3e45869f0919a4ddd8d309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:25.163370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.164026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e8de4f40-c5ab-49a4-adf8-03371de514c5 tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.169288 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1607/3182] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:24 2022] DELETE /identity/v3/projects/2ad34cbfdb3e45869f0919a4ddd8d309 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:25.174593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:25.176252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:25.374449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e72743-d608-4846-a258-cf84f101ecdd tempest-QuotasAdminTestV257-1056820233 tempest-QuotasAdminTestV257-1056820233-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:25.547925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:25.569634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:25.571041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:25.571976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:25.572767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] PATH_INFO: `/v3/users/d4f9798a4f3e42eebeb9ce026a6a9aed` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:25.575818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f9798a4f3e42eebeb9ce026a6a9aed)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:25.584260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:25.741758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f9798a4f3e42eebeb9ce026a6a9aed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.766089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f9798a4f3e42eebeb9ce026a6a9aed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.766855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f9798a4f3e42eebeb9ce026a6a9aed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.767592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f9798a4f3e42eebeb9ce026a6a9aed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.793631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f9798a4f3e42eebeb9ce026a6a9aed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:25.829380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1576/3183] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:25 2022] DELETE /identity/v3/users/d4f9798a4f3e42eebeb9ce026a6a9aed => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:25.833803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:25.834129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:25.834504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:25.882928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:25.893406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:25.904671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:26.067366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1608/3184] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:26.131262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:26.135322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:26.314822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac87d1-61a1-4209-8b8d-cdefc44be209 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:26.326398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:26.327583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:26.328254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:26.328847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:26.354105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:26.359412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:26.384447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1577/3185] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:27.841542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:27.843140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:27.880513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762f28-dfc8-43a5-a73a-be71fb08824c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:27.893674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:27.894405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:27.894662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:27.894944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] PATH_INFO: `/v3/projects/172156f658114aa59fac3e7394494228` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:27.903674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172156f658114aa59fac3e7394494228)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:27.908732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:28.042785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172156f658114aa59fac3e7394494228', 'request_id': 'req-0e03571f-181b-45a1-83b1-6f1e14963f07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.067218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172156f658114aa59fac3e7394494228', 'request_id': 'req-0e03571f-181b-45a1-83b1-6f1e14963f07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.091702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172156f658114aa59fac3e7394494228', 'request_id': 'req-0e03571f-181b-45a1-83b1-6f1e14963f07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.256967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] The token cache is being invalidate because project 172156f658114aa59fac3e7394494228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:28.257423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.259059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0e03571f-181b-45a1-83b1-6f1e14963f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.273180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:28.309345 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1609/3186] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:27 2022] DELETE /identity/v3/projects/172156f658114aa59fac3e7394494228 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:28.325786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e315c-efe6-49a2-be29-fb0716120e90 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:28.491258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:28.491826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:28.494813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:28.496517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] PATH_INFO: `/v3/users/4ba2e298ae0b4716b7dd111aa6857cbb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:28.501377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba2e298ae0b4716b7dd111aa6857cbb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:28.509009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:28.563987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:28.626058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba2e298ae0b4716b7dd111aa6857cbb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.645596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba2e298ae0b4716b7dd111aa6857cbb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.646498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba2e298ae0b4716b7dd111aa6857cbb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.647468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba2e298ae0b4716b7dd111aa6857cbb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.666392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba2e298ae0b4716b7dd111aa6857cbb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:28.734287 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1578/3187] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:28 2022] DELETE /identity/v3/users/4ba2e298ae0b4716b7dd111aa6857cbb => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:29.025336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5b5c-d317-467d-a187-ee051938739c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:29.026132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5b5c-d317-467d-a187-ee051938739c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:29.026686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5b5c-d317-467d-a187-ee051938739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:29.176113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ecde5b5c-d317-467d-a187-ee051938739c None None] MFA Rules not processed for user `740db9f913084aa59fd3e4e6f3f472de`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:29.179906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ecde5b5c-d317-467d-a187-ee051938739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:29.391479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1610/3188] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:29.945468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:29.947546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:30.170546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27ff5e-dc7d-4d9a-8ce5-152ccca94f82 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:30.190379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:30.191403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:30.191830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:30.192256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] PATH_INFO: `/v3/projects/e29982d692bd4fcaa08f42adb163fa9f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:30.194212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29982d692bd4fcaa08f42adb163fa9f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:30.201917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:30.310107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29982d692bd4fcaa08f42adb163fa9f', 'request_id': 'req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:30.327615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29982d692bd4fcaa08f42adb163fa9f', 'request_id': 'req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:30.344331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29982d692bd4fcaa08f42adb163fa9f', 'request_id': 'req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:30.371680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] The token cache is being invalidate because project e29982d692bd4fcaa08f42adb163fa9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:30.371680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:30.371680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3669944b-fb39-4b02-9ec2-97ab73c5f6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:30.395555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:30.396125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:30.396125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:30.399762 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1579/3189] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:29 2022] DELETE /identity/v3/projects/e29982d692bd4fcaa08f42adb163fa9f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:30.445579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:30.447297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:30.532003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:30.696211 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1611/3190] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:30.708984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:30.709785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:30.709785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:30.778213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:30.779884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:30.809016 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1580/3191] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:30.813454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:30.835759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c7cbc-3c00-438b-9861-e6c9d8c8b3f3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:30.860427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:30.861228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:30.861623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:30.862006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:30.865102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:30.865548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:30.867329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:30.907701 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1612/3192] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:30.908690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:30.922303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc572a2-8978-4d22-8343-f9e61c6af4c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:30.941985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:30.942665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:30.942957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:30.943240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:30.943913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:30.952155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:31.011400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:31.035020 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1581/3193] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:30 2022] POST /identity/v3/projects => generated 395 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:31.035231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:31.051007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ff262-3cd2-4189-82fe-b4a772cb61b0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:31.309401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:31.309693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:31.310088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:31.310664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:31.311841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:31.313963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:31.412230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1613/3194] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:31 2022] POST /identity/v3/users => generated 298 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:22:31.416323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:31.442634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdd8f-fd13-4fcb-bd11-8d14c554e97c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:31.473127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:31.473758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:31.474047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:31.474416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:31.481753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:31.498550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:31.549857 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1582/3195] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:31.554010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:31.571563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69290301-4db4-4dce-ba11-d100435f89ed admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:31.582919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cc819-3bf3-4658-8510-971b2bb224a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:31.584187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cc819-3bf3-4658-8510-971b2bb224a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:31.585524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cc819-3bf3-4658-8510-971b2bb224a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:31.587027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cc819-3bf3-4658-8510-971b2bb224a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:31.598926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cc819-3bf3-4658-8510-971b2bb224a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:31.627095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cc819-3bf3-4658-8510-971b2bb224a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:31.657366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1614/3196] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:31.661111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:31.684497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83f3f1-a3b6-47b1-b7e6-f1c2eea0b4fc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:31.720778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:31.721499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:31.721791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:31.739806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] PATH_INFO: `/v3/projects/daa79b4268b448a6950f637fb8b0dd2c/users/b070aae1bb674b01be77d389265a1c2b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:31.833304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa79b4268b448a6950f637fb8b0dd2c, user_id=b070aae1bb674b01be77d389265a1c2b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:31.836323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:31.915477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1583/3197] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:31 2022] PUT /identity/v3/projects/daa79b4268b448a6950f637fb8b0dd2c/users/b070aae1bb674b01be77d389265a1c2b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:31.928443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:31.929008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:31.929592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:32.031877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] MFA Rules not processed for user `b070aae1bb674b01be77d389265a1c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:32.033420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:32.272581 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1615/3198] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:32.277002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:32.578563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66115e5-a73c-48ae-9b2b-8859ebd09e5e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:32.584231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:32.585161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:32.585615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:32.586059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:32.587053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:32.591903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:32.642266 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1584/3199] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:32 2022] POST /identity/v3/projects => generated 395 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:32.646105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:32.681566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c105ec-0cdc-409e-8a76-f19807c5ce35 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:32.697330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:32.843406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:32.844885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:32.845188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:32.850584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:32.854000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:32.859989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:32.923586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1616/3200] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:32 2022] POST /identity/v3/users => generated 304 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:22:32.927933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:32.963703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821073a3-53e1-40b9-9589-d08465ee864c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:32.981216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:32.981865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:32.982173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:32.983077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:32.983873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:32.985370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:33.011733 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1585/3201] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:33.015353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:33.032724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c6a3-de03-4745-af3d-77cf5d62e4ca admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:33.052868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:33.053582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:33.053868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:33.054168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] PATH_INFO: `/v3/projects/b61fab09e3ad447da08cd0d1af5ed502/users/b4a43733e120491abc6be2378deee7fd/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:33.105897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61fab09e3ad447da08cd0d1af5ed502, user_id=b4a43733e120491abc6be2378deee7fd, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:33.113342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:33.147619 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1617/3202] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:33 2022] PUT /identity/v3/projects/b61fab09e3ad447da08cd0d1af5ed502/users/b4a43733e120491abc6be2378deee7fd/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:33.148907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:33.172959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629a17a-e21a-41f8-b75f-57fe02da1304 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:33.405197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaa3cb-6e94-4dff-82d8-7803807c0305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:33.405860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa3cb-6e94-4dff-82d8-7803807c0305 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:33.406126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa3cb-6e94-4dff-82d8-7803807c0305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:33.408950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa3cb-6e94-4dff-82d8-7803807c0305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:33.409847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaa3cb-6e94-4dff-82d8-7803807c0305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:33.411670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaa3cb-6e94-4dff-82d8-7803807c0305 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:33.455548 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1586/3203] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:22:33.458822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:33.482686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c213c-1b0b-4759-ae47-dda51e28a8bc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:33.503435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:33.506863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:33.507162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:33.508645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] PATH_INFO: `/v3/projects/b61fab09e3ad447da08cd0d1af5ed502/users/b4a43733e120491abc6be2378deee7fd/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:33.516673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61fab09e3ad447da08cd0d1af5ed502, user_id=b4a43733e120491abc6be2378deee7fd, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:33.527324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:33.566802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1618/3204] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:33 2022] PUT /identity/v3/projects/b61fab09e3ad447da08cd0d1af5ed502/users/b4a43733e120491abc6be2378deee7fd/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:33.567370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:33.567667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:33.568922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:33.669554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] MFA Rules not processed for user `b4a43733e120491abc6be2378deee7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:33.671213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:33.743328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:33.891899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1587/3205] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:34.004733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:34.006639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:34.193239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939827e-ff76-4af2-8c7e-26763a6cea63 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:34.204745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:34.204989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:34.205641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:34.206028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:34.206440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:34.206883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:34.214006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:34.373076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:34.374772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a33ff-5051-4830-a5b2-3ec801e19eb4 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:34.379510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe3055-69cb-4dd7-9467-e892a271d878 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:34.394658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:34.395809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:34.397765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:34.398287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:34.419312 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1619/3206] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:34.439444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:34.444463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:34.484701 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1588/3207] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:39.359496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:39.360188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:39.361064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:39.441815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:39.449903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:39.484295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:39.603582 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1620/3208] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:22:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:39.623806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:39.648824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:39.818972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b94b56-b141-4788-8793-a6c3f30c4cf5 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:39.819583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:39.827935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:39.830067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:39.830743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:39.831194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:39.849058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340af5d-a5d8-4aa7-8bef-d2d94ea08588 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:39.855886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf92693-391c-4646-ac74-f17b82536781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:39.856529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf92693-391c-4646-ac74-f17b82536781 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:39.856815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf92693-391c-4646-ac74-f17b82536781 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:39.857102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf92693-391c-4646-ac74-f17b82536781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:39.864984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:39.872224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:39.911548 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1589/3209] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:22:40.075237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf92693-391c-4646-ac74-f17b82536781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:40.079745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf92693-391c-4646-ac74-f17b82536781 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:40.112982 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1621/3210] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:22:40.163542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:40.306442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:40.381161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae906-fa69-49fe-b42a-bd35fa4ddc5d service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:40.397202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:40.397869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:40.398180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:40.398444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] PATH_INFO: `/v3/users/b070aae1bb674b01be77d389265a1c2b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:40.400070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b070aae1bb674b01be77d389265a1c2b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:40.405796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:40.491067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b070aae1bb674b01be77d389265a1c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:40.506709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b070aae1bb674b01be77d389265a1c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:40.507340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b070aae1bb674b01be77d389265a1c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:40.508100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b070aae1bb674b01be77d389265a1c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:40.522023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b070aae1bb674b01be77d389265a1c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:40.562996 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1590/3211] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:40 2022] DELETE /identity/v3/users/b070aae1bb674b01be77d389265a1c2b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:40.567971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030dec-74f5-4985-aba2-e42a751895a7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:40.568704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030dec-74f5-4985-aba2-e42a751895a7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:40.569808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76030dec-74f5-4985-aba2-e42a751895a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:40.656367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-76030dec-74f5-4985-aba2-e42a751895a7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:40.657790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-76030dec-74f5-4985-aba2-e42a751895a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:40.813951 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1622/3212] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:40.872578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:40.875029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:41.032090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900876e-459c-46bd-9d61-9cece523df95 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:41.043467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:41.044110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:41.044395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:41.044674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:41.075371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:41.076844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:41.099816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1591/3213] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:41.836423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:41.837393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:41.837831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:41.897179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:41.902013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:42.068057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1623/3214] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:42.084106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:42.086704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:42.218240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:42.233021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d74547-2305-4a1c-b110-1eec750c2dce service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:42.239165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccba45-75e2-4abb-841a-2aea93af6839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:42.240482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccba45-75e2-4abb-841a-2aea93af6839 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:42.240874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccba45-75e2-4abb-841a-2aea93af6839 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:42.242103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccba45-75e2-4abb-841a-2aea93af6839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:42.254804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccba45-75e2-4abb-841a-2aea93af6839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:42.256717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccba45-75e2-4abb-841a-2aea93af6839 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:42.274730 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1592/3215] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:22:42.667163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:42.668787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:42.697062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c91fe8-3183-4c66-b8ff-1a0888ac83a5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:42.712312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:42.714404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:42.714866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:42.718179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] PATH_INFO: `/v3/projects/daa79b4268b448a6950f637fb8b0dd2c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:42.720154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa79b4268b448a6950f637fb8b0dd2c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:42.723263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:42.740428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:42.913808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa79b4268b448a6950f637fb8b0dd2c', 'request_id': 'req-849ef5fd-a322-48b5-ada6-bd00994bdc03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:42.927596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa79b4268b448a6950f637fb8b0dd2c', 'request_id': 'req-849ef5fd-a322-48b5-ada6-bd00994bdc03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:42.968530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa79b4268b448a6950f637fb8b0dd2c', 'request_id': 'req-849ef5fd-a322-48b5-ada6-bd00994bdc03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.015110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:43.015652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] The token cache is being invalidate because project daa79b4268b448a6950f637fb8b0dd2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:43.015932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:43.016043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.016697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:43.017425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.020446 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1624/3216] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:42 2022] DELETE /identity/v3/projects/daa79b4268b448a6950f637fb8b0dd2c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:43.024787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:43.031431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:43.075288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:43.076957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:43.305887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ef5fd-a322-48b5-ada6-bd00994bdc03 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:43.341736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:43.343063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:43.343736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:43.344525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] PATH_INFO: `/v3/users/b4a43733e120491abc6be2378deee7fd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:43.348969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a43733e120491abc6be2378deee7fd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:43.349977 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1593/3217] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:22:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:43.352648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:43.363005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:43.373375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:43.570652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a43733e120491abc6be2378deee7fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.658191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a43733e120491abc6be2378deee7fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.667597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a43733e120491abc6be2378deee7fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.669618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a43733e120491abc6be2378deee7fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.719721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f051710-666b-4403-a5ca-9a8c89308144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a43733e120491abc6be2378deee7fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:43.812516 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1625/3218] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:43 2022] DELETE /identity/v3/users/b4a43733e120491abc6be2378deee7fd => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:43.826275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134101-bee3-4782-8db0-89147e0d5f24 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:44.099523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:44.105215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:44.106138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:44.109475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:44.132578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:44.279510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705df22-24c4-4c89-8f07-044ceac00cd4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:44.280470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705df22-24c4-4c89-8f07-044ceac00cd4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:44.280915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705df22-24c4-4c89-8f07-044ceac00cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:44.371337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7705df22-24c4-4c89-8f07-044ceac00cd4 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:44.372869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7705df22-24c4-4c89-8f07-044ceac00cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:44.388493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:44.398195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:44.546283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:44.548462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:44.591597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1594/3219] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:22:44.614608 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1626/3220] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:22:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:44.629862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:44.632000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:44.671183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12a04-45b5-4289-8b90-22ca4ac11786 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:44.685206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:44.685915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:44.686376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:44.686753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:44.750615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:44.753436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:44.796783 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1595/3221] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:22:45.989011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:45.989640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:45.990065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:46.051316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:46.052801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:46.084683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1627/3222] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:22:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:46.112296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:46.128764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b2da7-90ce-4541-840b-89c138560128 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:46.191134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:46.192250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:46.192763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:46.193264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:46.207146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:46.211446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:46.246790 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1596/3223] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:22:46.683813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:46.685686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:47.515745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:47.517420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:47.717582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c81d-bf65-4078-aabe-66d68128aa6b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:47.758830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:47.766539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:47.769395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:47.770470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] PATH_INFO: `/v3/users/d8dbe2b4010e41dc943e525c8453c7c2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:47.778603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dbe2b4010e41dc943e525c8453c7c2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:47.783230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:47.897623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6b12-3b03-41e3-a54e-a1df88da7dd6 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:47.928885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:47.929898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:47.930903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:47.931390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] PATH_INFO: `/v3/projects/b61fab09e3ad447da08cd0d1af5ed502` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:47.934262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61fab09e3ad447da08cd0d1af5ed502)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:47.937448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:48.004991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dbe2b4010e41dc943e525c8453c7c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.034901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dbe2b4010e41dc943e525c8453c7c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.036678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dbe2b4010e41dc943e525c8453c7c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.038228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dbe2b4010e41dc943e525c8453c7c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.062584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-31cff349-5407-448d-830a-c3d695982a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dbe2b4010e41dc943e525c8453c7c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.121251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61fab09e3ad447da08cd0d1af5ed502', 'request_id': 'req-5735dccd-894d-467e-ac08-918578c12cfd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.123676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1628/3224] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:46 2022] DELETE /identity/v3/users/d8dbe2b4010e41dc943e525c8453c7c2 => generated 0 bytes in 1441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:48.205543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61fab09e3ad447da08cd0d1af5ed502', 'request_id': 'req-5735dccd-894d-467e-ac08-918578c12cfd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.233191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61fab09e3ad447da08cd0d1af5ed502', 'request_id': 'req-5735dccd-894d-467e-ac08-918578c12cfd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.278412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] The token cache is being invalidate because project b61fab09e3ad447da08cd0d1af5ed502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:48.280855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.281627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5735dccd-894d-467e-ac08-918578c12cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:48.293078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1597/3225] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:47 2022] DELETE /identity/v3/projects/b61fab09e3ad447da08cd0d1af5ed502 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:48.294264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:48.294926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:48.295601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:48.349372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:48.355044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:48.431265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:48.542661 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1629/3226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:48.551649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:48.552605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:48.553044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:48.608366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:48.609627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:48.657761 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1598/3227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:48.662234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:48.678956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981d5e2-df07-4e77-ac71-aa8b22496fe2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:48.694615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:48.695399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:48.698581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:48.698997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:48.700666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:48.700981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:48.720536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:48.763162 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1630/3228] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:48.767701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:48.779266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:48.789041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:48.792414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb4629-8c9f-4b14-bd98-fcd9651609cb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:48.804032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:48.805093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:48.805610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:48.806410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:48.807326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:48.812101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:48.826378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c90c1-5f91-4dae-9a7a-4a3ae5d1fd1a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:48.860642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:48.861862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:48.862504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:48.864000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] PATH_INFO: `/v3/projects/420e89d01aaf4e17860828d3bd9540da` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:48.867784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=420e89d01aaf4e17860828d3bd9540da)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:48.871305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:48.928026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1599/3229] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:48 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:48.935483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:48.960542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:49.015395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420e89d01aaf4e17860828d3bd9540da', 'request_id': 'req-021a254d-98f7-4fd5-b91c-680eef6c7deb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:49.033878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420e89d01aaf4e17860828d3bd9540da', 'request_id': 'req-021a254d-98f7-4fd5-b91c-680eef6c7deb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:49.051266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420e89d01aaf4e17860828d3bd9540da', 'request_id': 'req-021a254d-98f7-4fd5-b91c-680eef6c7deb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:49.081722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] The token cache is being invalidate because project 420e89d01aaf4e17860828d3bd9540da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:49.082376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:49.083881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-021a254d-98f7-4fd5-b91c-680eef6c7deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:49.086782 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1631/3230] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:48 2022] DELETE /identity/v3/projects/420e89d01aaf4e17860828d3bd9540da => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:49.102123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8c69-e8fd-4372-b435-5346d2bf4c14 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.108289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8c69-e8fd-4372-b435-5346d2bf4c14 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.108819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8c69-e8fd-4372-b435-5346d2bf4c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.125325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067b08e-fd5c-4115-8629-c34202ece383 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.151101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-295f8c69-e8fd-4372-b435-5346d2bf4c14 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:49.154022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-295f8c69-e8fd-4372-b435-5346d2bf4c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:49.335020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1632/3231] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:49.343356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.343835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.344118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.379686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:49.381527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:49.392135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.392997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.393383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.393890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.394694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.396835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.399528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1633/3232] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:22:49.404573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.421161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b923bdd-ccd1-4e01-95eb-00e2f9ec51ec None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.430949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.432092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.434964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.434964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.438307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:49.440181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.443875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.463176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1600/3233] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:48 2022] POST /identity/v3/users => generated 286 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:22:49.467685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.470564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:49.481150 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1634/3234] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:22:49.490040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.493988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f307ad-6500-4c93-9d91-a81ed4e70581 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.516996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.517857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.518361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.518781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.519633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.521407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.524782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3ce1a-698f-43f3-876e-8d214a1de91f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.540638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3379933-9003-485e-8007-2163591d472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.542095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379933-9003-485e-8007-2163591d472a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.542397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379933-9003-485e-8007-2163591d472a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.542676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379933-9003-485e-8007-2163591d472a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.543530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3379933-9003-485e-8007-2163591d472a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.545242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3379933-9003-485e-8007-2163591d472a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.561201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1601/3235] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:22:49.564754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.584832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108e273-d122-493e-9e59-57da94d115c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.590657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:49.605365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.606555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.606996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.607416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.608317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.610070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.617236 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1635/3236] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:49 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:49.617236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.617236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.617236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.638836 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1602/3237] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:49.640016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.660825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:49.662078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:49.663724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f1102-5fbb-4747-adb3-82874bf0adf8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.793960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.794869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.795361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.795792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.796573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.798858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.801726 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1636/3238] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:22:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:49.803078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.821745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfd07e-74bd-4a30-8307-2a4c8cbfac74 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:49.829627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:49.831451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:49.831841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:49.832332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] PATH_INFO: `/v3/projects/6e3fcd398fba47998f0abcc63d2fdade/users/665a98fec8a44369ba99b442c401bb07/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:49.835136 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1603/3239] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:49 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:49.836234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:49.846564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:49.870066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3fcd398fba47998f0abcc63d2fdade, user_id=665a98fec8a44369ba99b442c401bb07, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:49.872808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:49.876281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:49.901172 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1637/3240] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:49 2022] PUT /identity/v3/projects/6e3fcd398fba47998f0abcc63d2fdade/users/665a98fec8a44369ba99b442c401bb07/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:49.906045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:50.031597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b6f80-5e4f-45cb-892d-6837dafa0ab5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:50.069540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeab88-0b0d-4a0d-bcfa-0836c7a22b2f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:50.078132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed823d-b3ec-41dd-8795-964a59ba08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:50.079215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed823d-b3ec-41dd-8795-964a59ba08dc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.079732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed823d-b3ec-41dd-8795-964a59ba08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.080242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed823d-b3ec-41dd-8795-964a59ba08dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.081762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed823d-b3ec-41dd-8795-964a59ba08dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:50.083697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed823d-b3ec-41dd-8795-964a59ba08dc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:50.098690 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1638/3241] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:50.100479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.100907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.101409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.165531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] MFA Rules not processed for user `665a98fec8a44369ba99b442c401bb07`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:50.167483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:50.213178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:50.213705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.213993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.214457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.369888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:50.371950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:50.384031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1604/3242] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:22:50.385779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:50.389759 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1639/3243] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:50.392201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:50.394759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:50.408829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:50.413503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce52ca3-58f6-4d93-8ebf-21d2bebcee3e service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:50.426999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:50.427852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.428038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.428168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.430704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:50.435751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:50.466206 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1605/3244] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:50.469420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:50.493384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989e1f-a9ba-4d8a-8c32-4a9c7cac1112 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:50.505224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:50.505918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.507570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.507855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] PATH_INFO: `/v3/projects/019c204241944f60b5166ffb8d8d510b/users/cf3c0860cf8e4015902c58e6622ee826/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.549526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019c204241944f60b5166ffb8d8d510b, user_id=cf3c0860cf8e4015902c58e6622ee826, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:50.557859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:50.573645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb8cb8-e589-4f5b-8d61-5626603b00fe None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:50.599058 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1606/3245] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:50 2022] PUT /identity/v3/projects/019c204241944f60b5166ffb8d8d510b/users/cf3c0860cf8e4015902c58e6622ee826/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:50.600915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:50.603381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:50.649718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:50.683464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:50.684580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.685604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.686126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.688338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:50.703260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:50.707180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a717c19-64b9-4c58-a419-8ed1ff124c67 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:50.722748 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1640/3246] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:50.724755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.725295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.726081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.747026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6e82-38d5-4113-8236-93829eeb1786 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:50.762369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:50.763055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:50.763341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:50.763623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] PATH_INFO: `/v3/users/185c3a9cfe614351bd1909c9eb271564` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:50.768419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185c3a9cfe614351bd1909c9eb271564)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:50.772530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:50.779920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:50.783275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:50.804565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1641/3247] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:50.820281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:50.824190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:50.884557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185c3a9cfe614351bd1909c9eb271564'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:50.902542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185c3a9cfe614351bd1909c9eb271564'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:50.903419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185c3a9cfe614351bd1909c9eb271564'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:50.906573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185c3a9cfe614351bd1909c9eb271564'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:50.919331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185c3a9cfe614351bd1909c9eb271564'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:50.958187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1607/3248] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:22:50 2022] DELETE /identity/v3/users/185c3a9cfe614351bd1909c9eb271564 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:51.000021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461bcdb-1255-43e8-a8c2-0d47585398e6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:51.085332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:51.098245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:51.099348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:51.099684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:51.100031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:51.103083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:51.224201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:51.227545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194c53e-f3dc-44d8-a86f-b10c2d598b78 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:51.270478 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1642/3249] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:22:51.419772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:51.421682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:51.456630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262997e-7fb3-46d1-832a-1fb6f516c9b0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:51.469117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:51.471508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:51.471798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:51.472602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] PATH_INFO: `/v3/projects/3510dfcab8bd4c338c220dcad8387e13` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:51.477330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3510dfcab8bd4c338c220dcad8387e13)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:51.482871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:51.622195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3510dfcab8bd4c338c220dcad8387e13', 'request_id': 'req-cb28a4dd-bfe9-4b13-a972-9700933106e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:51.637338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3510dfcab8bd4c338c220dcad8387e13', 'request_id': 'req-cb28a4dd-bfe9-4b13-a972-9700933106e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:51.647001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3510dfcab8bd4c338c220dcad8387e13', 'request_id': 'req-cb28a4dd-bfe9-4b13-a972-9700933106e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:51.672781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] The token cache is being invalidate because project 3510dfcab8bd4c338c220dcad8387e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:22:51.673088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:51.675723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb28a4dd-bfe9-4b13-a972-9700933106e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:22:51.684857 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1608/3250] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:22:51 2022] DELETE /identity/v3/projects/3510dfcab8bd4c338c220dcad8387e13 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:51.685942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:51.686260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:51.686783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:51.739548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:51.747178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:51.976602 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1643/3251] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:51.985685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:51.986007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:51.986353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.051949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:52.056432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:52.082003 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1609/3252] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:52.083170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.101204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440161a8-d308-4cde-95fa-6b1757ca0fbf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.122090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.122755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.123036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.123308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.123974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:22:52.124275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.125898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.149433 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1644/3253] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:22:52.154083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.176105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec6f86-20c9-4867-9bdb-0f27adcdf739 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.192093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84072211-c565-420c-be4f-573661387f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.192750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84072211-c565-420c-be4f-573661387f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.193050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84072211-c565-420c-be4f-573661387f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.193319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84072211-c565-420c-be4f-573661387f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.193977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84072211-c565-420c-be4f-573661387f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.220846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84072211-c565-420c-be4f-573661387f3d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.288158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:52.328456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1610/3254] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:22:52 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:52.329587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.347383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfabe4-df9f-4f9d-bad3-e308e87f3f4a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.385920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84072211-c565-420c-be4f-573661387f3d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.387962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84072211-c565-420c-be4f-573661387f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:52.456798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.457552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.458078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.458443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.459175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.462057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.508023 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1645/3255] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:22:52 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:22:52.515401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.537472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa35b-a50f-402a-ac87-f9545e321ea9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.543939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.545368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.545855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.546463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.547486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.549482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.556416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:52.569099 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1646/3256] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:52.576704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.581216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84072211-c565-420c-be4f-573661387f3d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.607141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb36a-529f-4a94-91a8-e9628cae6d07 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.619632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.620462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.620751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.621030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.632150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:52.652325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.653874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.654436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.655032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.657706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.659849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.695263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1647/3257] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:22:52.701544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:52.732628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1a98-2ed8-41e0-8ade-d7332f7d7d4a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:52.749581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c92aba-0049-47b4-af54-089be2ea54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:52.751193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c92aba-0049-47b4-af54-089be2ea54fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.751193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c92aba-0049-47b4-af54-089be2ea54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.751193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c92aba-0049-47b4-af54-089be2ea54fd admin admin] PATH_INFO: `/v3/projects/8086339813d54f66afba62e9ba666efb/users/f252123a759e4461be5a59c7ce84c899/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.785452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c92aba-0049-47b4-af54-089be2ea54fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8086339813d54f66afba62e9ba666efb, user_id=f252123a759e4461be5a59c7ce84c899, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.788092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c92aba-0049-47b4-af54-089be2ea54fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.823254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1648/3258] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:22:52 2022] PUT /identity/v3/projects/8086339813d54f66afba62e9ba666efb/users/f252123a759e4461be5a59c7ce84c899/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:22:52.829236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f18af-5dd4-4b6c-b2f6-f047b7859a0f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:52.829521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f18af-5dd4-4b6c-b2f6-f047b7859a0f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:52.829853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f18af-5dd4-4b6c-b2f6-f047b7859a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:52.832148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:52.833756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:52.859354 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1611/3259] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:22:52.865252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f94f18af-5dd4-4b6c-b2f6-f047b7859a0f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:52.866931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f94f18af-5dd4-4b6c-b2f6-f047b7859a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:53.115474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1649/3260] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:53.134515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:22:53.137651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:53.153613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d390-427b-4e11-a104-bfc23662e8f2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:53.153901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d390-427b-4e11-a104-bfc23662e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:53.154288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d390-427b-4e11-a104-bfc23662e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:53.208273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2483d390-427b-4e11-a104-bfc23662e8f2 None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:22:53.214888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2483d390-427b-4e11-a104-bfc23662e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:22:53.348827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5b85-e630-4bc3-972d-43a399233acf service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:22:53.363371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1650/3261] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:22:53.503139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:22:53.506922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:22:53.507839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:22:53.508492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:22:53.509057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:22:53.545684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:22:53.551767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:22:53.576114 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1612/3262] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:02.899915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:02.900460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:02.900559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:02.975216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] MFA Rules not processed for user `cf3c0860cf8e4015902c58e6622ee826`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:02.976795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:03.122573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:03.141687 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1651/3263] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:03.142797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:03.144264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:03.174591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcf3bd-b792-47d0-a5b6-dc6f66739216 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:03.191393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:03.192245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:03.192363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:03.192603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:03.201237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:03.211043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:03.309681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1613/3264] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:23:03 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:23:03.310136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:03.355410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb14d6-2fc2-477f-9c6c-0a9170edf900 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:03.600592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:03.601229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:03.601512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:03.601788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:03.602497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:03.616543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:03.737939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:03.741408 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1652/3265] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:23:03 2022] POST /identity/v3/users => generated 302 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:23:03.764988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccff82-b796-447f-91e1-67e44d1ce073 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:03.791056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:03.792110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:03.794643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:03.795186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:03.796112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:03.802015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:03.841178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1614/3266] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:03.844232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:03.873353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0d12-fbb4-4328-adb7-c2314deb2aeb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:03.898133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555ec2-21ef-4d6a-9975-d69a1d277515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:03.898804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555ec2-21ef-4d6a-9975-d69a1d277515 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:03.899087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555ec2-21ef-4d6a-9975-d69a1d277515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:03.899436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555ec2-21ef-4d6a-9975-d69a1d277515 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:03.900745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555ec2-21ef-4d6a-9975-d69a1d277515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:03.908536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555ec2-21ef-4d6a-9975-d69a1d277515 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:03.946057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:03.948100 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1653/3267] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:03.967198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c15f-0672-4757-af67-f69bb5ca41e6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:03.997178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94c5bb-33d3-4efd-bb2d-fba06470adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:03.998021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94c5bb-33d3-4efd-bb2d-fba06470adcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:03.998336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94c5bb-33d3-4efd-bb2d-fba06470adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:03.998616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94c5bb-33d3-4efd-bb2d-fba06470adcf admin admin] PATH_INFO: `/v3/projects/897be7f45a5b4c878062bb7a6c20f4f8/users/b18d10e159494c61a67d402a0ee1f773/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:04.070202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94c5bb-33d3-4efd-bb2d-fba06470adcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=897be7f45a5b4c878062bb7a6c20f4f8, user_id=b18d10e159494c61a67d402a0ee1f773, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:04.080286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94c5bb-33d3-4efd-bb2d-fba06470adcf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:04.121806 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1615/3268] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:23:03 2022] PUT /identity/v3/projects/897be7f45a5b4c878062bb7a6c20f4f8/users/b18d10e159494c61a67d402a0ee1f773/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:05.058974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:05.059528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:05.059528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:05.167657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] MFA Rules not processed for user `f252123a759e4461be5a59c7ce84c899`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:05.169284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:05.331869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:05.333100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:05.334449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:05.335437 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1654/3269] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:05.375396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] MFA Rules not processed for user `f252123a759e4461be5a59c7ce84c899`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:05.380159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:05.411447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1616/3270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:09.024082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:09.269465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a7380-2e3b-424e-820f-78a3a2b16618 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:09.301892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5f6b1-7e91-45d9-9f45-334535e0ea3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:09.302598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5f6b1-7e91-45d9-9f45-334535e0ea3d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:09.303049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5f6b1-7e91-45d9-9f45-334535e0ea3d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:09.303510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5f6b1-7e91-45d9-9f45-334535e0ea3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:09.313915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:09.330612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5f6b1-7e91-45d9-9f45-334535e0ea3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:09.333370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5f6b1-7e91-45d9-9f45-334535e0ea3d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:09.377631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1655/3271] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:10.605630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:10.621912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4654dd7-e905-432c-b195-842c8f58d490 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:10.629457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:10.630670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:10.631174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:10.631695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:10.633861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:10.763484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:10.765658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dfe9e-eeab-4365-ba4f-20e7559acd0a service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:10.778982 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1617/3272] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:13.961628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b82d4-4568-456a-9e05-8882c292ae05 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:13.963568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b82d4-4568-456a-9e05-8882c292ae05 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:13.963890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b82d4-4568-456a-9e05-8882c292ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:14.018450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-471b82d4-4568-456a-9e05-8882c292ae05 None None] MFA Rules not processed for user `4adcdf3712b443c18ff496cf5ff735ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:14.019707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-471b82d4-4568-456a-9e05-8882c292ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:14.269050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1656/3273] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:15.404272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8d0a5-23e4-4e9b-baf8-82c31231bd22 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:15.404795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8d0a5-23e4-4e9b-baf8-82c31231bd22 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:15.404795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8d0a5-23e4-4e9b-baf8-82c31231bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:15.452727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-43d8d0a5-23e4-4e9b-baf8-82c31231bd22 None None] MFA Rules not processed for user `b18d10e159494c61a67d402a0ee1f773`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:15.454775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-43d8d0a5-23e4-4e9b-baf8-82c31231bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:15.566225 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1618/3274] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:15.576005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:15.576479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:15.576593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:15.619589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] MFA Rules not processed for user `cf3c0860cf8e4015902c58e6622ee826`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:15.620876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:15.650114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:15.650443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:15.650753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:15.686310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] MFA Rules not processed for user `a4ba7cd8a0064bad86c7892272a11726`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:15.687543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:15.700509 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1619/3275] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:23:15.749237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1657/3276] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:16.514387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:16.520974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:16.604113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca107-bc75-4b21-add0-1018a887e847 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:16.616284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:16.616933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:16.617212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:16.617486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:16.632194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:16.643578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:16.647384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:16.681842 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1620/3277] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:16 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:17.290811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:17.455544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e280b5-7d82-4d93-a057-b83b1f4110cc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:17.462461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:17.466781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:17.467312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:17.467859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:17.473852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:17.504928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:17.506615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:17.528824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1658/3278] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:17.974952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:17.976466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:18.019091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a57c-cd7c-46d0-a9dd-8c9929de240c service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:18.031727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:18.032461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:18.032753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:18.033051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:18.040065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:18.071945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:18.073436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631ce79-0f27-4f37-a2d5-2d9e0ea99094 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:18.095086 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1621/3279] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:19.521016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:19.522543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:19.658322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:19.709642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6c9a-9322-4c59-a148-8c07a10b407b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:19.727346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:19.728205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:19.728571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:19.728952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] PATH_INFO: `/v3/users/665a98fec8a44369ba99b442c401bb07` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:19.731768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665a98fec8a44369ba99b442c401bb07)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:19.737253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:19.863431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665a98fec8a44369ba99b442c401bb07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:19.902492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665a98fec8a44369ba99b442c401bb07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:19.903568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665a98fec8a44369ba99b442c401bb07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:19.904547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665a98fec8a44369ba99b442c401bb07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:19.918392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665a98fec8a44369ba99b442c401bb07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:19.955724 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1659/3280] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:23:19 2022] DELETE /identity/v3/users/665a98fec8a44369ba99b442c401bb07 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:19.960153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb491e0-33a4-4c3f-af68-b22405c60664 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:19.961073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb491e0-33a4-4c3f-af68-b22405c60664 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:19.961590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb491e0-33a4-4c3f-af68-b22405c60664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:19.998736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bfb491e0-33a4-4c3f-af68-b22405c60664 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:20.000797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfb491e0-33a4-4c3f-af68-b22405c60664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:20.081323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1622/3281] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:20.108138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:20.109699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:20.270327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bdf89-7418-4c59-abe1-9c5f380acc50 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:20.292074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:20.294836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:20.294836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:20.299291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:20.336693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:20.343389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:20.374614 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1660/3282] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:20.856652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e697399-3210-48f0-84d3-9f7eb82670d1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:20.856970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e697399-3210-48f0-84d3-9f7eb82670d1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:20.857282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e697399-3210-48f0-84d3-9f7eb82670d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:20.893569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8e697399-3210-48f0-84d3-9f7eb82670d1 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:20.895439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e697399-3210-48f0-84d3-9f7eb82670d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:20.992746 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1623/3283] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:23:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:20.998575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:21.004047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:21.189546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6247b8-6e7a-4c3d-a783-ed54fe832b9e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:21.201784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:21.202805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:21.203639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:21.205327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:21.222629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:21.222868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:21.222997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:21.223209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:21.226687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:21.232719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:21.244224 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1661/3284] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:23:21.299145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:21.304640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:21.337494 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1624/3285] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:23:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:23:21.385322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:21.411277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3944b-810a-43a5-a889-320880e9081d service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:21.441065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084b084-a497-4006-92fa-83081fc07d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:21.445560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b084-a497-4006-92fa-83081fc07d70 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:21.447337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b084-a497-4006-92fa-83081fc07d70 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:21.450324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b084-a497-4006-92fa-83081fc07d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:21.515752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084b084-a497-4006-92fa-83081fc07d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:21.528345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084b084-a497-4006-92fa-83081fc07d70 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:21.564259 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1662/3286] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:23:21.818696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:21.820519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:21.857798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7295d5e-97e1-4156-9760-51ad00d8153e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:21.867097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:21.869617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:21.870184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:21.871569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] PATH_INFO: `/v3/projects/6e3fcd398fba47998f0abcc63d2fdade` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:21.873955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3fcd398fba47998f0abcc63d2fdade)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:21.877158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:22.001664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3fcd398fba47998f0abcc63d2fdade', 'request_id': 'req-0d99407d-a846-42aa-b283-412cb896bf3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:22.027261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3fcd398fba47998f0abcc63d2fdade', 'request_id': 'req-0d99407d-a846-42aa-b283-412cb896bf3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:22.072217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3fcd398fba47998f0abcc63d2fdade', 'request_id': 'req-0d99407d-a846-42aa-b283-412cb896bf3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:22.135878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] The token cache is being invalidate because project 6e3fcd398fba47998f0abcc63d2fdade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:23:22.136177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:22.136937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d99407d-a846-42aa-b283-412cb896bf3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:22.150453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1625/3287] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:23:21 2022] DELETE /identity/v3/projects/6e3fcd398fba47998f0abcc63d2fdade => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:22.156571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148026-8335-447f-9621-476ebcd34403 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:22.158032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148026-8335-447f-9621-476ebcd34403 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:22.158648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148026-8335-447f-9621-476ebcd34403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:22.209143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-68148026-8335-447f-9621-476ebcd34403 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:22.213403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-68148026-8335-447f-9621-476ebcd34403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:22.447235 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1663/3288] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:22.457338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:22.458177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:22.466914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:22.475065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:22.521176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:22.525167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:22.550201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1626/3289] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:22.553260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148026-8335-447f-9621-476ebcd34403 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:22.573425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148026-8335-447f-9621-476ebcd34403 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:22.603818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:22.605917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:22.606502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:22.608120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:22.609000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:23:22.609517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:22.614031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:22.671315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1664/3290] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:23:22.676823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:22.711653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdbc11-f44e-4b7f-87bb-5cf775b0e7bc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:22.735790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:22.736457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:22.736742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:22.737036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:22.737683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:22.739624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:22.829141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1627/3291] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:23:22 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:23:22.829291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:22.841939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6f6e-a9cc-4787-bef2-827b27bb5c92 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:22.978525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:22.980474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:22.982067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:22.982572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:22.986708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:22.992342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:23.058881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:23.060920 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1665/3292] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:23:22 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:23:23.081744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39fa99-4031-4152-aa4a-acee90263b7b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:23.121248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:23.122061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:23.122570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:23.122946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:23.123936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:23.129793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:23.184972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:23.187867 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1628/3293] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:23.203126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788f60-4099-4cee-bff8-24f0f4ccadcc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:23.216629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da866d-4a5b-474e-9d9f-31349fcd7256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:23.217950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da866d-4a5b-474e-9d9f-31349fcd7256 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:23.219464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da866d-4a5b-474e-9d9f-31349fcd7256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:23.219959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da866d-4a5b-474e-9d9f-31349fcd7256 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:23.220830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da866d-4a5b-474e-9d9f-31349fcd7256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:23.230328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da866d-4a5b-474e-9d9f-31349fcd7256 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:23.262224 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1666/3294] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:23.264381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:23.282701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928b6f-6caa-4cee-b80f-58eeaefd4b55 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:23.308164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:23.308960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:23.309485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:23.309980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] PATH_INFO: `/v3/projects/f5cb284f7d4f4577868af0fa8ec337d1/users/c31c5fd9a05b4a82963d5a1e630a2e61/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:23.348124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cb284f7d4f4577868af0fa8ec337d1, user_id=c31c5fd9a05b4a82963d5a1e630a2e61, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:23.351216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:23.378299 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1629/3295] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:23:23 2022] PUT /identity/v3/projects/f5cb284f7d4f4577868af0fa8ec337d1/users/c31c5fd9a05b4a82963d5a1e630a2e61/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:23.384369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b0712-6211-4a0c-b676-31109a728dfa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:23.384725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b0712-6211-4a0c-b676-31109a728dfa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:23.385349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b0712-6211-4a0c-b676-31109a728dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:23.432712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c75b0712-6211-4a0c-b676-31109a728dfa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:23.435239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c75b0712-6211-4a0c-b676-31109a728dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:23.553944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:23.617859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1667/3296] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:23.654615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:23.656369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:23.817044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27ec7e-de71-4fc7-8fa8-c648d7d6e0a4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:23.840415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:23.840415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:23.840415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:23.840415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:23.845629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:23.847376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:23.869017 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1630/3297] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:25.003091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058acdd-aadb-43b9-a120-94b421f9db3c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:25.003680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058acdd-aadb-43b9-a120-94b421f9db3c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:25.003883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058acdd-aadb-43b9-a120-94b421f9db3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:25.041064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3058acdd-aadb-43b9-a120-94b421f9db3c None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:25.043007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3058acdd-aadb-43b9-a120-94b421f9db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:25.120124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1668/3298] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:23:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:25.144312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:25.145970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:25.338657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330495-aa82-4379-8494-51d12ad929b0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:25.344555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:25.345259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:25.345718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:25.345995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:25.355861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:25.365445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:25.376817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1631/3299] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:23:28.132854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:28.133376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:28.133488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:28.176062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:28.179613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:28.202269 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1669/3300] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:23:28.217757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:28.248599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ccd8-b17b-4d86-9006-89acdc281f7e service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:28.267952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dedf96-7914-4573-afbd-441cda821845 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:28.269194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedf96-7914-4573-afbd-441cda821845 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:28.269635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedf96-7914-4573-afbd-441cda821845 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:28.270238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedf96-7914-4573-afbd-441cda821845 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:28.282983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dedf96-7914-4573-afbd-441cda821845 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:28.284998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dedf96-7914-4573-afbd-441cda821845 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:28.302336 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1632/3301] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:23:29.105707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:29.107564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:29.300760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee2821-d1aa-4b20-9b9b-6cc879d152dc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:29.323896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:29.324582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:29.324858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:29.325130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:29.328475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:29.504104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:29.507071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3710dc5-402d-4d6e-badf-12681dc1a6e2 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:29.561125 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1670/3302] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:37.468265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:37.469223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:37.469661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:37.509058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] MFA Rules not processed for user `c31c5fd9a05b4a82963d5a1e630a2e61`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:37.510738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:37.521960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:37.595824 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1633/3303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:37.614727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8aa8-9753-4603-8cef-a988269bc6f2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:37.615219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8aa8-9753-4603-8cef-a988269bc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:37.615517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc8aa8-9753-4603-8cef-a988269bc6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:37.657016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0ffc8aa8-9753-4603-8cef-a988269bc6f2 None None] MFA Rules not processed for user `c31c5fd9a05b4a82963d5a1e630a2e61`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:37.658275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0ffc8aa8-9753-4603-8cef-a988269bc6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:37.671002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1671/3304] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:38.047782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:38.090414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e09c6-3e6c-40dc-a407-2cadfca33e19 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:38.110354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:38.111548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:38.111832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:38.112109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:38.134354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:38.137705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:38.166008 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1634/3305] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:46.472466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c0bc-0796-40bb-b9ec-4f95f61d3556 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:46.472969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c0bc-0796-40bb-b9ec-4f95f61d3556 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:46.473088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c0bc-0796-40bb-b9ec-4f95f61d3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:46.497246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-90f1c0bc-0796-40bb-b9ec-4f95f61d3556 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:46.498996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-90f1c0bc-0796-40bb-b9ec-4f95f61d3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:46.507238 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1672/3306] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:23:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:46.537877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:46.562236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d79a83-5a35-4aaa-8c89-dac86e02ac31 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:46.582424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:46.583265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:46.583993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:46.584421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:46.601159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:46.604426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:46.620105 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1635/3307] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:23:46.885676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915698-8fc7-4779-9b59-a2b4f743b5a7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:46.885952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915698-8fc7-4779-9b59-a2b4f743b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:46.886416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915698-8fc7-4779-9b59-a2b4f743b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:46.949597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8d915698-8fc7-4779-9b59-a2b4f743b5a7 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:46.955377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d915698-8fc7-4779-9b59-a2b4f743b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:46.981737 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1673/3308] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:23:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:23:47.001166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:47.024774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac9b7-4ae6-41c8-9cee-843887acf913 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:47.039064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:47.043193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:47.043610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:47.044756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:47.067825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:47.072042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:47.101970 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1636/3309] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:23:47.468922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:47.469443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:47.469719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:47.486525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:47.497750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:47.502798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:47.529318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:47.537404 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1674/3310] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:23:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:47.558239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccda01d-3987-4a93-8b19-c8be6523da25 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:47.566462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13b28-daac-4909-a078-95dd17b85287 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:47.567413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13b28-daac-4909-a078-95dd17b85287 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:47.567898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13b28-daac-4909-a078-95dd17b85287 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:47.568434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13b28-daac-4909-a078-95dd17b85287 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:47.582510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e13b28-daac-4909-a078-95dd17b85287 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:47.585946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e13b28-daac-4909-a078-95dd17b85287 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:47.616946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1637/3311] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:23:47.805871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:47.810750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:47.828937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723b386-3f63-438d-91b2-0ba1bf0ea921 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:47.835169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:47.836115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:47.837301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:47.838247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] PATH_INFO: `/v3/users/d2808f585afe41ed94e5cf42bee5ee66` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:47.839793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2808f585afe41ed94e5cf42bee5ee66)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:47.843942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:47.924603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2808f585afe41ed94e5cf42bee5ee66'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:47.944456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2808f585afe41ed94e5cf42bee5ee66'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:47.945293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2808f585afe41ed94e5cf42bee5ee66'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:47.947581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2808f585afe41ed94e5cf42bee5ee66'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:47.957458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2808f585afe41ed94e5cf42bee5ee66'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:47.980861 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1675/3312] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:23:47 2022] DELETE /identity/v3/users/d2808f585afe41ed94e5cf42bee5ee66 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:47.985115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:47.985410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:47.985687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:48.005661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:48.007266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:48.100781 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1638/3313] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:48.112705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:48.114171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:48.199957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d463d2-69ab-4be4-a99b-dfbe63e5a2c2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:48.207195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:48.207960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:48.208341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:48.208715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:48.225211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:48.230930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:48.250979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1676/3314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:48.339627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:48.341480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:48.490377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:48.537202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e58af-e946-467e-bac7-db5d5166b7a0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:48.553548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:48.556668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:48.557175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:48.557619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:48.563794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:48.596317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:48.599000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:48.646743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5519bb-73f2-4968-96cf-d15246497e7e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:48.662570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:48.664790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e2b2-c913-4485-983f-db59c7a2e4a7 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:48.668082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:48.668947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:48.669411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:48.669839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] PATH_INFO: `/v3/projects/985e72d73d4c4c00a228d0802aadf499` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:48.671562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985e72d73d4c4c00a228d0802aadf499)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:48.673664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:48.679398 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1639/3315] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:48 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:48.860939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985e72d73d4c4c00a228d0802aadf499', 'request_id': 'req-6b98da83-17e2-4fa8-b948-be5604b40085'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:48.869502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985e72d73d4c4c00a228d0802aadf499', 'request_id': 'req-6b98da83-17e2-4fa8-b948-be5604b40085'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:48.881742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985e72d73d4c4c00a228d0802aadf499', 'request_id': 'req-6b98da83-17e2-4fa8-b948-be5604b40085'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:48.895705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:48.903249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] The token cache is being invalidate because project 985e72d73d4c4c00a228d0802aadf499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:23:48.904237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:48.905475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6b98da83-17e2-4fa8-b948-be5604b40085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:48.911833 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1677/3316] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:23:48 2022] DELETE /identity/v3/projects/985e72d73d4c4c00a228d0802aadf499 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:48.913467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:48.913805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:48.914046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:48.959923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:48.961387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:49.138799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1640/3317] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:23:49.151810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.152094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.152372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.174214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:49.175461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:49.192061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1678/3318] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:49.193174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:49.212682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb522-f200-4fa6-915d-460fa56db6b8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:49.235150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:49.235950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.236237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.236512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.237186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:23:49.237478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:49.240295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:49.259162 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1641/3319] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:23:49.261951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:49.296911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018166ce-bbf7-43b7-a85c-050eddc8347a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:49.306566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:49.307292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.307644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.307993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.308710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:49.310792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:49.376034 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1679/3320] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:23:49 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:23:49.380203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:49.396474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331425b-84a9-49a0-adef-8f7a1a58f1cc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:49.510598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:49.511532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.512005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.512425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.514332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:49.518048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:49.599167 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1642/3321] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:23:49 2022] POST /identity/v3/users => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:23:49.603293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:49.622051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a309-1162-4481-b6a9-1cc8948328aa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:49.640718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:49.641366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.641650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.641937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.642612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:49.644222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:49.676688 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1680/3322] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:49.681146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:49.697367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bd31e-2019-4f08-b1c2-e64e55fe95d1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:49.713288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea2cba-09b4-4ebe-a68e-a56a2e51e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:49.713937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2cba-09b4-4ebe-a68e-a56a2e51e554 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.714261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2cba-09b4-4ebe-a68e-a56a2e51e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.714540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2cba-09b4-4ebe-a68e-a56a2e51e554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.715201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea2cba-09b4-4ebe-a68e-a56a2e51e554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:49.717134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea2cba-09b4-4ebe-a68e-a56a2e51e554 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:49.730526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:49.747125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:49.757822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1643/3323] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:49.761715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42e19-64a4-4b5c-b51d-f335004be32d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:49.775838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:49.776535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.776945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.777155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] PATH_INFO: `/v3/projects/5c9556bba29d4790ac275838ce9e0ee4/users/952c3d6ab9f84c6db938a25c3d8db3d7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.816592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9556bba29d4790ac275838ce9e0ee4, user_id=952c3d6ab9f84c6db938a25c3d8db3d7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:49.819346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:49.844971 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1681/3324] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:23:49 2022] PUT /identity/v3/projects/5c9556bba29d4790ac275838ce9e0ee4/users/952c3d6ab9f84c6db938a25c3d8db3d7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:23:49.849943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:49.850567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:49.850844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:49.891798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:49.895194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:50.048402 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1644/3325] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:50.082521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:50.082521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:50.190436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16e1a0-073d-4e1e-b325-c6f223d7e7bf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:50.198291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:50.199092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:50.199480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:50.199900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:50.213422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:50.216019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:50.231093 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1682/3326] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:23:51.957277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:51.959609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:51.971962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46a5e-ac9e-4353-b17a-26c7526bad08 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:51.978173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:51.979097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:51.979541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:51.979975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] PATH_INFO: `/v3/users/f252123a759e4461be5a59c7ce84c899` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:51.981745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f252123a759e4461be5a59c7ce84c899)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:51.983875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:52.078204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f252123a759e4461be5a59c7ce84c899'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:52.092876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f252123a759e4461be5a59c7ce84c899'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:52.094321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f252123a759e4461be5a59c7ce84c899'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:52.095021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f252123a759e4461be5a59c7ce84c899'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:52.114798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0ea884b-9ec9-4280-abc5-717bd152231b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f252123a759e4461be5a59c7ce84c899'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:52.160267 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1645/3327] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:23:51 2022] DELETE /identity/v3/users/f252123a759e4461be5a59c7ce84c899 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:52.683906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:52.698313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1268df-ad9f-4c99-9438-215ce3ed085f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:52.912647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:52.913735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:52.914778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:52.916516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] PATH_INFO: `/v3/projects/8086339813d54f66afba62e9ba666efb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:52.918994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8086339813d54f66afba62e9ba666efb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:52.923538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.053929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:53.068285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8086339813d54f66afba62e9ba666efb', 'request_id': 'req-5c7322a5-ee9c-4984-9775-ca772ccd202c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:53.099938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8086339813d54f66afba62e9ba666efb', 'request_id': 'req-5c7322a5-ee9c-4984-9775-ca772ccd202c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:53.110933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8086339813d54f66afba62e9ba666efb', 'request_id': 'req-5c7322a5-ee9c-4984-9775-ca772ccd202c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:53.131234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] The token cache is being invalidate because project 8086339813d54f66afba62e9ba666efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:23:53.131753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:53.132765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c7322a5-ee9c-4984-9775-ca772ccd202c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:23:53.135711 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1683/3328] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:23:52 2022] DELETE /identity/v3/projects/8086339813d54f66afba62e9ba666efb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:23:53.141212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.141692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.142076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.169513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:53.171221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:53.286190 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1646/3329] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:23:53.295055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.295421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.295773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.319975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:53.321877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:53.332165 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1684/3330] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:53.337886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:53.376128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6eaa9-66f0-4193-9478-2dfb12440eb0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:53.405167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:53.410970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.411877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.411877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.412355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:23:53.412788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:53.414980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.456859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:23:53.474594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:53.474748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1647/3331] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:23:53.503208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcc9f1-b1ff-474a-baad-a4590064b738 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:53.516334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:53.517154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.517587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.518031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.519003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:53.521463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.563913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1685/3332] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:23:53 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:23:53.568211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:53.582002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66d66-0501-418f-bbd5-7ca588611f47 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:53.660663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:53.661374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.661829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.662190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.662848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:53.665606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.699822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1648/3333] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:23:53 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:23:53.702035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:53.716984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddacf2b-d7ac-424f-9fdd-35d5ab417ae0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:53.723241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:53.724065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.724695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.725135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.725937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:53.728459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.741731 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1686/3334] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:53.746657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:53.757166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf233-3635-43de-8f8f-e18d1c1a551d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:53.768843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4769-55a4-45ad-8af7-757b6dbadbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:53.769479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4769-55a4-45ad-8af7-757b6dbadbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.769765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4769-55a4-45ad-8af7-757b6dbadbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.770041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4769-55a4-45ad-8af7-757b6dbadbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.770735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4769-55a4-45ad-8af7-757b6dbadbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:53.772434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4769-55a4-45ad-8af7-757b6dbadbf3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.788774 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1649/3335] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:23:53.793280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:53.806007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac9a0e-3890-4d2b-b881-a0af40cf914c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:53.812065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:53.812886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.813318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.813665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] PATH_INFO: `/v3/projects/3d6cd9a722ec4d899b4c4ad4457c3647/users/d55e71c267f34f2da01691b5066b924a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.831570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6cd9a722ec4d899b4c4ad4457c3647, user_id=d55e71c267f34f2da01691b5066b924a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:53.837068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:53.856085 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1687/3336] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:23:53 2022] PUT /identity/v3/projects/3d6cd9a722ec4d899b4c4ad4457c3647/users/d55e71c267f34f2da01691b5066b924a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:23:53.861151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076cb8a-720e-4f1b-9d10-489d56307696 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:53.861798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076cb8a-720e-4f1b-9d10-489d56307696 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:53.862105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076cb8a-720e-4f1b-9d10-489d56307696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:53.886648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f076cb8a-720e-4f1b-9d10-489d56307696 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:23:53.896091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f076cb8a-720e-4f1b-9d10-489d56307696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:54.056755 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1650/3337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:23:54.069264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:23:54.076508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:23:54.174552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccdf4e-19e9-4075-b2e8-02ed2abf196c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:23:54.178714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:23:54.179559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:23:54.180093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:23:54.180588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:23:54.192044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:23:54.193710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:23:54.209234 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1688/3338] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:01.508697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:01.509256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:01.509362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:01.571008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] MFA Rules not processed for user `952c3d6ab9f84c6db938a25c3d8db3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:01.572250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:01.811579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1651/3339] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:01.822626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:01.824034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:01.997653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:02.012527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e377-b582-405d-bedf-d11d5b888fde service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:02.031232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9bac6-a559-4a12-8e64-61a90fdcd392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:02.031977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9bac6-a559-4a12-8e64-61a90fdcd392 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:02.032373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9bac6-a559-4a12-8e64-61a90fdcd392 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:02.032778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9bac6-a559-4a12-8e64-61a90fdcd392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:02.051519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9bac6-a559-4a12-8e64-61a90fdcd392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:02.053332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9bac6-a559-4a12-8e64-61a90fdcd392 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:02.087272 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1689/3340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:03.379462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:03.382237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:03.419174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84f16-ac9f-444e-9255-cdc894c21105 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:03.424562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:03.425420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:03.425872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:03.426332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] PATH_INFO: `/v3/users/df490263853a477593fc98d754c7a2f7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:03.427730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df490263853a477593fc98d754c7a2f7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:03.430798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:03.436588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:03.530932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:03.531816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:03.532273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:03.587089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df490263853a477593fc98d754c7a2f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:03.603737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df490263853a477593fc98d754c7a2f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:03.604545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df490263853a477593fc98d754c7a2f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:03.605598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df490263853a477593fc98d754c7a2f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:03.615674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:03.620600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:03.623151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a52b6a04-8873-4d72-b676-7880d07191c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df490263853a477593fc98d754c7a2f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:03.679328 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1652/3341] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:03 2022] DELETE /identity/v3/users/df490263853a477593fc98d754c7a2f7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:03.772292 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1690/3342] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:24:03.785489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:03.791151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:03.791744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:03.819446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:03.823494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:03.918253 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1653/3343] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:04.124671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:04.126932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:04.160267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431b03b-24c5-4ed5-9f19-18b43f021928 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:04.313188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:04.313732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:04.314014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:04.315803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] PATH_INFO: `/v3/projects/0dac8ce9bd5a4524b5d68f523a7276ed` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:04.317136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dac8ce9bd5a4524b5d68f523a7276ed)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:04.319784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:04.406645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dac8ce9bd5a4524b5d68f523a7276ed', 'request_id': 'req-073cb9a5-25fd-4870-971b-62266e09e2b3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:04.419528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dac8ce9bd5a4524b5d68f523a7276ed', 'request_id': 'req-073cb9a5-25fd-4870-971b-62266e09e2b3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:04.438939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dac8ce9bd5a4524b5d68f523a7276ed', 'request_id': 'req-073cb9a5-25fd-4870-971b-62266e09e2b3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:04.441631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:04.443368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:04.479451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] The token cache is being invalidate because project 0dac8ce9bd5a4524b5d68f523a7276ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:04.479736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:04.480619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-073cb9a5-25fd-4870-971b-62266e09e2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:04.490479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1691/3344] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:04 2022] DELETE /identity/v3/projects/0dac8ce9bd5a4524b5d68f523a7276ed => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:04.503288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab2bf-4fa3-4b52-afe4-582aa9dcb13a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:04.503603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab2bf-4fa3-4b52-afe4-582aa9dcb13a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:04.508164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab2bf-4fa3-4b52-afe4-582aa9dcb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:04.555885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-081ab2bf-4fa3-4b52-afe4-582aa9dcb13a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:04.557065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-081ab2bf-4fa3-4b52-afe4-582aa9dcb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:04.566863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:04.680746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e4a5-2902-4f84-812f-73c4329dfbc8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:04.709286 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1692/3345] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:04.718874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:04.719165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:04.719452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:04.760668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:04.786902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:04.788139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:04.812477 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1693/3346] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:04.818374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:04.842903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1892b-157f-41f5-b69a-533540610ce8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:04.865233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:04.865853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:04.866867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:04.867910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:04.869123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:04.870105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:04.881464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:04.888246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:04.890101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:04.891459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:04.891745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:04.896980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:04.902590 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1694/3347] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:24:04.904805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:04.924673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48515-56c1-46b2-ae3c-4572995b8d67 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:04.938130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:04.938812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:04.939093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:04.939365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:04.940143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:04.944616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:05.082209 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1695/3348] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:04 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:05.086731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:05.138767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:05.141932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:05.171544 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1654/3349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:05.339151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beffbb1-389b-49f9-9fa8-de3422c1e4aa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:05.353600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:05.357441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:05.357984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:05.358846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:05.362004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:05.371814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:05.414678 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1696/3350] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:05 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:24:05.416606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:05.433171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf0519-617a-420c-8091-e64a2be30ce0 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:05.447755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:05.449396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:05.449895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:05.450660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:05.452588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:05.457348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:05.479790 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1655/3351] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:05.483819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:05.510164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3bfe8-4017-41f8-a21b-028faf2abeb2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:05.530775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae236cb6-7cfc-42cb-ace2-30b1c44e6269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:05.534554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236cb6-7cfc-42cb-ace2-30b1c44e6269 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:05.534846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236cb6-7cfc-42cb-ace2-30b1c44e6269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:05.535129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236cb6-7cfc-42cb-ace2-30b1c44e6269 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:05.539183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae236cb6-7cfc-42cb-ace2-30b1c44e6269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:05.546641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae236cb6-7cfc-42cb-ace2-30b1c44e6269 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:05.600511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1697/3352] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:05.601148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:05.623933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1894b-c20a-4bc6-af43-30b30a830c07 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:05.639542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:05.641487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:05.641650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:05.641937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] PATH_INFO: `/v3/projects/bf078ba45d5a4f22bfff75464efc5161/users/b1f4529759354867a45d7f6bc0c8230d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:05.700083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf078ba45d5a4f22bfff75464efc5161, user_id=b1f4529759354867a45d7f6bc0c8230d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:05.710871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:05.748359 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1656/3353] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:05 2022] PUT /identity/v3/projects/bf078ba45d5a4f22bfff75464efc5161/users/b1f4529759354867a45d7f6bc0c8230d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:05.753124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602ca5-3525-4b25-a5ca-6f5995143516 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:05.753680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602ca5-3525-4b25-a5ca-6f5995143516 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:05.754112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602ca5-3525-4b25-a5ca-6f5995143516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:05.796166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-75602ca5-3525-4b25-a5ca-6f5995143516 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:05.798127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-75602ca5-3525-4b25-a5ca-6f5995143516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:05.916313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:05.954246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1698/3354] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:05.978864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:05.986400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:06.276304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f900aa4-6a44-469b-9132-acf08039e0fc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:06.298071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10d0e-54a0-49a6-8a70-eb6e80f859aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:06.299397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10d0e-54a0-49a6-8a70-eb6e80f859aa service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:06.299718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10d0e-54a0-49a6-8a70-eb6e80f859aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:06.299997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10d0e-54a0-49a6-8a70-eb6e80f859aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:06.321651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10d0e-54a0-49a6-8a70-eb6e80f859aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:06.323223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10d0e-54a0-49a6-8a70-eb6e80f859aa service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:06.361674 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1657/3355] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:24:09.426365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:09.426920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:09.426920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:09.477268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] MFA Rules not processed for user `98da4b117139423aa99f3597de54c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:09.478555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:09.633751 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1699/3356] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:12.275701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f7a3-6bb1-4c2c-b666-d4b156e5676c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:12.276185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f7a3-6bb1-4c2c-b666-d4b156e5676c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:12.276305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f7a3-6bb1-4c2c-b666-d4b156e5676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:12.341196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bf20f7a3-6bb1-4c2c-b666-d4b156e5676c None None] MFA Rules not processed for user `4adcdf3712b443c18ff496cf5ff735ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:12.341196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf20f7a3-6bb1-4c2c-b666-d4b156e5676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:12.397541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:12.466528 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1658/3357] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:15.211239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:15.212782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:15.239298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a68d-7ed3-4d17-bfe7-1c142cc0b646 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:15.245074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:15.246487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:15.246877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:15.248199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] PATH_INFO: `/v3/users/cf3c0860cf8e4015902c58e6622ee826` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:15.250393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3c0860cf8e4015902c58e6622ee826)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:15.253402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:15.360597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3c0860cf8e4015902c58e6622ee826'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:15.379881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3c0860cf8e4015902c58e6622ee826'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:15.381379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3c0860cf8e4015902c58e6622ee826'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:15.382369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3c0860cf8e4015902c58e6622ee826'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:15.394521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3c0860cf8e4015902c58e6622ee826'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:15.417806 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1700/3358] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:15 2022] DELETE /identity/v3/users/cf3c0860cf8e4015902c58e6622ee826 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:16.160314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:16.160872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:16.164721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:16.230891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] MFA Rules not processed for user `c31c5fd9a05b4a82963d5a1e630a2e61`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:16.236175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:16.248200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:16.250604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:16.385387 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1659/3359] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:16.456581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b28d-a901-40ff-b97f-9a323a5b7333 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:16.463450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:16.464331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:16.464911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:16.465350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] PATH_INFO: `/v3/projects/019c204241944f60b5166ffb8d8d510b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:16.466706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019c204241944f60b5166ffb8d8d510b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:16.468788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:16.481104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:16.602052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019c204241944f60b5166ffb8d8d510b', 'request_id': 'req-b87c39fb-ee58-4608-90ff-69c821730e80'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:16.618985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019c204241944f60b5166ffb8d8d510b', 'request_id': 'req-b87c39fb-ee58-4608-90ff-69c821730e80'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:16.645034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019c204241944f60b5166ffb8d8d510b', 'request_id': 'req-b87c39fb-ee58-4608-90ff-69c821730e80'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:16.694134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] The token cache is being invalidate because project 019c204241944f60b5166ffb8d8d510b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:16.695958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:16.696831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:16.702775 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1701/3360] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:16 2022] DELETE /identity/v3/projects/019c204241944f60b5166ffb8d8d510b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:16.703670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:16.728994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ce486-d9d5-4e70-a159-2d3a1c7d636c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:16.899949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:16.901513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:16.901804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:16.902082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] PATH_INFO: `/v3/users/b18d10e159494c61a67d402a0ee1f773` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:16.904053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18d10e159494c61a67d402a0ee1f773)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:16.909478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:17.065860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18d10e159494c61a67d402a0ee1f773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:17.087500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18d10e159494c61a67d402a0ee1f773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:17.089847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18d10e159494c61a67d402a0ee1f773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:17.091922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18d10e159494c61a67d402a0ee1f773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:17.112086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7f9600f-568f-4f3e-b628-f2116a996c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18d10e159494c61a67d402a0ee1f773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:17.138465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:17.145608 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1660/3361] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:16 2022] DELETE /identity/v3/users/b18d10e159494c61a67d402a0ee1f773 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:18.384501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:18.386743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:18.410388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c39fb-ee58-4608-90ff-69c821730e80 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:18.637023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:18.638261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:18.638938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:18.639469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] PATH_INFO: `/v3/projects/897be7f45a5b4c878062bb7a6c20f4f8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:18.642841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897be7f45a5b4c878062bb7a6c20f4f8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:18.645408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:18.756673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897be7f45a5b4c878062bb7a6c20f4f8', 'request_id': 'req-d5bd1090-b2d2-4085-8f32-f87d4270ad70'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:18.778740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897be7f45a5b4c878062bb7a6c20f4f8', 'request_id': 'req-d5bd1090-b2d2-4085-8f32-f87d4270ad70'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:18.787147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897be7f45a5b4c878062bb7a6c20f4f8', 'request_id': 'req-d5bd1090-b2d2-4085-8f32-f87d4270ad70'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:18.823839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] The token cache is being invalidate because project 897be7f45a5b4c878062bb7a6c20f4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:18.824266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:18.825477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5bd1090-b2d2-4085-8f32-f87d4270ad70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:18.827590 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1702/3362] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:18 2022] DELETE /identity/v3/projects/897be7f45a5b4c878062bb7a6c20f4f8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:18.833219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:18.833219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:18.833219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:18.875599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:18.876852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:19.108931 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1661/3363] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:19.119433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.120124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.120789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.156181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:19.159447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:19.189300 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1703/3364] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:19.190885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.209240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ef19-09e1-4d10-9c6b-8297f527fb68 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.220284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.221073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.221368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.221650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.222354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:19.222679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.229619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.276003 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1662/3365] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:19.277227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.287627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37caad1-516b-4d89-90ab-0f947d572e5a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.315101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.315754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.316039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.316316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.317221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.318945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.400357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:19.420318 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1704/3366] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:19 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:19.424541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.437763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e346-d94d-4c61-9755-024f38677107 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.528584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.529618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.530039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.531102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.531939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.535267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.587302 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1663/3367] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:19 2022] POST /identity/v3/users => generated 281 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:19.592319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.614704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fedc9c-9e90-4068-8b32-8bd2de5c06a0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.628544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.629568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.630902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.631417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.633477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.635845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.651315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1705/3368] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:19.654870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.667055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.669550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:19.670651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c1aa-a1ff-4fe3-abba-1b1acf64e014 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.675707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.676477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.677192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.677495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.678102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.680271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.697370 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1664/3369] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:19.704397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:19.724820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480145d9-3689-400d-afb6-76638689cad9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.731718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab0624-ba9b-420f-916f-7b69f173cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.734001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab0624-ba9b-420f-916f-7b69f173cebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.734323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab0624-ba9b-420f-916f-7b69f173cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.734601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab0624-ba9b-420f-916f-7b69f173cebe admin admin] PATH_INFO: `/v3/projects/5f52a92168414defbdc1c230f85eed8a/users/64130ced3a3949a888986c8136221aea/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.755243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab0624-ba9b-420f-916f-7b69f173cebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f52a92168414defbdc1c230f85eed8a, user_id=64130ced3a3949a888986c8136221aea, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.759496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab0624-ba9b-420f-916f-7b69f173cebe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.794954 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1665/3370] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:19 2022] PUT /identity/v3/projects/5f52a92168414defbdc1c230f85eed8a/users/64130ced3a3949a888986c8136221aea/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:19.805758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4c4b-5db2-4d4a-a4be-9c89e9d31cdc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.806731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4c4b-5db2-4d4a-a4be-9c89e9d31cdc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.806731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4c4b-5db2-4d4a-a4be-9c89e9d31cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.806922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d520d3-c5e2-4641-b798-900e9aa47d59 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:19.890452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-914e4c4b-5db2-4d4a-a4be-9c89e9d31cdc None None] MFA Rules not processed for user `64130ced3a3949a888986c8136221aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:19.893113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-914e4c4b-5db2-4d4a-a4be-9c89e9d31cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:19.943240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:19.943913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:19.944201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:19.944477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:19.947873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:19.962471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:19.964188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:19.977389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:20.000695 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1706/3371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:24:20.051417 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1666/3372] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:24:20.112140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:20.293394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30975f-3631-4788-8658-e253e2700130 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:20.306430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:20.307168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:20.307453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:20.308942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] PATH_INFO: `/v3/users/64130ced3a3949a888986c8136221aea` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:20.311087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64130ced3a3949a888986c8136221aea)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:20.315248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:20.375757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:20.435025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64130ced3a3949a888986c8136221aea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:20.458533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64130ced3a3949a888986c8136221aea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:20.459573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64130ced3a3949a888986c8136221aea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:20.461278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64130ced3a3949a888986c8136221aea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:20.491492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64130ced3a3949a888986c8136221aea'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:20.531736 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1707/3373] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:20 2022] DELETE /identity/v3/users/64130ced3a3949a888986c8136221aea => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:20.547550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f1064-580f-4d36-9515-b52156380b6f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:20.550720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f1064-580f-4d36-9515-b52156380b6f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:20.551040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f1064-580f-4d36-9515-b52156380b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:20.621908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fe8f1064-580f-4d36-9515-b52156380b6f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:20.626102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fe8f1064-580f-4d36-9515-b52156380b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:20.851975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1667/3374] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:20.887507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:20.890704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:21.069494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032270-2c8c-4514-991c-fb5032a51632 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:21.075667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988ad66-93e9-483f-94a3-b9a4f3026d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:21.076298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ad66-93e9-483f-94a3-b9a4f3026d28 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:21.076574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ad66-93e9-483f-94a3-b9a4f3026d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:21.076845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ad66-93e9-483f-94a3-b9a4f3026d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:21.102045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ad66-93e9-483f-94a3-b9a4f3026d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:21.103937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ad66-93e9-483f-94a3-b9a4f3026d28 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:21.125034 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1708/3375] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:23.524210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:23.525607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:23.525747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:23.595147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] MFA Rules not processed for user `b1f4529759354867a45d7f6bc0c8230d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:23.596953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:23.720196 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1668/3376] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:23.730521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:23.731045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:23.731152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:23.753470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] MFA Rules not processed for user `b1f4529759354867a45d7f6bc0c8230d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:23.754967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:23.765038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1709/3377] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:23.885910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:23.887591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:23.922530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d3a91-bde0-414c-ae82-5584650c0708 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:23.938364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:23.939480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:23.939480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:23.939480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] PATH_INFO: `/v3/projects/5f52a92168414defbdc1c230f85eed8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:23.940696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f52a92168414defbdc1c230f85eed8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:23.942655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:24.059327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:24.061027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f52a92168414defbdc1c230f85eed8a', 'request_id': 'req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:24.061745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:24.067730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:24.072715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f52a92168414defbdc1c230f85eed8a', 'request_id': 'req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:24.088092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f52a92168414defbdc1c230f85eed8a', 'request_id': 'req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:24.105613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] The token cache is being invalidate because project 5f52a92168414defbdc1c230f85eed8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:24.107383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:24.108331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7ae695f-1ab4-4ee1-9fed-b8ed8a18cc1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:24.110620 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1669/3378] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:23 2022] DELETE /identity/v3/projects/5f52a92168414defbdc1c230f85eed8a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:24.129612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c261d-c1f3-416f-b16f-8252f817cf41 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:24.134437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c261d-c1f3-416f-b16f-8252f817cf41 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:24.136097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c261d-c1f3-416f-b16f-8252f817cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:24.210262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-de2c261d-c1f3-416f-b16f-8252f817cf41 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:24.217034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de2c261d-c1f3-416f-b16f-8252f817cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:24.245952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41415652-c6b2-402b-b6b4-5b6ec1c5cfc6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:24.283941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:24.347831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:24.348519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:24.348806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:24.349078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:24.351362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:24.452606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:24.454271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:24.473492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1670/3379] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:24.479161 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1710/3380] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:24:24.496243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:24.496654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:24.500207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:24.580062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:24.581680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:24.593135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1671/3381] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:24.596628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:24.620572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae695b8-ed4e-4f52-8979-9977e90072fb service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:24.625807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:24.626811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:24.627128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:24.627598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:24.628548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:24.629195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:24.637522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:24.658568 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1711/3382] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:24:24.659873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:24.675437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e70c-5947-4aae-89a9-fc6cce2d05d5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:24.686952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:24.687864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:24.688355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:24.688856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:24.689719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:24.691969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:24.749060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1672/3383] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:24 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:24.754035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:24.785446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb81ec3-e874-4230-b95a-cf66a74df12a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:24.901480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:24.906967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:24.907233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:24.907427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:24.908276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:24.910818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:24.971261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1712/3384] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:24 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:24.974007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:24.995920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21522fb3-2d5f-44d7-9acd-aec0d3e90047 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.017799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.018918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.019321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.019837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.020602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.026307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:25.049579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1673/3385] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:25.050745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:25.078819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b642af-562d-40b8-835f-cb9adf54082e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.128373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb841bc-1e98-4ab1-9460-f78ec4e4aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.129055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb841bc-1e98-4ab1-9460-f78ec4e4aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.138315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb841bc-1e98-4ab1-9460-f78ec4e4aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.138723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb841bc-1e98-4ab1-9460-f78ec4e4aaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.139429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb841bc-1e98-4ab1-9460-f78ec4e4aaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.141252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb841bc-1e98-4ab1-9460-f78ec4e4aaf1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:25.176536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1713/3386] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:25.178647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:25.195373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b854cc7-863f-4698-aca2-174ae3d7aa8d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.212784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.213480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.213758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.214030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] PATH_INFO: `/v3/projects/d90b8a789eb0407eaa508ac45d03b93c/users/490bd142b2d4433c93fba203ef3cc27c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.234975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90b8a789eb0407eaa508ac45d03b93c, user_id=490bd142b2d4433c93fba203ef3cc27c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.237648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:25.267013 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1674/3387] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:25 2022] PUT /identity/v3/projects/d90b8a789eb0407eaa508ac45d03b93c/users/490bd142b2d4433c93fba203ef3cc27c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:25.279498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.279781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.280060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.325649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] MFA Rules not processed for user `490bd142b2d4433c93fba203ef3cc27c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:25.327674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:25.359995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:25.452345 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1714/3388] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:25.454126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:25.489150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:25.490873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:25.566877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c17c9e-5722-4b97-ae7d-8d2be8a7af5d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.612435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.615823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.618759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.622021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.623085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.625363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:25.665378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406ee2-5d60-4e34-9a38-576feb78a225 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.692637 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1675/3389] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:25 2022] POST /identity/v3/projects => generated 389 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:25.696600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:25.698791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.699428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.699715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.699991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.706652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:25.709039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:25.737135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.741018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:25.774652 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1715/3390] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:25.863996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213bef-faf8-4c5f-bd2d-1dc8007b77f1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.879414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.880384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.880933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.881965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.885556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.891517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:25.938641 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1676/3391] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:25 2022] POST /identity/v3/users => generated 301 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:25.942629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:25.956366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c498acc-8f23-4367-8da6-e43a9eb14b85 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:25.970348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:25.972263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:25.972708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:25.973335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:25.974140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:25.989780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:26.010213 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1716/3392] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:26.014027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:26.031568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a46dc-ffc7-4615-bdf1-d510747b8efc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:26.039959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:26.040279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:26.040755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:26.042011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] PATH_INFO: `/v3/projects/d4b089d4453a4a01bf1398ddef0d5d6c/users/39e89eb2a6f9496ca7bf1ad5af900aff/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:26.086196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b089d4453a4a01bf1398ddef0d5d6c, user_id=39e89eb2a6f9496ca7bf1ad5af900aff, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:26.092661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:26.122729 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1677/3393] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:26 2022] PUT /identity/v3/projects/d4b089d4453a4a01bf1398ddef0d5d6c/users/39e89eb2a6f9496ca7bf1ad5af900aff/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:26.126812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:26.150561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e2231-b815-4163-afe1-fa284fa2c91e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:26.365559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0348660-fc92-4c64-9a0b-7717117408e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:26.366292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348660-fc92-4c64-9a0b-7717117408e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:26.366673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348660-fc92-4c64-9a0b-7717117408e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:26.366955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348660-fc92-4c64-9a0b-7717117408e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:26.367780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0348660-fc92-4c64-9a0b-7717117408e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:26.369825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0348660-fc92-4c64-9a0b-7717117408e9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:26.392301 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1717/3394] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:26.396248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:26.422426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880abce-0f5f-4b98-8cb4-5502256b1ba4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:26.451452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:26.453319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:26.454221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:26.458059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] PATH_INFO: `/v3/projects/d4b089d4453a4a01bf1398ddef0d5d6c/users/39e89eb2a6f9496ca7bf1ad5af900aff/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:26.482131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b089d4453a4a01bf1398ddef0d5d6c, user_id=39e89eb2a6f9496ca7bf1ad5af900aff, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:26.489882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:26.537468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1678/3395] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:26 2022] PUT /identity/v3/projects/d4b089d4453a4a01bf1398ddef0d5d6c/users/39e89eb2a6f9496ca7bf1ad5af900aff/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:26.547858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9c06-7a96-4fd1-921c-fb7c2bbee823 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:26.548367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9c06-7a96-4fd1-921c-fb7c2bbee823 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:26.548813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9c06-7a96-4fd1-921c-fb7c2bbee823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:26.606938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a69d9c06-7a96-4fd1-921c-fb7c2bbee823 None None] MFA Rules not processed for user `39e89eb2a6f9496ca7bf1ad5af900aff`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:26.610874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a69d9c06-7a96-4fd1-921c-fb7c2bbee823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:26.681553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:26.781894 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1718/3396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:26.785917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:26.804254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293d7e3-3ba8-4336-a86c-e9bacfd7ca0b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:26.816532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:26.817364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:26.817831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:26.818456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:26.819297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:26.820713 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:26.820713 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:26.820713 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:26.821912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:26.856047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:26.856335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:26.856614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:26.871266 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1679/3397] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:24:26 2022] POST /identity/v3/domains => generated 275 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:26.882967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:26.912222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:26.921174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:27.081146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9738105-4760-4e3a-955a-31afe8e4d2d8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.097675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.098383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.098667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.098950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.099648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.100666 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:27.100666 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:27.100666 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:27.102100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.111339 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1719/3398] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:24:27.206314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1680/3399] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:24:26 2022] PUT /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config => generated 138 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:27.210409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.237906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257dad-7df6-4818-ab3d-0feebf636b8f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.267370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.268849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.269143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.269435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.271514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18, group=identity)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.280741 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:27.280741 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:27.280741 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:27.281726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.331339 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1720/3400] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 31 05:24:27 2022] GET /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config/identity => generated 45 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:27.333883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.368673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438723-329d-4dac-911c-f7111c0f2afc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.380501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.384781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.386296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.386707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config/identity/driver` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.389221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18, group=identity, option=driver)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.391318 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:27.391318 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:27.391318 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:27.395149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.415330 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1681/3401] 10.222.0.23 () {58 vars in 1296 bytes} [Mon Oct 31 05:24:27 2022] GET /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config/identity/driver => generated 31 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:27.419276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.434040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152bdb3-4c4a-40c5-805f-be513775773d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.454029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.457775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.459537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.460011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config/ldap` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.476671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18, group=ldap)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.480170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.533840 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1721/3402] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:24:27 2022] GET /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config/ldap => generated 106 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:27.537744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.552850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42dede-0eba-43d8-9878-4e8145a14d08 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.570525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.571348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.582220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.583539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config/ldap/url` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.587784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18, group=ldap, option=url)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.589513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.595497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:27.613964 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1682/3403] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 31 05:24:27 2022] GET /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config/ldap/url => generated 46 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:27.618966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.633791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c1d7-d9c1-48f1-b333-3ead12f15065 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.648134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.651238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.651756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.652894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config/ldap/user_tree_dn` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.659018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18, group=ldap, option=user_tree_dn)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.661413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.692839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.697883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1722/3404] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 31 05:24:27 2022] GET /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config/ldap/user_tree_dn => generated 63 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:27.705701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514defd-e1d1-461b-9bce-9a1071da9592 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.724089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.724758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.725110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.725392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.726612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6132fb87ba7f469985f591375e00bd18)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.727666 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:27.727666 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:27.727666 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:27.728573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.765278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:27.765515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1683/3405] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:27 2022] DELETE /identity/v3/domains/6132fb87ba7f469985f591375e00bd18/config => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:27.781602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b903b-b0c2-48a6-84f0-2087d3301ca2 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:27.792749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:27.793599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:27.794064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:27.794541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:27.796890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6132fb87ba7f469985f591375e00bd18)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:27.800185 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:27.800185 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:27.800185 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:27.802552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:27.894122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6132fb87ba7f469985f591375e00bd18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:27.895783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6132fb87ba7f469985f591375e00bd18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.013175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6132fb87ba7f469985f591375e00bd18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.014273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6132fb87ba7f469985f591375e00bd18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.018655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1723/3406] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:27 2022] PATCH /identity/v3/domains/6132fb87ba7f469985f591375e00bd18 => generated 276 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:28.022819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:28.026292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:28.063285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a44c0-d338-4a45-ae98-2da4af4bbded tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:28.188020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:28.195968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:28.196262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:28.196550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:28.231992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6132fb87ba7f469985f591375e00bd18)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:28.234929 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:28.234929 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:28.234929 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:28.238459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:28.288002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6132fb87ba7f469985f591375e00bd18'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.314045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6132fb87ba7f469985f591375e00bd18'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.393861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6132fb87ba7f469985f591375e00bd18', 'request_id': 'req-14f3ab1c-d10b-4502-842d-24c9330fb677'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.403584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6132fb87ba7f469985f591375e00bd18', 'request_id': 'req-14f3ab1c-d10b-4502-842d-24c9330fb677'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.416402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6132fb87ba7f469985f591375e00bd18', 'request_id': 'req-14f3ab1c-d10b-4502-842d-24c9330fb677'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.432210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] The token cache is being invalidate because project 6132fb87ba7f469985f591375e00bd18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:28.432516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.433347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.446393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6132fb87ba7f469985f591375e00bd18', 'request_id': 'req-14f3ab1c-d10b-4502-842d-24c9330fb677'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.447269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6132fb87ba7f469985f591375e00bd18', 'request_id': 'req-14f3ab1c-d10b-4502-842d-24c9330fb677'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.447926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6132fb87ba7f469985f591375e00bd18', 'request_id': 'req-14f3ab1c-d10b-4502-842d-24c9330fb677'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:28.476612 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1684/3407] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:28 2022] DELETE /identity/v3/domains/6132fb87ba7f469985f591375e00bd18 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:28.477985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:28.495206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04bd3-94ce-49d5-a9aa-c21d3dab8198 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:28.662473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:28.663112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:28.664252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:28.664858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:28.665092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:28.667778 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:28.667778 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:28.667778 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:28.669193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:28.683404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:28.710295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1724/3408] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:24:28 2022] POST /identity/v3/domains => generated 276 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:28.713387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:28.715440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:28.774230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ab1c-d10b-4502-842d-24c9330fb677 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:28.829345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:28.846021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:28.848639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:28.918485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:28.919298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:28.920012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:28.920405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:28.921212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:28.932408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.024944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1685/3409] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:24:28 2022] PUT /identity/v3/domains/d22f170552e945529f70825f6141cdf2/config => generated 138 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:29.029235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:29.090693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f35de-28e6-4369-9da2-fd265e3fc7ef tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.112341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.113013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.114479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.114792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.120124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.121279 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:29.121279 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:29.121279 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:29.123336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.135294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7573c5-6209-4daf-9331-5e792bcdd1e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.166299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.168595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.168893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.188541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] PATH_INFO: `/v3/users/952c3d6ab9f84c6db938a25c3d8db3d7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.203349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952c3d6ab9f84c6db938a25c3d8db3d7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.224320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.240647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1686/3410] 10.222.0.23 () {60 vars in 1271 bytes} [Mon Oct 31 05:24:29 2022] PATCH /identity/v3/domains/d22f170552e945529f70825f6141cdf2/config => generated 142 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:29.245795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:29.278101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399ec61-57f9-473d-bc1b-68d95a7aad82 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.303229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.304213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.305144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.307888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.310684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.318913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.371755 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1687/3411] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:29 2022] GET /identity/v3/domains/d22f170552e945529f70825f6141cdf2/config => generated 142 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:29.372914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:29.446217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b951a-3ba1-4309-8144-48efc0527c0a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.471530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952c3d6ab9f84c6db938a25c3d8db3d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:29.472686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.473359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.473648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.473932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.474562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.477189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.551519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952c3d6ab9f84c6db938a25c3d8db3d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:29.557340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952c3d6ab9f84c6db938a25c3d8db3d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:29.559426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952c3d6ab9f84c6db938a25c3d8db3d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:29.577495 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1688/3412] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:29 2022] DELETE /identity/v3/domains/d22f170552e945529f70825f6141cdf2/config => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:29.581381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:29.588428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:29.621757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952c3d6ab9f84c6db938a25c3d8db3d7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:29.624466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961f630-b4e1-4222-ac75-866481018fcf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.644615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.646746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.649549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.649862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.655878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.660884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.664319 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1725/3413] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:28 2022] DELETE /identity/v3/users/952c3d6ab9f84c6db938a25c3d8db3d7 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Could not find any options in domain configuration for domain d22f170552e945529f70825f6141cdf2.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain d22f170552e945529f70825f6141cdf2. Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 31 05:24:29.735590 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain d22f170552e945529f70825f6141cdf2. Oct 31 05:24:29.737448 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:29.738191 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1689/3414] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:29 2022] GET /identity/v3/domains/d22f170552e945529f70825f6141cdf2/config => generated 151 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:29.744987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:29.922454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893256-13a3-4f6b-8716-1a5ac0de5b25 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.928450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.930082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.931028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.931755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2/config` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.932550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.935128 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:29.935128 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:29.935128 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:29.936502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:29.947511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1726/3415] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:29 2022] DELETE /identity/v3/domains/d22f170552e945529f70825f6141cdf2/config => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:29.951521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:29.965521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca641e4-159e-4078-b29a-0950a7cde74b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:29.970932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:29.972528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:29.973126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:29.973611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:29.975206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:29.976662 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:29.976662 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:29.976662 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:29.977976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:30.008456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd22f170552e945529f70825f6141cdf2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.009556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd22f170552e945529f70825f6141cdf2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.068608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd22f170552e945529f70825f6141cdf2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.074846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4401b718-8c46-4e1b-9ea5-31bb2e6363e0 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd22f170552e945529f70825f6141cdf2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.082101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:30.083868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:30.093467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1690/3416] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:29 2022] PATCH /identity/v3/domains/d22f170552e945529f70825f6141cdf2 => generated 277 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:30.101401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6582c3a-d4f6-43c0-a8ce-ebdcd5b5cddf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:30.128592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:30.223215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:30.235483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:30.236160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:30.236160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:30.306820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d22f170552e945529f70825f6141cdf2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:30.307877 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:30.307877 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:30.307877 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:30.308789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:30.314341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:30.314671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:30.314957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:30.358742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:30.359965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:30.391294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd22f170552e945529f70825f6141cdf2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.403619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd22f170552e945529f70825f6141cdf2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.479596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:30.498111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1691/3417] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:30.521718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22f170552e945529f70825f6141cdf2', 'request_id': 'req-30220837-8766-495d-8f2c-82814e2f0db4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.538811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22f170552e945529f70825f6141cdf2', 'request_id': 'req-30220837-8766-495d-8f2c-82814e2f0db4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.550351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22f170552e945529f70825f6141cdf2', 'request_id': 'req-30220837-8766-495d-8f2c-82814e2f0db4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.566379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] The token cache is being invalidate because project d22f170552e945529f70825f6141cdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:30.566847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.567504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.578964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd22f170552e945529f70825f6141cdf2', 'request_id': 'req-30220837-8766-495d-8f2c-82814e2f0db4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.583926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd22f170552e945529f70825f6141cdf2', 'request_id': 'req-30220837-8766-495d-8f2c-82814e2f0db4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.584937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd22f170552e945529f70825f6141cdf2', 'request_id': 'req-30220837-8766-495d-8f2c-82814e2f0db4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.594016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1727/3418] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:30 2022] DELETE /identity/v3/domains/d22f170552e945529f70825f6141cdf2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:30.601705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:30.621387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3734f-9bfc-4f83-924c-2ef4c93109a2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:30.640014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:30.641746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:30.777341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:30.782801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:30.784674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:30.785271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:30.786543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:30.787333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:30.793251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:30.808131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30220837-8766-495d-8f2c-82814e2f0db4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:30.815149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:30.825173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:30.825958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:30.826445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] PATH_INFO: `/v3/projects/5c9556bba29d4790ac275838ce9e0ee4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:30.828784 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1692/3419] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:24:30 2022] POST /identity/v3/domains => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:30.833115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9556bba29d4790ac275838ce9e0ee4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:30.833799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:30.836423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:30.837128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:30.907131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9556bba29d4790ac275838ce9e0ee4', 'request_id': 'req-1201998b-7cf3-4693-ab74-79995d401563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.915243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9556bba29d4790ac275838ce9e0ee4', 'request_id': 'req-1201998b-7cf3-4693-ab74-79995d401563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.923008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9556bba29d4790ac275838ce9e0ee4', 'request_id': 'req-1201998b-7cf3-4693-ab74-79995d401563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.942358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] The token cache is being invalidate because project 5c9556bba29d4790ac275838ce9e0ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:30.942952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.943962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1201998b-7cf3-4693-ab74-79995d401563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:30.949536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1728/3420] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:30 2022] DELETE /identity/v3/projects/5c9556bba29d4790ac275838ce9e0ee4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:30.955402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddf73f-f35f-471a-aec1-410da2d4ba7e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:30.955686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddf73f-f35f-471a-aec1-410da2d4ba7e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:30.955958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddf73f-f35f-471a-aec1-410da2d4ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:30.995439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bdddf73f-f35f-471a-aec1-410da2d4ba7e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:30.996913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bdddf73f-f35f-471a-aec1-410da2d4ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:31.002267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da970f2-dc7e-4260-aa6b-8807c8c8a8a3 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.091891 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1729/3421] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:31.101058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.104028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.104416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.186390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:31.191768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.192614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:31.194320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.196179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.197854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.202285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.218567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.231822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1730/3422] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:31.235550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.251903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffb445-ee1f-43f4-bec6-ff634ef25c03 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.257507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.258228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.258516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.258792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.259450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:31.259751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.261557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.281466 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1731/3423] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:24:31.282871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.297298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfb276-5882-43ce-a26a-ed8d7a9519f6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.299870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1693/3424] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:24:30 2022] PUT /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config => generated 138 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:24:31.304763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.304945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.305808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.306072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.306635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.307420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.308134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:31.309460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.332690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fce24-1f86-4e6f-93c3-d21ee93983e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.349432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.351462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.351760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.352043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.358376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae, group=identity)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.359436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1732/3425] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:31 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:31.360368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.361798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.383607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:31.427012 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1694/3426] 10.222.0.23 () {60 vars in 1297 bytes} [Mon Oct 31 05:24:31 2022] PATCH /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity => generated 177 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:31.431079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.455902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476326ef-3d74-4733-ac02-9f17c5e05a74 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.473814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:31.553547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8d48d-dfea-4df1-aef8-ebb0c9d57eb0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.559164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.559606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.559893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.560166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.560805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.563705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.589309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.590074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.590396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.590676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity/driver` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.591428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae, group=identity, option=driver)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.593117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.622445 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1733/3427] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:31 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:31.626553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.642277 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1695/3428] 10.222.0.23 () {60 vars in 1318 bytes} [Mon Oct 31 05:24:31 2022] PATCH /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity/driver => generated 177 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:31.643375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.652225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6de97-a897-4e29-a161-d2d6911da413 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.657244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11cabf-c4e7-450e-b982-25abd3b6ad7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.664637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.665374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.665489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.665683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.665919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.666390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.666601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.666845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.667198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity/driver` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.667883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae, group=identity, option=driver)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.668672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.671008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.688436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1734/3429] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:24:31.692995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.698418 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1696/3430] 10.222.0.23 () {58 vars in 1299 bytes} [Mon Oct 31 05:24:31 2022] DELETE /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity/driver => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:31.699421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.712618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3ee2-ce21-417e-a514-87f186e35990 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.714920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd5d15-553c-49fa-be11-ae2d46c7c283 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.718349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.719088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.719380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.719659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity/driver` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.720990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae, group=identity, option=driver)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.723381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.729080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.729715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.730416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.731104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.733071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Could not find option driver in group identity in domain configuration for domain 758a919f290541ed9e3113a6266c60ae.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:31.736608 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:31.737474 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:31.738044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.741390 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1697/3431] 10.222.0.23 () {58 vars in 1296 bytes} [Mon Oct 31 05:24:31 2022] GET /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity/driver => generated 171 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:31.743553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.755381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef285-bf8f-444c-9e29-1c7bd950cc54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.762387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.763444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.763971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.764254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.765610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae, group=identity)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.767250 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1735/3432] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:31.771897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.774329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.798858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a893-faa3-4528-a341-4b71027f256a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.807787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a57d1-ddae-4058-aa31-58d5f2194ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.808567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a57d1-ddae-4058-aa31-58d5f2194ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.808994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a57d1-ddae-4058-aa31-58d5f2194ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.811617 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1698/3433] 10.222.0.23 () {58 vars in 1278 bytes} [Mon Oct 31 05:24:31 2022] DELETE /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:31.812165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a57d1-ddae-4058-aa31-58d5f2194ce3 admin admin] PATH_INFO: `/v3/projects/bcef8bb73a12439890c578d3cc840a70/users/3188e7be5b534714a76bc578112df550/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.817439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.842283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5e637-63fd-405d-ae83-bf0969c3fae5 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.853482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:31.855363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.855657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.858761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a57d1-ddae-4058-aa31-58d5f2194ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcef8bb73a12439890c578d3cc840a70, user_id=3188e7be5b534714a76bc578112df550, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.859036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.863377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae, group=identity)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:31.868650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a57d1-ddae-4058-aa31-58d5f2194ce3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.868880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Could not find group identity in domain configuration for domain 758a919f290541ed9e3113a6266c60ae.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:31.885670 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:31.886919 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:31.901871 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1699/3434] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 31 05:24:31 2022] GET /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config/identity => generated 154 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:31.906449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1736/3435] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:31 2022] PUT /identity/v3/projects/bcef8bb73a12439890c578d3cc840a70/users/3188e7be5b534714a76bc578112df550/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:31.911160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:31.912865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683398-f80e-4225-b602-64ca418e446c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:31.913199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683398-f80e-4225-b602-64ca418e446c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:31.913604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683398-f80e-4225-b602-64ca418e446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:31.955472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88205ac1-2204-4689-9195-d1ee288b04b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:31.980104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-be683398-f80e-4225-b602-64ca418e446c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:31.982659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-be683398-f80e-4225-b602-64ca418e446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:32.096562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:32.097138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:32.097426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:32.097715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae/config` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:32.103137 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1737/3436] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:32.103446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=758a919f290541ed9e3113a6266c60ae)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:32.105191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:32.110173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:32.133141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be683398-f80e-4225-b602-64ca418e446c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:32.134045 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1700/3437] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:31 2022] DELETE /identity/v3/domains/758a919f290541ed9e3113a6266c60ae/config => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:32.149857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:32.156314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:32.157648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be683398-f80e-4225-b602-64ca418e446c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:32.171158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:32.172432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:32.173687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:32.174232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:32.180128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=758a919f290541ed9e3113a6266c60ae)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:32.181808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:32.228575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '758a919f290541ed9e3113a6266c60ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.229375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '758a919f290541ed9e3113a6266c60ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.255967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2fa2f-f47c-46b4-b666-4ec39c14f702 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:32.279512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '758a919f290541ed9e3113a6266c60ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.280575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '758a919f290541ed9e3113a6266c60ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.283873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1738/3438] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:32 2022] PATCH /identity/v3/domains/758a919f290541ed9e3113a6266c60ae => generated 276 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:32.296034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:32.302817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:32.340565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:32.341200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:32.341486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:32.341799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:32.344376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:32.403580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:32.436208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056fd0a-53f3-44ab-8574-1feaf2c99015 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:32.442590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:32.468746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:32.470503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:32.470763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:32.471631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:32.472622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:32.487478 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1701/3439] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:32.495967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=758a919f290541ed9e3113a6266c60ae)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:32.497816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:32.531645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '758a919f290541ed9e3113a6266c60ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.536732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '758a919f290541ed9e3113a6266c60ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.709801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758a919f290541ed9e3113a6266c60ae', 'request_id': 'req-ab212762-81e0-4636-ad65-58b06d6cbd68'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.718670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758a919f290541ed9e3113a6266c60ae', 'request_id': 'req-ab212762-81e0-4636-ad65-58b06d6cbd68'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.726527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758a919f290541ed9e3113a6266c60ae', 'request_id': 'req-ab212762-81e0-4636-ad65-58b06d6cbd68'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.752459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] The token cache is being invalidate because project 758a919f290541ed9e3113a6266c60ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:32.753258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.754131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.765303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '758a919f290541ed9e3113a6266c60ae', 'request_id': 'req-ab212762-81e0-4636-ad65-58b06d6cbd68'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.776307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '758a919f290541ed9e3113a6266c60ae', 'request_id': 'req-ab212762-81e0-4636-ad65-58b06d6cbd68'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.777704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '758a919f290541ed9e3113a6266c60ae', 'request_id': 'req-ab212762-81e0-4636-ad65-58b06d6cbd68'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:32.792287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1739/3440] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:32 2022] DELETE /identity/v3/domains/758a919f290541ed9e3113a6266c60ae => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:32.799596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:32.828063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237749e0-a0c4-4eb4-ac85-c8378a8cd189 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:32.952852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:32.953548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:32.953769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:32.954055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:32.954968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:32.957053 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:32.957053 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:32.957053 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:32.957960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:32.975580 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1702/3441] 10.222.0.23 () {58 vars in 1173 bytes} [Mon Oct 31 05:24:32 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:32.978661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:32.980522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:33.018015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212762-81e0-4636-ad65-58b06d6cbd68 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.031238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.033804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.034103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.036380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.037016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.039393 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:33.039393 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:33.039393 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:33.041541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.046401 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1740/3442] 10.222.0.23 () {58 vars in 1200 bytes} [Mon Oct 31 05:24:32 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.058364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.072773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07cca-bfa2-46c6-b672-0590fbde601a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.086926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.087639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.087924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.088203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.088809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.090999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.096364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.106394 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1703/3443] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.111553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4209b48-cc31-4c6e-9a97-db69d7c9a6fc tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.119949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.120624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.120907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.121188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.121785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.123644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.124765 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1741/3444] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.129089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.140036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:33.154240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9412de-6b0f-44bf-9284-6ff9cbedbb46 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.168314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.169000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.169285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.169563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.170296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.171887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.177963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.179516 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1704/3445] 10.222.0.23 () {58 vars in 1188 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:33.192503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5288d-f6cd-4cb0-826a-da2b70bd32e9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.205593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.206296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.206583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.206860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.207459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.209081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.214530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.227848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd29d45-4cab-4da7-b321-4587a54d05ac tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.231436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1742/3446] 10.222.0.23 () {58 vars in 1200 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.245231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.246175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.246608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.246890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.247493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.249095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.254262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.267912 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1705/3447] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:33.271791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243a60a-2184-4547-a992-0b31291332b1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.282921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.283602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.283892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.284173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.284776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.286460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.292906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.304998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5308bf6-29d9-4a3c-9440-643ecfc9444f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.306936 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1743/3448] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:33.330506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.331312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.331596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.331916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.332744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.335090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.346740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.354738 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1706/3449] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.368108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca7847-925c-463f-91f4-f4fa52e078c8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.391031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.391640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.392230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.392509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.393107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.394747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.401066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.412930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7d5b3-e7ca-4b11-ad27-45d61361e9a6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.418369 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1744/3450] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.432592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.433248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.433534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.433812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.434444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.439259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.444648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.445808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1707/3451] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:33.458917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b444ea-54be-4992-bd34-da527bc74d6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.475255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.476490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.477923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.479977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.480752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.485706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.493545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1745/3452] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:33.494956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.505741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484757a2-ee92-4d1b-9ada-483b357f664a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.534269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.535108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.535392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.535663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.536266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.537866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.547169 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1708/3453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.553548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.568738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00512d-eba8-4c65-9f1e-88b87a673cb4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.583502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.589099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.589610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.590015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.590794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.594451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.599392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1746/3454] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.603864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.614781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926751e5-dbf5-42a8-a723-dd321a923b23 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.627337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.628245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.628678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.628995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.630123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.632621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.639047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1709/3455] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.642829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.661498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4a11-9036-4d35-8e92-f366d6d19236 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.674067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.674971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.675376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.675762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.676475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.678236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.687094 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1747/3456] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.691159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.718075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b98b-1369-4860-9e1b-dc0bef0a96cf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.752331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.754585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.755161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.756755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.759051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.762899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.764940 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1710/3457] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.769856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.784858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aeb48-f8e5-46b7-9eeb-baadeb605fca tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.798377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.800473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.800683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.801147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.802097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.805238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.812632 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1748/3458] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.814133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.828065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa86e7-7644-4089-b1b3-ba60da1010b7 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.840068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.842993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.843788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.844369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.845277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.849164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.851840 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1711/3459] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.857718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.869546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7d3eb-016d-4c1f-844a-40818180e0e1 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.885826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.886535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.886819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.887241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.887850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.889496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.898336 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1749/3460] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.903075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.917171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775916b1-60d3-442f-abb9-1f15413f8880 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.930174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.931593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.932961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.934356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.935124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.939277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.945359 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1712/3461] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.949849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:33.976740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2209b-7e49-468d-a776-a86b531069d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:33.984392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:33.985957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:33.986503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:33.987045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:33.987945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:33.993648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:33.995413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1750/3462] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:33.999745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.015302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa610cc2-7d82-4bb4-bc9b-cf80b53423cb tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.031431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.034868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.035571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.036160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.037347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.041474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.043524 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1713/3463] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:24:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.047170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.060545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57159c-6b94-4cd5-9dea-52338459ad36 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.067521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.068661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.069174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.070431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.071340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.073381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.074964 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1751/3464] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:34.079024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.094369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bcfc7-29d1-4839-91ef-2a27684f2fa8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.101662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.103175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.104158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.104699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.105525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.107377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.109059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1714/3465] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.113387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.128891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eb739-5b35-4f1f-91f3-74a18c25067f tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.139336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.140938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.141588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.142090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.143172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.146105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.149783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1752/3466] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.154421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.180472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ef503-2f88-45f7-9dd3-fccb68ababc4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.215960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.217141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.217739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.218383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.219405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.221729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.223131 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1715/3467] 10.222.0.23 () {58 vars in 1290 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.227641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.254655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17835-6089-4aa7-ad7d-85e01b898d65 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.269509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.270220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.270507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.270783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.271386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.275273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.279491 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1753/3468] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:34.280632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.295006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a80f6-7118-4691-bb6e-2d8febbf2699 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.308077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.308753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.309202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.309873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.310080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.312816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.316757 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1716/3469] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:34.317953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.329708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a091e-6bac-4565-9468-04b083de3c7e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.335759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.336683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.337121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.337555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.338341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.340375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.346447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.360340 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1754/3470] 10.222.0.23 () {58 vars in 1308 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.361967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d619422-f179-41b6-b3f1-cb5a05f8a262 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.367472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.368134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.368669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.368949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.369556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.371202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.376723 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1717/3471] 10.222.0.23 () {58 vars in 1290 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.376998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.402926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e54a3-e90d-47ad-a5ca-fb725ddfad8e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.409966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.411090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.411674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.412200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.413132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.415970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.419956 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1755/3472] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.421926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.452434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572608-f27c-4536-9397-af9459f448dd tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.457789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.460204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.460784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.461244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.462808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.464578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.470052 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1718/3473] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.470354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.487292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbb7d5-944a-4014-bfab-7d82cfe2e85d tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.497437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.498386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.498754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.499106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.499831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.501825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.504687 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1756/3474] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.508279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.519317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e32f6-d20f-4a1e-8eda-8fd3fff6f03a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.524687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.525427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.525786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.526138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.526833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.528481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.529952 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1719/3475] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.542706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.562461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:34.578897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7761-3026-4e7a-b34f-3c9c03f8c455 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.586536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.588177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.588988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.589598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.590235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.592659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.598116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.598759 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1757/3476] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.619991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1485-ed58-4c42-9a0e-b60b72d3569c tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.636726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.637415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.637807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.638203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.638882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.640537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.642616 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1720/3477] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:34.646665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.679546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa0665-572e-4a38-8d7d-41261b8831db tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.691837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.692514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.692796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.693072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.693667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.696400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.697235 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1758/3478] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.705489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.720439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f625-ec1a-4425-9f83-295fe7df9052 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.734976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.736384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.736384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.737650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.738394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.753093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.754679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1721/3479] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.759453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.770361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cce2b-81f0-4c9e-a243-a35a7ddda7e6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.787644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.788844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.789233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.789541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.790441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.792165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.793905 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1759/3480] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.798296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.811625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd74b3-d934-4644-8bb2-0fabaa57b504 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.818876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.839412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.840599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.841947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.843910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.850773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.858140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.858486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1722/3481] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.877648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cf7e6-12b7-4861-a97a-4ea34303c665 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.886970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.887560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.887847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.888685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.888685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.890332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.895617 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1760/3482] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:34.898097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.911868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa77e87-b517-4258-aac8-b874d7709ecf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.937408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.938129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.938444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.939876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.940513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.945335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.947386 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1723/3483] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:34.951254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:34.963460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36b12-abe6-4a01-913e-e5c500264246 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:34.994113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:34.994858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:34.995068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:34.995590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:34.996424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:34.998318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:34.999883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1761/3484] 10.222.0.23 () {58 vars in 1212 bytes} [Mon Oct 31 05:24:34 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.005663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.018944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8ec3-168f-4277-8041-cebfd4cab135 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.036678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.037443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.037821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.038297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.039202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.040957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.042262 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1724/3485] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.046480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.059785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc451c-046e-4a00-ae68-f80a189ef173 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.072350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.073129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.073407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.073907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.074877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.078644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.080684 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1762/3486] 10.222.0.23 () {58 vars in 1215 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.084889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.104039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be522-719e-4f90-9f6c-96d9f40b1af8 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.117631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.118592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.118877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.119152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.119744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.121335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.122636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1725/3487] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.127081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.138622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dfb62-6a7c-4851-a5c3-c3431cfaa4b4 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.153939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.154634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.154918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.155191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.155783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.157370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.158587 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1763/3488] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.162618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.173937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d7034-8c19-4670-a66a-ec064cd3c98e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.180113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.181277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.181924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.182441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.183259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.185262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.191017 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1726/3489] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.195803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.214257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc6f8-b3ad-4e83-9175-a08461e61eaf tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.223485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.224137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.224422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.224700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.225356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.229845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.233114 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1764/3490] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.237150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.251420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554dd0-79ea-49c3-beb0-3228db21db6e tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.264121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.265171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.265660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.266116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.267034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.268948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.270477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1727/3491] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.276075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.297690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d13f-d950-405f-b27b-716c2f690ae6 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.303606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.304673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.305431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.306123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.307236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.308603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.316263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1765/3492] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 05:24:35.321114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.341292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01943d-966d-4f60-9f66-b28acd90c1d9 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.347804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.351358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.351358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.351358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.351358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.353668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.362025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.382610 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1728/3493] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.385416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b9007-fc06-4761-891e-2fb6c3a37b14 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.402393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.403351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.403904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.404318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.405149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.408190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.418639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.427447 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1766/3494] 10.222.0.23 () {58 vars in 1278 bytes} [Mon Oct 31 05:24:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:24:35.432100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78485c-4405-4362-b6b0-9f810e968b54 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.438748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.439673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.439995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.440474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/758a919f290541ed9e3113a6266c60ae` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.472523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Could not find domain: 758a919f290541ed9e3113a6266c60ae.: keystone.exception.DomainNotFound: Could not find domain: 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:35.493444 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:35.494687 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:24:35.496445 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 758a919f290541ed9e3113a6266c60ae. Oct 31 05:24:35.497672 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:35.497672 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1729/3495] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:35 2022] PATCH /identity/v3/domains/758a919f290541ed9e3113a6266c60ae => generated 112 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:35.499316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.515697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c840-b93f-4446-b017-520d15f0bb42 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.531524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.532548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.532839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.533116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/d22f170552e945529f70825f6141cdf2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.551107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Could not find domain: d22f170552e945529f70825f6141cdf2.: keystone.exception.DomainNotFound: Could not find domain: d22f170552e945529f70825f6141cdf2. Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d22f170552e945529f70825f6141cdf2. Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:35.565977 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:35.567193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:24:35.569193 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d22f170552e945529f70825f6141cdf2. Oct 31 05:24:35.571276 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:24:35.571276 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1767/3496] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:35 2022] PATCH /identity/v3/domains/d22f170552e945529f70825f6141cdf2 => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:35.572112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.588050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bb02a-5848-41ef-96b5-8e3f622dc270 tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.598956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802345c-3715-4c85-995b-aeef0cae171b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39e89eb2a6f9496ca7bf1ad5af900aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.599626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802345c-3715-4c85-995b-aeef0cae171b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.602070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802345c-3715-4c85-995b-aeef0cae171b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.602379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802345c-3715-4c85-995b-aeef0cae171b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] PATH_INFO: `/v3/domains/6132fb87ba7f469985f591375e00bd18` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.623893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802345c-3715-4c85-995b-aeef0cae171b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7802345c-3715-4c85-995b-aeef0cae171b tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Could not find domain: 6132fb87ba7f469985f591375e00bd18.: keystone.exception.DomainNotFound: Could not find domain: 6132fb87ba7f469985f591375e00bd18. Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6132fb87ba7f469985f591375e00bd18. Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:35.629889 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:35.631050 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:24:35.632131 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6132fb87ba7f469985f591375e00bd18. Oct 31 05:24:35.633147 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:35.635481 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1730/3497] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:35 2022] PATCH /identity/v3/domains/6132fb87ba7f469985f591375e00bd18 => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:35.639143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:35.641647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:35.750818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c4b16-1b6a-4a2d-ad3e-6f1dfc1a411a tempest-DomainConfigurationTestJSON-524392779 tempest-DomainConfigurationTestJSON-524392779-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:35.757576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:35.758424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.758750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.759029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] PATH_INFO: `/v3/users/490bd142b2d4433c93fba203ef3cc27c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.760281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490bd142b2d4433c93fba203ef3cc27c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:35.762601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:35.849748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490bd142b2d4433c93fba203ef3cc27c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:35.873093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490bd142b2d4433c93fba203ef3cc27c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:35.874186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490bd142b2d4433c93fba203ef3cc27c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:35.874936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490bd142b2d4433c93fba203ef3cc27c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:35.886820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490bd142b2d4433c93fba203ef3cc27c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:35.912301 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1768/3498] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:35 2022] DELETE /identity/v3/users/490bd142b2d4433c93fba203ef3cc27c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:35.916988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:35.917579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:35.918081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:35.979877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:35.986640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:36.106596 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1731/3499] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:36.134613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:36.136748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:36.195785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:36.289021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401f945-94f6-4362-adc1-d65a74430f19 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:36.305356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:36.306856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:36.310392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:36.310872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:36.333125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:36.342042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:36.369188 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1769/3500] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:37.298923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:37.302170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:37.319201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c6738-4e84-42ff-a463-0eebaf753608 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:37.342621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:37.343231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:37.343543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:37.343791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] PATH_INFO: `/v3/projects/d90b8a789eb0407eaa508ac45d03b93c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:37.347024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90b8a789eb0407eaa508ac45d03b93c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:37.348968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:37.414503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:37.453503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90b8a789eb0407eaa508ac45d03b93c', 'request_id': 'req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.470725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90b8a789eb0407eaa508ac45d03b93c', 'request_id': 'req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.510104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90b8a789eb0407eaa508ac45d03b93c', 'request_id': 'req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.537578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] The token cache is being invalidate because project d90b8a789eb0407eaa508ac45d03b93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:37.537884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.540885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.545113 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1732/3501] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:37 2022] DELETE /identity/v3/projects/d90b8a789eb0407eaa508ac45d03b93c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:37.550701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:37.570118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17685-fec8-440d-8b1d-2c295f028ab8 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:37.672949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:37.674131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:37.674865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:37.675707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] PATH_INFO: `/v3/users/39e89eb2a6f9496ca7bf1ad5af900aff` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:37.677625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e89eb2a6f9496ca7bf1ad5af900aff)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:37.682235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:37.802896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e89eb2a6f9496ca7bf1ad5af900aff'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.855928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e89eb2a6f9496ca7bf1ad5af900aff'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.856869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e89eb2a6f9496ca7bf1ad5af900aff'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.857618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e89eb2a6f9496ca7bf1ad5af900aff'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.872564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcb39f67-9c55-49e6-a61e-659bb2f13f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e89eb2a6f9496ca7bf1ad5af900aff'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:37.902218 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1770/3502] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:37 2022] DELETE /identity/v3/users/39e89eb2a6f9496ca7bf1ad5af900aff => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:38.649688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:38.651090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:38.709844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980ef35-5bc8-44c7-a6f4-6a5e9653d598 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:38.840325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:38.841930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:38.842325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:38.843025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] PATH_INFO: `/v3/projects/d4b089d4453a4a01bf1398ddef0d5d6c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:38.844522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b089d4453a4a01bf1398ddef0d5d6c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:38.846746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:38.949283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'request_id': 'req-306f885b-65c8-46e0-a16e-546aec00b55d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:38.992010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'request_id': 'req-306f885b-65c8-46e0-a16e-546aec00b55d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:39.020922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b089d4453a4a01bf1398ddef0d5d6c', 'request_id': 'req-306f885b-65c8-46e0-a16e-546aec00b55d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:39.047594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] The token cache is being invalidate because project d4b089d4453a4a01bf1398ddef0d5d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:39.048202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:39.059650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-306f885b-65c8-46e0-a16e-546aec00b55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:39.078802 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1733/3503] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:38 2022] DELETE /identity/v3/projects/d4b089d4453a4a01bf1398ddef0d5d6c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:39.081131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.081619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.082061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.155260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:39.167321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:39.311151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:39.365960 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1771/3504] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:39.375892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.376511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.377009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.415278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:39.417306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:39.441161 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1734/3505] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:39.441503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:39.457364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d7215-62b6-4662-ad3f-46be17d0bc93 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:39.463538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:39.464389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.464547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.464819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.465773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:39.466086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:39.467942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:39.486126 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1772/3506] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:39.494090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:39.511447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ffde-1de6-4c36-a009-50d2c1fcaf9a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:39.533190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:39.534699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.535080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.536600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.537872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:39.561130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:39.673289 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1735/3507] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:39 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:39.678063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:39.696718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79320e5c-f68b-4d07-bc12-b696a31281c6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:39.865863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:39.867877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.868594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.868872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.872354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:39.879635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:39.923756 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1773/3508] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:39 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:39.925330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:39.935938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e184-8df7-4055-8bff-46a0b3b6245f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:39.940775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:39.941397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.941677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.941951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.942711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:39.944919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:39.957205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1736/3509] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:39.962424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:39.974269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011149-a9ca-40fb-a2cc-041298a47c38 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:39.980046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e670ff-63cf-44f8-8b1e-67774e1a4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:39.980748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e670ff-63cf-44f8-8b1e-67774e1a4e33 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:39.981104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e670ff-63cf-44f8-8b1e-67774e1a4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:39.981453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e670ff-63cf-44f8-8b1e-67774e1a4e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:39.982382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e670ff-63cf-44f8-8b1e-67774e1a4e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:39.984114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e670ff-63cf-44f8-8b1e-67774e1a4e33 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.012363 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1774/3510] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:40.016461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.033216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71fd3e-9f33-400a-8005-54d93da98a88 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.040987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.041862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.042374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.042811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] PATH_INFO: `/v3/projects/5197169727594b3c99a98149c141e6bd/users/54d42647578a44bba06ba670f9d5b7b2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.055117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:40.067189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5197169727594b3c99a98149c141e6bd, user_id=54d42647578a44bba06ba670f9d5b7b2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.070867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.092192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1737/3511] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:40 2022] PUT /identity/v3/projects/5197169727594b3c99a98149c141e6bd/users/54d42647578a44bba06ba670f9d5b7b2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:40.109230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.109778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.111915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.168855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] MFA Rules not processed for user `54d42647578a44bba06ba670f9d5b7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:40.170734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:40.277341 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1775/3512] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:40.281448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.353050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfccf5-003f-4967-a619-a9914c0d3234 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.357822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.358486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.358770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.359047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.359696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.361612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.396057 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1738/3513] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:40 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:40.400927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.412168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b39961-b44e-4837-b119-903dce62bc10 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.487401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:40.509681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.510466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.510873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.511244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.511983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.514129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.538037 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1776/3514] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:40 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:24:40.542056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.552477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b3c19-66b0-4a1d-a296-13bb25a82851 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.557438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.558032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.560133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.560133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.560133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.565873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.582653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1739/3515] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:40.587896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.609904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb641-498b-4c84-ba4d-8cda0fb85563 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.617287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.618040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.618666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.619006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] PATH_INFO: `/v3/projects/306b0e6810764a3da3f5a7f6d32e32c1/users/fa0cee9f44af44cf9897fb167decc8fc/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.645778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306b0e6810764a3da3f5a7f6d32e32c1, user_id=fa0cee9f44af44cf9897fb167decc8fc, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.649673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.669258 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1777/3516] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:40 2022] PUT /identity/v3/projects/306b0e6810764a3da3f5a7f6d32e32c1/users/fa0cee9f44af44cf9897fb167decc8fc/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:40.673019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.685990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758211b-9ab7-4eba-8997-69c1437d338c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.825182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315d27f-34f4-46a4-b9da-e8f7aefb2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.826815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d27f-34f4-46a4-b9da-e8f7aefb2eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.827313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d27f-34f4-46a4-b9da-e8f7aefb2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.827826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d27f-34f4-46a4-b9da-e8f7aefb2eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.828863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315d27f-34f4-46a4-b9da-e8f7aefb2eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.832294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315d27f-34f4-46a4-b9da-e8f7aefb2eeb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.863465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1740/3517] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:40.868029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:40.884011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319420be-f7c1-477b-b44e-17065986ccf6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:40.899074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:40.899924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.900265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.900566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] PATH_INFO: `/v3/projects/306b0e6810764a3da3f5a7f6d32e32c1/users/fa0cee9f44af44cf9897fb167decc8fc/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:40.902616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=306b0e6810764a3da3f5a7f6d32e32c1, user_id=fa0cee9f44af44cf9897fb167decc8fc, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:40.905952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:40.931900 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1778/3518] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:24:40 2022] PUT /identity/v3/projects/306b0e6810764a3da3f5a7f6d32e32c1/users/fa0cee9f44af44cf9897fb167decc8fc/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:40.942185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:40.942586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:40.942749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.016696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] MFA Rules not processed for user `fa0cee9f44af44cf9897fb167decc8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:41.018508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:41.105342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:41.138892 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1741/3519] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:41.144459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.157266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6db57-ffc7-47eb-baa0-16b8be7688fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:41.162379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:41.163275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:41.163713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:41.165471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.167364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:41.169418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:41.203545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1779/3520] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:41 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:41.207829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.217715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3d554-6536-4fb4-9370-540b64a62a39 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:41.312326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:41.313164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:41.313548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:41.314228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.314728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:41.317218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:41.347979 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1742/3521] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:24:41 2022] POST /identity/v3/users => generated 416 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:41.352349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.363650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534723e1-691f-4a07-a160-9d324155e4a2 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:41.368998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:41.370386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:41.370386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:41.370386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/users/29fbd1f89a084555a8f2bfbe91844ce5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.388015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_user(user_id=29fbd1f89a084555a8f2bfbe91844ce5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:41.391023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:41.393135 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1780/3522] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:24:41 2022] GET /identity/v3/users/29fbd1f89a084555a8f2bfbe91844ce5 => generated 416 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:41.398540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.411012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021b76d-aa69-444d-99e0-cf0b3964bfb3 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:41.416728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:41.417577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:41.417958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:41.418358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/users/29fbd1f89a084555a8f2bfbe91844ce5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.419648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=29fbd1f89a084555a8f2bfbe91844ce5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:41.421855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:41.499946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fbd1f89a084555a8f2bfbe91844ce5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.514237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fbd1f89a084555a8f2bfbe91844ce5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.516491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fbd1f89a084555a8f2bfbe91844ce5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.517553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fbd1f89a084555a8f2bfbe91844ce5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.530801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fbd1f89a084555a8f2bfbe91844ce5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.555356 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1743/3523] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:41 2022] DELETE /identity/v3/users/29fbd1f89a084555a8f2bfbe91844ce5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:41.560108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.564128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:41.582171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2194-3e44-4aa0-b553-41dfab8a39d5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:41.645628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:41.646375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:41.647176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:41.647176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/bbc1d4a5b0134a9da7db288be795b609` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.649248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbc1d4a5b0134a9da7db288be795b609)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:41.651393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:41.730182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc1d4a5b0134a9da7db288be795b609', 'request_id': 'req-fa9d81e4-63e8-45d2-a135-a1c6d2933955'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.745305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc1d4a5b0134a9da7db288be795b609', 'request_id': 'req-fa9d81e4-63e8-45d2-a135-a1c6d2933955'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.753510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc1d4a5b0134a9da7db288be795b609', 'request_id': 'req-fa9d81e4-63e8-45d2-a135-a1c6d2933955'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.755807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:41.778235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project bbc1d4a5b0134a9da7db288be795b609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:41.779410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.782513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:41.784452 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1781/3524] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:41 2022] DELETE /identity/v3/projects/bbc1d4a5b0134a9da7db288be795b609 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:41.791225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.805972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6574-feee-4716-8168-1a170389a714 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:41.864066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:41.892467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:41.893396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:41.893880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:41.894347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:41.895203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:41.897228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:41.931378 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1744/3525] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:41 2022] POST /identity/v3/projects => generated 347 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:41.933774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:41.936075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:41.953531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d81e4-63e8-45d2-a135-a1c6d2933955 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:42.089566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:42.090390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:42.091009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:42.091372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:42.092284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:42.092610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:42.093801 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:42.093801 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:42.093801 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:42.112240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:42.154823 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1782/3526] 10.222.0.23 () {58 vars in 1160 bytes} [Mon Oct 31 05:24:41 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:42.158892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:42.174276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c96a-7af4-4b65-8510-89d5af1ca496 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:42.195926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:42.197239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:42.199607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:42.200034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:42.200989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:42.204596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:42.265171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1745/3527] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 31 05:24:42 2022] GET /identity/v3/domains => generated 828 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:42.273014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:42.306129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c87f-9a11-4abd-bf75-0e3d2e5a7422 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:42.333837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:42.337799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:42.338178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:42.338640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/33880dfa7663484fb8c5d89e2643783a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:42.342041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:update_project(project_id=33880dfa7663484fb8c5d89e2643783a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:42.345554 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:42.345554 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:24:42.345554 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:24:42.347344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:42.378435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '33880dfa7663484fb8c5d89e2643783a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.380270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '33880dfa7663484fb8c5d89e2643783a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.435338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '33880dfa7663484fb8c5d89e2643783a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.438076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '33880dfa7663484fb8c5d89e2643783a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.440742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1783/3528] 10.222.0.23 () {60 vars in 1252 bytes} [Mon Oct 31 05:24:42 2022] PATCH /identity/v3/projects/33880dfa7663484fb8c5d89e2643783a => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:42.445581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:42.448723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:42.474074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac47e3-ce4b-4f8b-82e4-689d8918f8ea tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:42.598651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:42.599322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:42.599606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:42.599884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/33880dfa7663484fb8c5d89e2643783a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:42.633089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33880dfa7663484fb8c5d89e2643783a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:42.635116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:42.707424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '33880dfa7663484fb8c5d89e2643783a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.731893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '33880dfa7663484fb8c5d89e2643783a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.858205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33880dfa7663484fb8c5d89e2643783a', 'request_id': 'req-013a51cc-2686-492e-aa3c-55a6c7df8340'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.858205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33880dfa7663484fb8c5d89e2643783a', 'request_id': 'req-013a51cc-2686-492e-aa3c-55a6c7df8340'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.872133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33880dfa7663484fb8c5d89e2643783a', 'request_id': 'req-013a51cc-2686-492e-aa3c-55a6c7df8340'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.894499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 33880dfa7663484fb8c5d89e2643783a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:42.894930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.896063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.908023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '33880dfa7663484fb8c5d89e2643783a', 'request_id': 'req-013a51cc-2686-492e-aa3c-55a6c7df8340'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.908920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '33880dfa7663484fb8c5d89e2643783a', 'request_id': 'req-013a51cc-2686-492e-aa3c-55a6c7df8340'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.909789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '33880dfa7663484fb8c5d89e2643783a', 'request_id': 'req-013a51cc-2686-492e-aa3c-55a6c7df8340'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:42.922074 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1746/3529] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:42 2022] DELETE /identity/v3/projects/33880dfa7663484fb8c5d89e2643783a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:42.927230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:42.945866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd55f-ccf4-4c65-96d8-e57ad6992193 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:43.111706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:43.112341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:43.112624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:43.113008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:43.113677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:43.115572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:43.231105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1784/3530] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:42 2022] POST /identity/v3/projects => generated 357 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:43.235416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:43.237049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:43.251608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:43.273167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a51cc-2686-492e-aa3c-55a6c7df8340 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:43.438283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:43.440427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:43.440427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:43.440629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/f8bf87ff8624407296c3016a2e67720e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:43.446674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8bf87ff8624407296c3016a2e67720e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:43.449042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:43.452695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1747/3531] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:43 2022] GET /identity/v3/projects/f8bf87ff8624407296c3016a2e67720e => generated 357 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:43.457043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:43.480565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b5be2-db03-4809-b0f3-4e682eae35cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:43.493731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:43.494630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:43.495077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:43.495529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/f8bf87ff8624407296c3016a2e67720e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:43.513863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8bf87ff8624407296c3016a2e67720e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:43.529291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:43.623842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=94,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:43.646127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8bf87ff8624407296c3016a2e67720e', 'request_id': 'req-d2864ebe-3322-4cda-9663-ac7ef67363ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:43.704195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8bf87ff8624407296c3016a2e67720e', 'request_id': 'req-d2864ebe-3322-4cda-9663-ac7ef67363ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:43.731239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8bf87ff8624407296c3016a2e67720e', 'request_id': 'req-d2864ebe-3322-4cda-9663-ac7ef67363ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:43.766140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project f8bf87ff8624407296c3016a2e67720e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:43.766947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:43.767894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:43.779052 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1785/3532] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:43 2022] DELETE /identity/v3/projects/f8bf87ff8624407296c3016a2e67720e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:43.780275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:43.782471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:43.816689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73d01-a0a9-4b57-8a3f-64967a4571de tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:43.921936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:43.922762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:43.924832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:43.925395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:43.926552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:43.930353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:44.021753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1748/3533] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:43 2022] POST /identity/v3/projects => generated 361 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:44.022111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:44.033980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864ebe-3322-4cda-9663-ac7ef67363ee tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:44.171252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ddd2a-f919-423d-b7be-c9f7c49597eb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:44.173086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ddd2a-f919-423d-b7be-c9f7c49597eb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:44.173364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ddd2a-f919-423d-b7be-c9f7c49597eb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:44.178275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ddd2a-f919-423d-b7be-c9f7c49597eb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/6512b292070945e5b001c9394726ebdb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:44.182762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ddd2a-f919-423d-b7be-c9f7c49597eb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=6512b292070945e5b001c9394726ebdb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:44.184967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ddd2a-f919-423d-b7be-c9f7c49597eb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:44.193394 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1786/3534] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:44 2022] GET /identity/v3/projects/6512b292070945e5b001c9394726ebdb => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:44.196150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:44.214885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df328b0e-04f5-4304-b9a8-b82495cad2e0 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:44.236601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:44.237422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:44.237838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:44.238670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/6512b292070945e5b001c9394726ebdb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:44.241249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6512b292070945e5b001c9394726ebdb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:44.248297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:44.276948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:44.277976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:44.278465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:44.368835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] MFA Rules not processed for user `3188e7be5b534714a76bc578112df550`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:44.370478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:44.470867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6512b292070945e5b001c9394726ebdb', 'request_id': 'req-ae771f9e-7de7-478f-98b7-adce2b5d2d20'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:44.490134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6512b292070945e5b001c9394726ebdb', 'request_id': 'req-ae771f9e-7de7-478f-98b7-adce2b5d2d20'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:44.517054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6512b292070945e5b001c9394726ebdb', 'request_id': 'req-ae771f9e-7de7-478f-98b7-adce2b5d2d20'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:44.549980 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1787/3535] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:44.569758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:44.573225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:44.579088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 6512b292070945e5b001c9394726ebdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:44.582189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:44.586283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:44.593317 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1749/3536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:44 2022] DELETE /identity/v3/projects/6512b292070945e5b001c9394726ebdb => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:44.602195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:44.609530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:44.653409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:44.733963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5306-31fd-4efa-919e-bbc138d560d7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:44.749869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:44.784628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae771f9e-7de7-478f-98b7-adce2b5d2d20 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:44.805092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:44.806270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:44.806748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:44.807186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:44.808051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:44.811379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:44.865636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:44.866917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:44.867530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:44.882676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:44.886437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:44.913815 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1750/3537] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:24:44 2022] POST /identity/v3/projects => generated 348 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:44.921236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:44.969041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:44.970986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:44.984405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1788/3538] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:24:45.053559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045bef-ecf1-4f11-9a72-9cdd0adf85e7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:45.061819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:45.062986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:45.064084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:45.064563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/45997916ee8f4cc4a44d86487936d77d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:45.066081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=45997916ee8f4cc4a44d86487936d77d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:45.068559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:45.073034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1751/3539] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:44 2022] GET /identity/v3/projects/45997916ee8f4cc4a44d86487936d77d => generated 348 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:45.076980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:45.091885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ee4a8-e196-40ce-b7f3-c42e58613957 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:45.097296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:45.098064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:45.098645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:45.099169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/45997916ee8f4cc4a44d86487936d77d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:45.101116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45997916ee8f4cc4a44d86487936d77d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:45.103381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:45.176696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45997916ee8f4cc4a44d86487936d77d', 'request_id': 'req-115eebe6-1243-4a90-b92e-2972cf50ab99'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:45.186441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45997916ee8f4cc4a44d86487936d77d', 'request_id': 'req-115eebe6-1243-4a90-b92e-2972cf50ab99'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:45.198136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45997916ee8f4cc4a44d86487936d77d', 'request_id': 'req-115eebe6-1243-4a90-b92e-2972cf50ab99'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:45.220739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 45997916ee8f4cc4a44d86487936d77d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:45.221045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:45.221761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:45.223742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1789/3540] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:45 2022] DELETE /identity/v3/projects/45997916ee8f4cc4a44d86487936d77d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:45.229380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:45.240555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:45.273062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66743d82-1fe6-4473-a101-ecf87d5faf08 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:45.392319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:45.393258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:45.394681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:45.395094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:45.396956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:45.400617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:45.437305 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1752/3541] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:24:45 2022] POST /identity/v3/domains => generated 276 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:45.441165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:45.454764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115eebe6-1243-4a90-b92e-2972cf50ab99 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:45.613988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:45.638997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:45.639824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:45.640295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:45.640641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:45.641352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:45.643394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:45.699345 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1790/3542] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:45 2022] POST /identity/v3/projects => generated 404 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:45.703196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:45.714749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772970a-b205-43d5-91b5-36bf6b1d8faa tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:45.766921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:45.815957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:45.817124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:45.817633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:45.818180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/102806f99b3b490bb92dc8c323456879` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:45.820989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=102806f99b3b490bb92dc8c323456879)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:45.823763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:45.836486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1753/3543] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:45 2022] GET /identity/v3/projects/102806f99b3b490bb92dc8c323456879 => generated 404 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:45.841492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:45.861340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803882eb-5f20-4d98-b511-551f8f34b1f5 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:45.876778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:45.877459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:45.877740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:45.878015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/102806f99b3b490bb92dc8c323456879` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:45.879912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=102806f99b3b490bb92dc8c323456879)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:45.888625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:46.065806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102806f99b3b490bb92dc8c323456879', 'request_id': 'req-7b41baa0-83f3-4e1f-ac60-437725365e8b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.080487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102806f99b3b490bb92dc8c323456879', 'request_id': 'req-7b41baa0-83f3-4e1f-ac60-437725365e8b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.098554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102806f99b3b490bb92dc8c323456879', 'request_id': 'req-7b41baa0-83f3-4e1f-ac60-437725365e8b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.120796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 102806f99b3b490bb92dc8c323456879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:46.121088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.121767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.123349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1791/3544] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:45 2022] DELETE /identity/v3/projects/102806f99b3b490bb92dc8c323456879 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:46.127920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:46.129981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:46.159233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d109305-f908-4e40-9150-8aa92b4cadfd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:46.332954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:46.333623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:46.333912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:46.334217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains/ce4be4e0eeed483596d800f89b09a59a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:46.340630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ce4be4e0eeed483596d800f89b09a59a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:46.344895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:46.405891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.407996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.465061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.466289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.479368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:46.494569 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1754/3545] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:46 2022] PATCH /identity/v3/domains/ce4be4e0eeed483596d800f89b09a59a => generated 277 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:46.497828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41baa0-83f3-4e1f-ac60-437725365e8b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:46.712412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:46.716385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:46.716900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:46.720423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains/ce4be4e0eeed483596d800f89b09a59a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:46.753349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ce4be4e0eeed483596d800f89b09a59a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:46.757851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:46.808005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.812693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.837884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:46.926048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a', 'request_id': 'req-1441b6b5-50a5-4284-a055-a5df2f41ed5f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.969882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a', 'request_id': 'req-1441b6b5-50a5-4284-a055-a5df2f41ed5f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:46.977676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a', 'request_id': 'req-1441b6b5-50a5-4284-a055-a5df2f41ed5f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:47.004057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project ce4be4e0eeed483596d800f89b09a59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:47.004419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:47.005444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:47.026846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a', 'request_id': 'req-1441b6b5-50a5-4284-a055-a5df2f41ed5f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:47.031344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a', 'request_id': 'req-1441b6b5-50a5-4284-a055-a5df2f41ed5f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:47.032240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ce4be4e0eeed483596d800f89b09a59a', 'request_id': 'req-1441b6b5-50a5-4284-a055-a5df2f41ed5f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:47.056714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:47.057680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1792/3546] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:46 2022] DELETE /identity/v3/domains/ce4be4e0eeed483596d800f89b09a59a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:47.058661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:47.086724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26258d9-5a7a-4ca6-9d3c-19cc3448994e tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:47.204032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:47.204756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:47.205086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:47.205375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:47.206124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:47.211086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:47.254032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:47.256010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:47.262302 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1755/3547] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:24:47 2022] POST /identity/v3/domains => generated 276 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:47.277208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b6b5-50a5-4284-a055-a5df2f41ed5f tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:47.457173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:47.457827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:47.458509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:47.458800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:47.460781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:47.463569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:47.575299 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1793/3548] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:47 2022] POST /identity/v3/projects => generated 410 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:47.580127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:47.607333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e28a3e-cd51-4529-b1f4-c02a37436c87 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:47.712004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:47.779981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:47.780541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:47.780832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:47.781171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:47.781848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:47.783900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:47.918781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:47.931330 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1756/3549] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:47 2022] POST /identity/v3/projects => generated 405 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:47.935243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba61e6f-4483-4b73-a7fb-1f758c2ece49 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:48.097170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:48.101483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:48.101784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:48.102075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/97c0115b4d554b639cdb10fac3c20fc5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:48.105778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97c0115b4d554b639cdb10fac3c20fc5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:48.107947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:48.111975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:48.303315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c0115b4d554b639cdb10fac3c20fc5', 'request_id': 'req-2a1e8da2-c9c7-4c70-8717-89f91fb38785'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.313287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c0115b4d554b639cdb10fac3c20fc5', 'request_id': 'req-2a1e8da2-c9c7-4c70-8717-89f91fb38785'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.330016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c0115b4d554b639cdb10fac3c20fc5', 'request_id': 'req-2a1e8da2-c9c7-4c70-8717-89f91fb38785'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.365658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 97c0115b4d554b639cdb10fac3c20fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:48.366798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.374707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a1e8da2-c9c7-4c70-8717-89f91fb38785 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.380710 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1794/3550] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:47 2022] DELETE /identity/v3/projects/97c0115b4d554b639cdb10fac3c20fc5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:48.385674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:48.388370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:48.423257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaa533-4240-4368-bd4a-3783451bc069 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:48.602648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:48.602648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:48.602648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:48.607525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/6e96b690923c4d53b2e728fe003d3c7f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:48.611128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e96b690923c4d53b2e728fe003d3c7f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:48.619589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:48.780773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e96b690923c4d53b2e728fe003d3c7f', 'request_id': 'req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.802648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e96b690923c4d53b2e728fe003d3c7f', 'request_id': 'req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.812159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:48.812668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:48.812838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:48.825159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e96b690923c4d53b2e728fe003d3c7f', 'request_id': 'req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.856191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 6e96b690923c4d53b2e728fe003d3c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:48.859643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.860972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] MFA Rules not processed for user `3188e7be5b534714a76bc578112df550`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:48.861431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:48.867626 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1757/3551] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:48 2022] DELETE /identity/v3/projects/6e96b690923c4d53b2e728fe003d3c7f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:48.872371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:48.874736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:48.876358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:48.991933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:49.020417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ddeb9-eed4-434e-8eb2-f903e27820bb tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:49.033858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:49.034878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:49.035270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:49.035652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains/36743492d33f417f9043fe3cb4d69f2a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:49.037059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=36743492d33f417f9043fe3cb4d69f2a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:49.039757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:49.071507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.074004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.082132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1795/3552] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:24:49.113981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.114978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.122458 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1758/3553] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:48 2022] PATCH /identity/v3/domains/36743492d33f417f9043fe3cb4d69f2a => generated 277 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:49.123199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:49.138730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fbf2a-6a74-42ab-901d-f7da2de64324 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:49.293032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:49.293711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:49.294001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:49.294310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains/36743492d33f417f9043fe3cb4d69f2a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:49.364536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=36743492d33f417f9043fe3cb4d69f2a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:49.382282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:49.454290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.463282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.468324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:49.576532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a', 'request_id': 'req-3a2907aa-231c-4b59-8102-15b7cfe9016c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.589969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a', 'request_id': 'req-3a2907aa-231c-4b59-8102-15b7cfe9016c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.604674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a', 'request_id': 'req-3a2907aa-231c-4b59-8102-15b7cfe9016c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.639489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 36743492d33f417f9043fe3cb4d69f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:49.639848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.640541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.651657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a', 'request_id': 'req-3a2907aa-231c-4b59-8102-15b7cfe9016c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.703079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a', 'request_id': 'req-3a2907aa-231c-4b59-8102-15b7cfe9016c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.707148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '36743492d33f417f9043fe3cb4d69f2a', 'request_id': 'req-3a2907aa-231c-4b59-8102-15b7cfe9016c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:49.730519 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1796/3554] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:49 2022] DELETE /identity/v3/domains/36743492d33f417f9043fe3cb4d69f2a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:49.731145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:49.734449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:49.773971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30312a0-46e1-442e-bc4a-5d3563e054ca tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:50.062097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:50.066333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:50.070738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:50.070738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:50.070738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:50.075066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:50.199160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:50.201642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:50.213164 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1759/3555] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:49 2022] POST /identity/v3/projects => generated 375 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:50.228775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2907aa-231c-4b59-8102-15b7cfe9016c tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:50.419542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:50.421990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:50.422609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:50.425411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/d63cb02c56454be59e5c4c9c3fa5d85e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:50.431232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=d63cb02c56454be59e5c4c9c3fa5d85e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:50.434250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:50.442336 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1797/3556] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:50 2022] GET /identity/v3/projects/d63cb02c56454be59e5c4c9c3fa5d85e => generated 375 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:50.445082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:50.487907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9959-1a47-481f-be64-7687acd79d24 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:50.517748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:50.520765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:50.521164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:50.523870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:50.526252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:50.534818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:50.590301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:50.598301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1760/3557] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:24:50 2022] GET /identity/v3/projects => generated 6572 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:24:50.603956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6a9b7-7190-4b24-9cdc-b777592ae3d6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:50.633495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:50.634179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:50.634470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:50.634750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/d63cb02c56454be59e5c4c9c3fa5d85e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:50.636034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d63cb02c56454be59e5c4c9c3fa5d85e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:50.637969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:50.830356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63cb02c56454be59e5c4c9c3fa5d85e', 'request_id': 'req-69fabfc2-bcbd-4549-b6df-eebca74168f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:50.868542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63cb02c56454be59e5c4c9c3fa5d85e', 'request_id': 'req-69fabfc2-bcbd-4549-b6df-eebca74168f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:50.894707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63cb02c56454be59e5c4c9c3fa5d85e', 'request_id': 'req-69fabfc2-bcbd-4549-b6df-eebca74168f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:50.907652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:50.935639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project d63cb02c56454be59e5c4c9c3fa5d85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:50.935967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:50.938573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:50.942605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1798/3558] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:50 2022] DELETE /identity/v3/projects/d63cb02c56454be59e5c4c9c3fa5d85e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:50.948942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:50.951055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:50.985953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882236f-3619-4416-947d-dd1f5ed97a68 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:51.182762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:51.188472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:51.191191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:51.191581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:51.195239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:51.198229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:51.322619 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1761/3559] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:24:50 2022] POST /identity/v3/projects => generated 347 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:51.326580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:51.346788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabfc2-bcbd-4549-b6df-eebca74168f6 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:51.583021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:51.583918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:51.584293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:51.585206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/d443a9a3a94b42b1921e59d351323331` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:51.587220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:update_project(project_id=d443a9a3a94b42b1921e59d351323331)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:51.589399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:51.675198 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1799/3560] 10.222.0.23 () {60 vars in 1252 bytes} [Mon Oct 31 05:24:51 2022] PATCH /identity/v3/projects/d443a9a3a94b42b1921e59d351323331 => generated 362 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:51.680948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:51.701945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a434ac9-97ec-46b1-bc5d-6a09c95206cc tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:51.719250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:51.720123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:51.725022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:51.734400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/d443a9a3a94b42b1921e59d351323331` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:51.740258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:51.773833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=d443a9a3a94b42b1921e59d351323331)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:51.776149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:51.780985 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1762/3561] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:51 2022] GET /identity/v3/projects/d443a9a3a94b42b1921e59d351323331 => generated 349 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:51.789280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:51.806800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bad60d-9632-4217-b6a0-e8f953749fe4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:51.816146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:51.816948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:51.817336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:51.817717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/d443a9a3a94b42b1921e59d351323331` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:51.822385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d443a9a3a94b42b1921e59d351323331)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:51.825419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:51.937041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd443a9a3a94b42b1921e59d351323331', 'request_id': 'req-83a0f949-53b3-4695-83a9-ec236e844d60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:51.955987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd443a9a3a94b42b1921e59d351323331', 'request_id': 'req-83a0f949-53b3-4695-83a9-ec236e844d60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:51.967131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd443a9a3a94b42b1921e59d351323331', 'request_id': 'req-83a0f949-53b3-4695-83a9-ec236e844d60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:51.996492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project d443a9a3a94b42b1921e59d351323331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:51.997281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:52.000065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:52.005895 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1800/3562] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:51 2022] DELETE /identity/v3/projects/d443a9a3a94b42b1921e59d351323331 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:52.008245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:52.010226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:52.034263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02697f-1166-4db1-b8c1-29f4350b82e9 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:52.198732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:52.200642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:52.201034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:52.201410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:52.202237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:52.204313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:52.296081 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1763/3563] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:52 2022] POST /identity/v3/projects => generated 361 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:24:52.297763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:52.322861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f949-53b3-4695-83a9-ec236e844d60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:52.455903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:52.466374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4b0c7-6518-4994-9145-256566af39d7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:52.467028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b0c7-6518-4994-9145-256566af39d7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:52.467288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b0c7-6518-4994-9145-256566af39d7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:52.467582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b0c7-6518-4994-9145-256566af39d7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/35aa3e29d7be43ffa4e68cfa6026221d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:52.469262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4b0c7-6518-4994-9145-256566af39d7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:update_project(project_id=35aa3e29d7be43ffa4e68cfa6026221d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:52.473706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4b0c7-6518-4994-9145-256566af39d7 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:52.591344 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1801/3564] 10.222.0.23 () {60 vars in 1252 bytes} [Mon Oct 31 05:24:52 2022] PATCH /identity/v3/projects/35aa3e29d7be43ffa4e68cfa6026221d => generated 373 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:52.595254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:52.612272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c7b08-fd10-4821-86b4-0193c4bf4e90 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:52.630088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:52.630859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:52.631533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:52.631838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/35aa3e29d7be43ffa4e68cfa6026221d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:52.674833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=35aa3e29d7be43ffa4e68cfa6026221d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:52.679422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:52.679824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:52.680172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:52.684036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:52.690193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1764/3565] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:52 2022] GET /identity/v3/projects/35aa3e29d7be43ffa4e68cfa6026221d => generated 360 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:52.693347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:52.740027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e0dbb-0c27-445b-8062-01bef4676706 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:52.746287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] MFA Rules not processed for user `c31c5fd9a05b4a82963d5a1e630a2e61`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:52.753860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:52.778379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:52.780821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:52.781733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:52.782138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/35aa3e29d7be43ffa4e68cfa6026221d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:52.788264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35aa3e29d7be43ffa4e68cfa6026221d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:52.797166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:52.915238 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1802/3566] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:52.943720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35aa3e29d7be43ffa4e68cfa6026221d', 'request_id': 'req-cb6bede6-9c6c-435e-8139-0eeaf57238f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:52.977449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35aa3e29d7be43ffa4e68cfa6026221d', 'request_id': 'req-cb6bede6-9c6c-435e-8139-0eeaf57238f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:52.995198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35aa3e29d7be43ffa4e68cfa6026221d', 'request_id': 'req-cb6bede6-9c6c-435e-8139-0eeaf57238f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:53.020822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 35aa3e29d7be43ffa4e68cfa6026221d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:53.021482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:53.024183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:53.030137 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1765/3567] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:52 2022] DELETE /identity/v3/projects/35aa3e29d7be43ffa4e68cfa6026221d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:53.034675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:53.062528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821d66-b408-4f28-9979-6fa057859ee7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:53.247694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:53.248346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:53.248629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:53.248904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:53.249544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:53.251442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:53.358621 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1803/3568] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:53 2022] POST /identity/v3/projects => generated 353 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:24:53.360789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:53.363044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:53.391960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bede6-9c6c-435e-8139-0eeaf57238f4 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:53.579556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:53.611436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:53.612166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:53.612465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:53.612905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/78e7dcb6f77041249ba3ef62aa9a6e63` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:53.614296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:update_project(project_id=78e7dcb6f77041249ba3ef62aa9a6e63)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:53.615463 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:24:53.615463 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:24:53.615463 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:24:53.617873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:53.686190 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1766/3569] 10.222.0.23 () {60 vars in 1252 bytes} [Mon Oct 31 05:24:53 2022] PATCH /identity/v3/projects/78e7dcb6f77041249ba3ef62aa9a6e63 => generated 367 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:53.692217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:53.716854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1740afc-338f-4a00-a49a-3d655ebb1b60 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:53.737129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:53.737826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:53.738887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:53.739076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/78e7dcb6f77041249ba3ef62aa9a6e63` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:53.775071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:get_project(project_id=78e7dcb6f77041249ba3ef62aa9a6e63)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:53.783414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:53.795540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1804/3570] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:24:53 2022] GET /identity/v3/projects/78e7dcb6f77041249ba3ef62aa9a6e63 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:53.796592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:53.819826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b889a-7858-4ef3-a874-fd09360f0930 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:53.827182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:53.828009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:53.828547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:53.828937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/projects/78e7dcb6f77041249ba3ef62aa9a6e63` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:53.831394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78e7dcb6f77041249ba3ef62aa9a6e63)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:53.837049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:53.935839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e7dcb6f77041249ba3ef62aa9a6e63', 'request_id': 'req-180512e8-7fbf-4827-942d-06751d256fbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:53.943006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e7dcb6f77041249ba3ef62aa9a6e63', 'request_id': 'req-180512e8-7fbf-4827-942d-06751d256fbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:53.953929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e7dcb6f77041249ba3ef62aa9a6e63', 'request_id': 'req-180512e8-7fbf-4827-942d-06751d256fbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:53.993201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] The token cache is being invalidate because project 78e7dcb6f77041249ba3ef62aa9a6e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:53.999134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.002070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.008994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1767/3571] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:53 2022] DELETE /identity/v3/projects/78e7dcb6f77041249ba3ef62aa9a6e63 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:54.021713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:54.039076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:54.111875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd567-4444-4dfd-a9a0-49d9c5a94c7a tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:54.228757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:54.310930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:54.311644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:54.312091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:54.312710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains/36743492d33f417f9043fe3cb4d69f2a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:54.327547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Could not find domain: 36743492d33f417f9043fe3cb4d69f2a.: keystone.exception.DomainNotFound: Could not find domain: 36743492d33f417f9043fe3cb4d69f2a. Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 36743492d33f417f9043fe3cb4d69f2a. Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:54.335972 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:54.337151 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 36743492d33f417f9043fe3cb4d69f2a. Oct 31 05:24:54.339306 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:24:54.340395 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1805/3572] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:54 2022] PATCH /identity/v3/domains/36743492d33f417f9043fe3cb4d69f2a => generated 112 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:54.342509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:54.357399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180512e8-7fbf-4827-942d-06751d256fbd tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:54.362660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0cee9f44af44cf9897fb167decc8fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306b0e6810764a3da3f5a7f6d32e32c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:54.363452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:54.363769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:54.364055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] PATH_INFO: `/v3/domains/ce4be4e0eeed483596d800f89b09a59a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:54.373369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:24:54.386921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:54.392084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Could not find domain: ce4be4e0eeed483596d800f89b09a59a.: keystone.exception.DomainNotFound: Could not find domain: ce4be4e0eeed483596d800f89b09a59a. Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ce4be4e0eeed483596d800f89b09a59a. Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:24:54.413125 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:24:54.414829 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ce4be4e0eeed483596d800f89b09a59a. Oct 31 05:24:54.416105 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:24:54.417322 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1768/3573] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:24:54 2022] PATCH /identity/v3/domains/ce4be4e0eeed483596d800f89b09a59a => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:24:54.427908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:54.432617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:54.558179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ac24-492f-41c4-92e5-5a08da7fdd42 tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:54.582786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:54.583428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:54.583766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:54.584054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:54.589507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:54.602457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0b12-1f20-455c-b47e-93ece2abff2b tempest-ProjectsTestJSON-1311129228 tempest-ProjectsTestJSON-1311129228-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:54.608656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:54.609608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:54.609891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:54.610204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] PATH_INFO: `/v3/users/54d42647578a44bba06ba670f9d5b7b2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:54.611543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d42647578a44bba06ba670f9d5b7b2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:54.616279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:54.617852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:54.622011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486afafe-3027-44dc-a41b-b6803c9e7ffc service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:54.645669 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1806/3574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:24:54.739725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:54.762711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d42647578a44bba06ba670f9d5b7b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.810037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d42647578a44bba06ba670f9d5b7b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.812896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d42647578a44bba06ba670f9d5b7b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.814847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d42647578a44bba06ba670f9d5b7b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.835599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d42647578a44bba06ba670f9d5b7b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:54.861376 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1769/3575] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:54 2022] DELETE /identity/v3/users/54d42647578a44bba06ba670f9d5b7b2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:24:54.864661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:54.865393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:54.865393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:54.908573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:54.915141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:55.123785 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1807/3576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:55.152740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:55.155554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:55.367314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202e15c-6cd3-4d00-8e7e-7be3e5e02058 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:55.375693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:55.376584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:55.377018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:55.379230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:55.391728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:55.394294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:55.422093 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1770/3577] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:24:57.363004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:57.364892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:57.389753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a9f4-a00b-418c-ad22-7c3c6b78380d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:57.394947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:57.395619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:57.403701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:57.404226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] PATH_INFO: `/v3/projects/5197169727594b3c99a98149c141e6bd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:57.407516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5197169727594b3c99a98149c141e6bd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:57.411480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:57.513631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5197169727594b3c99a98149c141e6bd', 'request_id': 'req-0389d400-ce90-4de7-a5c7-8217749aafe2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.526918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5197169727594b3c99a98149c141e6bd', 'request_id': 'req-0389d400-ce90-4de7-a5c7-8217749aafe2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.541320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5197169727594b3c99a98149c141e6bd', 'request_id': 'req-0389d400-ce90-4de7-a5c7-8217749aafe2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.560432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] The token cache is being invalidate because project 5197169727594b3c99a98149c141e6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:57.560737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.561432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.564252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1808/3578] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:57 2022] DELETE /identity/v3/projects/5197169727594b3c99a98149c141e6bd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:57.568182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:57.580089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f9df8-cc65-4261-abfa-f041b32182ad service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:57.701083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:57.703059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:57.704340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:57.705319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] PATH_INFO: `/v3/users/fa0cee9f44af44cf9897fb167decc8fc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:57.707764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0cee9f44af44cf9897fb167decc8fc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:57.713743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:57.855061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0cee9f44af44cf9897fb167decc8fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.900136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0cee9f44af44cf9897fb167decc8fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.900798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0cee9f44af44cf9897fb167decc8fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.901432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0cee9f44af44cf9897fb167decc8fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.933692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9349de10-a716-420f-ae8a-c41177b8a328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0cee9f44af44cf9897fb167decc8fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:57.937631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:57.978984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1771/3579] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:24:57 2022] DELETE /identity/v3/users/fa0cee9f44af44cf9897fb167decc8fc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:59.253016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:59.254555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:59.297730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:24:59.309693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389d400-ce90-4de7-a5c7-8217749aafe2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:59.430515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:59.433271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:59.433861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:59.434394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] PATH_INFO: `/v3/projects/306b0e6810764a3da3f5a7f6d32e32c1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:59.435856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306b0e6810764a3da3f5a7f6d32e32c1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:59.438176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:59.593098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306b0e6810764a3da3f5a7f6d32e32c1', 'request_id': 'req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:59.605544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306b0e6810764a3da3f5a7f6d32e32c1', 'request_id': 'req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:59.624003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306b0e6810764a3da3f5a7f6d32e32c1', 'request_id': 'req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:59.639912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] The token cache is being invalidate because project 306b0e6810764a3da3f5a7f6d32e32c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:24:59.640213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:59.640926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76d18eb5-9ba2-4cf5-8ac1-50bc9565f836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:24:59.643557 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1809/3580] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:24:59 2022] DELETE /identity/v3/projects/306b0e6810764a3da3f5a7f6d32e32c1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:24:59.649279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:59.649784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:59.650399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:59.675816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:59.677238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:59.769681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1772/3581] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:59.778795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:59.779082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:59.779421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:59.826670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:24:59.829094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:24:59.857809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:59.858233 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1810/3582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:24:59.888232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f929fe-3e9c-4a0b-bb2b-3c49c8f47074 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:59.902174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:59.908955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:59.909365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:59.909725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:59.912086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:24:59.912086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:59.914104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:24:59.940037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:24:59.945308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1773/3583] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:24:59.953828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501610ad-d8d3-43b9-beb3-26eac95d8f66 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:24:59.965826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:24:59.966682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:24:59.967072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:24:59.967453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:24:59.970992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:24:59.973044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:00.046418 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1811/3584] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:24:59 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:00.050414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:00.062393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4275f2-37a0-4b4b-a073-9a2b80dff8f8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:00.208256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:00.209185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:00.209814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:00.210388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:00.211514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:00.216250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:00.266960 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1774/3585] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:00 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:00.271228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:00.286439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b69bac-9a0a-41c6-b520-4a5154cf6312 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:00.296911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:00.298529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:00.298916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:00.299338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:00.301022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:00.304781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:00.327733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1812/3586] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:00.333556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:00.349366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f422f-5254-4afb-baed-7b515351d29f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:00.357191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7661-8fbf-4b32-a17c-c7d92008f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:00.358031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7661-8fbf-4b32-a17c-c7d92008f986 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:00.358540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7661-8fbf-4b32-a17c-c7d92008f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:00.359004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7661-8fbf-4b32-a17c-c7d92008f986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:00.359826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d7661-8fbf-4b32-a17c-c7d92008f986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:00.362013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d7661-8fbf-4b32-a17c-c7d92008f986 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:00.385638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1775/3587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:00.389623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:00.405057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd069fb1-fd9b-4edf-a91f-a2feb3d84a44 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:00.417037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:00.423546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:00.424597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:00.425759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] PATH_INFO: `/v3/projects/8348c9280747474ea14ba5767d27e21a/users/cfdc779a1b094c898fbdaae317a74ef2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:00.467415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8348c9280747474ea14ba5767d27e21a, user_id=cfdc779a1b094c898fbdaae317a74ef2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:00.471533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:00.492020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1813/3588] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:00 2022] PUT /identity/v3/projects/8348c9280747474ea14ba5767d27e21a/users/cfdc779a1b094c898fbdaae317a74ef2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:00.502959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:00.503262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:00.503541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:00.573100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] MFA Rules not processed for user `cfdc779a1b094c898fbdaae317a74ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:00.575519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:00.673571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:00.743567 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1776/3589] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:00.747635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:00.823923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:00.936829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0392-dce7-4da1-b009-1820aa7001bc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:00.969419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:00.969847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:00.970350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:00.971511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:00.971511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:00.973507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.041532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1814/3590] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:00 2022] POST /identity/v3/projects => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:01.043037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.063106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5beb9-1ab6-498d-8c25-02bd591763f4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.220305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.221126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.221691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.222062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.222916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.225013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.285865 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1777/3591] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:01 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:01.292024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.308261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc024cfd-6200-40d7-abde-13026ee2abc7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.315862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.316517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.316802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.317987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.318923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.321774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.341959 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1815/3592] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:01.346089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.357674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d4085-a2e0-4654-a137-03f3f28b557f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.367416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.367798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.368004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.368284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] PATH_INFO: `/v3/projects/52e83d8d7dca4b9697c0edd399dc4b4e/users/0e2f52b5a83c48368913fe0d025f7baa/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.399043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e83d8d7dca4b9697c0edd399dc4b4e, user_id=0e2f52b5a83c48368913fe0d025f7baa, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.401215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.433149 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1778/3593] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:01 2022] PUT /identity/v3/projects/52e83d8d7dca4b9697c0edd399dc4b4e/users/0e2f52b5a83c48368913fe0d025f7baa/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:01.434915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.453803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fd7d0-02b9-4bb5-8e31-013d80433130 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.540036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0facf-9ca2-4827-8453-0aaeeba6e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.540825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0facf-9ca2-4827-8453-0aaeeba6e82a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.541381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0facf-9ca2-4827-8453-0aaeeba6e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.542237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0facf-9ca2-4827-8453-0aaeeba6e82a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.544038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0facf-9ca2-4827-8453-0aaeeba6e82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.546570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0facf-9ca2-4827-8453-0aaeeba6e82a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.562721 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1816/3594] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:01.564229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.578059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131281d-4d4c-4ae5-bb86-3a95c7c3abda admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.585311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.586012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.586692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.586692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] PATH_INFO: `/v3/projects/52e83d8d7dca4b9697c0edd399dc4b4e/users/0e2f52b5a83c48368913fe0d025f7baa/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.589254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e83d8d7dca4b9697c0edd399dc4b4e, user_id=0e2f52b5a83c48368913fe0d025f7baa, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.598787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.611974 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1779/3595] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:01 2022] PUT /identity/v3/projects/52e83d8d7dca4b9697c0edd399dc4b4e/users/0e2f52b5a83c48368913fe0d025f7baa/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:01.624489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.624954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.625359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.701200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] MFA Rules not processed for user `0e2f52b5a83c48368913fe0d025f7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:01.710082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:01.826453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1817/3596] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:01.831774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.848473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654fbc-0b34-43e2-a93f-aa42c90058e4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.854881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.855818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.856551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.857024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.857880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.859401 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:01.859401 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:25:01.859401 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:25:01.861343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.890532 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1780/3597] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:25:01 2022] POST /identity/v3/services => generated 239 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:01.892060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:01.904688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d7b5-fc17-4a97-a15a-88b748a527da None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:01.937618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:01.938538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:01.939090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:01.939499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/2814c37d3e904c6c88d45ca06c7db8c9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:01.940222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2814c37d3e904c6c88d45ca06c7db8c9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:01.941635 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:01.941635 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:25:01.941635 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:25:01.942931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:01.958982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:01.993800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1818/3598] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:01 2022] DELETE /identity/v3/services/2814c37d3e904c6c88d45ca06c7db8c9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:01.995210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.008216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bef39-3e60-4bdb-8b5a-a9d005c6a70c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.058904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.059552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.059844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.060126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.060807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.065997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.098873 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1781/3599] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:01 2022] POST /identity/v3/services => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:02.103008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.125276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f3e3-be2b-45d6-9215-dde8cceb6741 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.160092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.161024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.161578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.161956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/0df90687a4e54097bdf6e4de43f41024` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.162914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:update_service(service_id=0df90687a4e54097bdf6e4de43f41024)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.164333 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:02.164333 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:25:02.164333 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:25:02.165541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.198971 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1819/3600] 10.222.0.23 () {60 vars in 1252 bytes} [Mon Oct 31 05:25:02 2022] PATCH /identity/v3/services/0df90687a4e54097bdf6e4de43f41024 => generated 282 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:25:02.200387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.216257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce30c9-13e1-4258-a25a-b42e0f9a27f6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.236321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.237316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.237702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.238085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/0df90687a4e54097bdf6e4de43f41024` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.238833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:get_service(service_id=0df90687a4e54097bdf6e4de43f41024)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.243182 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:02.243182 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:25:02.243182 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:25:02.245530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.259079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1782/3601] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:25:02 2022] GET /identity/v3/services/0df90687a4e54097bdf6e4de43f41024 => generated 282 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:02.268198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.284189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752a73-76ef-43e8-9a48-53f200516b90 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.291258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.292519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.292519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.293169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/0df90687a4e54097bdf6e4de43f41024` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.295905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0df90687a4e54097bdf6e4de43f41024)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.297937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.332091 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1820/3602] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:02 2022] DELETE /identity/v3/services/0df90687a4e54097bdf6e4de43f41024 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:02.337362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.363932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69409b-00bf-4630-9f41-8052d12479c1 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.413804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.415044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.415669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.416140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/0df90687a4e54097bdf6e4de43f41024` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.416937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:get_service(service_id=0df90687a4e54097bdf6e4de43f41024)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.419065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Could not find service: 0df90687a4e54097bdf6e4de43f41024.: keystone.exception.ServiceNotFound: Could not find service: 0df90687a4e54097bdf6e4de43f41024. Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 0df90687a4e54097bdf6e4de43f41024. Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:25:02.456223 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:25:02.457606 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 0df90687a4e54097bdf6e4de43f41024. Oct 31 05:25:02.458857 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:25:02.468862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1783/3603] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:25:02 2022] GET /identity/v3/services/0df90687a4e54097bdf6e4de43f41024 => generated 113 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:25:02.475843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.492850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da1aed-945d-483a-a4e2-43f44679082c tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.510882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.511793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.512314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.512810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.513766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.515261 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:02.515261 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:25:02.515261 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:25:02.516685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aafe8f-2b93-47c9-8c18-abb7443df7b2 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.551892 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1821/3604] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:02 2022] POST /identity/v3/services => generated 274 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:02.556223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.581030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9be22-87ac-4d02-bfe0-446d9426c6e3 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.623159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.623824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.624063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.624505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.626619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.638919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.655795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.656392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.656736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.661665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:02.675773 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1784/3605] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:02 2022] POST /identity/v3/services => generated 274 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:02.681967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.695745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:02.697113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:02.721314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741e461-4068-4cf2-8385-4301e66fb863 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.726952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.727592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.727881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.728165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.728824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.730487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.754178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1785/3606] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:02 2022] POST /identity/v3/services => generated 274 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:02.755125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.779582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d148-0601-4918-ab2b-90287be442b9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.785238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.785871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.786264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.786549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.787167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.788495 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:02.788495 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:25:02.788495 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:25:02.789403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.810318 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1786/3607] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:25:02 2022] GET /identity/v3/services => generated 2977 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:02.822062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1822/3608] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:02.884368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.898576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe9dc0-db50-4525-b5c9-6cd0914d5e2d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.904364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.905811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.906344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.906781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.907594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1586022771) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:02.908052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.910360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.922321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1787/3609] 10.222.0.23 () {58 vars in 1222 bytes} [Mon Oct 31 05:25:02 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1586022771 => generated 417 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:02.922715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.943479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302936-8cd3-462e-bd77-fe25e164470c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:02.950409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:02.951745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:02.951745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:02.951745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:02.953040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-182587002) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:02.954053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:02.954598 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:02.954598 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:25:02.954598 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:25:02.955753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:02.966627 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1823/3610] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Oct 31 05:25:02 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-182587002 => generated 416 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:02.982744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:02.999943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27189c52-66aa-40dd-9345-320a97179ee4 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:03.008652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:03.015757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:03.016171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:03.017336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:03.017710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2130186191) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:03.018244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:03.020351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:03.031592 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1788/3611] 10.222.0.23 () {58 vars in 1222 bytes} [Mon Oct 31 05:25:02 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2130186191 => generated 417 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:03.034906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:03.050040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d715e0e-b9db-4b97-b1af-6f15b22ee036 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:03.056079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:03.057073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:03.057467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:03.057875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/07cb629ec4ac4908b0efef4b2dfb3ce1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:03.058807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:delete_service(service_id=07cb629ec4ac4908b0efef4b2dfb3ce1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:03.060891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:03.152432 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1824/3612] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:03 2022] DELETE /identity/v3/services/07cb629ec4ac4908b0efef4b2dfb3ce1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:03.156829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:03.212622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899badd7-bc75-49f4-9385-92ac6d800ed7 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:03.267197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:03.268069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:03.269250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:03.269693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/fe4af9ac79094f2796b663ec5dbfe96c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:03.271153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fe4af9ac79094f2796b663ec5dbfe96c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:03.272366 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:25:03.272366 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:25:03.272366 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:25:03.281360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:03.347275 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1789/3613] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:03 2022] DELETE /identity/v3/services/fe4af9ac79094f2796b663ec5dbfe96c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:03.351789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:03.366941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8663b36-f6d2-470c-bc92-df03c39b098d tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:03.387191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4288890-41a4-4459-99a9-9f76ddb222e9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e2f52b5a83c48368913fe0d025f7baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e83d8d7dca4b9697c0edd399dc4b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:03.387909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288890-41a4-4459-99a9-9f76ddb222e9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:03.389608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288890-41a4-4459-99a9-9f76ddb222e9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:03.390964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288890-41a4-4459-99a9-9f76ddb222e9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] PATH_INFO: `/v3/services/898bec8fe8ff4de8ae4cb81c6ee3f53d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:03.400019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4288890-41a4-4459-99a9-9f76ddb222e9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorizing `identity:delete_service(service_id=898bec8fe8ff4de8ae4cb81c6ee3f53d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:03.403014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4288890-41a4-4459-99a9-9f76ddb222e9 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:03.434178 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1825/3614] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:03 2022] DELETE /identity/v3/services/898bec8fe8ff4de8ae4cb81c6ee3f53d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:03.440588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:03.602652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762e3c0-688e-43aa-b20d-aabfe94655d6 tempest-ServicesTestJSON-103653028 tempest-ServicesTestJSON-103653028-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:03.638291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:03.639027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:03.639442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:03.639737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] PATH_INFO: `/v3/users/cfdc779a1b094c898fbdaae317a74ef2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:03.641025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdc779a1b094c898fbdaae317a74ef2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:03.643116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:03.726863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdc779a1b094c898fbdaae317a74ef2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:03.732114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:03.742711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdc779a1b094c898fbdaae317a74ef2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:03.746642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdc779a1b094c898fbdaae317a74ef2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:03.748342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdc779a1b094c898fbdaae317a74ef2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:03.764757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdc779a1b094c898fbdaae317a74ef2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:03.809602 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1790/3615] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:03 2022] DELETE /identity/v3/users/cfdc779a1b094c898fbdaae317a74ef2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:03.814990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:03.814990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:03.814990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:03.895921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:03.901343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:03.942329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:04.020223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1826/3616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:04.037254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:04.040528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:04.175426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad438944-32f9-46e6-a7c3-405a25860341 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:04.181275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:04.182103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:04.182761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:04.183163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:04.195004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:04.196691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:04.208322 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1791/3617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:05.367635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:05.371183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:05.398752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c978d5c-328c-4351-965a-190c50ebc2e3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:05.404501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:05.406873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:05.414339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:05.415115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:05.415505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:05.417881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] PATH_INFO: `/v3/users/98da4b117139423aa99f3597de54c56b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:05.420504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98da4b117139423aa99f3597de54c56b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:05.424962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:05.432583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e5470-1ded-43f6-acd5-108731bcb4dc service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:05.443384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:05.447586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:05.447881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:05.448159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] PATH_INFO: `/v3/projects/8348c9280747474ea14ba5767d27e21a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:05.455786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8348c9280747474ea14ba5767d27e21a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:05.462103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:05.548619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98da4b117139423aa99f3597de54c56b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.561929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8348c9280747474ea14ba5767d27e21a', 'request_id': 'req-1ac11d58-606c-4162-92ba-8c14924f977b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.569994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8348c9280747474ea14ba5767d27e21a', 'request_id': 'req-1ac11d58-606c-4162-92ba-8c14924f977b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.583808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8348c9280747474ea14ba5767d27e21a', 'request_id': 'req-1ac11d58-606c-4162-92ba-8c14924f977b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.592355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98da4b117139423aa99f3597de54c56b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.593375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98da4b117139423aa99f3597de54c56b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.594533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98da4b117139423aa99f3597de54c56b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.601480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] The token cache is being invalidate because project 8348c9280747474ea14ba5767d27e21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:05.601695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.603348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.605908 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1792/3618] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:05 2022] DELETE /identity/v3/projects/8348c9280747474ea14ba5767d27e21a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:05.607318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98da4b117139423aa99f3597de54c56b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.610213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:05.628485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:05.634527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1827/3619] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:05 2022] DELETE /identity/v3/users/98da4b117139423aa99f3597de54c56b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:05.705204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:05.729160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11d58-606c-4162-92ba-8c14924f977b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:05.803700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:05.804745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:05.805235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:05.805619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] PATH_INFO: `/v3/users/0e2f52b5a83c48368913fe0d025f7baa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:05.807059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2f52b5a83c48368913fe0d025f7baa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:05.809202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:05.868204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2f52b5a83c48368913fe0d025f7baa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.882376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2f52b5a83c48368913fe0d025f7baa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.883386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2f52b5a83c48368913fe0d025f7baa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.884065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2f52b5a83c48368913fe0d025f7baa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.892642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40f155ec-820d-49b6-bc49-e0a11aa5bd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2f52b5a83c48368913fe0d025f7baa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:05.917388 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1793/3620] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:05 2022] DELETE /identity/v3/users/0e2f52b5a83c48368913fe0d025f7baa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:06.242099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:06.244177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:06.278967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268850-3184-4561-9fd5-082d47d8bc06 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:06.446832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:06.447541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:06.448002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:06.449838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] PATH_INFO: `/v3/projects/42a10fcdbd9c42518b28ca8a2d9b7c1a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:06.454070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a10fcdbd9c42518b28ca8a2d9b7c1a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:06.457024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:06.518596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:06.534608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a10fcdbd9c42518b28ca8a2d9b7c1a', 'request_id': 'req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:06.544116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a10fcdbd9c42518b28ca8a2d9b7c1a', 'request_id': 'req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:06.552881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a10fcdbd9c42518b28ca8a2d9b7c1a', 'request_id': 'req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:06.580189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] The token cache is being invalidate because project 42a10fcdbd9c42518b28ca8a2d9b7c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:06.580790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:06.582503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3a18bbc-8aa0-4baa-9cc7-ab27761a23f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:06.587581 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1828/3621] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:06 2022] DELETE /identity/v3/projects/42a10fcdbd9c42518b28ca8a2d9b7c1a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:06.599557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:06.600813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:06.601321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:06.641155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:06.642572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:06.741256 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1794/3622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:06.742861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:06.743753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:06.744281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:06.773826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:06.775147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:06.785154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1829/3623] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:06.789037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:06.800154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa1e8-07fa-4cfb-ac1f-afd312595f2e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:06.807478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:06.808269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:06.808648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:06.809021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:06.810348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:06.810348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:06.812986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:06.825851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:06.840314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1795/3624] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:06.844720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:06.860330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c0ab8-55d9-4bc6-9766-2cdc366e1035 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:06.871104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:06.873582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:06.874027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:06.874584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:06.876756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:06.882185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:06.923739 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1830/3625] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:06 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:06.925269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:06.936125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72ac5-c9fb-4032-ade4-e4a10214817f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.026378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.027605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.028594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.029272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.030470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.032838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.052001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.054002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:07.075677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575870-823f-4b4a-8d31-f828adda3baa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.082194 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1796/3626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:06 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:25:07.084312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.085504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.086380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.086752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.087140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] PATH_INFO: `/v3/projects/52e83d8d7dca4b9697c0edd399dc4b4e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.088576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e83d8d7dca4b9697c0edd399dc4b4e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.099147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.106550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd53e3-0737-4ca0-8af8-b24cec80bfb4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.150079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.151158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.151547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.152159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.153448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.156275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.198761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e83d8d7dca4b9697c0edd399dc4b4e', 'request_id': 'req-24beecd6-a3b3-4c19-94af-76dcc5a053f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:07.208593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1797/3627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:07.211023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.216441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e83d8d7dca4b9697c0edd399dc4b4e', 'request_id': 'req-24beecd6-a3b3-4c19-94af-76dcc5a053f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:07.228898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e83d8d7dca4b9697c0edd399dc4b4e', 'request_id': 'req-24beecd6-a3b3-4c19-94af-76dcc5a053f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:07.275361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ec21-fdaf-4fc5-9550-6e62ce566544 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.276076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] The token cache is being invalidate because project 52e83d8d7dca4b9697c0edd399dc4b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:07.277062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:07.279231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-24beecd6-a3b3-4c19-94af-76dcc5a053f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:07.293626 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1831/3628] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:07 2022] DELETE /identity/v3/projects/52e83d8d7dca4b9697c0edd399dc4b4e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:07.299870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4553749-8f84-4d72-8f44-e37e1d8a0ac3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.300524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4553749-8f84-4d72-8f44-e37e1d8a0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.301709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4553749-8f84-4d72-8f44-e37e1d8a0ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.357990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f4553749-8f84-4d72-8f44-e37e1d8a0ac3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:07.359529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f4553749-8f84-4d72-8f44-e37e1d8a0ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:07.426499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.429032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.430005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.430005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.431777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.436679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.462184 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1798/3629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:07.464274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.467204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:07.485120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2b80-e6f2-4d90-87eb-bb36737dc7b0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.490031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8adcd0-e1f3-4a15-b864-feb63d52663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.490881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8adcd0-e1f3-4a15-b864-feb63d52663d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.491301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8adcd0-e1f3-4a15-b864-feb63d52663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.491767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8adcd0-e1f3-4a15-b864-feb63d52663d admin admin] PATH_INFO: `/v3/projects/1595b5f2b68346b18796f3613fc87b52/users/f3e6d4615d8444f1b7d4013f732cc7cf/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.523866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8adcd0-e1f3-4a15-b864-feb63d52663d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1595b5f2b68346b18796f3613fc87b52, user_id=f3e6d4615d8444f1b7d4013f732cc7cf, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.527562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8adcd0-e1f3-4a15-b864-feb63d52663d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.556456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1799/3630] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:07 2022] PUT /identity/v3/projects/1595b5f2b68346b18796f3613fc87b52/users/f3e6d4615d8444f1b7d4013f732cc7cf/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:07.557782 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1832/3631] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:07.566294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.566516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.566938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.567486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.567622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.568016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.594200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:07.595746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:07.611366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:07.612621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:07.644838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:07.666571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:07.692813 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1800/3632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:07.715381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.719796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:07.737438 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1833/3633] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:07.739494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.753098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e00bc-02e2-4adc-ab21-654d30898bd6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.761973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.762721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.763003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.764837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.764837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:07.764837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.765948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.786243 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1834/3634] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:25:07.788689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.801033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8faea-7b62-4e43-9f8f-42420379b320 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:07.821750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:07.822643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:07.823098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:07.823876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:07.826464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:07.831309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:07.908506 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1835/3635] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:07 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:07.912798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:07.941683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187da1c-4207-4f1f-bd31-7b560556e7c8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.089364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314328-1522-4244-bbde-5d22589bed19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.090320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314328-1522-4244-bbde-5d22589bed19 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.091019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314328-1522-4244-bbde-5d22589bed19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.092226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314328-1522-4244-bbde-5d22589bed19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.099484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061866-a29f-4b6f-80b1-2e85b158591e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.106101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314328-1522-4244-bbde-5d22589bed19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.107944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314328-1522-4244-bbde-5d22589bed19 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.109057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.109747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.110037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.110345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.115151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.121242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.123974 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1801/3636] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:08.126312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198c2-abf6-4136-90b2-77906be7665c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.127652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198c2-abf6-4136-90b2-77906be7665c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.128183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198c2-abf6-4136-90b2-77906be7665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.156078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-29d198c2-abf6-4136-90b2-77906be7665c None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:08.158238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-29d198c2-abf6-4136-90b2-77906be7665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:08.176196 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1836/3637] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:07 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:08.182067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.197058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff5df6-c3b8-4d28-866b-92f3647d297b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.204530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.205555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.206099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.207296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.208258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.210930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.226234 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1837/3638] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:08.228995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.244737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd838-1d4b-4907-9d4e-52ed7589dad3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.262346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.267013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.267627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.268269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.269230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.273187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.291549 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1838/3639] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:08.295412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.309744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682281f-3b61-4772-9d62-c9704421b519 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.316762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.317910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.319281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.319790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] PATH_INFO: `/v3/projects/67f1c7415acc42d9800f330de1836efc/users/024fd09fe85c42089302404bb87fb22e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.320103 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1802/3640] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:08.357332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c7415acc42d9800f330de1836efc, user_id=024fd09fe85c42089302404bb87fb22e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.360396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.411828 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1839/3641] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:08 2022] PUT /identity/v3/projects/67f1c7415acc42d9800f330de1836efc/users/024fd09fe85c42089302404bb87fb22e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:08.421065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.421503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.422529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.427471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.437219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:08.483777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] MFA Rules not processed for user `024fd09fe85c42089302404bb87fb22e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:08.485924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:08.497938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:08.550166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:08.595123 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1803/3642] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:08.599970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.624698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af26b-dfdf-4217-b2ff-a87c67980fd8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.642834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.644028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.644314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.646520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.675221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd82e6-10ab-4340-9457-062cd95765b5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.683777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.684236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.684592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.684968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.685697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.687903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.740129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1804/3643] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:08 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:25:08.746043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.820701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.822355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.845250 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1840/3644] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:25:08.890456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317385a-f0e0-48f9-9741-49f1b8680070 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.899254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.900095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.900390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.901188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.901996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.904036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.942924 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1805/3645] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:08 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:08.947855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:08.964007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc355e0-41c9-4ebe-a480-c516c23a029e service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:08.969158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:08.969850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:08.970263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:08.970684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:08.971398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:08.973511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:08.992907 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1841/3646] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:08.994255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:09.012747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62688da-0f8d-47b8-bfcb-18d7bb0d8075 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:09.019530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf261-86e8-4938-b4f3-9a385a944fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:09.020233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf261-86e8-4938-b4f3-9a385a944fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:09.020626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf261-86e8-4938-b4f3-9a385a944fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:09.028371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf261-86e8-4938-b4f3-9a385a944fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:09.029448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bf261-86e8-4938-b4f3-9a385a944fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:09.032129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bf261-86e8-4938-b4f3-9a385a944fc5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:09.047453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1806/3647] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:09.052283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:09.079366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7479f2-e3f0-455d-a52a-d878b5a57cac admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:09.084558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:09.085530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:09.085911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:09.086323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] PATH_INFO: `/v3/projects/e8938fd062874080a5728e94628ec96a/users/0605f702b8974434bd522abaac4e53c4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:09.115378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8938fd062874080a5728e94628ec96a, user_id=0605f702b8974434bd522abaac4e53c4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:09.118803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:09.148705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1842/3648] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:09 2022] PUT /identity/v3/projects/e8938fd062874080a5728e94628ec96a/users/0605f702b8974434bd522abaac4e53c4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:09.161906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ada49-65db-4ff6-9730-16ad3cc298a1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:09.163264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ada49-65db-4ff6-9730-16ad3cc298a1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:09.163711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ada49-65db-4ff6-9730-16ad3cc298a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:09.249306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-030ada49-65db-4ff6-9730-16ad3cc298a1 None None] MFA Rules not processed for user `0605f702b8974434bd522abaac4e53c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:09.250507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-030ada49-65db-4ff6-9730-16ad3cc298a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:09.326123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:09.425634 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1807/3649] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:09.431700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:09.581478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5a980-6dc8-4dcf-904b-6ddbfe593c4e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:09.596863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b064a-95a8-48ec-8a45-ad2755dbb37d tempest-IdentityV3ProjectsTest-1810545253 tempest-IdentityV3ProjectsTest-1810545253-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024fd09fe85c42089302404bb87fb22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f1c7415acc42d9800f330de1836efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:09.597862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b064a-95a8-48ec-8a45-ad2755dbb37d tempest-IdentityV3ProjectsTest-1810545253 tempest-IdentityV3ProjectsTest-1810545253-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:09.598270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b064a-95a8-48ec-8a45-ad2755dbb37d tempest-IdentityV3ProjectsTest-1810545253 tempest-IdentityV3ProjectsTest-1810545253-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:09.598662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b064a-95a8-48ec-8a45-ad2755dbb37d tempest-IdentityV3ProjectsTest-1810545253 tempest-IdentityV3ProjectsTest-1810545253-project] PATH_INFO: `/v3/users/024fd09fe85c42089302404bb87fb22e/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:09.601855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b064a-95a8-48ec-8a45-ad2755dbb37d tempest-IdentityV3ProjectsTest-1810545253 tempest-IdentityV3ProjectsTest-1810545253-project] RBAC: Authorizing `identity:list_user_projects(user_id=024fd09fe85c42089302404bb87fb22e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:09.604786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b064a-95a8-48ec-8a45-ad2755dbb37d tempest-IdentityV3ProjectsTest-1810545253 tempest-IdentityV3ProjectsTest-1810545253-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:09.688085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:09.728526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:09.729102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:09.729102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:09.739692 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1843/3650] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:25:09 2022] GET /identity/v3/users/024fd09fe85c42089302404bb87fb22e/projects => generated 517 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:09.786256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] MFA Rules not processed for user `024fd09fe85c42089302404bb87fb22e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:09.788061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:09.822161 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1808/3651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:09.823729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:09.824213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:09.824566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:09.867779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] MFA Rules not processed for user `024fd09fe85c42089302404bb87fb22e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:09.871456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:09.934269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.models.token_model [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] User 024fd09fe85c42089302404bb87fb22e has no access to project e8938fd062874080a5728e94628ec96a {{(pid=82000) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 31 05:25:09.938908 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.server.flask.application [None req-827c25ea-7d77-472a-92bd-6e94e1bec1c1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 05:25:09.942205 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1844/3652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:09 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 119 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 05:25:09.948737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:10.075068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602c0d-e098-4be2-8c04-4adec825d09c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:10.084518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:10.087607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:10.088228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:10.088741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] PATH_INFO: `/v3/users/024fd09fe85c42089302404bb87fb22e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:10.091189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=024fd09fe85c42089302404bb87fb22e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:10.094929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:10.230520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024fd09fe85c42089302404bb87fb22e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:10.244494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024fd09fe85c42089302404bb87fb22e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:10.245289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024fd09fe85c42089302404bb87fb22e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:10.246160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024fd09fe85c42089302404bb87fb22e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:10.256209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024fd09fe85c42089302404bb87fb22e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:10.315946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1809/3653] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:09 2022] DELETE /identity/v3/users/024fd09fe85c42089302404bb87fb22e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:10.317936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:10.318690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:10.319252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:10.360321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:10.361991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:10.505287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1845/3654] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:10.559402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:10.561718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:10.629813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:10.659664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b43d5-edbe-47c8-b15b-e94886fb3e9c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:10.665635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:10.666534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:10.666950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:10.667710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:10.682433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:10.684594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:10.701844 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1810/3655] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:12.150631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:12.156556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:12.186889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f55e70-5b25-4de0-82d5-e3951f4dbccc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:12.212428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:12.213006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:12.213295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:12.213592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] PATH_INFO: `/v3/projects/67f1c7415acc42d9800f330de1836efc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:12.215377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f1c7415acc42d9800f330de1836efc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:12.217306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:12.367567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f1c7415acc42d9800f330de1836efc', 'request_id': 'req-b7743f89-d16d-4745-a48c-a2ee2a1e420f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.375321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f1c7415acc42d9800f330de1836efc', 'request_id': 'req-b7743f89-d16d-4745-a48c-a2ee2a1e420f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.382090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f1c7415acc42d9800f330de1836efc', 'request_id': 'req-b7743f89-d16d-4745-a48c-a2ee2a1e420f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.399450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] The token cache is being invalidate because project 67f1c7415acc42d9800f330de1836efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:12.399745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.401645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.407630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:12.412448 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1846/3656] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:12 2022] DELETE /identity/v3/projects/67f1c7415acc42d9800f330de1836efc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:12.425378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5112a-f8a1-458b-a013-d58de6c78fca service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:12.550056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:12.551013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:12.551555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:12.552006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] PATH_INFO: `/v3/users/0605f702b8974434bd522abaac4e53c4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:12.585930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0605f702b8974434bd522abaac4e53c4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:12.591514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:12.741671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0605f702b8974434bd522abaac4e53c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.765782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0605f702b8974434bd522abaac4e53c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.767386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0605f702b8974434bd522abaac4e53c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.768218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0605f702b8974434bd522abaac4e53c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.797879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-172b2889-0f7c-4b87-80e8-a82003801726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0605f702b8974434bd522abaac4e53c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:12.862063 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1811/3657] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:12 2022] DELETE /identity/v3/users/0605f702b8974434bd522abaac4e53c4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:13.518387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:13.520423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:13.544370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7743f89-d16d-4745-a48c-a2ee2a1e420f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:13.613297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:13.687549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:13.688611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:13.689404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:13.690507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] PATH_INFO: `/v3/projects/e8938fd062874080a5728e94628ec96a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:13.695616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8938fd062874080a5728e94628ec96a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:13.700582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:13.803765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8938fd062874080a5728e94628ec96a', 'request_id': 'req-93ff179b-807c-441d-a08d-e71bf287c444'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:13.821870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8938fd062874080a5728e94628ec96a', 'request_id': 'req-93ff179b-807c-441d-a08d-e71bf287c444'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:13.835185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8938fd062874080a5728e94628ec96a', 'request_id': 'req-93ff179b-807c-441d-a08d-e71bf287c444'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:13.866021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] The token cache is being invalidate because project e8938fd062874080a5728e94628ec96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:13.867583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:13.869139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93ff179b-807c-441d-a08d-e71bf287c444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:13.876953 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1847/3658] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:13 2022] DELETE /identity/v3/projects/e8938fd062874080a5728e94628ec96a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:13.879007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960ef08-e947-45eb-8820-966890078892 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:13.882918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960ef08-e947-45eb-8820-966890078892 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:13.883678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960ef08-e947-45eb-8820-966890078892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:13.925326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e960ef08-e947-45eb-8820-966890078892 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:13.926709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e960ef08-e947-45eb-8820-966890078892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:14.043668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:14.070585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1812/3659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:14.076771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244882a-da09-42ee-a04a-4c514059369c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.080830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244882a-da09-42ee-a04a-4c514059369c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.082605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244882a-da09-42ee-a04a-4c514059369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.108066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c244882a-da09-42ee-a04a-4c514059369c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:14.110489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c244882a-da09-42ee-a04a-4c514059369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:14.124495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1848/3660] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:14.125299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960ef08-e947-45eb-8820-966890078892 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.142991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960ef08-e947-45eb-8820-966890078892 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.156241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.156942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.157228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.157499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.158195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:14.158492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.160096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.204357 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1813/3661] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:25:14.210741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244882a-da09-42ee-a04a-4c514059369c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.233737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244882a-da09-42ee-a04a-4c514059369c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.255577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.257738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.258680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.264265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.265888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.269125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.325290 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1849/3662] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:14 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:14.331054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.383504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc72-5924-46c1-929a-9589b9771ae7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.501919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.506624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.507888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.508394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.510484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.518718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.548928 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1814/3663] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:14 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:14.553192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.567488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ee14-0a69-4ddf-ab8d-4e2b01aebb7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.576286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.577520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.589464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.590160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.591123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.593478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.604580 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1850/3664] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:14.608919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.626907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc2cc-2a16-466d-ab19-92ba92d5e95d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.633543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.634471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.634914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.635381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] PATH_INFO: `/v3/projects/e1b01d9568894a2e9fed5a26fffbf37d/users/f48734300202459aa16806ed5ab9fa04/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.655191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b01d9568894a2e9fed5a26fffbf37d, user_id=f48734300202459aa16806ed5ab9fa04, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.658070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.689753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1815/3665] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:14 2022] PUT /identity/v3/projects/e1b01d9568894a2e9fed5a26fffbf37d/users/f48734300202459aa16806ed5ab9fa04/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:14.695056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.709173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bf87b-7bfb-40d1-a6b2-e050c4d57cb6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.806372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720fca7-018b-4382-b1ee-3de587b1d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.807027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fca7-018b-4382-b1ee-3de587b1d31f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.807787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fca7-018b-4382-b1ee-3de587b1d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.807787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fca7-018b-4382-b1ee-3de587b1d31f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.808528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720fca7-018b-4382-b1ee-3de587b1d31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.810230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720fca7-018b-4382-b1ee-3de587b1d31f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.825234 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1851/3666] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:14.826329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:14.839785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25f26f-23cc-48c4-97d8-183b3e21d37d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:14.844708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:14.845495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.845878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.846340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] PATH_INFO: `/v3/projects/e1b01d9568894a2e9fed5a26fffbf37d/users/f48734300202459aa16806ed5ab9fa04/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.848412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b01d9568894a2e9fed5a26fffbf37d, user_id=f48734300202459aa16806ed5ab9fa04, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:14.851305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:14.862630 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1816/3667] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:14 2022] PUT /identity/v3/projects/e1b01d9568894a2e9fed5a26fffbf37d/users/f48734300202459aa16806ed5ab9fa04/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:14.873894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:14.874212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:14.874493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:14.923562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] MFA Rules not processed for user `f48734300202459aa16806ed5ab9fa04`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:14.924963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:14.933609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:15.029555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:15.033698 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1852/3668] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:15.113641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f35c35-8f8a-4930-bac1-771bd1ffa0a6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:15.120324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:15.121021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:15.121411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:15.121791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:15.122595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:15.124668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:15.194994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1817/3669] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:15 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:15.199516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:15.219755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809888d-25f6-4e2f-8f3b-000f66960d60 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:15.331842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:15.334761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:15.335283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:15.335788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:15.336644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:15.338911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:15.371011 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1853/3670] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:15 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:15.375254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:15.392706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713575-e78f-47fa-846f-ac58a6f5761e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:15.398963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:15.401432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:15.402091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:15.402611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:15.403827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:15.405955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:15.420977 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1818/3671] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:15.424730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:15.444665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd50aa-4600-44cb-b9ed-2adfe500054d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:15.478801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e8c8c-ddc1-4074-8e76-fef9f85018d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:15.479460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e8c8c-ddc1-4074-8e76-fef9f85018d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:15.479749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e8c8c-ddc1-4074-8e76-fef9f85018d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:15.480022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e8c8c-ddc1-4074-8e76-fef9f85018d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:15.480683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e8c8c-ddc1-4074-8e76-fef9f85018d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:15.482546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e8c8c-ddc1-4074-8e76-fef9f85018d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:15.514742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1854/3672] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:15.515908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:15.532095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bd714-dc34-4983-b66f-81260aabd9d1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:15.547427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:15.548669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:15.549168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:15.551576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] PATH_INFO: `/v3/projects/c3817f602e4a4aa7a123fd4a8484c2fd/users/62c695e157654e4ba96166e3482cf957/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:15.578235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:15.594588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3817f602e4a4aa7a123fd4a8484c2fd, user_id=62c695e157654e4ba96166e3482cf957, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:15.597886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:15.631502 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1819/3673] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:15 2022] PUT /identity/v3/projects/c3817f602e4a4aa7a123fd4a8484c2fd/users/62c695e157654e4ba96166e3482cf957/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:15.643303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:15.643880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:15.643880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:15.707408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] MFA Rules not processed for user `62c695e157654e4ba96166e3482cf957`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:15.708751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:15.858298 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1855/3674] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:15.876150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:15.878052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:16.058642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23582d-437f-490c-b4b3-e8b87cde1394 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:16.067338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a1b2-c8ea-4bf9-874d-d281629e0506 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:16.067890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a1b2-c8ea-4bf9-874d-d281629e0506 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:16.069015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a1b2-c8ea-4bf9-874d-d281629e0506 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:16.069439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a1b2-c8ea-4bf9-874d-d281629e0506 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:16.211302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62a1b2-c8ea-4bf9-874d-d281629e0506 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:16.219770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62a1b2-c8ea-4bf9-874d-d281629e0506 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:16.254039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1820/3675] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:17.792797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:17.815789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:17.986182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795b42-ef21-4818-b8ed-4d529fdbd21a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:18.000943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:18.003389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:18.004406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:18.004789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] PATH_INFO: `/v3/users/f48734300202459aa16806ed5ab9fa04` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:18.009474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48734300202459aa16806ed5ab9fa04)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:18.022475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:18.114406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48734300202459aa16806ed5ab9fa04'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:18.128775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48734300202459aa16806ed5ab9fa04'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:18.129526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48734300202459aa16806ed5ab9fa04'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:18.130292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48734300202459aa16806ed5ab9fa04'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:18.142380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48734300202459aa16806ed5ab9fa04'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:18.177941 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1856/3676] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:17 2022] DELETE /identity/v3/users/f48734300202459aa16806ed5ab9fa04 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:18.180657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:18.181186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:18.181612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:18.229536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:18.236406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:18.391928 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1821/3677] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:18.466497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:18.468241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:18.581579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fa852-a872-4509-8017-6ccf69c9bf0f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:18.589718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:18.594744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:18.595336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:18.596162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:18.621559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:18.628518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:18.652349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1857/3678] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:20.472232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:20.475467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:20.497330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceba19-de43-4985-97d4-16a94e4a6ab3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:20.519211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:20.520656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:20.520946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:20.523162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] PATH_INFO: `/v3/projects/e1b01d9568894a2e9fed5a26fffbf37d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:20.527926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b01d9568894a2e9fed5a26fffbf37d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:20.531833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:20.571359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:20.625327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b01d9568894a2e9fed5a26fffbf37d', 'request_id': 'req-e3d1fbd4-51a2-47b8-9844-7746763e7d80'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.645627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b01d9568894a2e9fed5a26fffbf37d', 'request_id': 'req-e3d1fbd4-51a2-47b8-9844-7746763e7d80'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.653907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b01d9568894a2e9fed5a26fffbf37d', 'request_id': 'req-e3d1fbd4-51a2-47b8-9844-7746763e7d80'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.687203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] The token cache is being invalidate because project e1b01d9568894a2e9fed5a26fffbf37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:20.687505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.689521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e3d1fbd4-51a2-47b8-9844-7746763e7d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.694617 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1822/3679] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:20 2022] DELETE /identity/v3/projects/e1b01d9568894a2e9fed5a26fffbf37d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:20.695710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:20.713308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1285d-44d9-4566-a73b-72eaec070ed3 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:20.812846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:20.853858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:20.854543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:20.854826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:20.855295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] PATH_INFO: `/v3/users/62c695e157654e4ba96166e3482cf957` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:20.856404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c695e157654e4ba96166e3482cf957)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:20.859223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:20.928138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c695e157654e4ba96166e3482cf957'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.949427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c695e157654e4ba96166e3482cf957'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.950742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c695e157654e4ba96166e3482cf957'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.951381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c695e157654e4ba96166e3482cf957'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.964013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a9ef3f78-065c-4691-88c1-1f5de2e2bdaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c695e157654e4ba96166e3482cf957'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:20.991938 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1858/3680] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:20 2022] DELETE /identity/v3/users/62c695e157654e4ba96166e3482cf957 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:21.156425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:21.156714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:21.156996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:21.231238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] MFA Rules not processed for user `f3e6d4615d8444f1b7d4013f732cc7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:21.233402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:21.366677 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1823/3681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:21.377069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:21.377385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:21.377631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:21.400299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] MFA Rules not processed for user `f3e6d4615d8444f1b7d4013f732cc7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:21.401553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:21.414626 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1859/3682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:21.820089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:21.821826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:21.966783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25124-47f8-4ef3-8377-d9ffeae03315 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:21.972790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3e682-093d-478c-9100-da04ccdaed35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:21.973618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3e682-093d-478c-9100-da04ccdaed35 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:21.974041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3e682-093d-478c-9100-da04ccdaed35 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:21.975894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3e682-093d-478c-9100-da04ccdaed35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:21.984218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3e682-093d-478c-9100-da04ccdaed35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:21.986455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3e682-093d-478c-9100-da04ccdaed35 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:22.016097 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1824/3683] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:22.278712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:22.280663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:22.430261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829aa04-7904-4148-8fd0-05773b462b3a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:22.449125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:22.450134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:22.450543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:22.450916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] PATH_INFO: `/v3/projects/c3817f602e4a4aa7a123fd4a8484c2fd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:22.452239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3817f602e4a4aa7a123fd4a8484c2fd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:22.455505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:22.585994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:22.591452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3817f602e4a4aa7a123fd4a8484c2fd', 'request_id': 'req-616e752a-679e-4266-a15b-158a37b9c3f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:22.611218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3817f602e4a4aa7a123fd4a8484c2fd', 'request_id': 'req-616e752a-679e-4266-a15b-158a37b9c3f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:22.625643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3817f602e4a4aa7a123fd4a8484c2fd', 'request_id': 'req-616e752a-679e-4266-a15b-158a37b9c3f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:22.652382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] The token cache is being invalidate because project c3817f602e4a4aa7a123fd4a8484c2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:22.652833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:22.653516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-616e752a-679e-4266-a15b-158a37b9c3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:22.659981 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1860/3684] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:22 2022] DELETE /identity/v3/projects/c3817f602e4a4aa7a123fd4a8484c2fd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:22.661439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:22.662568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:22.662873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:22.710549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:22.711818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:22.745150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:22.824465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1825/3685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:22.833163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:22.833523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:22.834005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:22.875238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:22.877638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:22.891020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1861/3686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:22.895145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:22.906501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a105-96f8-4f1f-85b4-4c6fd5f13cc9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:22.912109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:22.913136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:22.913639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:22.914108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:22.915002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:22.915637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:22.917540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:22.933903 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1826/3687] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:22.938046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:22.964761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39d05-cf83-435c-9972-cbfc54f009ce None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:23.000887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:23.001535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:23.001818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:23.002521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:23.010037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:23.015075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:23.101170 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1862/3688] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:22 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:23.105082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:23.118102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7003c-0c3c-4608-b7e2-39e3ec405c29 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:23.263018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:23.263773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:23.264078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:23.264360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:23.265009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:23.274346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:23.317190 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1827/3689] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:23 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:23.322209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:23.344862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e95a8-5274-4801-a898-dc56f00d7b2e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:23.351508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:23.352369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:23.352846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:23.353938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:23.355701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:23.359521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:23.392788 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1863/3690] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:23.397023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:23.421605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf7d08-5526-46f2-b1f1-ff34cfb6a970 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:23.456298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35c233-6c46-445f-a8ae-d187bb327b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:23.458189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c233-6c46-445f-a8ae-d187bb327b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:23.462951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c233-6c46-445f-a8ae-d187bb327b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:23.463413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c233-6c46-445f-a8ae-d187bb327b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:23.465705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35c233-6c46-445f-a8ae-d187bb327b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:23.475388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35c233-6c46-445f-a8ae-d187bb327b2f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:23.521883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1828/3691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:23.523108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:23.539509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4405-ba6d-4d83-9599-8eb0b5efb9f1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:23.552286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:23.553162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:23.553605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:23.554023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] PATH_INFO: `/v3/projects/221f5a7ab9e14abe88f70fd9c7c50ef2/users/c56eba2b4fc1482c871d884b6a849316/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:23.580175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] RBAC: Authorizing `identity:create_grant(project_id=221f5a7ab9e14abe88f70fd9c7c50ef2, user_id=c56eba2b4fc1482c871d884b6a849316, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:23.583229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:23.645920 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1864/3692] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:23 2022] PUT /identity/v3/projects/221f5a7ab9e14abe88f70fd9c7c50ef2/users/c56eba2b4fc1482c871d884b6a849316/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:23.646992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:23.647291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:23.647570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:23.728374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] MFA Rules not processed for user `c56eba2b4fc1482c871d884b6a849316`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:23.729623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:23.858792 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1829/3693] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:23.885918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:23.888657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:24.053518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeddc1-0936-43a8-9e94-bb7ef15c925d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:24.060700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b92f4-084a-401b-8345-234e81170f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:24.061338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b92f4-084a-401b-8345-234e81170f98 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:24.061624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b92f4-084a-401b-8345-234e81170f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:24.062064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b92f4-084a-401b-8345-234e81170f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:24.084540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b92f4-084a-401b-8345-234e81170f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:24.085433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b92f4-084a-401b-8345-234e81170f98 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:24.109651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1865/3694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:24.225553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:24.247127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:24.346741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cca6c4-eefa-4c38-8ace-4d469b775940 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:24.354415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:24.355851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:24.356387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:24.356907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] PATH_INFO: `/v3/users/c56eba2b4fc1482c871d884b6a849316` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:24.359238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56eba2b4fc1482c871d884b6a849316)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:24.361623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:24.491793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56eba2b4fc1482c871d884b6a849316'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:24.511151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56eba2b4fc1482c871d884b6a849316'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:24.511800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56eba2b4fc1482c871d884b6a849316'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:24.513404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56eba2b4fc1482c871d884b6a849316'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:24.546750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56eba2b4fc1482c871d884b6a849316'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:24.611700 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1830/3695] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:24 2022] DELETE /identity/v3/users/c56eba2b4fc1482c871d884b6a849316 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:24.617046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:24.617578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:24.617578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:24.651836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:24.653614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:24.819446 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1866/3696] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:24.830686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:24.834224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:24.949833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff947b38-4576-4051-836d-2657061b1c0a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:24.958578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:24.958578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:24.958578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:24.958578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:24.968261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:24.969878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:24.998932 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1831/3697] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:25.876625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:25.878941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:25.935218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:25.940028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:25.941492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:25.969165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f80eb-8e74-4ac5-aaa2-60e251dfa058 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:25.985978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:25.986681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:25.986964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:25.987245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] PATH_INFO: `/v3/projects/221f5a7ab9e14abe88f70fd9c7c50ef2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:25.988586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221f5a7ab9e14abe88f70fd9c7c50ef2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:25.993085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:26.101905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:26.129477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf02d5-3983-49c1-b167-61b9210e4d3a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:26.134914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221f5a7ab9e14abe88f70fd9c7c50ef2', 'request_id': 'req-e68ed03a-11dd-4f35-99d5-e91ca2f55325'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:26.155265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221f5a7ab9e14abe88f70fd9c7c50ef2', 'request_id': 'req-e68ed03a-11dd-4f35-99d5-e91ca2f55325'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:26.175005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221f5a7ab9e14abe88f70fd9c7c50ef2', 'request_id': 'req-e68ed03a-11dd-4f35-99d5-e91ca2f55325'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:26.208332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] The token cache is being invalidate because project 221f5a7ab9e14abe88f70fd9c7c50ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:26.208658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:26.211912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e68ed03a-11dd-4f35-99d5-e91ca2f55325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:26.215431 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1832/3698] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:25 2022] DELETE /identity/v3/projects/221f5a7ab9e14abe88f70fd9c7c50ef2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:26.222263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c06521-eefe-4a0f-b28e-e8f45630580e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:26.222757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c06521-eefe-4a0f-b28e-e8f45630580e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:26.231287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c06521-eefe-4a0f-b28e-e8f45630580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:26.268145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-28c06521-eefe-4a0f-b28e-e8f45630580e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:26.269679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-28c06521-eefe-4a0f-b28e-e8f45630580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:26.356507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:26.357147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:26.357427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:26.357705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:26.364340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:26.411149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:26.413466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:26.438372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1833/3699] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:26.451803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:26.452295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:26.454003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:26.465732 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1867/3700] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:26.523422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:26.524673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:26.559751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1834/3701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:26.564206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:26.587640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a0a1-6c0a-412b-b2cc-f3ce46ba7864 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:26.602080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:26.602759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:26.603042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:26.603316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:26.607326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:26.607658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:26.612787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:26.644715 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1868/3702] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:26.650562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:26.671207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9205-b5c2-4262-88a8-daebc02d4a78 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:26.690445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:26.691100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:26.691384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:26.691663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:26.692321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:26.698243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:26.799640 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1835/3703] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:26 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:26.801296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:26.819772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a83be-62fe-490e-bfd5-3e0007949a90 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:26.973017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:26.973667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:26.974031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:26.977603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:26.978473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:26.980965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:27.023018 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1869/3704] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:26 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:27.027198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:27.044293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537d342-1354-43a7-9caa-2c55bb66112d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:27.057277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:27.058414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:27.058760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:27.059132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:27.059985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:27.061670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:27.083290 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1836/3705] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:27.088504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:27.103776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49cc2f-af7f-480a-b25c-e10c66e61c54 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:27.108993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22244c-aa36-4e55-a6af-3107563bbb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:27.109661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22244c-aa36-4e55-a6af-3107563bbb3c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:27.109942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22244c-aa36-4e55-a6af-3107563bbb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:27.110257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22244c-aa36-4e55-a6af-3107563bbb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:27.110911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22244c-aa36-4e55-a6af-3107563bbb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:27.113147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22244c-aa36-4e55-a6af-3107563bbb3c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:27.134324 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1870/3706] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:27.137766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:27.158279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f54d-9eee-440f-8778-0e03eca5331f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:27.166708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:27.167420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:27.167698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:27.168170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] PATH_INFO: `/v3/projects/406e25dc13494b789fc70290bbe0220b/users/64715b11f2384d1587fee723e8c8befa/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:27.187573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=406e25dc13494b789fc70290bbe0220b, user_id=64715b11f2384d1587fee723e8c8befa, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:27.190446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:27.213514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1837/3707] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:27 2022] PUT /identity/v3/projects/406e25dc13494b789fc70290bbe0220b/users/64715b11f2384d1587fee723e8c8befa/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:27.225738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4bf83-c2c1-4a81-8c7a-4df609247c11 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:27.226229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4bf83-c2c1-4a81-8c7a-4df609247c11 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:27.226610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4bf83-c2c1-4a81-8c7a-4df609247c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:27.238439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:27.268933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b8c4bf83-c2c1-4a81-8c7a-4df609247c11 None None] MFA Rules not processed for user `64715b11f2384d1587fee723e8c8befa`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:27.270184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b8c4bf83-c2c1-4a81-8c7a-4df609247c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:27.365932 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1871/3708] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:27.387856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:27.390207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:27.487258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba448070-7ff5-4f9d-a756-19bac71afd8c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:27.492529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:27.493323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:27.494044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:27.494371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:27.504324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:27.506370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:27.511669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:27.524359 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1838/3709] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:29.475096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:29.475655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:29.475797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:29.517430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:29.523707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:29.670323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1872/3710] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:33.605246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:33.607262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:33.698252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0d63-e271-4213-ab76-5a3981584df6 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:33.704331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:33.705383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:33.705895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:33.706450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] PATH_INFO: `/v3/users/a4ba7cd8a0064bad86c7892272a11726` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:33.707875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ba7cd8a0064bad86c7892272a11726)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:33.710811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:33.806351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ba7cd8a0064bad86c7892272a11726'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:33.828133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ba7cd8a0064bad86c7892272a11726'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:33.829152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ba7cd8a0064bad86c7892272a11726'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:33.830114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ba7cd8a0064bad86c7892272a11726'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:33.842583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8da63f39-0233-4da5-815a-f30812d3e75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ba7cd8a0064bad86c7892272a11726'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:33.889227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1839/3711] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:33 2022] DELETE /identity/v3/users/a4ba7cd8a0064bad86c7892272a11726 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:34.683306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:34.712492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103efbf-8d78-46f4-b628-70b5f67fd60f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:34.851817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:34.852847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:34.854005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:34.854486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] PATH_INFO: `/v3/projects/aadf9e08ab6b4aa4a79ecde61d4870bf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:34.855976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadf9e08ab6b4aa4a79ecde61d4870bf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:34.858409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:34.864439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:34.866621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:34.867075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:34.891515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] MFA Rules not processed for user `b1f4529759354867a45d7f6bc0c8230d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:34.892657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:34.924642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:34.947712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadf9e08ab6b4aa4a79ecde61d4870bf', 'request_id': 'req-9bdd23b0-5b77-48af-8b30-24a9ef809505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:34.957247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadf9e08ab6b4aa4a79ecde61d4870bf', 'request_id': 'req-9bdd23b0-5b77-48af-8b30-24a9ef809505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:34.968066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadf9e08ab6b4aa4a79ecde61d4870bf', 'request_id': 'req-9bdd23b0-5b77-48af-8b30-24a9ef809505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:34.987964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] The token cache is being invalidate because project aadf9e08ab6b4aa4a79ecde61d4870bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:34.988434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:34.990573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:34.996770 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1873/3712] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:34 2022] DELETE /identity/v3/projects/aadf9e08ab6b4aa4a79ecde61d4870bf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:34.998310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:35.000425 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1840/3713] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:35.015943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:35.126924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd23b0-5b77-48af-8b30-24a9ef809505 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:35.132709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:35.133677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:35.133816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:35.134033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] PATH_INFO: `/v3/users/740db9f913084aa59fd3e4e6f3f472de` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:35.135861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740db9f913084aa59fd3e4e6f3f472de)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:35.137805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:35.265788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740db9f913084aa59fd3e4e6f3f472de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:35.289245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740db9f913084aa59fd3e4e6f3f472de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:35.290350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740db9f913084aa59fd3e4e6f3f472de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:35.291140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740db9f913084aa59fd3e4e6f3f472de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:35.300693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740db9f913084aa59fd3e4e6f3f472de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:35.323198 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1874/3714] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:34 2022] DELETE /identity/v3/users/740db9f913084aa59fd3e4e6f3f472de => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:36.179128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:36.182019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:36.197539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:36.304304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c0bc4-3d32-48fd-866a-c4089142ef86 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:36.389347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:36.392814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:36.418736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:36.419966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:36.420864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:36.422346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:36.425717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:36.450059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:36.452567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:36.467405 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1841/3715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:36.485161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:36.540162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75527c-c97b-4408-a28f-960c13dcde43 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:36.548118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:36.548818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:36.549247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:36.549524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] PATH_INFO: `/v3/users/c31c5fd9a05b4a82963d5a1e630a2e61` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:36.551746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31c5fd9a05b4a82963d5a1e630a2e61)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:36.555360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:36.575430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:36.577069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:36.620701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107a137-fc6e-47ff-871d-3bc52b15e62d service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:36.647819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:36.648720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:36.649411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:36.649871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] PATH_INFO: `/v3/projects/c2b2e352367c4038bff41c5d75cad0c2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:36.655655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b2e352367c4038bff41c5d75cad0c2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:36.665581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:36.730732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31c5fd9a05b4a82963d5a1e630a2e61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.761051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31c5fd9a05b4a82963d5a1e630a2e61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.761879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31c5fd9a05b4a82963d5a1e630a2e61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.762744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31c5fd9a05b4a82963d5a1e630a2e61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.771652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2e2bec38-1e44-4ff9-89ca-5619967b9fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31c5fd9a05b4a82963d5a1e630a2e61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.797081 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1875/3716] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:36 2022] DELETE /identity/v3/users/c31c5fd9a05b4a82963d5a1e630a2e61 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:36.797432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b2e352367c4038bff41c5d75cad0c2', 'request_id': 'req-4dc47398-91ef-47c9-bf94-81700297506f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.805470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b2e352367c4038bff41c5d75cad0c2', 'request_id': 'req-4dc47398-91ef-47c9-bf94-81700297506f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.817101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b2e352367c4038bff41c5d75cad0c2', 'request_id': 'req-4dc47398-91ef-47c9-bf94-81700297506f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.831534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] The token cache is being invalidate because project c2b2e352367c4038bff41c5d75cad0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:36.831842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.832535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4dc47398-91ef-47c9-bf94-81700297506f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:36.834747 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1842/3717] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:36 2022] DELETE /identity/v3/projects/c2b2e352367c4038bff41c5d75cad0c2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:36.839303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:36.840132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:36.840132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:36.862020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:36.863090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:36.976564 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1876/3718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:36.985428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:36.985774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:36.985982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.033926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:37.035342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:37.051537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.069901 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1843/3719] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:37.074407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bcf11-a4af-435a-a5b9-96c5c116f464 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.079757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.080382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.080662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.080937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.081591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:37.082646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.085084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.108942 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1877/3720] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:37.109299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.121104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe592f-2ce8-4838-a211-65f5dcb43460 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.127032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.127837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.128952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.129443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.131014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.132914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.172339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:37.191687 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1844/3721] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:37 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:37.195225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.209504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cf2bd-7390-48fb-88f1-e92b7ea67984 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.300232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:37.323745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.324554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.324841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.325121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.325765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.328933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.366024 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1878/3722] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:37 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:37.367382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.383240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb99a5-bd34-4b74-be84-e594cf11add7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.413787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.415753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.415753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.415753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.432280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.435380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.453379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.454797 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1845/3723] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:37.466529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8606-e7b4-4881-9d3f-9f708610a469 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.476806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.477649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.477778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.478029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.478668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.485231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.510199 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1879/3724] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:37.511740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.525241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10e1e2-00ad-40f6-9907-de63bbd9d3c9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.532917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3084f6-cfd6-40f0-b7f2-2512c43d304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.533995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3084f6-cfd6-40f0-b7f2-2512c43d304e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.534571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3084f6-cfd6-40f0-b7f2-2512c43d304e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.535214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3084f6-cfd6-40f0-b7f2-2512c43d304e admin admin] PATH_INFO: `/v3/projects/b87eb1c13bdb4d99beb479e9c284c983/users/2512010236034319952ea34c2a76a96b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.556056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3084f6-cfd6-40f0-b7f2-2512c43d304e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87eb1c13bdb4d99beb479e9c284c983, user_id=2512010236034319952ea34c2a76a96b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.573532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3084f6-cfd6-40f0-b7f2-2512c43d304e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.589998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.594694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:37.608153 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1846/3725] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:37 2022] PUT /identity/v3/projects/b87eb1c13bdb4d99beb479e9c284c983/users/2512010236034319952ea34c2a76a96b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:37.611799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.612402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.612924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.625058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46bfcd-eb0d-4b16-bfe0-0c8730a992b8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:37.660821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:37.667822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:37.764813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:37.765860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.766454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.768511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] PATH_INFO: `/v3/projects/f5cb284f7d4f4577868af0fa8ec337d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.773960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cb284f7d4f4577868af0fa8ec337d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:37.777582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:37.798107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1847/3726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:37.837908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:37.840444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:37.856146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cb284f7d4f4577868af0fa8ec337d1', 'request_id': 'req-5caaf71f-014b-4a24-8287-19cf9b90f4d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:37.864428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cb284f7d4f4577868af0fa8ec337d1', 'request_id': 'req-5caaf71f-014b-4a24-8287-19cf9b90f4d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:37.876181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cb284f7d4f4577868af0fa8ec337d1', 'request_id': 'req-5caaf71f-014b-4a24-8287-19cf9b90f4d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:37.899153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] The token cache is being invalidate because project f5cb284f7d4f4577868af0fa8ec337d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:37.913571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:37.914548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5caaf71f-014b-4a24-8287-19cf9b90f4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:37.923205 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1880/3727] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:37 2022] DELETE /identity/v3/projects/f5cb284f7d4f4577868af0fa8ec337d1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:37.930246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0e0cd-77c4-4c4b-978e-c2bbbcf0cb4b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:37.930891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0e0cd-77c4-4c4b-978e-c2bbbcf0cb4b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:37.931398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0e0cd-77c4-4c4b-978e-c2bbbcf0cb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:37.960343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-64d0e0cd-77c4-4c4b-978e-c2bbbcf0cb4b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:37.961942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-64d0e0cd-77c4-4c4b-978e-c2bbbcf0cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:37.977860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c714d8-2f31-4734-a54f-fd537995ae19 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.075681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.076069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.076361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.076775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.079070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:38.095188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:38.143026 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1881/3728] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:38.148221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.148767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.149121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.183302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:38.235336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:38.239964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:38.251363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.252831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.273402 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1848/3729] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:38.292062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1882/3730] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:38.296285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.309848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7368ef-f231-4e7a-9bb6-a40e17108dda service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.314746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.315373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.315657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.315934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.316593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:38.316900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.319324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.335181 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1849/3731] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:25:38.339429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.356030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a964301-dd57-43b0-bc5d-f69260d90b5f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.365292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.366229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.366686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.367125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.367951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.370351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.418128 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1883/3732] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:38 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:38.420021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.431933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b6b8-5b7c-41a6-8feb-c90f8769ebe3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.546536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.547163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.547460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.547746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.548395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.550390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.616435 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1850/3733] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:38 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:38.621230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.644188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280970-ba99-4be7-ae19-a614683d54c3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.651564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.652378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.652766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.653217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.654374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.657103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.671313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1884/3734] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:38.675400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.687268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589d2d-616e-40fd-91fc-6b8a86198f64 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.692833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217f05-0957-4d64-a643-cb80aab9fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.693523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217f05-0957-4d64-a643-cb80aab9fa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.693948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217f05-0957-4d64-a643-cb80aab9fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.694322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217f05-0957-4d64-a643-cb80aab9fa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.695075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92217f05-0957-4d64-a643-cb80aab9fa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.696792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92217f05-0957-4d64-a643-cb80aab9fa39 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.714014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1851/3735] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:38.714465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.760633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b72dc1-7659-4f4a-b2dd-e32403c4a5d9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:38.773839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:38.774926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.776174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.776561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] PATH_INFO: `/v3/projects/1038634cc3ab468fa156c393bacbc932/users/03aebbee7e224b96830248fd9f0eb0bc/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.795535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1038634cc3ab468fa156c393bacbc932, user_id=03aebbee7e224b96830248fd9f0eb0bc, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:38.801094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:38.828510 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1885/3736] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:38 2022] PUT /identity/v3/projects/1038634cc3ab468fa156c393bacbc932/users/03aebbee7e224b96830248fd9f0eb0bc/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:38.834116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62594-3727-4c8b-a83b-8a63d255b496 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:38.834932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62594-3727-4c8b-a83b-8a63d255b496 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:38.834932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62594-3727-4c8b-a83b-8a63d255b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:38.874479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4fd62594-3727-4c8b-a83b-8a63d255b496 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:38.875979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4fd62594-3727-4c8b-a83b-8a63d255b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:38.972741 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1852/3737] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:38.983632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:38.985606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:39.053656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6916b12-3376-412f-94a1-9aa152ab25cf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:39.057588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e7426-27f1-477d-93a4-7bc5db38151b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:39.058258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e7426-27f1-477d-93a4-7bc5db38151b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:39.058515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e7426-27f1-477d-93a4-7bc5db38151b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:39.058783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e7426-27f1-477d-93a4-7bc5db38151b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:39.069712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e7426-27f1-477d-93a4-7bc5db38151b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:39.071473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e7426-27f1-477d-93a4-7bc5db38151b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:39.081989 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1886/3738] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:48.955403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:49.077680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:52.514079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f0688-12ae-469e-a248-a077c9233333 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:52.514558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f0688-12ae-469e-a248-a077c9233333 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:52.515193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f0688-12ae-469e-a248-a077c9233333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:52.550601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5b6f0688-12ae-469e-a248-a077c9233333 None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:52.553849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5b6f0688-12ae-469e-a248-a077c9233333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:52.683221 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1853/3739] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:52.761438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:52.762002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:52.762002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:52.814521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] MFA Rules not processed for user `3188e7be5b534714a76bc578112df550`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:52.821439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:52.970375 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1887/3740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:54.355454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:54.356432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:54.356929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:54.424283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] MFA Rules not processed for user `2512010236034319952ea34c2a76a96b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:54.425891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:54.606678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:54.608849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:54.643503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1854/3741] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:54.643820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d517a9-3b24-4a21-aed2-48cb377721ff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:54.647537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:54.650963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:54.667775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:54.669027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:54.669972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:54.673219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] PATH_INFO: `/v3/users/64715b11f2384d1587fee723e8c8befa` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:54.676241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64715b11f2384d1587fee723e8c8befa)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:54.681360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:54.692811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8233c3-ec5f-4405-9820-64ca88304b9b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:54.709576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:54.710229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:54.710504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:54.710778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:54.711430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:54.716991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:54.789281 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1855/3742] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:54 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:54.793000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:54.798677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64715b11f2384d1587fee723e8c8befa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:54.830053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64715b11f2384d1587fee723e8c8befa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:54.832334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64715b11f2384d1587fee723e8c8befa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:54.838903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64715b11f2384d1587fee723e8c8befa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:54.861272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34f7cac2-1f4e-423c-80d2-1cb4a9abde6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64715b11f2384d1587fee723e8c8befa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:54.895488 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1888/3743] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:25:54 2022] DELETE /identity/v3/users/64715b11f2384d1587fee723e8c8befa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:54.900195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:54.900638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:54.901169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:54.953020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:54.954704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:54.992406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a834aa3-b948-459e-ac69-6c86db7e3696 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.057128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:55.081349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1889/3744] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:55.095134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:55.096563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:55.120713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:55.237894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.238573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.238862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.239157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.240353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.242490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.256884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b780-6895-45a6-82a1-c04859a97100 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.269547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.271034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.271640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.272071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.312686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.316829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.317125 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1856/3745] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:54 2022] POST /identity/v3/users => generated 299 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:55.318126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:55.331576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:55.359911 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1890/3746] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:25:55.375334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71957-d4b7-46f9-be9a-301fdaecafaf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.398959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.399612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.399901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.400182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.400848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.402730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.426191 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1857/3747] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:25:55.430997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:55.447273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b5e8-8d60-44f2-a7d8-31f99d67f60c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.460871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.465558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.465957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.466270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] PATH_INFO: `/v3/projects/515fabf459b241bf97980e2bac960bab/users/69281416d1db40c991e25af0d9438aa2/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.512885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515fabf459b241bf97980e2bac960bab, user_id=69281416d1db40c991e25af0d9438aa2, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.524205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.565853 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1891/3748] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:55 2022] PUT /identity/v3/projects/515fabf459b241bf97980e2bac960bab/users/69281416d1db40c991e25af0d9438aa2/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:55.570354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:55.593272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ad4f-46bc-4474-a9d3-ab92a70f541d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.810055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.810866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.811009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.811368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.812803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.814583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.868045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:55.875750 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1858/3749] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:55.887805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af177632-719a-4ec0-8d80-907573642cf4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.894110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:55.897447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:55.912779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd4bcd-0fea-4e00-87ec-7bcd1662176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.913811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd4bcd-0fea-4e00-87ec-7bcd1662176a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.914223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd4bcd-0fea-4e00-87ec-7bcd1662176a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.915383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd4bcd-0fea-4e00-87ec-7bcd1662176a admin admin] PATH_INFO: `/v3/projects/515fabf459b241bf97980e2bac960bab/users/69281416d1db40c991e25af0d9438aa2/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.916944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81584032-9b05-4dc1-bb44-448deced954a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:55.920763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd4bcd-0fea-4e00-87ec-7bcd1662176a admin admin] RBAC: Authorizing `identity:create_grant(project_id=515fabf459b241bf97980e2bac960bab, user_id=69281416d1db40c991e25af0d9438aa2, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.924683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:55.925450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:55.925746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:55.926025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] PATH_INFO: `/v3/projects/406e25dc13494b789fc70290bbe0220b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:55.927734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406e25dc13494b789fc70290bbe0220b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:55.929827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd4bcd-0fea-4e00-87ec-7bcd1662176a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.930175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:55.966216 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1892/3750] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:55 2022] PUT /identity/v3/projects/515fabf459b241bf97980e2bac960bab/users/69281416d1db40c991e25af0d9438aa2/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:25:56.050183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406e25dc13494b789fc70290bbe0220b', 'request_id': 'req-7492340b-2e18-4295-89e9-f245a6796ae6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:56.076839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406e25dc13494b789fc70290bbe0220b', 'request_id': 'req-7492340b-2e18-4295-89e9-f245a6796ae6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:56.104045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406e25dc13494b789fc70290bbe0220b', 'request_id': 'req-7492340b-2e18-4295-89e9-f245a6796ae6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:56.154005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] The token cache is being invalidate because project 406e25dc13494b789fc70290bbe0220b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:25:56.154437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:56.155789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7492340b-2e18-4295-89e9-f245a6796ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:25:56.158664 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1859/3751] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:25:55 2022] DELETE /identity/v3/projects/406e25dc13494b789fc70290bbe0220b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:56.164407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:56.164729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:56.164999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:56.220107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:56.228690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:56.412331 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1893/3752] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:56.417853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:56.418421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:56.418508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:56.458124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:56.464056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:56.480078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1860/3753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:56.484165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:56.496723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36349c0-3ca5-494a-9929-1ca4bd13a9fb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:56.519966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:56.520812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:56.525464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:56.525787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:56.528638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:25:56.531555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:56.542600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:56.586997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:56.587494 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1894/3754] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:25:56.598652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255e68-5ff1-45eb-9dd4-0d25b10c4ed3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:56.615167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:56.615383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:56.615568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:56.615852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:56.619152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:56.626259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:56.654774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:56.730714 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1861/3755] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:25:56 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:56.730963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:56.749048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cceb-0905-4970-8ec2-219a5cacdf8f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:57.051521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:57.053732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.054328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.054800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.056157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:57.061994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:57.082125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:25:57.124281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1895/3756] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:25:56 2022] POST /identity/v3/users => generated 285 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:25:57.128718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:57.145208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df720-49af-4edb-9c84-4483c284f932 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:57.163073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:57.166912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.167199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.170791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.172533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:57.176638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:57.202116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:57.204607 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1862/3757] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:57.240853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b849a42-6a96-45db-afa0-ff83a927b717 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:57.257871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee0ddf-6611-4173-8822-9f5949b64e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:57.262004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee0ddf-6611-4173-8822-9f5949b64e07 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.262590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee0ddf-6611-4173-8822-9f5949b64e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.263773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee0ddf-6611-4173-8822-9f5949b64e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.264779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee0ddf-6611-4173-8822-9f5949b64e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:57.280010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee0ddf-6611-4173-8822-9f5949b64e07 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:57.314474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1896/3758] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:25:57.319737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:57.338716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8805d6-6d36-41e8-918b-aa36da9d94f5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:57.354565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:57.358065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.358476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.359918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] PATH_INFO: `/v3/projects/dce3824b75604fb4ab9db1c1b358555c/users/d2facd8a9d44488e9aaf3f135821d563/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.401081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce3824b75604fb4ab9db1c1b358555c, user_id=d2facd8a9d44488e9aaf3f135821d563, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:57.405129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:57.428822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1863/3759] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:25:57 2022] PUT /identity/v3/projects/dce3824b75604fb4ab9db1c1b358555c/users/d2facd8a9d44488e9aaf3f135821d563/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:25:57.438856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33eb58-0d88-42bd-851d-daaaa41a07fc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.439154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33eb58-0d88-42bd-851d-daaaa41a07fc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.439417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33eb58-0d88-42bd-851d-daaaa41a07fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.488956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9c33eb58-0d88-42bd-851d-daaaa41a07fc None None] MFA Rules not processed for user `d2facd8a9d44488e9aaf3f135821d563`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:57.491953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9c33eb58-0d88-42bd-851d-daaaa41a07fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:57.674163 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1897/3760] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:25:57.690966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:57.695481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:57.843356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017745d-fab3-4a3c-80f9-09bd7631ad9b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:57.850913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:57.851905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.852754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.864456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.890126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:57.891642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:57.904177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f1aa6-3da6-470d-bdcd-3e04d6754625 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:57.904708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f1aa6-3da6-470d-bdcd-3e04d6754625 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:57.905006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1864/3761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:25:57.905350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f1aa6-3da6-470d-bdcd-3e04d6754625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:57.952294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-892f1aa6-3da6-470d-bdcd-3e04d6754625 None None] MFA Rules not processed for user `03aebbee7e224b96830248fd9f0eb0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:25:57.953746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-892f1aa6-3da6-470d-bdcd-3e04d6754625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:58.057514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1898/3762] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:25:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:25:58.084010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:25:58.087871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:25:58.228197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede26b2a-f63f-413e-9444-111561c46aa5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:25:58.244694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:25:58.246488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:25:58.247818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:25:58.248336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:25:58.262793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:25:58.264777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:25:58.317515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1865/3763] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:25:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:06.424051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:06.424577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:06.424702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:06.447583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] MFA Rules not processed for user `03aebbee7e224b96830248fd9f0eb0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:06.449504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:06.462974 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1899/3764] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:06.971444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:06.972965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:07.061486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:07.092377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2661e-f842-4b0a-830a-699d3f6d6512 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:07.101110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:07.102119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:07.102683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:07.103014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] PATH_INFO: `/v3/users/f3e6d4615d8444f1b7d4013f732cc7cf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:07.104429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e6d4615d8444f1b7d4013f732cc7cf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:07.107467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:07.185041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e6d4615d8444f1b7d4013f732cc7cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:07.209507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e6d4615d8444f1b7d4013f732cc7cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:07.211136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e6d4615d8444f1b7d4013f732cc7cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:07.212161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e6d4615d8444f1b7d4013f732cc7cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:07.225813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a073c21-ac6e-4846-93a1-502868cf7008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e6d4615d8444f1b7d4013f732cc7cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:07.269958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1866/3765] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:26:06 2022] DELETE /identity/v3/users/f3e6d4615d8444f1b7d4013f732cc7cf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:26:07.600468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:07.626717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440dbf-759a-4765-b548-fcb7d33533e3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:07.823495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:07.848005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:07.849086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:07.849373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:07.849647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] PATH_INFO: `/v3/projects/1595b5f2b68346b18796f3613fc87b52` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:07.852352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1595b5f2b68346b18796f3613fc87b52)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:07.867905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:08.024965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1595b5f2b68346b18796f3613fc87b52', 'request_id': 'req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:08.033355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1595b5f2b68346b18796f3613fc87b52', 'request_id': 'req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:08.049422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1595b5f2b68346b18796f3613fc87b52', 'request_id': 'req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:08.073074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] The token cache is being invalidate because project 1595b5f2b68346b18796f3613fc87b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:26:08.073634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:08.074581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7b9d990-bcaa-4754-9146-3cd6268e2cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:08.078306 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1900/3766] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:26:07 2022] DELETE /identity/v3/projects/1595b5f2b68346b18796f3613fc87b52 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:26:08.083651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:08.084173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:08.084173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:08.153677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:08.156579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:08.397589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:08.397953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:08.398537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:08.403719 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1867/3767] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:08.448392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:08.453210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:08.474253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1901/3768] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:08.489805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:08.514682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222fc37-f42e-411d-aa98-9555b0703e65 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:08.526772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:08.527694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:08.528993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:08.529542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:08.530472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:26:08.531024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:08.533859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:08.591719 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1868/3769] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:26:08.596503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:08.609199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a96637-8915-4f0a-887b-34aaac73af81 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:08.632265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:08.633488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:08.634174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:08.634821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:08.637373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:08.642231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:08.717541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:08.733600 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1902/3770] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:26:08 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:26:08.733946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7569971-97df-46c0-8ef8-cd0d7da4ec0c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:08.814337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:08.865559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:08.866358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:08.867491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:08.870534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:08.870534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:08.875593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:08.924182 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1869/3771] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:26:08 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:26:08.925928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:08.941431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73853-5877-4843-a61a-5f52a9066850 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:08.951595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:08.952237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:08.952517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:08.953782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:08.955362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:08.960796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:08.997011 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1903/3772] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:26:09.001066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:09.021452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a1f8-f0b8-4fd5-ba8d-a40c06879226 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:09.029016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efab4-f3e1-4cde-95a7-4b117d2a2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:09.030488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efab4-f3e1-4cde-95a7-4b117d2a2300 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:09.031121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efab4-f3e1-4cde-95a7-4b117d2a2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:09.031655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efab4-f3e1-4cde-95a7-4b117d2a2300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:09.032800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8efab4-f3e1-4cde-95a7-4b117d2a2300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:09.034900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8efab4-f3e1-4cde-95a7-4b117d2a2300 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:09.084401 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1870/3773] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:26:09.088164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:09.100940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363542f-79fd-489e-ba44-950ec9bd19fe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:09.109510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:09.111753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:09.112922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:09.113874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] PATH_INFO: `/v3/projects/a785dcbbdc4d41c9a283f5e10e000648/users/4f3f477b0688490f8e55312da41c2cb6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:09.169486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a785dcbbdc4d41c9a283f5e10e000648, user_id=4f3f477b0688490f8e55312da41c2cb6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:09.173173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:09.202237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1904/3774] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:26:09 2022] PUT /identity/v3/projects/a785dcbbdc4d41c9a283f5e10e000648/users/4f3f477b0688490f8e55312da41c2cb6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:26:09.205048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91740110-e593-4b27-8aa3-e6f30b34f3e5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:09.205580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91740110-e593-4b27-8aa3-e6f30b34f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:09.205909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91740110-e593-4b27-8aa3-e6f30b34f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:09.237643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-91740110-e593-4b27-8aa3-e6f30b34f3e5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:09.239994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-91740110-e593-4b27-8aa3-e6f30b34f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:09.386355 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1871/3775] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:09.719704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:09.722230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:09.861859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7465-f470-49bf-9a8b-0e3131852816 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:09.872233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:09.872970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:09.873257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:09.873537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:09.896076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:09.900338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:09.936726 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1905/3776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:14.843781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:14.844583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:14.845034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:14.906503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] MFA Rules not processed for user `69281416d1db40c991e25af0d9438aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:14.907981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:15.079989 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1872/3777] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:15.094986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:15.096763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:15.170930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:15.295041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7584-c808-4e09-a1e5-c0eb9e6a5621 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:15.303690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:15.305038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:15.306372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:15.306841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:15.312979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:15.464286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:15.466290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:15.490755 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1906/3778] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:23.616705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:23.619353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:23.663284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06ed7-3e2c-40a2-8464-5157d5a1bbf7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:23.677432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:23.678965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:23.679616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:23.680085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:23.682827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:23.684907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:23.709136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016e6e-75b8-4b97-95aa-4dbcd8319cc0 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:23.722060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:23.725161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:23.726477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:23.728390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:23.733460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:23.758676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:23.761866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b068f-5a65-4e0a-9fca-087012157db7 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:23.777359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:23.780920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90805-9f47-44f7-932b-99a24686a092 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:23.797071 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1873/3779] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:23.816631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1907/3780] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:26:24.804394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e14c4-7f7d-47ba-9737-62d9b56418c3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:24.805253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e14c4-7f7d-47ba-9737-62d9b56418c3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:24.805692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e14c4-7f7d-47ba-9737-62d9b56418c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:24.842249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-782e14c4-7f7d-47ba-9737-62d9b56418c3 None None] MFA Rules not processed for user `2512010236034319952ea34c2a76a96b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:24.854921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-782e14c4-7f7d-47ba-9737-62d9b56418c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:24.875001 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1874/3781] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:24.884673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:24.888525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:24.889014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:24.991226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] MFA Rules not processed for user `4f3f477b0688490f8e55312da41c2cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:24.995143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:25.360410 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1908/3782] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:25.373805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49741b8-5519-414d-8071-79e6697c73f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:25.374089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49741b8-5519-414d-8071-79e6697c73f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:25.374775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49741b8-5519-414d-8071-79e6697c73f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:25.421476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a49741b8-5519-414d-8071-79e6697c73f4 None None] MFA Rules not processed for user `4f3f477b0688490f8e55312da41c2cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:25.422763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a49741b8-5519-414d-8071-79e6697c73f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:25.444989 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1875/3783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:25.630243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:25.649122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0c376-84e0-4e3d-856e-62018004edf0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:25.655668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:25.656954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:25.657429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:25.657976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:25.674044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:25.678941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:25.689807 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1909/3784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:34.361159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:34.361975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:34.362447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:34.436841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:34.438454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:34.486578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:34.573044 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1876/3785] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:35.685331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:40.866940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:40.868367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:41.099249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d845-114d-4652-afbc-1f57379b55f7 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:41.127552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:41.128410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:41.129540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:41.133663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:41.140574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:41.178231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:41.180118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:41.219650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1910/3786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:26:44.555680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=13 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:47.543120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:47.557044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8abdc3-8f88-4721-9aac-507c4f0c1c26 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:47.564957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:47.567466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:47.568275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:47.568665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:47.573229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:47.587913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:47.589565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:47.601450 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1877/3787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:51.202934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=32 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:55.088863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:55.090236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:55.117339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c4c98-7f79-4c2c-b31d-33fbfad48ee7 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:55.147038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:55.147038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:55.147038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:55.147038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:55.147651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:55.161891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:55.163875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:55.201739 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1911/3788] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:56.163808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:56.165853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:56.180753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf638aa8-0c24-4275-b21c-a790ece078e6 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:56.187845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:56.187845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:56.188683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:56.188964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] PATH_INFO: `/v3/users/b1f4529759354867a45d7f6bc0c8230d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:56.191053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f4529759354867a45d7f6bc0c8230d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:56.194891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:56.265719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f4529759354867a45d7f6bc0c8230d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.277594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f4529759354867a45d7f6bc0c8230d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.278824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f4529759354867a45d7f6bc0c8230d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.279616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f4529759354867a45d7f6bc0c8230d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.289304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f4529759354867a45d7f6bc0c8230d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.317047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1878/3789] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:26:56 2022] DELETE /identity/v3/users/b1f4529759354867a45d7f6bc0c8230d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:26:56.648958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:56.656535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:56.657992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:56.679605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f888c7-b7d1-4136-a241-ceb1f3f31494 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:56.821141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aa933-c444-431d-a146-56f777db99f8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:56.826529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:56.826962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:56.827930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:56.828087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:56.828274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:56.828707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:56.828847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] PATH_INFO: `/v3/projects/bf078ba45d5a4f22bfff75464efc5161` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:56.829508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:56.830012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf078ba45d5a4f22bfff75464efc5161)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:56.832971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:56.850884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:56.894626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:56.896290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25849c8b-10b2-4d36-8d7d-ae2200a3aaa7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:56.931713 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1912/3790] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:26:56.932145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf078ba45d5a4f22bfff75464efc5161', 'request_id': 'req-f4ebe00e-338b-4cf2-bd62-46013e119f97'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.940798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf078ba45d5a4f22bfff75464efc5161', 'request_id': 'req-f4ebe00e-338b-4cf2-bd62-46013e119f97'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.948606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:56.966739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf078ba45d5a4f22bfff75464efc5161', 'request_id': 'req-f4ebe00e-338b-4cf2-bd62-46013e119f97'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.995734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] The token cache is being invalidate because project bf078ba45d5a4f22bfff75464efc5161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:26:56.996308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:56.997144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f4ebe00e-338b-4cf2-bd62-46013e119f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:26:57.000473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1879/3791] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:26:56 2022] DELETE /identity/v3/projects/bf078ba45d5a4f22bfff75464efc5161 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:26:57.005841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.006432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.006878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.028298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:57.030351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:57.138244 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1913/3792] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:57.143677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.144221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.144399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.180628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:57.181876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:57.196470 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1880/3793] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:57.200664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.218191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f1d04-774e-4766-a8d1-9dcec8f117f9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:57.231327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:57.232243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.233586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.234063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.239023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:26:57.239478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:57.241244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:57.259314 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1914/3794] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:26:57.263872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.282543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ecf4c-d139-4592-8c24-d03682734d66 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:57.291097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:57.291832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.292116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.292391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.293045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:57.296323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:57.351591 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1881/3795] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:26:57.354838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.370680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b50d36-6fdb-4d04-aebc-042a190ddca3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:57.461552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:57.463055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.463427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.464898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.465928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:57.476804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:57.489464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:26:57.510176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1915/3796] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:26:57 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:26:57.511495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.528870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eef9a-e608-43d8-b824-6174d89b7cb5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:57.535295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:57.536209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.536601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.537558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.538365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:57.540946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:57.562376 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1882/3797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:26:57.564471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.586477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e7c9-0d96-4801-ad01-968c94b53003 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:57.599456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b11d3-16ce-4c68-84b7-8bf93e128edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:57.600494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b11d3-16ce-4c68-84b7-8bf93e128edd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.601437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b11d3-16ce-4c68-84b7-8bf93e128edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.601871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b11d3-16ce-4c68-84b7-8bf93e128edd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.603636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b11d3-16ce-4c68-84b7-8bf93e128edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:57.606068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b11d3-16ce-4c68-84b7-8bf93e128edd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:57.624629 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1916/3798] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:26:57.626318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.642876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23a98-53f0-418d-a30e-93080f5aa392 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:57.656328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f72e8-43a7-4fb5-829d-9427454dcacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:57.657226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f72e8-43a7-4fb5-829d-9427454dcacd admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.657600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f72e8-43a7-4fb5-829d-9427454dcacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.658077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f72e8-43a7-4fb5-829d-9427454dcacd admin admin] PATH_INFO: `/v3/projects/a9bcc8b0003a4991890b8c6c23f69989/users/39bd97a54a674af3babcfe185e0a9baa/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.678098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f72e8-43a7-4fb5-829d-9427454dcacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bcc8b0003a4991890b8c6c23f69989, user_id=39bd97a54a674af3babcfe185e0a9baa, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:57.681791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f72e8-43a7-4fb5-829d-9427454dcacd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:57.703472 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1883/3799] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:26:57 2022] PUT /identity/v3/projects/a9bcc8b0003a4991890b8c6c23f69989/users/39bd97a54a674af3babcfe185e0a9baa/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:26:57.714313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.714890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.715132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.770064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] MFA Rules not processed for user `39bd97a54a674af3babcfe185e0a9baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:57.772155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:57.916113 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1917/3800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:57.927782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:57.928004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:57.928248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:57.959147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] MFA Rules not processed for user `39bd97a54a674af3babcfe185e0a9baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:26:57.960391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:57.982634 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1884/3801] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:26:57.997276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:26:57.998927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:26:58.167824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52ff8-f9d6-459c-afb1-257f171150d6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:26:58.185322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a1163-fc0a-41e2-9227-de7771f74596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:26:58.186423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1163-fc0a-41e2-9227-de7771f74596 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:26:58.187013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1163-fc0a-41e2-9227-de7771f74596 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:26:58.187634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1163-fc0a-41e2-9227-de7771f74596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:26:58.211372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a1163-fc0a-41e2-9227-de7771f74596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:26:58.218266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a1163-fc0a-41e2-9227-de7771f74596 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:26:58.235829 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1918/3802] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:26:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:03.020781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:03.022622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:03.148303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3066-4687-4a0f-8ee0-9318b9e31cab None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:03.157750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:03.160150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:03.160683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:03.161185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] PATH_INFO: `/v3/users/d2facd8a9d44488e9aaf3f135821d563` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:03.162665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2facd8a9d44488e9aaf3f135821d563)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:03.165592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:03.250251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2facd8a9d44488e9aaf3f135821d563'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:03.273175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2facd8a9d44488e9aaf3f135821d563'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:03.273905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2facd8a9d44488e9aaf3f135821d563'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:03.274648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2facd8a9d44488e9aaf3f135821d563'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:03.295679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2facd8a9d44488e9aaf3f135821d563'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:03.331952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:03.351031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1885/3803] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:03 2022] DELETE /identity/v3/users/d2facd8a9d44488e9aaf3f135821d563 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:03.355234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:03.356162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:03.356608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:03.395785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:03.419062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:03.527476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:03.547747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1919/3804] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:27:03.574016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:03.577450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:03.648592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4b08b-6e57-454a-a3b7-09c8899edc98 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:03.652998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355da52-50aa-4c82-821a-0dc1997d54ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:03.653732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355da52-50aa-4c82-821a-0dc1997d54ac service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:03.653934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355da52-50aa-4c82-821a-0dc1997d54ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:03.654236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355da52-50aa-4c82-821a-0dc1997d54ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:03.666967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355da52-50aa-4c82-821a-0dc1997d54ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:03.668454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355da52-50aa-4c82-821a-0dc1997d54ac service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:03.680171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1886/3805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:04.017578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:04.019123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:04.043028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fb28-0692-4ca5-b928-f6397aa83c6c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:04.057637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:04.058642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.059437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.059868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] PATH_INFO: `/v3/projects/dce3824b75604fb4ab9db1c1b358555c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.061349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce3824b75604fb4ab9db1c1b358555c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:04.063559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:04.141626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce3824b75604fb4ab9db1c1b358555c', 'request_id': 'req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:04.156404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce3824b75604fb4ab9db1c1b358555c', 'request_id': 'req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:04.163544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce3824b75604fb4ab9db1c1b358555c', 'request_id': 'req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:04.181678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] The token cache is being invalidate because project dce3824b75604fb4ab9db1c1b358555c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:04.181974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:04.183233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c1ce66e7-5536-421e-b72f-c233ac8c9d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:04.185068 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1920/3806] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:04 2022] DELETE /identity/v3/projects/dce3824b75604fb4ab9db1c1b358555c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:04.191148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.191970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.191970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.246354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:04.247582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:04.430988 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1887/3807] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:04.438958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.439842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.440314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.493773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:04.495465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:04.514731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:04.515216 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1921/3808] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:04.533566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d445bd-906e-4c3e-adc2-d3120441db5c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:04.552109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:04.553119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.553635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.554116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.555096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:27:04.555599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:04.562333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:04.585528 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1888/3809] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:27:04.590498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:04.612659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fecd-9b46-4b05-ae7d-e17b1d325fca None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:04.619710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:04.635708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.636154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.636693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.637760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:04.640026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:04.686583 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1922/3810] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:04 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:04.690413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:04.754130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36062d2-4347-4235-a3df-0d3d9634f1e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:04.895268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:04.896234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.896690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.897125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.897937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:04.900063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:04.930590 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1889/3811] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:04 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:04.934433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:04.958001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e19f28-77d6-4a25-adc5-d351f3a534f0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:04.965661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:04.966906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:04.967192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:04.967476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:04.968140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:04.969763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:04.988560 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1923/3812] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:27:04.992318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.011222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673ba17-301e-4be1-904e-44e5d3d27a01 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.026318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.031733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.040923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.041164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.041487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.041934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.043552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.046586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.059552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b38a05-bf3e-4a89-80b5-b6ae1999fc54 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.065710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.067419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.067903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.068355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] PATH_INFO: `/v3/users/3188e7be5b534714a76bc578112df550` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.069765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3188e7be5b534714a76bc578112df550)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.071911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1890/3813] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:27:05.072411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.075854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.087419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb08bf-6822-4ed0-918e-3b43ad074410 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.095690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b40c2-863e-41a0-91ea-d8bdd71069cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.096382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b40c2-863e-41a0-91ea-d8bdd71069cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.096704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b40c2-863e-41a0-91ea-d8bdd71069cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.097599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b40c2-863e-41a0-91ea-d8bdd71069cb admin admin] PATH_INFO: `/v3/projects/a6605b7b22e64a90bd74c29159b4d4ad/users/9c5ae8ee79144b929496a20f8be2293b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.100311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:05.118842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b40c2-863e-41a0-91ea-d8bdd71069cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6605b7b22e64a90bd74c29159b4d4ad, user_id=9c5ae8ee79144b929496a20f8be2293b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.121930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b40c2-863e-41a0-91ea-d8bdd71069cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.134947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3188e7be5b534714a76bc578112df550'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.137046 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1891/3814] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:05 2022] PUT /identity/v3/projects/a6605b7b22e64a90bd74c29159b4d4ad/users/9c5ae8ee79144b929496a20f8be2293b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:05.147599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.148100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.148443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.158886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3188e7be5b534714a76bc578112df550'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.160724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3188e7be5b534714a76bc578112df550'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.161353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3188e7be5b534714a76bc578112df550'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.180469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3188e7be5b534714a76bc578112df550'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.203155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1924/3815] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:05 2022] DELETE /identity/v3/users/3188e7be5b534714a76bc578112df550 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:05.204183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] MFA Rules not processed for user `9c5ae8ee79144b929496a20f8be2293b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:05.205548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.291097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.291097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.302881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:05.313572 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1892/3816] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:05.328703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.330408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.397652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f080e-fbe7-46db-a425-746d1222124f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.403353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.404154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.404440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.404722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] PATH_INFO: `/v3/users/4f3f477b0688490f8e55312da41c2cb6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.406037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3f477b0688490f8e55312da41c2cb6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.408020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.417104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3f61f-b8ac-4082-9ae9-916b5c27d013 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.422526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.422526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.422950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.423408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.433987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.434996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.447027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1893/3817] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:05.469335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.478092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.498560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3f477b0688490f8e55312da41c2cb6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.501992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98de84-b9e1-44ca-9f5f-3d7ab224467b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.508868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.509887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.510269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.511371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] PATH_INFO: `/v3/projects/bcef8bb73a12439890c578d3cc840a70` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.512791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcef8bb73a12439890c578d3cc840a70)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.515542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.516541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3f477b0688490f8e55312da41c2cb6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.517350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3f477b0688490f8e55312da41c2cb6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.518045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3f477b0688490f8e55312da41c2cb6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.526309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5d510ce-5df5-405a-bcf2-a6eeab0ee265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3f477b0688490f8e55312da41c2cb6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.544670 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1925/3818] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:05 2022] DELETE /identity/v3/users/4f3f477b0688490f8e55312da41c2cb6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:27:05.594128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcef8bb73a12439890c578d3cc840a70', 'request_id': 'req-c2696105-65a6-4003-bbf2-c3b0568439bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.601604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcef8bb73a12439890c578d3cc840a70', 'request_id': 'req-c2696105-65a6-4003-bbf2-c3b0568439bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.616462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcef8bb73a12439890c578d3cc840a70', 'request_id': 'req-c2696105-65a6-4003-bbf2-c3b0568439bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.628867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:05.641330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] The token cache is being invalidate because project bcef8bb73a12439890c578d3cc840a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:05.642752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.643142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2696105-65a6-4003-bbf2-c3b0568439bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:05.652830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.653660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.654050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.666577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1894/3819] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:05 2022] DELETE /identity/v3/projects/bcef8bb73a12439890c578d3cc840a70 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:05.687612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:05.689015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.774928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1926/3820] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:05.783192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.783485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.783753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.823621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:05.825064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:05.851676 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1895/3821] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:05.853401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.896003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6380-b294-4cb9-8d36-00d1529faeda None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.903559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:05.904626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:05.918232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:05.918532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:05.919267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:27:05.921986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:05.927302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:05.960449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1927/3822] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:05.961720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:05.982795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df33a94-de9c-4ed8-a475-269e5c07e63f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:05.997927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.000830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.001517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.001799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.008471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.015038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.058682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.060634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.091154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1896/3823] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:05 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:06.095327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.098737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29937f22-c8a8-4a61-91e4-514f0ec88879 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.128055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:06.248343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b17940-8792-40ec-9425-cbe85cec4b1b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.256072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.256737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.257017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.257332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.257478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] PATH_INFO: `/v3/users/9c5ae8ee79144b929496a20f8be2293b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.258954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.259342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.259474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5ae8ee79144b929496a20f8be2293b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.259797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.260540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.261320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.262958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.294319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1897/3824] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:27:06.295327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.297517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.315875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85356a-7185-4e0e-80dd-bafb582aecc1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.322354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.322930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.323209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.323479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] PATH_INFO: `/v3/projects/a785dcbbdc4d41c9a283f5e10e000648` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.324874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a785dcbbdc4d41c9a283f5e10e000648)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.326806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.351469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5ae8ee79144b929496a20f8be2293b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.367429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5ae8ee79144b929496a20f8be2293b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.368383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5ae8ee79144b929496a20f8be2293b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.369342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5ae8ee79144b929496a20f8be2293b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.383000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5ae8ee79144b929496a20f8be2293b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.396479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a785dcbbdc4d41c9a283f5e10e000648', 'request_id': 'req-255ea7e7-9484-487e-a052-2f04733ea3e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.403472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a785dcbbdc4d41c9a283f5e10e000648', 'request_id': 'req-255ea7e7-9484-487e-a052-2f04733ea3e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.408851 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1928/3825] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:06 2022] DELETE /identity/v3/users/9c5ae8ee79144b929496a20f8be2293b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:27:06.410616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.412172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.413941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a785dcbbdc4d41c9a283f5e10e000648', 'request_id': 'req-255ea7e7-9484-487e-a052-2f04733ea3e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.430131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] The token cache is being invalidate because project a785dcbbdc4d41c9a283f5e10e000648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:06.430486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.431172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-255ea7e7-9484-487e-a052-2f04733ea3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:06.436152 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1898/3826] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:06 2022] DELETE /identity/v3/projects/a785dcbbdc4d41c9a283f5e10e000648 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:06.436152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.436152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.436152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.455815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:06.459848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.491862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0353e6-abce-427d-89c2-fc6b78c42a9f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.498482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836991e-e605-4e46-b7ba-cd6b8b760481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.499340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836991e-e605-4e46-b7ba-cd6b8b760481 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.500399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836991e-e605-4e46-b7ba-cd6b8b760481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.500878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836991e-e605-4e46-b7ba-cd6b8b760481 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.501800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836991e-e605-4e46-b7ba-cd6b8b760481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.504682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836991e-e605-4e46-b7ba-cd6b8b760481 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.509434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:06.518616 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1929/3827] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:06.523158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.523515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.523804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.539334 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1899/3828] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:06.540475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.543869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.548940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:06.550897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.556671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386721a1-dd97-45ca-a6b0-12a83323b89f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.559827 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1930/3829] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:06.567971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481c023-9148-4fae-8b44-8992ae662328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.568685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481c023-9148-4fae-8b44-8992ae662328 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.568828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.568952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481c023-9148-4fae-8b44-8992ae662328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.569320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481c023-9148-4fae-8b44-8992ae662328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.570723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481c023-9148-4fae-8b44-8992ae662328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.570878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.571835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481c023-9148-4fae-8b44-8992ae662328 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.585473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1900/3830] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:06.586788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.587077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.587350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.605180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:06.607941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:06.609203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.621333 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1901/3831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:06.625852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.636801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f4f0-de21-47ad-91ba-30ad2548443c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.641911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.642626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.642908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.643186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] PATH_INFO: `/v3/projects/df9b8fc02e4046a488bfb1b222b4b989/users/4eff9d64a7c84373ace007cd34d1809c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.647233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4deb11-d797-450e-af9e-7f7b13eb399d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.651705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7339228-b764-465d-b966-d838de2367aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.652476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339228-b764-465d-b966-d838de2367aa service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.652763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339228-b764-465d-b966-d838de2367aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.653036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339228-b764-465d-b966-d838de2367aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.659069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9b8fc02e4046a488bfb1b222b4b989, user_id=4eff9d64a7c84373ace007cd34d1809c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.662295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.664876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339228-b764-465d-b966-d838de2367aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.666486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339228-b764-465d-b966-d838de2367aa service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.677901 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1902/3832] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:06 2022] PUT /identity/v3/projects/df9b8fc02e4046a488bfb1b222b4b989/users/4eff9d64a7c84373ace007cd34d1809c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:06.681924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1931/3833] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:27:06.682259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.683418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.683769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.684115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.705588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:06.707158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.763058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06cbc7-c922-449e-8788-4b300bd77740 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.769394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.770089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.770414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.772226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.772226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:27:06.772226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.775059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.781047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1932/3834] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:06.791339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.792877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:06.793688 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1903/3835] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:06.798758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.815446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bea17-7fe0-47e7-86e2-7d4eaedad00a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.827389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.828931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.829440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.829850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:06.830776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:06.833586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:06.877483 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1904/3836] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/projects => generated 395 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:27:06.881242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab76b7-abdf-473c-a926-cba1dbab11f5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:06.882371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:06.991874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:06.992668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:06.992954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:06.993267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.011343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a7f4-251b-411a-a194-f486884533be admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:07.018136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:07.019238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.019531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.019813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.020478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.023144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.045521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:07.054209 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1905/3837] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:06 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:07.057755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:07.063989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:07.071056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4ac0-4bba-421e-86b6-7d49cbad57cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:07.074621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.076230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.077484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:07.078122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.078437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.078717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.079520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.081922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.090396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1933/3838] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:27:07.102021 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1906/3839] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:27:07.106394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:07.118723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945e74a-f421-440f-829e-e35af729e44b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:07.125782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce1f4-aa9d-48f3-89e9-3f125c429338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:07.126582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce1f4-aa9d-48f3-89e9-3f125c429338 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.126928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce1f4-aa9d-48f3-89e9-3f125c429338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.127270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce1f4-aa9d-48f3-89e9-3f125c429338 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.128145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ce1f4-aa9d-48f3-89e9-3f125c429338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.129771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ce1f4-aa9d-48f3-89e9-3f125c429338 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.141307 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1934/3840] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:07.146333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:07.157096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73016704-3a4b-4ca9-bd90-1b0d995f96cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:07.162495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:07.163183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.163468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.163901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] PATH_INFO: `/v3/projects/e0f1808504704f0890542dbf6c4c4860/users/9718b1b9b0a34bc09d105a1849bcf0f2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.184652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f1808504704f0890542dbf6c4c4860, user_id=9718b1b9b0a34bc09d105a1849bcf0f2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.188141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.206089 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1907/3841] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:07 2022] PUT /identity/v3/projects/e0f1808504704f0890542dbf6c4c4860/users/9718b1b9b0a34bc09d105a1849bcf0f2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:27:07.211748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.212645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.212941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.235206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:07.236435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:07.354677 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1935/3842] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:07.371176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:07.448773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56235115-babe-42f7-9fb6-fff3f764a69c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:07.457232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29fc9e-fc82-48a1-9bac-d62582e60275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:07.458426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29fc9e-fc82-48a1-9bac-d62582e60275 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.458981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29fc9e-fc82-48a1-9bac-d62582e60275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.459460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29fc9e-fc82-48a1-9bac-d62582e60275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.480679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29fc9e-fc82-48a1-9bac-d62582e60275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.481246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29fc9e-fc82-48a1-9bac-d62582e60275 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.502310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1908/3843] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:07.716229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:07.718660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:07.752122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797164ae-aa93-4e42-a64d-707b7a6d6238 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:07.775822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:07.780309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:07.781746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:07.783096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] PATH_INFO: `/v3/projects/a6605b7b22e64a90bd74c29159b4d4ad` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:07.789582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6605b7b22e64a90bd74c29159b4d4ad)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:07.796674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:07.936423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6605b7b22e64a90bd74c29159b4d4ad', 'request_id': 'req-4ed97805-0649-4f61-b823-26aeea720fb9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:07.949037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6605b7b22e64a90bd74c29159b4d4ad', 'request_id': 'req-4ed97805-0649-4f61-b823-26aeea720fb9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:07.969397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6605b7b22e64a90bd74c29159b4d4ad', 'request_id': 'req-4ed97805-0649-4f61-b823-26aeea720fb9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:07.996013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] The token cache is being invalidate because project a6605b7b22e64a90bd74c29159b4d4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:07.996390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:07.997052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ed97805-0649-4f61-b823-26aeea720fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:07.998982 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1936/3844] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:07 2022] DELETE /identity/v3/projects/a6605b7b22e64a90bd74c29159b4d4ad => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:08.003851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.004148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.004431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.027974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:08.029418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:08.185377 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1909/3845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:08.196289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.196622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.197009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.236015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:08.237386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:08.260328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1937/3846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:08.265644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:08.278479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8421049-0702-4d40-b369-b872f4659b77 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:08.291604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:08.295081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.295674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.296332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.297428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:27:08.297928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:08.300571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd795-912a-4702-bf7a-5d0bc4e4295c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:08.336788 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1910/3847] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:08.337355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:08.373920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4d756-cc80-4ea9-8bd6-1e983dbd7fdd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:08.387122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:08.395817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.395817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.395817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.395817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:08.396513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:08.415638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.416751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.417258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.447315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] MFA Rules not processed for user `d55e71c267f34f2da01691b5066b924a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:08.449416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:08.475347 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1938/3848] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:08 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:08.480009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:08.528667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:08.588775 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1911/3849] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:08.663597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634206-bd59-453e-be6c-328373882df6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:08.679127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:08.679349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.680652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.681106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.682394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:08.687133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:08.751820 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1939/3850] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:08 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:08.757514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:08.765505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:08.776411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c000e7-6632-4dde-9326-8ecfb3cd7f4f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:08.783355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:08.784243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.784692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.785844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.785999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:08.788448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:08.804512 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1912/3851] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:08.805319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:08.817154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14df719-eb44-49ec-9758-717c00340f01 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:08.823355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c21cb2-776c-4602-a768-b139c03e9fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:08.824117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21cb2-776c-4602-a768-b139c03e9fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.824556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21cb2-776c-4602-a768-b139c03e9fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.824939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21cb2-776c-4602-a768-b139c03e9fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.825867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21cb2-776c-4602-a768-b139c03e9fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:08.827654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21cb2-776c-4602-a768-b139c03e9fa6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:08.840968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1940/3852] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:08.847261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:08.860744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44170-cf0b-466d-a3ad-702088a1c662 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:08.867811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:08.868645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.869642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.870023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] PATH_INFO: `/v3/projects/209e3887b05e4c09986bb188c1bb6be6/users/7f20ecd9e6c54278bf387ea307918158/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.891363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209e3887b05e4c09986bb188c1bb6be6, user_id=7f20ecd9e6c54278bf387ea307918158, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:08.895466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:08.927165 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1913/3853] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:08 2022] PUT /identity/v3/projects/209e3887b05e4c09986bb188c1bb6be6/users/7f20ecd9e6c54278bf387ea307918158/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:08.932378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:08.932378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:08.932696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:08.979182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] MFA Rules not processed for user `7f20ecd9e6c54278bf387ea307918158`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:08.982131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:09.076092 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1941/3854] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:09.106719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:09.108739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:09.227694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf819-4650-4d4b-b853-ad9b16205844 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:09.231786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:09.232548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:09.232910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:09.233259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:09.269983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:09.271586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:09.295097 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1914/3855] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:09.447363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:09.450948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:09.469733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a96c98-ca3b-4c50-87cf-7f90e4d9c82d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:09.477456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:09.478588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:09.479763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:09.480727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:09.484095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:09.505064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:09.507581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af3b2-ad1a-4b9f-b2e3-72646ef3cd9e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:09.523692 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1942/3856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:18.672482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:18.673092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:18.853621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45224-0b40-4a8d-b59d-d541a350f2a0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:18.860349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:18.861335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:18.861704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:18.862086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:18.872914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:18.914869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:18.918895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:18.953751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1915/3857] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:19.515768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:20.167932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:20.168404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:20.168979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:20.234027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] MFA Rules not processed for user `4eff9d64a7c84373ace007cd34d1809c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:20.237345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:20.405453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1943/3858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:20.411083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:20.413310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:20.537250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:20.545155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2effcb-c069-4a5d-bb27-509e35be3a7b service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:20.553143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:20.553979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:20.554392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:20.554772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:20.555625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:20.560225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:20.608833 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1916/3859] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:20 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:20.614051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:20.667210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e4021-7436-405e-af2a-0ddc6494f68f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:20.820337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:20.821648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:20.822186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:20.822685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:20.823686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:20.825916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:20.866282 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1944/3860] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:20 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:27:20.870440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:20.896765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40912-6f3c-4993-8d1a-3d7086363d63 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:20.905459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:20.906375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:20.906503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:20.908190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:20.908833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:20.912235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:20.929206 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1917/3861] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:20.933917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:20.948505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c71b-be55-4d78-8b19-e1da8107bbc6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:20.954984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:20.955677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:20.956009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:20.957106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] PATH_INFO: `/v3/projects/870e87005c33480e91ac51a105beb30b/users/75eb8fa3a81749259cf07cb2bfeba79b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:20.976650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870e87005c33480e91ac51a105beb30b, user_id=75eb8fa3a81749259cf07cb2bfeba79b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:20.979524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:21.007138 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1945/3862] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:20 2022] PUT /identity/v3/projects/870e87005c33480e91ac51a105beb30b/users/75eb8fa3a81749259cf07cb2bfeba79b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:21.008368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:21.022531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc239450-7487-4dc2-aea5-b40964ffab95 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:21.151915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fee102-72f7-40da-8290-ccc5f1f2e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:21.152263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fee102-72f7-40da-8290-ccc5f1f2e60b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:21.152649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fee102-72f7-40da-8290-ccc5f1f2e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:21.153028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fee102-72f7-40da-8290-ccc5f1f2e60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:21.153851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fee102-72f7-40da-8290-ccc5f1f2e60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:21.156388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fee102-72f7-40da-8290-ccc5f1f2e60b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:21.192480 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1918/3863] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:21.198167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:21.214621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dcd1a-64a0-4e75-8bb6-d49649f5fb92 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:21.225536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9696-ddd0-4673-8fad-96600fb1ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:21.226259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9696-ddd0-4673-8fad-96600fb1ec1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:21.226539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9696-ddd0-4673-8fad-96600fb1ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:21.226817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9696-ddd0-4673-8fad-96600fb1ec1a admin admin] PATH_INFO: `/v3/projects/870e87005c33480e91ac51a105beb30b/users/75eb8fa3a81749259cf07cb2bfeba79b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:21.229058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e9696-ddd0-4673-8fad-96600fb1ec1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=870e87005c33480e91ac51a105beb30b, user_id=75eb8fa3a81749259cf07cb2bfeba79b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:21.232956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e9696-ddd0-4673-8fad-96600fb1ec1a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:21.246527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1946/3864] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:21 2022] PUT /identity/v3/projects/870e87005c33480e91ac51a105beb30b/users/75eb8fa3a81749259cf07cb2bfeba79b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:21.400695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e344-e6c5-4df0-832a-1df90030adc6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:21.401082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e344-e6c5-4df0-832a-1df90030adc6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:21.401271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e344-e6c5-4df0-832a-1df90030adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:21.435207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-db82e344-e6c5-4df0-832a-1df90030adc6 None None] MFA Rules not processed for user `4adcdf3712b443c18ff496cf5ff735ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:21.436484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db82e344-e6c5-4df0-832a-1df90030adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:21.568081 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1919/3865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:21.795475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:21.795992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:21.796101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:21.855284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:21.858165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:21.924125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:21.992280 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1947/3866] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:22.006798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:22.008760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:22.009666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:22.057223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:22.062751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:22.089018 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1920/3867] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:22.345401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:22.512752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174fb5d-9e27-4a95-a26c-053749ce02b0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:22.525187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3c3d8-5cbc-4364-b8d2-e3bb6c99703c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:22.525825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3c3d8-5cbc-4364-b8d2-e3bb6c99703c service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:22.526110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3c3d8-5cbc-4364-b8d2-e3bb6c99703c service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:22.526473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3c3d8-5cbc-4364-b8d2-e3bb6c99703c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:22.583301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3c3d8-5cbc-4364-b8d2-e3bb6c99703c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:22.585051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3c3d8-5cbc-4364-b8d2-e3bb6c99703c service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:22.599979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1948/3868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:22 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:23.010350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:23.169346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556279a-728e-4416-8230-d0673a93acb5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:23.180016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:23.185323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:23.188870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:23.191335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:23.199178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:23.236133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:23.238108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:23.242041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:23.256508 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1921/3869] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:32.592049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=47 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:33.269634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:34.975394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5e484-7b7d-499f-bf02-25d7380b6717 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:34.975394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5e484-7b7d-499f-bf02-25d7380b6717 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:34.975908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5e484-7b7d-499f-bf02-25d7380b6717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:35.068739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-03d5e484-7b7d-499f-bf02-25d7380b6717 None None] MFA Rules not processed for user `75eb8fa3a81749259cf07cb2bfeba79b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:35.070933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-03d5e484-7b7d-499f-bf02-25d7380b6717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:35.274307 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1949/3870] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:35.288846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:35.291187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:35.415382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39a1db-3cca-4a85-99da-bcf0c7751dbc service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:35.421449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806e019-43f2-455c-aaea-4874f892d4a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:35.422637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e019-43f2-455c-aaea-4874f892d4a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:35.423216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e019-43f2-455c-aaea-4874f892d4a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:35.423683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e019-43f2-455c-aaea-4874f892d4a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:35.562659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806e019-43f2-455c-aaea-4874f892d4a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:35.564672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806e019-43f2-455c-aaea-4874f892d4a1 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:35.600895 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1922/3871] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:27:44.710812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5573a-2d6d-488c-9904-bc53f1c74d16 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:44.711349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5573a-2d6d-488c-9904-bc53f1c74d16 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:44.711349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5573a-2d6d-488c-9904-bc53f1c74d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:44.741995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-83e5573a-2d6d-488c-9904-bc53f1c74d16 None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:44.743605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83e5573a-2d6d-488c-9904-bc53f1c74d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:44.752368 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1950/3872] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:44.833552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a3076-0bbf-461a-939d-f24d8e07f2d8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:44.834046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a3076-0bbf-461a-939d-f24d8e07f2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:44.834277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a3076-0bbf-461a-939d-f24d8e07f2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:44.860475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-641a3076-0bbf-461a-939d-f24d8e07f2d8 None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:44.862933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-641a3076-0bbf-461a-939d-f24d8e07f2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:44.870600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1923/3873] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:44.969959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:44.970280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:44.970563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:44.997243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:44.999049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.009059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1951/3874] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:45.148337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3099fe-749f-4c51-936b-89c17c1990c5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:45.148651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3099fe-749f-4c51-936b-89c17c1990c5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:45.148933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3099fe-749f-4c51-936b-89c17c1990c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:45.172732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1a3099fe-749f-4c51-936b-89c17c1990c5 None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:45.182802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1a3099fe-749f-4c51-936b-89c17c1990c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.193987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1924/3875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:45.206917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:45.208867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.244712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016c17-548e-4587-aaeb-bd54c5e8516c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:45.245071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016c17-548e-4587-aaeb-bd54c5e8516c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:45.245279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7016c17-548e-4587-aaeb-bd54c5e8516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:45.285203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7016c17-548e-4587-aaeb-bd54c5e8516c None None] MFA Rules not processed for user `9718b1b9b0a34bc09d105a1849bcf0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:45.287090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7016c17-548e-4587-aaeb-bd54c5e8516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.302454 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1925/3876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:45.372536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba190c-71ac-40be-8a1a-8e4dac1b10dc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:45.383909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:45.384746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:45.385037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:45.385322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] PATH_INFO: `/v3/users/39bd97a54a674af3babcfe185e0a9baa` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:45.401018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bd97a54a674af3babcfe185e0a9baa)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:45.401018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:45.480740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bd97a54a674af3babcfe185e0a9baa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:45.496869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bd97a54a674af3babcfe185e0a9baa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:45.497984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bd97a54a674af3babcfe185e0a9baa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:45.498837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bd97a54a674af3babcfe185e0a9baa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:45.509784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bd97a54a674af3babcfe185e0a9baa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:45.511927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:45.535747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1952/3877] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:45 2022] DELETE /identity/v3/users/39bd97a54a674af3babcfe185e0a9baa => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:45.541314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6f036-5c70-4df2-a577-6ae7edb7d856 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:45.541927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6f036-5c70-4df2-a577-6ae7edb7d856 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:45.542440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6f036-5c70-4df2-a577-6ae7edb7d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:45.590276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bcc6f036-5c70-4df2-a577-6ae7edb7d856 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:45.595020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bcc6f036-5c70-4df2-a577-6ae7edb7d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.779850 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1926/3878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:45.802458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:45.804828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.889167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fde96-be79-43bd-b056-c8a4159f0d71 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:45.890048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fde96-be79-43bd-b056-c8a4159f0d71 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:45.890780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fde96-be79-43bd-b056-c8a4159f0d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:45.922954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b50fde96-be79-43bd-b056-c8a4159f0d71 None None] MFA Rules not processed for user `4adcdf3712b443c18ff496cf5ff735ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:45.926687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b50fde96-be79-43bd-b056-c8a4159f0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:45.972111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d039a1-69c6-43db-b82b-59fe9a510684 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:45.985465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:45.987606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:45.987953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:45.988146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:46.011967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:46.026487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:46.032274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:46.058923 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1953/3879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:46.068530 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1927/3880] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:46.975242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:47.009503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:47.022360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84193288-dd5b-481a-92a6-61f0fe090f49 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:47.042301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:47.046850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:47.047982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:47.048349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] PATH_INFO: `/v3/projects/a9bcc8b0003a4991890b8c6c23f69989` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:47.051055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bcc8b0003a4991890b8c6c23f69989)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:47.053035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:47.134538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bcc8b0003a4991890b8c6c23f69989', 'request_id': 'req-bddc5c60-7d32-4801-ad94-82ce5d1be3db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:47.146044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bcc8b0003a4991890b8c6c23f69989', 'request_id': 'req-bddc5c60-7d32-4801-ad94-82ce5d1be3db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:47.155244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bcc8b0003a4991890b8c6c23f69989', 'request_id': 'req-bddc5c60-7d32-4801-ad94-82ce5d1be3db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:47.213875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] The token cache is being invalidate because project a9bcc8b0003a4991890b8c6c23f69989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:47.214233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:47.216554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bddc5c60-7d32-4801-ad94-82ce5d1be3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:47.218793 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1954/3881] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:46 2022] DELETE /identity/v3/projects/a9bcc8b0003a4991890b8c6c23f69989 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:47.224323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:47.224914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:47.225107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:47.279307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:47.280833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:47.429997 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1928/3882] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:47.435885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aef74-8659-485e-bc03-872496d2386b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:47.436225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aef74-8659-485e-bc03-872496d2386b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:47.436623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aef74-8659-485e-bc03-872496d2386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:47.481392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-490aef74-8659-485e-bc03-872496d2386b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:47.483350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-490aef74-8659-485e-bc03-872496d2386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:47.512390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:47.523631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1955/3883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:27:47.528978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03211519-6a33-49dd-a79f-0e091cbbbc22 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:47.545160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:47.545925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:47.546237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:47.546509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:47.547615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:27:47.548113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:47.552338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:47.603116 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1929/3884] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:47.606691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aef74-8659-485e-bc03-872496d2386b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:47.619743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aef74-8659-485e-bc03-872496d2386b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:47.643835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:47.646615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:47.647632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:47.648801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:47.650416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:47.655291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:47.773057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1956/3885] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:47 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:27:47.773529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:47.787559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07656-d5d5-40d7-a3c9-61a92c915418 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:47.940855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:47.947726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:47.947726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:47.947726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:47.947726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:47.947726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:47.977451 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1930/3886] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:47 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:47.981329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:47.999908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed9b6-7db2-4146-88b1-c96dc54bdcc2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:48.010001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:48.011123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.011655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.012008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.013071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:48.015665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:48.037080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1957/3887] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:48.037526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:48.052305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362d0f-34cf-43c8-8288-841af1de3c73 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:48.061013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129ea6-0dee-4c8f-aa49-ebd10815aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:48.062018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129ea6-0dee-4c8f-aa49-ebd10815aa96 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.062362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129ea6-0dee-4c8f-aa49-ebd10815aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.063064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129ea6-0dee-4c8f-aa49-ebd10815aa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.063555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73129ea6-0dee-4c8f-aa49-ebd10815aa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:48.065840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73129ea6-0dee-4c8f-aa49-ebd10815aa96 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:48.091452 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1931/3888] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:27:48.097102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:48.113431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5787-6bb1-40b5-ac38-1e3085d36878 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:48.124317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:48.125553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.125942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.126411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0/users/195f5b487fe749db9ed2ebff0fab524a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.170078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff7fd913a1845adb0f82570346f88e0, user_id=195f5b487fe749db9ed2ebff0fab524a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:48.173399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:48.218347 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1958/3889] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:48 2022] PUT /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0/users/195f5b487fe749db9ed2ebff0fab524a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:48.230307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9de1-c580-4a3d-ab65-cd3cd93c1855 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.230908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9de1-c580-4a3d-ab65-cd3cd93c1855 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.230908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9de1-c580-4a3d-ab65-cd3cd93c1855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.315684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-116a9de1-c580-4a3d-ab65-cd3cd93c1855 None None] MFA Rules not processed for user `195f5b487fe749db9ed2ebff0fab524a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:48.316982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-116a9de1-c580-4a3d-ab65-cd3cd93c1855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:48.358791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:48.440955 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1932/3890] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:48.460093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:48.462377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:48.515697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:48.693577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b08cb-7da7-408e-8a8d-b27a2cfc0693 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:48.710262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:48.712980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.713530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.714751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.738235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:48.740785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:48.755954 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1959/3891] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:48.780288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706439-4adf-430a-b534-2addc2cdaa78 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.780610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706439-4adf-430a-b534-2addc2cdaa78 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.780910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706439-4adf-430a-b534-2addc2cdaa78 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.782607 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1933/3892] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:27:48.788827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:27:48.807793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:48.821822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337ae74-418d-4999-bd82-f45076554e76 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:48.827902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195f5b487fe749db9ed2ebff0fab524a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff7fd913a1845adb0f82570346f88e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:48.829544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:48.829937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:48.831169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:48.832598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorizing `identity:get_project(project_id=cff7fd913a1845adb0f82570346f88e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:48.835187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:48.849682 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1960/3893] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:27:48 2022] GET /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0 => generated 365 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:49.078724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378d0b-4f28-460f-99e4-dffab8627d6f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.079155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378d0b-4f28-460f-99e4-dffab8627d6f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.079713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378d0b-4f28-460f-99e4-dffab8627d6f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.082108 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1934/3894] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:27:49.109337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:27:49.141457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:49.163956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064991-b987-473e-95d4-f3c2b627a1c1 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:49.172176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195f5b487fe749db9ed2ebff0fab524a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff7fd913a1845adb0f82570346f88e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:49.173252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.173763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.174968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.176836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorizing `identity:get_project(project_id=cff7fd913a1845adb0f82570346f88e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:49.179277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:49.193548 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1961/3895] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:27:49 2022] GET /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0 => generated 365 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:27:49.280504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cb29b-8d58-4151-aaba-86408e8ec5c5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.281639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cb29b-8d58-4151-aaba-86408e8ec5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.282272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cb29b-8d58-4151-aaba-86408e8ec5c5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.287604 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1935/3896] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:27:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 05:27:49.321356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:27:49.379834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:49.420942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a0df-f713-481d-914e-f570a70920c3 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:49.436206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195f5b487fe749db9ed2ebff0fab524a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff7fd913a1845adb0f82570346f88e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:49.438782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.440940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.441811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.446926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorizing `identity:get_project(project_id=cff7fd913a1845adb0f82570346f88e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:49.452178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:49.458202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1962/3897] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:27:49 2022] GET /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0 => generated 365 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:49.529028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4708-b92d-4a8f-ac0c-2bc0b2ee0899 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.529337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4708-b92d-4a8f-ac0c-2bc0b2ee0899 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.529606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4708-b92d-4a8f-ac0c-2bc0b2ee0899 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.531372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1936/3898] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:27:49.537746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:27:49.539836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:49.566224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:49.577707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051196a5-4142-4e1e-90b3-d1b39cf6a116 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:49.584866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195f5b487fe749db9ed2ebff0fab524a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff7fd913a1845adb0f82570346f88e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:49.585749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.586377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.586813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.588152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorizing `identity:get_project(project_id=cff7fd913a1845adb0f82570346f88e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:49.590463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:49.593547 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1963/3899] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:27:49 2022] GET /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0 => generated 365 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:27:49.655527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c907da-37a9-47bc-b8be-d99cfe242dcc None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.655831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c907da-37a9-47bc-b8be-d99cfe242dcc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.656201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c907da-37a9-47bc-b8be-d99cfe242dcc None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.657431 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1937/3900] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:27:49.664756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating service token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 05:27:49.687450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:49.699964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7619-8c67-4032-af53-05ffec7e5e33 tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:49.708547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6daa1-dbe6-4ad1-a703-82bcca4a3a4b tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195f5b487fe749db9ed2ebff0fab524a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff7fd913a1845adb0f82570346f88e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:49.710520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6daa1-dbe6-4ad1-a703-82bcca4a3a4b tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.711065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6daa1-dbe6-4ad1-a703-82bcca4a3a4b tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.711896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6daa1-dbe6-4ad1-a703-82bcca4a3a4b tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.713903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6daa1-dbe6-4ad1-a703-82bcca4a3a4b tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorizing `identity:get_project(project_id=cff7fd913a1845adb0f82570346f88e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:49.716281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6daa1-dbe6-4ad1-a703-82bcca4a3a4b tempest-QuotasTestJSON-1116715013 tempest-QuotasTestJSON-1116715013-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:49.718600 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1964/3901] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 05:27:49 2022] GET /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0 => generated 365 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:49.791414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c907da-37a9-47bc-b8be-d99cfe242dcc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:49.945504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c907da-37a9-47bc-b8be-d99cfe242dcc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:49.959252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:49.960839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:49.962640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:49.963406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] PATH_INFO: `/v3/users/195f5b487fe749db9ed2ebff0fab524a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:49.968676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=195f5b487fe749db9ed2ebff0fab524a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:49.978058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:50.092159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195f5b487fe749db9ed2ebff0fab524a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:50.113528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195f5b487fe749db9ed2ebff0fab524a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:50.114722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195f5b487fe749db9ed2ebff0fab524a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:50.116469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195f5b487fe749db9ed2ebff0fab524a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:50.143276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195f5b487fe749db9ed2ebff0fab524a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:50.232370 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1938/3902] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:49 2022] DELETE /identity/v3/users/195f5b487fe749db9ed2ebff0fab524a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:50.233866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:50.233866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:50.233866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:50.294422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:50.296710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:50.453158 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1965/3903] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:50.465153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:50.466673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:50.559859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:50.568243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218229ce-13cd-4859-a0e8-ba96c143f7af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:50.575701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4450b-3331-4fd3-a385-f4763771943d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:50.576660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4450b-3331-4fd3-a385-f4763771943d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:50.577296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4450b-3331-4fd3-a385-f4763771943d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:50.578922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4450b-3331-4fd3-a385-f4763771943d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:50.593366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4450b-3331-4fd3-a385-f4763771943d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:50.595284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4450b-3331-4fd3-a385-f4763771943d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:50.609134 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1939/3904] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:51.067852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:51.069594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:51.090775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9fbf-df20-418a-89a5-4d35266cff2f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:51.104940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:51.105624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:51.105975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:51.106774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] PATH_INFO: `/v3/projects/cff7fd913a1845adb0f82570346f88e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:51.107664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff7fd913a1845adb0f82570346f88e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:51.110064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:51.176440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff7fd913a1845adb0f82570346f88e0', 'request_id': 'req-301f6d28-8457-4850-81a9-7e902a157c03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:51.178921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:51.188150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff7fd913a1845adb0f82570346f88e0', 'request_id': 'req-301f6d28-8457-4850-81a9-7e902a157c03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:51.199746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff7fd913a1845adb0f82570346f88e0', 'request_id': 'req-301f6d28-8457-4850-81a9-7e902a157c03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:51.224761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] The token cache is being invalidate because project cff7fd913a1845adb0f82570346f88e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:51.225410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:51.226353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-301f6d28-8457-4850-81a9-7e902a157c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:51.229998 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1966/3905] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:51 2022] DELETE /identity/v3/projects/cff7fd913a1845adb0f82570346f88e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:51.242873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:51.243560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:51.243560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:51.290364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:51.296287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:51.453421 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1940/3906] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:51.550477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:51.551030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:51.551030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:51.584259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:51.585754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:51.637921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:51.643236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:51.679707 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1967/3907] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:51.680903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:51.716222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15258f-cb0f-4dde-b4c8-11ab996dea80 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:51.733030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:51.742824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:51.743409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:51.745541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:51.748814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:27:51.749778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:51.752157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:51.778502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1968/3908] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:51.780007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:51.792717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2dc84-075e-4043-9b31-1e2ee30addf3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:51.798582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:51.800424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:51.800878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:51.801316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:51.802313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:51.804663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:51.805205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e325e-8e05-4cb0-82bc-bc94f450406a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:51.822436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:51.827131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:51.829124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:51.830084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:51.834982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:51.857904 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1969/3909] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:51 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:51.859266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:52.026415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:52.032113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:52.054173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308c1e-3dcb-4342-a7c0-ba16350d718a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:52.054173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:52.054173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:52.054173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:52.054708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:52.054708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:52.057474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:52.062105 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1941/3910] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:52.116337 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1970/3911] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:51 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:52.117677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:52.135554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a37b6-156e-442d-b812-a341dba901e2 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:52.163625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:52.164408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:52.167189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:52.167189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:52.172755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:52.175554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:52.206104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1942/3912] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:52.208621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:52.227912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063422-3612-4e5d-b3e6-b654205ac30f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:52.245512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68d91c-0abe-4cf5-a091-b775b2dbd53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:52.246795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68d91c-0abe-4cf5-a091-b775b2dbd53e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:52.247458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68d91c-0abe-4cf5-a091-b775b2dbd53e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:52.247913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68d91c-0abe-4cf5-a091-b775b2dbd53e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:52.248752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68d91c-0abe-4cf5-a091-b775b2dbd53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:52.256324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68d91c-0abe-4cf5-a091-b775b2dbd53e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:52.276218 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1971/3913] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:52.277101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:52.294132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455ead0-50c5-4933-92ab-e0b5637b5641 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:52.307161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:52.308100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:52.308452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:52.309252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] PATH_INFO: `/v3/projects/b3515f68240a4c8085484db6088bcada/users/568416488fa5484d83a7aedc493912ee/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:52.327852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:52.349211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3515f68240a4c8085484db6088bcada, user_id=568416488fa5484d83a7aedc493912ee, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:52.353830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:52.436876 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1943/3914] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:52 2022] PUT /identity/v3/projects/b3515f68240a4c8085484db6088bcada/users/568416488fa5484d83a7aedc493912ee/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:52.463035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:52.463334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:52.463615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:52.520623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] MFA Rules not processed for user `568416488fa5484d83a7aedc493912ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:52.521817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:52.671726 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1972/3915] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:52.674110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:52.875478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765335d7-91ed-42f4-bb95-e8d4f70ba789 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:52.882533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:52.884285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:52.884574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:52.884827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:52.886470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:52.892348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:52.966295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1944/3916] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:52 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:27:52.969196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:52.987950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:52.996177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd404788-ebe7-4d3c-ad23-d9ba68b49b60 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:53.208978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:53.209634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.209923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.210232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.210887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:53.226561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:53.294985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1973/3917] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:52 2022] POST /identity/v3/users => generated 295 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:53.299331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:53.318196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d8ea8-6c5e-4c0a-ad28-1be1f6c89b59 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:53.333672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:53.334358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.334642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.334921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.335572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:53.337189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:53.353382 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1945/3918] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:53.354409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:53.372170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4bcf3-aae2-40a8-b4ac-4cd3335c15b0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:53.396397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:53.399408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.401778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.403466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] PATH_INFO: `/v3/projects/21531fb386bd457a81918a9691da1f81/users/0d2a33364c644d86b505ab0bd28dea2f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.438040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21531fb386bd457a81918a9691da1f81, user_id=0d2a33364c644d86b505ab0bd28dea2f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:53.443207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:53.470471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:53.472441 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1974/3919] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:53 2022] PUT /identity/v3/projects/21531fb386bd457a81918a9691da1f81/users/0d2a33364c644d86b505ab0bd28dea2f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:53.487362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb161b-e2db-4040-9912-02f6114ce4a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:53.625514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6497932-d3e1-4f5a-8466-dac74aef9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:53.626187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6497932-d3e1-4f5a-8466-dac74aef9074 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.626732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6497932-d3e1-4f5a-8466-dac74aef9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.628081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6497932-d3e1-4f5a-8466-dac74aef9074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.628822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6497932-d3e1-4f5a-8466-dac74aef9074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:53.632310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6497932-d3e1-4f5a-8466-dac74aef9074 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:53.650610 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1946/3920] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:53.654623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:53.675084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ce5b-1c05-43d2-95ec-f71a23e24913 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:53.687008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:53.688011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.688714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.689247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] PATH_INFO: `/v3/projects/21531fb386bd457a81918a9691da1f81/users/0d2a33364c644d86b505ab0bd28dea2f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.693645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=21531fb386bd457a81918a9691da1f81, user_id=0d2a33364c644d86b505ab0bd28dea2f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:53.697697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:53.719959 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1975/3921] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:53 2022] PUT /identity/v3/projects/21531fb386bd457a81918a9691da1f81/users/0d2a33364c644d86b505ab0bd28dea2f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:27:53.730950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.731410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.731410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.822623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] MFA Rules not processed for user `0d2a33364c644d86b505ab0bd28dea2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:53.834966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:53.903053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:53.937781 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1947/3922] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:53.943406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:53.964440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af96cfc-e460-45d3-bdce-47ace0aea0ca admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:53.977449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:53.981858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:53.982191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:53.982469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:53.985243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:53.986257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:54.042083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1976/3923] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:27:53 2022] POST /identity/v3/domains => generated 245 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:27:54.046818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:54.058470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f999ebe-077d-4662-ae9b-50b419c85d75 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:54.227631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:54.227631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:54.227631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:54.228131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:54.230423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:54.233601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:54.336232 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1948/3924] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:27:54 2022] POST /identity/v3/projects => generated 409 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:54.337251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:54.358516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8428a2-f92b-4fcf-8256-7bf2422d9f0b tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:54.534404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:54.535018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:54.535310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:54.535594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:54.539119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:54.546081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:54.601066 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1977/3925] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:27:54 2022] POST /identity/v3/users => generated 347 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:27:54.604606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:54.621167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9432df9-f017-49c1-a146-7446e2f879f5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:54.651384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54151f35-6802-487e-9f54-b4bfa7d58a42 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:54.651950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151f35-6802-487e-9f54-b4bfa7d58a42 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:54.652238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151f35-6802-487e-9f54-b4bfa7d58a42 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:54.652519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54151f35-6802-487e-9f54-b4bfa7d58a42 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:54.653185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54151f35-6802-487e-9f54-b4bfa7d58a42 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:54.661445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54151f35-6802-487e-9f54-b4bfa7d58a42 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:54.713652 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1949/3926] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:27:54.718055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:54.734814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0076e-5cdf-4131-9eb1-f85ea57227a0 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:54.754133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d530b0-cb44-4293-afb2-1fa99d4d6f55 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:54.755222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d530b0-cb44-4293-afb2-1fa99d4d6f55 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:54.755752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d530b0-cb44-4293-afb2-1fa99d4d6f55 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:54.756263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d530b0-cb44-4293-afb2-1fa99d4d6f55 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/projects/7d07571463b245c3b2da66e459c78a9f/users/5204e5479f41444cb5ec83512b462087/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:54.781685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d530b0-cb44-4293-afb2-1fa99d4d6f55 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d07571463b245c3b2da66e459c78a9f, user_id=5204e5479f41444cb5ec83512b462087, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:54.785750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d530b0-cb44-4293-afb2-1fa99d4d6f55 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:54.825402 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1978/3927] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:27:54 2022] PUT /identity/v3/projects/7d07571463b245c3b2da66e459c78a9f/users/5204e5479f41444cb5ec83512b462087/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:54.832631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:54.833158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:54.833286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:55.117331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] MFA Rules not processed for user `5204e5479f41444cb5ec83512b462087`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:55.118971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:55.153626 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1950/3928] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:54 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:55.165016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:55.165500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:55.165819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:55.203847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] MFA Rules not processed for user `5204e5479f41444cb5ec83512b462087`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:55.205615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:55.223037 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1979/3929] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:55 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:27:55.224421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:55.271989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952762a-dc39-4b07-93ab-5b98b3a1521c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:55.287156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5204e5479f41444cb5ec83512b462087', 'user_domain_id': '938eca34deae4d75a71ff60e26051954', 'system_scope': None, 'project_id': '7d07571463b245c3b2da66e459c78a9f', 'project_domain_id': '938eca34deae4d75a71ff60e26051954', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:55.295741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:55.296048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:55.296334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:55.337376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:55.339909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:55.387902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1951/3930] 10.222.0.23 () {56 vars in 1284 bytes} [Mon Oct 31 05:27:55 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:55.392442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:55.404517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:55.585943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34ddf-eaca-400e-a8ec-0d09a1004e85 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:55.615940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:55.626925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:55.627733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:55.628447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/users/5204e5479f41444cb5ec83512b462087` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:55.630271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5204e5479f41444cb5ec83512b462087)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:55.632232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:55.734889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5204e5479f41444cb5ec83512b462087'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:55.774292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5204e5479f41444cb5ec83512b462087'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:55.775454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5204e5479f41444cb5ec83512b462087'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:55.776339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5204e5479f41444cb5ec83512b462087'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:55.787178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5204e5479f41444cb5ec83512b462087'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:55.808753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1980/3931] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:55 2022] DELETE /identity/v3/users/5204e5479f41444cb5ec83512b462087 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:55.812799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:55.824172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:55.829891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c4a0-18ea-4d70-9bb7-79e9afed7004 tempest-test_project-184572104 tempest-user-618368684] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:55.920356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:55.925540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:55.926382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:55.926675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/projects/7d07571463b245c3b2da66e459c78a9f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:55.928375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d07571463b245c3b2da66e459c78a9f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:55.930375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:56.007136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d07571463b245c3b2da66e459c78a9f', 'request_id': 'req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.040105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d07571463b245c3b2da66e459c78a9f', 'request_id': 'req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.058257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d07571463b245c3b2da66e459c78a9f', 'request_id': 'req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.088177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] The token cache is being invalidate because project 7d07571463b245c3b2da66e459c78a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:56.088177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.088177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.091626 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1952/3932] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:55 2022] DELETE /identity/v3/projects/7d07571463b245c3b2da66e459c78a9f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:56.095496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:56.097586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:56.116180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5479eb-ca6e-403e-a090-da4f46a13c0f tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:56.203952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:56.204619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:56.204905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:56.206073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/domains/938eca34deae4d75a71ff60e26051954` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:56.207517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=938eca34deae4d75a71ff60e26051954)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:56.209460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:56.273433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '938eca34deae4d75a71ff60e26051954'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.277989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '938eca34deae4d75a71ff60e26051954'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.295055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:56.345593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '938eca34deae4d75a71ff60e26051954'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.348152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '938eca34deae4d75a71ff60e26051954'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.356878 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1981/3933] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:27:56 2022] PATCH /identity/v3/domains/938eca34deae4d75a71ff60e26051954 => generated 246 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:27:56.359268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:56.360726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:56.379406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495bb5-524f-4f7a-8799-a3c8f9dd8dc4 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:56.537004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d2a33364c644d86b505ab0bd28dea2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21531fb386bd457a81918a9691da1f81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:56.537673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:56.537958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:56.538256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] PATH_INFO: `/v3/domains/938eca34deae4d75a71ff60e26051954` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:56.559060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=938eca34deae4d75a71ff60e26051954)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:56.562269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:56.603051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '938eca34deae4d75a71ff60e26051954'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.609355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:56.616026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '938eca34deae4d75a71ff60e26051954'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.704872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938eca34deae4d75a71ff60e26051954', 'request_id': 'req-3d70f9df-6f5e-4b10-be7c-79526de43de5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.713199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938eca34deae4d75a71ff60e26051954', 'request_id': 'req-3d70f9df-6f5e-4b10-be7c-79526de43de5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.728752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938eca34deae4d75a71ff60e26051954', 'request_id': 'req-3d70f9df-6f5e-4b10-be7c-79526de43de5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.758336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] The token cache is being invalidate because project 938eca34deae4d75a71ff60e26051954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:56.758748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.759625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.774850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '938eca34deae4d75a71ff60e26051954', 'request_id': 'req-3d70f9df-6f5e-4b10-be7c-79526de43de5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.781953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '938eca34deae4d75a71ff60e26051954', 'request_id': 'req-3d70f9df-6f5e-4b10-be7c-79526de43de5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.784503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3d70f9df-6f5e-4b10-be7c-79526de43de5 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '938eca34deae4d75a71ff60e26051954', 'request_id': 'req-3d70f9df-6f5e-4b10-be7c-79526de43de5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:56.822930 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1953/3934] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:27:56 2022] DELETE /identity/v3/domains/938eca34deae4d75a71ff60e26051954 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:56.824852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:56.827352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:57.023903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac133-5913-425c-b689-086c0cc97bc9 tempest-TestDefaultProjectId-1062060313 tempest-TestDefaultProjectId-1062060313-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:57.159069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:57.160544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:57.161557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:57.162613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] PATH_INFO: `/v3/users/568416488fa5484d83a7aedc493912ee` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:57.166748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568416488fa5484d83a7aedc493912ee)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:57.169469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:57.280236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568416488fa5484d83a7aedc493912ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:57.326630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568416488fa5484d83a7aedc493912ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:57.328475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568416488fa5484d83a7aedc493912ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:57.329919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568416488fa5484d83a7aedc493912ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:57.354520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568416488fa5484d83a7aedc493912ee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:57.387459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1982/3935] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:56 2022] DELETE /identity/v3/users/568416488fa5484d83a7aedc493912ee => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:57.393476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:57.394035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:57.394790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:57.442674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:27:57.451929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:57.622119 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1954/3936] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:27:57.869839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:57.871486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:57.902837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:58.008121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79696b4c-0396-4733-bb8b-501b05517ad0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:58.016806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:58.017907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:58.018493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:58.018961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:58.043278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:58.045013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:58.070967 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1983/3937] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:27:59.549067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:59.550572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:27:59.584599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715396-b7f6-4c2c-8a33-a55e7d81f2c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:59.599196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:59.599886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:59.600173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:59.600453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] PATH_INFO: `/v3/projects/b3515f68240a4c8085484db6088bcada` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:59.602976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3515f68240a4c8085484db6088bcada)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:59.604287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:27:59.740406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3515f68240a4c8085484db6088bcada', 'request_id': 'req-e60da70e-51ad-4edb-89f9-f5604c36d1ec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:59.752050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3515f68240a4c8085484db6088bcada', 'request_id': 'req-e60da70e-51ad-4edb-89f9-f5604c36d1ec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:59.773229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3515f68240a4c8085484db6088bcada', 'request_id': 'req-e60da70e-51ad-4edb-89f9-f5604c36d1ec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:59.776004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:27:59.792721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] The token cache is being invalidate because project b3515f68240a4c8085484db6088bcada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:27:59.798612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:59.800016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:27:59.802451 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1955/3938] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:27:59 2022] DELETE /identity/v3/projects/b3515f68240a4c8085484db6088bcada => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:27:59.806021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:27:59.826164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887ee03-70c2-4103-8e32-2fa4c6c48b43 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:27:59.952448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:27:59.953113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:27:59.953397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:27:59.953675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] PATH_INFO: `/v3/users/0d2a33364c644d86b505ab0bd28dea2f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:27:59.956672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2a33364c644d86b505ab0bd28dea2f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:27:59.958673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:00.052468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2a33364c644d86b505ab0bd28dea2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:00.069049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2a33364c644d86b505ab0bd28dea2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:00.069867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2a33364c644d86b505ab0bd28dea2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:00.071001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2a33364c644d86b505ab0bd28dea2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:00.079695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7f6193f-5cc3-467b-90e6-5c7e37738b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2a33364c644d86b505ab0bd28dea2f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:00.108599 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1984/3939] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:27:59 2022] DELETE /identity/v3/users/0d2a33364c644d86b505ab0bd28dea2f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:01.369810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:01.371446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:01.395989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60da70e-51ad-4edb-89f9-f5604c36d1ec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:01.701388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:01.702303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:01.702591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:01.702874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] PATH_INFO: `/v3/projects/21531fb386bd457a81918a9691da1f81` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:01.711547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21531fb386bd457a81918a9691da1f81)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:01.713551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:01.838876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21531fb386bd457a81918a9691da1f81', 'request_id': 'req-79064efb-949b-4d49-8921-610867fa3c71'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:01.858071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21531fb386bd457a81918a9691da1f81', 'request_id': 'req-79064efb-949b-4d49-8921-610867fa3c71'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:01.879084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21531fb386bd457a81918a9691da1f81', 'request_id': 'req-79064efb-949b-4d49-8921-610867fa3c71'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:01.899408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] The token cache is being invalidate because project 21531fb386bd457a81918a9691da1f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:01.900019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:01.900841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-79064efb-949b-4d49-8921-610867fa3c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:01.902842 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1956/3940] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:01 2022] DELETE /identity/v3/projects/21531fb386bd457a81918a9691da1f81 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:01.908953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:01.909478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:01.909593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:01.946875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:01.948985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:02.021962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:02.130016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:02.130657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:02.131076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:02.134410 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1985/3941] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:02.170127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:02.173012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:02.209648 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1957/3942] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:02.210589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:02.235932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855116-e61b-4e6d-88cb-e854bf67061c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:02.253180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:02.254110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:02.254582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:02.255048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:02.255887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:02.256378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:02.267117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:02.297313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1986/3943] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:02.301088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:02.311175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6e61a-439a-44da-9427-93706d24d2b0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:02.325005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:02.325696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:02.325986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:02.326292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:02.326964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:02.328946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:02.400535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1958/3944] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:02 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:28:02.404680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:02.429535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:02.432675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e786d-5f38-413b-a411-2ec2fcdfaefa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:02.435342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:02.599052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:02.604316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e52e-c6e1-4223-954e-09aca239fa3e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:02.619940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:02.620613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:02.620898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:02.621178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] PATH_INFO: `/v3/users/9718b1b9b0a34bc09d105a1849bcf0f2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:02.621474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:02.622395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9718b1b9b0a34bc09d105a1849bcf0f2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:02.623950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:02.624262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:02.624966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:02.625205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:02.626520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:02.627971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:02.717042 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1987/3945] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:02 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:02.722330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:02.735679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9718b1b9b0a34bc09d105a1849bcf0f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:02.743344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394971b6-b405-4566-93a4-606c1d99e240 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:02.748919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9718b1b9b0a34bc09d105a1849bcf0f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:02.749719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9718b1b9b0a34bc09d105a1849bcf0f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:02.750441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9718b1b9b0a34bc09d105a1849bcf0f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:02.754822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:02.755669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:02.756124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:02.756583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:02.757695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:02.759625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:02.763125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9718b1b9b0a34bc09d105a1849bcf0f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:02.789768 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1988/3946] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:02.790466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:02.793782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:02.798515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1959/3947] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:02 2022] DELETE /identity/v3/users/9718b1b9b0a34bc09d105a1849bcf0f2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:02.819850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14774cfe-39cc-4197-91f7-700e2c037e56 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:03.089940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e871d5-3a68-44fa-bba9-7e3b6fa7c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:03.094304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e871d5-3a68-44fa-bba9-7e3b6fa7c764 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.094304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e871d5-3a68-44fa-bba9-7e3b6fa7c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.096664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e871d5-3a68-44fa-bba9-7e3b6fa7c764 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.109481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e871d5-3a68-44fa-bba9-7e3b6fa7c764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:03.117131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e871d5-3a68-44fa-bba9-7e3b6fa7c764 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:03.142182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1989/3948] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:03.146947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:03.165893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bada01-30da-44ef-a2cf-e71973ab4bcd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:03.199843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:03.204024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.204314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.205086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] PATH_INFO: `/v3/projects/7ad96d6ea24e44fcbeb32f8224b92d31/users/79ea8c4411f349c39d00e4caabaf73c0/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.247159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad96d6ea24e44fcbeb32f8224b92d31, user_id=79ea8c4411f349c39d00e4caabaf73c0, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:03.249859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:03.313847 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1960/3949] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:03 2022] PUT /identity/v3/projects/7ad96d6ea24e44fcbeb32f8224b92d31/users/79ea8c4411f349c39d00e4caabaf73c0/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:03.317850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.318495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.319070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.340159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:03.342390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:03.464566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] MFA Rules not processed for user `79ea8c4411f349c39d00e4caabaf73c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:03.467397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:03.604208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:03.645900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bbbd7-c894-4a9a-8187-e6a68bb8505c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:03.661163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:03.662197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.665223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.665746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] PATH_INFO: `/v3/projects/e0f1808504704f0890542dbf6c4c4860` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.668088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f1808504704f0890542dbf6c4c4860)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:03.670034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:03.721330 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1990/3950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:03.731504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:03.753223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3560e3-5bef-46ce-95e8-cc4bb1f96607 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:03.765641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:03.766433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.767175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.767743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.768703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:03.773744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:03.795064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f1808504704f0890542dbf6c4c4860', 'request_id': 'req-bbd79921-55ce-4973-b933-09fd4fe6e4b3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:03.805513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:03.810460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f1808504704f0890542dbf6c4c4860', 'request_id': 'req-bbd79921-55ce-4973-b933-09fd4fe6e4b3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:03.829396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f1808504704f0890542dbf6c4c4860', 'request_id': 'req-bbd79921-55ce-4973-b933-09fd4fe6e4b3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:03.845215 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1991/3951] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:03 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:03.849806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:03.853300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] The token cache is being invalidate because project e0f1808504704f0890542dbf6c4c4860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:03.853597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:03.854402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbd79921-55ce-4973-b933-09fd4fe6e4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:03.862962 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1961/3952] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:03 2022] DELETE /identity/v3/projects/e0f1808504704f0890542dbf6c4c4860 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:03.869574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de9f5-afac-449e-8194-2228bae699a8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.869857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de9f5-afac-449e-8194-2228bae699a8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.870364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de9f5-afac-449e-8194-2228bae699a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.908002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-340de9f5-afac-449e-8194-2228bae699a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:03.910391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-340de9f5-afac-449e-8194-2228bae699a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:03.936975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5406-401b-404d-b4f1-fb2a37002df4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:03.944539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:03.945780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:03.945969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:03.946380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:03.947149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:03.949466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:03.990723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1992/3953] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:03 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:03.995661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.000597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:04.035153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a519da3-d922-472b-a6d7-84d2bfb59853 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.042193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1962/3954] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:04.048154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.048880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.049850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.050139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.050431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.050820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.051195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.051709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.053092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.075493 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1993/3955] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:28:04.079372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.099992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:04.100292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5e929-dc59-4128-b7d4-60f0f192f342 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.103207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:04.113365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.114048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.114355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.114636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] PATH_INFO: `/v3/projects/866fa5d0cd084ff2ba5748d907b68385/users/feac41f3d6fc40fd98c404cd38f4efa2/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.120595 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1963/3956] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:04.125509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.142284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866fa5d0cd084ff2ba5748d907b68385, user_id=feac41f3d6fc40fd98c404cd38f4efa2, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.145309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.154656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75293-08cb-474b-926a-6da15fe5c5cd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.171856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.174561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.175439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.175879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.179359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:04.179805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.181566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1994/3957] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:04 2022] PUT /identity/v3/projects/866fa5d0cd084ff2ba5748d907b68385/users/feac41f3d6fc40fd98c404cd38f4efa2/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:28:04.183911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.185346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.239216 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1964/3958] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:28:04.254431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.301185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd104ff-9a54-4930-99ea-9ac57a6690c7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.370171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda64a-d740-47b2-ae3c-75d3a1965817 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.371942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa4b96-7ad9-4612-8ae3-6d3d445304a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.372343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4b96-7ad9-4612-8ae3-6d3d445304a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.372634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4b96-7ad9-4612-8ae3-6d3d445304a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.372914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4b96-7ad9-4612-8ae3-6d3d445304a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.379736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa4b96-7ad9-4612-8ae3-6d3d445304a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.379736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa4b96-7ad9-4612-8ae3-6d3d445304a7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.380803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:04.405084 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1995/3959] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:28:04.406598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.406716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.406975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.461588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] MFA Rules not processed for user `2512010236034319952ea34c2a76a96b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:04.463064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:04.484080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.484856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.485295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.485679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.487423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.490576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.549567 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1965/3960] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/projects => generated 393 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:04.551041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.638137 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1996/3961] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:04.638137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.665291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407b38-e033-4b85-a118-5cad88b0f54e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.682793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:04.716217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd250-10df-4dbe-8c4f-db85dd58f1e3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.729634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d420a-ade5-4875-9c7e-13b88d40da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.730409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d420a-ade5-4875-9c7e-13b88d40da58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.730702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d420a-ade5-4875-9c7e-13b88d40da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.731615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d420a-ade5-4875-9c7e-13b88d40da58 admin admin] PATH_INFO: `/v3/projects/866fa5d0cd084ff2ba5748d907b68385/users/feac41f3d6fc40fd98c404cd38f4efa2/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.734128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d420a-ade5-4875-9c7e-13b88d40da58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866fa5d0cd084ff2ba5748d907b68385, user_id=feac41f3d6fc40fd98c404cd38f4efa2, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.737407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d420a-ade5-4875-9c7e-13b88d40da58 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.749721 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1966/3962] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:04 2022] PUT /identity/v3/projects/866fa5d0cd084ff2ba5748d907b68385/users/feac41f3d6fc40fd98c404cd38f4efa2/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:04.771027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.771410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.771757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.810027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] MFA Rules not processed for user `feac41f3d6fc40fd98c404cd38f4efa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:04.811439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:04.818708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.820001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.820353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.820637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.821668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.823752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.885670 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1997/3963] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:04.893220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.917097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00840b-298a-4287-b4e4-a392d5356d24 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.919891 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1967/3964] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:04.921171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.933660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bf631-ccbd-4937-bc01-12b6ee454b84 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.939662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.942017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.942599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.942982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:04.943954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:04.945999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invalid input for field 'name': '' is too short Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: On instance['name']: Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: On instance['name']: Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: '' Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise error Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application '' Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.971047 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:28:04.972929 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application '' Oct 31 05:28:04.975393 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:04.977510 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1968/3965] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/domains => generated 283 bytes in 57 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:28:04.978434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:04.991629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9972a4-064a-4921-95c3-5fa8f83a2699 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:04.998064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:04.998772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:04.999053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:04.999323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.000010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.002477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: On instance['name']: Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: On instance['name']: Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise error Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:05.012381 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 31 05:28:05.014046 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 05:28:05.016302 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.019112 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1969/3966] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:28:04 2022] POST /identity/v3/domains => generated 412 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:28:05.020018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.032600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b0043-6de1-4a2a-ba17-af26f39fb422 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.037726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.041114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.041489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.041777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.042539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.044185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.062989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.064375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.065863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.066564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.067605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.078600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.079465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1970/3967] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:28:05 2022] POST /identity/v3/domains => generated 275 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:05.084101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.109378 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1998/3968] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:05.114777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.139611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1e4a9-7e54-4293-8883-e0380f9ec87b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.203382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:05.241446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55e87-b3d6-46e2-9a9e-a0d9475081d8 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.253784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.254479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.254770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.256433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/616b50b2d424495db3be5b461a21caa2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.316951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=616b50b2d424495db3be5b461a21caa2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.318645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.325112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.325773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.326057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.326362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.327022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.328648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.357747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 1999/3969] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:05.358737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 31 05:28:05.361787 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 31 05:28:05.363076 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:05.371198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1971/3970] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:28:05 2022] DELETE /identity/v3/domains/616b50b2d424495db3be5b461a21caa2 => generated 120 bytes in 287 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:28:05.375460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.377237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48090087-5e29-41eb-8aab-104f4a61fdff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.382576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0e5c6-44e2-415d-87e5-e399643e888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.383254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0e5c6-44e2-415d-87e5-e399643e888f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.383538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0e5c6-44e2-415d-87e5-e399643e888f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.383818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0e5c6-44e2-415d-87e5-e399643e888f admin admin] PATH_INFO: `/v3/projects/7b7a441b95c747e082a84cd7fda57903/users/535a335d59cc400fb6d573f536fa808e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.394838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e23851-1b15-4a79-b961-f5ead46bfb44 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.402494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0e5c6-44e2-415d-87e5-e399643e888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7a441b95c747e082a84cd7fda57903, user_id=535a335d59cc400fb6d573f536fa808e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.405562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0e5c6-44e2-415d-87e5-e399643e888f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.411614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.412768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.426354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.427652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/616b50b2d424495db3be5b461a21caa2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.432096 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2000/3971] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:05 2022] PUT /identity/v3/projects/7b7a441b95c747e082a84cd7fda57903/users/535a335d59cc400fb6d573f536fa808e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:05.432610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=616b50b2d424495db3be5b461a21caa2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.436882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.437512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.437788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.438064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.497423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:05.501069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:05.509757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '616b50b2d424495db3be5b461a21caa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.510872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '616b50b2d424495db3be5b461a21caa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.522721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:05.556367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '616b50b2d424495db3be5b461a21caa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.558574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '616b50b2d424495db3be5b461a21caa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.561331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1972/3972] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:28:05 2022] PATCH /identity/v3/domains/616b50b2d424495db3be5b461a21caa2 => generated 276 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:28:05.568108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.570465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:05.634072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2001/3973] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:05.693520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:05.695256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:05.762659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c3ba-5957-4ced-8ee1-ae823176e8dc tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.779024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.780131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.780429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.780717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/616b50b2d424495db3be5b461a21caa2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.807681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=616b50b2d424495db3be5b461a21caa2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:05.807921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312cb0b-d263-406e-9802-849eedf280cf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:05.809681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:05.866799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '616b50b2d424495db3be5b461a21caa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.877888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:05.877888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:05.878205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:05.879094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:05.885914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '616b50b2d424495db3be5b461a21caa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.896421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:05.958511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616b50b2d424495db3be5b461a21caa2', 'request_id': 'req-23a943f0-b060-4737-a483-11e46b737a1b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:05.974136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616b50b2d424495db3be5b461a21caa2', 'request_id': 'req-23a943f0-b060-4737-a483-11e46b737a1b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.004237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616b50b2d424495db3be5b461a21caa2', 'request_id': 'req-23a943f0-b060-4737-a483-11e46b737a1b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.019539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] The token cache is being invalidate because project 616b50b2d424495db3be5b461a21caa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:06.020181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.020869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.031814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '616b50b2d424495db3be5b461a21caa2', 'request_id': 'req-23a943f0-b060-4737-a483-11e46b737a1b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.032558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '616b50b2d424495db3be5b461a21caa2', 'request_id': 'req-23a943f0-b060-4737-a483-11e46b737a1b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.033957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '616b50b2d424495db3be5b461a21caa2', 'request_id': 'req-23a943f0-b060-4737-a483-11e46b737a1b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.066619 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1973/3974] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:28:05 2022] DELETE /identity/v3/domains/616b50b2d424495db3be5b461a21caa2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:06.070111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:06.072362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:06.089179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:06.090719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:06.138012 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2002/3975] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:28:06.186618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:UPDATE=1,keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:06.272077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a943f0-b060-4737-a483-11e46b737a1b tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:06.278602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:06.279400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:06.279763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:06.280119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/aae834de0f154d989e2e0f340bb101fd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:06.310059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Could not find domain: aae834de0f154d989e2e0f340bb101fd.: keystone.exception.DomainNotFound: Could not find domain: aae834de0f154d989e2e0f340bb101fd. Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: aae834de0f154d989e2e0f340bb101fd. Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:06.330968 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:28:06.332446 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:28:06.333632 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: aae834de0f154d989e2e0f340bb101fd. Oct 31 05:28:06.335893 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.340538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1974/3976] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:28:06 2022] DELETE /identity/v3/domains/aae834de0f154d989e2e0f340bb101fd => generated 112 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:28:06.345365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:06.367637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da274c6-276d-4219-a454-eb698ff0df43 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:06.380681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:06.381811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:06.382984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:06.383461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:06.384359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:06.386262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:06.430366 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2003/3977] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:28:06 2022] POST /identity/v3/domains => generated 251 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:06.434213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:06.452227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1edc4-4969-42b7-9728-cfc3f367a7eb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:06.576797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:06.577437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:06.577733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:06.578002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:06.578716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:06.580950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:06.604949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.sql.core [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-84715711' for key 'project.ixu_project_name_domain_id'") Oct 31 05:28:06.604949 n-d-862355-5 devstack@keystone.service[81999]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 05:28:06.604949 n-d-862355-5 devstack@keystone.service[81999]: [parameters: {'id': 'ffc680a683a9405faf38822f701cbdf6', 'name': 'tempest-domain-dup-84715711', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 05:28:06.604949 n-d-862355-5 devstack@keystone.service[81999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-84715711.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-84715711. Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 05:28:06.625462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-84715711' for key 'project.ixu_project_name_domain_id'") Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 05:28:06.626675 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application yield resource Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise self.value Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application session.commit() Oct 31 05:28:06.631506 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.flush() Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application compat.raise_( Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 05:28:06.632872 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 05:28:06.635274 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 05:28:06.637835 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-84715711' for key 'project.ixu_project_name_domain_id'") Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [parameters: {'id': 'ffc680a683a9405faf38822f701cbdf6', 'name': 'tempest-domain-dup-84715711', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.639493 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-84715711. Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:06.640697 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-84715711. Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:06.642126 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1975/3978] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:28:06 2022] POST /identity/v3/domains => generated 210 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:28:06.647522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:06.658065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9697307-7465-42fc-903b-8a2689f73a72 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:06.684831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:06.684831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:06.684831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:06.685309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/36b9d59ff1294fda9267bb54948c5bfc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:06.730840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=36b9d59ff1294fda9267bb54948c5bfc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:06.732739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:06.816096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.818729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.883729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.887880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:06.893586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2004/3979] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:28:06 2022] PATCH /identity/v3/domains/36b9d59ff1294fda9267bb54948c5bfc => generated 252 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:28:06.894915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:06.897499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:06.928381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a8b89-f0c6-4317-9714-9387874a2efb tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:07.212334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:07.213334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:07.215873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:07.216388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/36b9d59ff1294fda9267bb54948c5bfc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:07.262233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=36b9d59ff1294fda9267bb54948c5bfc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:07.263885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:07.321861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.389511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.557610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:07.595193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc', 'request_id': 'req-742f8013-0c25-47e2-bcf3-acc9379150c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.619767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc', 'request_id': 'req-742f8013-0c25-47e2-bcf3-acc9379150c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.645773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc', 'request_id': 'req-742f8013-0c25-47e2-bcf3-acc9379150c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.707139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] The token cache is being invalidate because project 36b9d59ff1294fda9267bb54948c5bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:07.709609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.716113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.763893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc', 'request_id': 'req-742f8013-0c25-47e2-bcf3-acc9379150c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.774818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc', 'request_id': 'req-742f8013-0c25-47e2-bcf3-acc9379150c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.774818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '36b9d59ff1294fda9267bb54948c5bfc', 'request_id': 'req-742f8013-0c25-47e2-bcf3-acc9379150c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:07.800026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1976/3980] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:28:06 2022] DELETE /identity/v3/domains/36b9d59ff1294fda9267bb54948c5bfc => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:07.806079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:07.844490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb346-5978-4910-a419-36ca270a30b7 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:08.172139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd316e-68c8-4196-b5b8-5b9b77f23c06 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'feac41f3d6fc40fd98c404cd38f4efa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '866fa5d0cd084ff2ba5748d907b68385', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:08.175986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd316e-68c8-4196-b5b8-5b9b77f23c06 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:08.177980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd316e-68c8-4196-b5b8-5b9b77f23c06 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:08.178311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd316e-68c8-4196-b5b8-5b9b77f23c06 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] PATH_INFO: `/v3/domains/616b50b2d424495db3be5b461a21caa2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:08.207856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd316e-68c8-4196-b5b8-5b9b77f23c06 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-cecd316e-68c8-4196-b5b8-5b9b77f23c06 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Could not find domain: 616b50b2d424495db3be5b461a21caa2.: keystone.exception.DomainNotFound: Could not find domain: 616b50b2d424495db3be5b461a21caa2. Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 616b50b2d424495db3be5b461a21caa2. Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:08.232955 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:28:08.234465 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:28:08.235723 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 616b50b2d424495db3be5b461a21caa2. Oct 31 05:28:08.237701 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:28:08.237701 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2005/3981] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:28:07 2022] PATCH /identity/v3/domains/616b50b2d424495db3be5b461a21caa2 => generated 112 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:28:08.240283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:08.241736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:08.465890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8013-0c25-47e2-bcf3-acc9379150c5 tempest-DomainsNegativeTestJSON-576525837 tempest-DomainsNegativeTestJSON-576525837-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:08.493494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:08.497845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:08.498140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:08.499814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] PATH_INFO: `/v3/users/79ea8c4411f349c39d00e4caabaf73c0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:08.506252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ea8c4411f349c39d00e4caabaf73c0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:08.516423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:08.619575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ea8c4411f349c39d00e4caabaf73c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:08.630458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ea8c4411f349c39d00e4caabaf73c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:08.632420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ea8c4411f349c39d00e4caabaf73c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:08.633504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ea8c4411f349c39d00e4caabaf73c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:08.645795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ea8c4411f349c39d00e4caabaf73c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:08.691060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1977/3982] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:08 2022] DELETE /identity/v3/users/79ea8c4411f349c39d00e4caabaf73c0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:08.696884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:08.697213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:08.697571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:08.757422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:08.759745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:08.862837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:08.936799 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2006/3983] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:08.952671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:08.956587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:09.011749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:09.110448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303a36-927a-4535-aaa8-00eb01c37b27 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:09.129736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:09.130505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:09.130830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:09.131216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:09.168674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:09.171026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:09.204626 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1978/3984] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:10.819712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:10.821556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:10.849365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b539-82b1-46f5-98f6-06e2f5b1f604 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:10.865651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:10.869936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:10.870582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:10.872249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] PATH_INFO: `/v3/projects/7ad96d6ea24e44fcbeb32f8224b92d31` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:10.873029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad96d6ea24e44fcbeb32f8224b92d31)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:10.890931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:11.014555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad96d6ea24e44fcbeb32f8224b92d31', 'request_id': 'req-ab494f91-02fa-435d-873a-9bb644d48388'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.022602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad96d6ea24e44fcbeb32f8224b92d31', 'request_id': 'req-ab494f91-02fa-435d-873a-9bb644d48388'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.030325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad96d6ea24e44fcbeb32f8224b92d31', 'request_id': 'req-ab494f91-02fa-435d-873a-9bb644d48388'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.051616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] The token cache is being invalidate because project 7ad96d6ea24e44fcbeb32f8224b92d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:11.052264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.053657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.059131 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2007/3985] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:10 2022] DELETE /identity/v3/projects/7ad96d6ea24e44fcbeb32f8224b92d31 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:11.060133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:11.079711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa90542-4a0e-40ac-b821-0d20490a4684 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:11.245397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:11.247689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:11.249170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:11.249477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] PATH_INFO: `/v3/users/feac41f3d6fc40fd98c404cd38f4efa2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:11.252971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feac41f3d6fc40fd98c404cd38f4efa2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:11.259646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:11.394127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feac41f3d6fc40fd98c404cd38f4efa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.420305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feac41f3d6fc40fd98c404cd38f4efa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.420987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feac41f3d6fc40fd98c404cd38f4efa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.421655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feac41f3d6fc40fd98c404cd38f4efa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.443660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69ccf0d7-bbb7-4091-bff1-3faff50614f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feac41f3d6fc40fd98c404cd38f4efa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:11.509134 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1979/3986] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:11 2022] DELETE /identity/v3/users/feac41f3d6fc40fd98c404cd38f4efa2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:13.364878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:13.366848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:13.389614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab494f91-02fa-435d-873a-9bb644d48388 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:13.493297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:13.494257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:13.494961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:13.495431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] PATH_INFO: `/v3/projects/866fa5d0cd084ff2ba5748d907b68385` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:13.496821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866fa5d0cd084ff2ba5748d907b68385)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:13.498998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:13.642907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866fa5d0cd084ff2ba5748d907b68385', 'request_id': 'req-a715f7a9-0170-4475-be9a-434373a3a2c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:13.658651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866fa5d0cd084ff2ba5748d907b68385', 'request_id': 'req-a715f7a9-0170-4475-be9a-434373a3a2c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:13.688744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866fa5d0cd084ff2ba5748d907b68385', 'request_id': 'req-a715f7a9-0170-4475-be9a-434373a3a2c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:13.693363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:13.715190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] The token cache is being invalidate because project 866fa5d0cd084ff2ba5748d907b68385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:13.718564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:13.719633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a715f7a9-0170-4475-be9a-434373a3a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:13.731256 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2008/3987] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:13 2022] DELETE /identity/v3/projects/866fa5d0cd084ff2ba5748d907b68385 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:13.739835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:13.743772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:13.744127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:13.786231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:13.787713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:14.020338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:14.095109 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1980/3988] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:14.105449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:14.107024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:14.107773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:14.186334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:14.192378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:14.222206 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2009/3989] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:14.222655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:14.239621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97544aff-fd6a-401a-9ec2-d5de22e48052 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:14.269677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:14.271178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:14.273738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:14.274276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:14.282259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:14.282727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:14.295060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:14.346117 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1981/3990] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:14.348935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:14.359781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2554-a6c6-4bb7-8777-7051626281f4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:14.368517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:14.370282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:14.372490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:14.372964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:14.374705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:14.380024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:14.444601 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2010/3991] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:14 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:14.445197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:14.474691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b725-afa4-4a2f-b293-fdb03124f766 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:14.791848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:14.793269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:14.793673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:14.794059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:14.795042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:14.797203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:14.865261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1982/3992] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:14 2022] POST /identity/v3/users => generated 284 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:28:14.871307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:14.887386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9765d52-11fb-4ce9-961f-bce2c22ae08e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:14.902360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:14.902992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:14.905452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:14.905665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:14.906740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:14.913384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:14.951731 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2011/3993] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:14.952484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:14.975879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acbdd6-a413-4878-a106-f62742a144ae admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:14.996657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d11b3-bdd8-4772-9f8b-e491029f45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:15.000299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d11b3-bdd8-4772-9f8b-e491029f45cf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:15.010168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d11b3-bdd8-4772-9f8b-e491029f45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:15.023448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d11b3-bdd8-4772-9f8b-e491029f45cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:15.024496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d11b3-bdd8-4772-9f8b-e491029f45cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:15.030822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d11b3-bdd8-4772-9f8b-e491029f45cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:15.066615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:15.067212 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1983/3994] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:15.080756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfda02-04e9-458a-b55e-dd383adcf5a3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:15.108436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:15.118207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:15.118207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:15.118207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] PATH_INFO: `/v3/projects/68a141a840f94d448c9e680bb3b53c17/users/a9ea6447229148d5a707ed188c83c66c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:15.179430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a141a840f94d448c9e680bb3b53c17, user_id=a9ea6447229148d5a707ed188c83c66c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:15.184978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:15.226891 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2012/3995] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:15 2022] PUT /identity/v3/projects/68a141a840f94d448c9e680bb3b53c17/users/a9ea6447229148d5a707ed188c83c66c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:15.242969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:15.243574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:15.244134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:15.325229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] MFA Rules not processed for user `a9ea6447229148d5a707ed188c83c66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:15.328997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:15.520355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:15.521842 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1984/3996] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:15.652634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c03a-ccb9-4794-b909-bece44e8bb35 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:15.669929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:15.678551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:15.678986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:15.679783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:15.680675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:15.685601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:15.766891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:15.778688 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2013/3997] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:15 2022] POST /identity/v3/projects => generated 369 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:15.789632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24952fd8-850d-4c54-89f7-4dd9cfc22d42 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:15.887936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:15.966364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:15.967290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:15.968104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:15.968891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:15.972895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:15.976546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:16.058196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:16.058838 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1985/3998] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:15 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:16.074726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744e7a-cc1d-40ce-b95a-b388b0951b3b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:16.085270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:16.086022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:16.086452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:16.086842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:16.091871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:16.093877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:16.147048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:16.147753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2014/3999] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:16.176587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b75d-99a3-4464-a04d-b2c00ef6db15 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:16.196232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:16.196944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:16.197227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:16.197503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] PATH_INFO: `/v3/projects/5d43c9a49a634cb4a01e8accf6eddefa/users/c40e1552f98a46d59844da6e8e74dac3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:16.279445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d43c9a49a634cb4a01e8accf6eddefa, user_id=c40e1552f98a46d59844da6e8e74dac3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:16.288357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:16.381805 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1986/4000] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:16 2022] PUT /identity/v3/projects/5d43c9a49a634cb4a01e8accf6eddefa/users/c40e1552f98a46d59844da6e8e74dac3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:16.383278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:16.414966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04036fa1-a7ee-4b6b-8c2d-795cad232fe6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:16.592761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662850c4-313c-4533-a240-c2e2ef112b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:16.596556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662850c4-313c-4533-a240-c2e2ef112b90 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:16.599861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662850c4-313c-4533-a240-c2e2ef112b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:16.600289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662850c4-313c-4533-a240-c2e2ef112b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:16.601102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662850c4-313c-4533-a240-c2e2ef112b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:16.602912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662850c4-313c-4533-a240-c2e2ef112b90 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:16.616803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:16.630313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2015/4001] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:16.634294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:16.661282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc5e62-56a4-465a-845a-9d16382ed73a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:16.674812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:16.675517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:16.675800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:16.676072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] PATH_INFO: `/v3/projects/5d43c9a49a634cb4a01e8accf6eddefa/users/c40e1552f98a46d59844da6e8e74dac3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:16.685100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d43c9a49a634cb4a01e8accf6eddefa, user_id=c40e1552f98a46d59844da6e8e74dac3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:16.688067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:16.734725 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1987/4002] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:16 2022] PUT /identity/v3/projects/5d43c9a49a634cb4a01e8accf6eddefa/users/c40e1552f98a46d59844da6e8e74dac3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:16.736485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:16.737134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:16.737731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:16.786485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] MFA Rules not processed for user `c40e1552f98a46d59844da6e8e74dac3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:16.788647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:16.980683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:16.982052 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2016/4003] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:17.003105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f915-ceef-4cdb-ab07-3c60b32fcfdc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:17.025353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3158e8-2f75-4786-b8d8-05669dd812da tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:17.026955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3158e8-2f75-4786-b8d8-05669dd812da tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:17.028197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3158e8-2f75-4786-b8d8-05669dd812da tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:17.029258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3158e8-2f75-4786-b8d8-05669dd812da tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:17.030384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3158e8-2f75-4786-b8d8-05669dd812da tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:17.035939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3158e8-2f75-4786-b8d8-05669dd812da tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:17.089965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:17.097091 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1988/4004] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:16 2022] POST /identity/v3/services => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:28:17.102887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877d9dd-50e3-4620-8980-027fa093944a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:17.145677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:17.147782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:17.148076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:17.148356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:17.151673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:17.152765 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:17.152765 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:28:17.152765 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:17.155834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:17.231725 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1577663349. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:17.231725 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:17.231725 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:17.261211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:17.261506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:17.261784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:17.323209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:17.333687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:17.334229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2017/4005] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:28:17 2022] POST /identity/v3/endpoints => generated 360 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:17.335333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:17.476585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f7ba-00ec-4c43-b981-cda62e86811b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:17.490925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:17.496758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:17.497062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:17.500608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-1577663349` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:17.502345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1577663349)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:17.503463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:17.520435 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2018/4006] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:28:17 2022] GET /identity/v3/regions/tempest-region-1577663349 => generated 180 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:17.523652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:17.541920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c45e22-d2f3-4e23-aa01-c8d93299ad59 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:17.583998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:17.584759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:17.585554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:17.586906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:17.587996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:17.591929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:17.652916 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1989/4007] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:28:17 2022] POST /identity/v3/auth/tokens => generated 3511 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:17.677465 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2019/4008] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:17 2022] POST /identity/v3/services => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:17.679356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:17.713792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06cd42-d8ac-4cd7-9fdb-71cbe4f0e0e0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:17.764537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:17.766646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:17.785350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:17.789697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:17.790364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:17.791766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:17.804271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:17.805455 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:17.805455 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:28:17.805455 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:17.813611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:17.895027 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-467398882. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:17.895027 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:17.895027 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:17.982635 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1990/4009] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:28:17 2022] POST /identity/v3/endpoints => generated 359 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:17.984152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.000827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:18.012957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eab59-212c-4fa4-883c-9fa41e47d251 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.049055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badf75d-856e-41f6-a9f8-93a574286786 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.061448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.063061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.064934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.065585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-467398882` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.069106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-467398882)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.070747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.079456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1991/4010] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 31 05:28:17 2022] GET /identity/v3/regions/tempest-region-467398882 => generated 178 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:18.079954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.079954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.079954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.079954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.083775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.103735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.107885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.108251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442798c3-546f-4656-980f-6f1fe60c60d4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.123120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.123776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.125241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.125519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.127580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.135426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.155566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2020/4011] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:28:18.206470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:18.236946 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-336707221. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:18.236946 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:18.236946 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:18.329074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.331998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:18.362462 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1992/4012] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:28:18 2022] POST /identity/v3/endpoints => generated 359 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:18.374075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.503062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544d326-3c06-496a-bad5-3f18dc9fcbc4 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.539749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.541158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.541492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.541782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-336707221` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.543094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-336707221)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.546335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.554597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1993/4013] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 31 05:28:18 2022] GET /identity/v3/regions/tempest-region-336707221 => generated 178 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:18.560285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.586290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024511-326d-4816-9995-d5ee38ee3faa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.612108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.618707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.620477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.620989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.621915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.628488 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:18.628488 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:28:18.628488 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:18.631987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.658768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4d526-b2b6-461a-bda3-3d7027a695ee service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.678727 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1994/4014] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 31 05:28:18 2022] GET /identity/v3/endpoints => generated 4392 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:18.687489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.708551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1fc3-e010-448d-bc7d-31be33651e92 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.717244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.718547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.721005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.726755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.727036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.727970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.728380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.728966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/e7fc59a143164e0389489228e69d4230` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.729806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:18.757710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=e7fc59a143164e0389489228e69d4230)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.759099 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:18.759099 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:28:18.759099 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:18.760333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.770241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1995/4015] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:18 2022] GET /identity/v3/endpoints/e7fc59a143164e0389489228e69d4230 => generated 359 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:18.771907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.805974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ef77-9907-483d-a8cb-a1565d561444 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.825384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.826322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.826883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.827402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/e7fc59a143164e0389489228e69d4230` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.828766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e7fc59a143164e0389489228e69d4230)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.830701 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:18.830701 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:28:18.830701 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:18.832133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.855979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e7fc59a143164e0389489228e69d4230', 'request_id': 'req-4057002a-e258-4dc2-a6d3-3d9fa8229dff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:18.874288 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1996/4016] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:28:18 2022] DELETE /identity/v3/endpoints/e7fc59a143164e0389489228e69d4230 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:18.878673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:18.932028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057002a-e258-4dc2-a6d3-3d9fa8229dff tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:18.937237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:18.938019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:18.938442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:18.938830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:18.939850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.941361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.976572 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1997/4017] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 31 05:28:18 2022] GET /identity/v3/endpoints => generated 4046 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:28:18.977825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:18.979668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:18.987284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.020507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fae579-fdfc-4599-871e-970b280c9e28 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.048252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.049567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.050006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.050387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/e7fc59a143164e0389489228e69d4230` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.068689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:28:19.072882 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2021/4018] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:18 2022] GET /identity/v3/auth/tokens => generated 3884 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Could not find endpoint: e7fc59a143164e0389489228e69d4230.: keystone.exception.EndpointNotFound: Could not find endpoint: e7fc59a143164e0389489228e69d4230. Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:19.087518 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: e7fc59a143164e0389489228e69d4230. Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:28:19.088843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:28:19.090186 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: e7fc59a143164e0389489228e69d4230. Oct 31 05:28:19.091401 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:28:19.094659 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1998/4019] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:28:18 2022] DELETE /identity/v3/endpoints/e7fc59a143164e0389489228e69d4230 => generated 114 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:28:19.097335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.125782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d74221-52f0-4803-8e5c-9399d158589a service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.152697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.153740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.154275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.155041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-336707221` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.155862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-336707221)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.157082 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:19.157082 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:28:19.157082 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:19.162865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.219307 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-336707221. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:19.219307 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:19.219307 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:19.230293 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2022/4020] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:28:19 2022] DELETE /identity/v3/regions/tempest-region-336707221 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:19.235570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.276136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d7a02-aeec-4d57-a4a9-e23c7b83791e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.324160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.324946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.325324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.326214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.326876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.330304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.379107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.381039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1999/4021] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 31 05:28:19 2022] GET /identity/v3/endpoints => generated 4046 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:19.425963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4aa28-8115-45a5-8664-ec9c8b4fad0a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.472986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.473799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.474646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.474646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.475356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Adding query filter params (service_id=8b6a4f2e42f843afb974b7c6a29cf072) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:19.475765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.476942 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:19.476942 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:28:19.476942 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:19.478125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.497080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2023/4022] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:28:19 2022] GET /identity/v3/endpoints?service_id=8b6a4f2e42f843afb974b7c6a29cf072 => generated 502 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:19.501029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.517705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b42b-4861-4cc9-9c20-eba5a4ef32ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.532199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.532199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.533576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.533576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.538837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Adding query filter params (service_id=15f88ba1abd54763b9672fe078370b3d) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:19.539237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.540925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.589233 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2000/4023] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:28:19 2022] GET /identity/v3/endpoints?service_id=15f88ba1abd54763b9672fe078370b3d => generated 501 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:19.592161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.599262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:19.619323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd848e-d45c-480b-9570-0d457fa79747 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.654922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.655585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.655869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.656146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.656828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:19.657138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.659393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.715057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.722294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2024/4024] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 31 05:28:19 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:19.728578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12f79a-1afa-4324-a0bd-5cf04ca675f0 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.741581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.742252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.742541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.742839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.743471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:19.743780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.745647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.796532 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2001/4025] 10.222.0.23 () {58 vars in 1171 bytes} [Mon Oct 31 05:28:19 2022] GET /identity/v3/endpoints?interface=internal => generated 476 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:19.802648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.822425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6892-3033-4300-bdf0-465f1fffbe95 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.835694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.836705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.837220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.837710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.839811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:19.841661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:19.907059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:19.907387 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2025/4026] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:19 2022] POST /identity/v3/services => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:19.922982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037067ed-9450-48c2-9c9e-d2a3a054fbd1 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:19.972669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:19.973318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:19.976446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:19.976742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:19.977463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.004019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.066576 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1770900985. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:20.066576 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:20.066576 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:20.156826 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2002/4027] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:28:19 2022] POST /identity/v3/endpoints => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:20.158661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.182500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c1e4-6b95-4897-969e-0f1b8cb1662d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:20.233212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:20.234767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:20.235063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:20.235341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-1770900985` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:20.236706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1770900985)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.237680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.248240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2026/4028] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:28:20 2022] GET /identity/v3/regions/tempest-region-1770900985 => generated 180 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:28:20.253280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.274848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2c43-fe30-4526-9d1e-5a7b50f044ee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:20.297068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:20.299658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:20.303656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:20.304821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/5e8531fbfa9941e1bb0f5a45cb2d59db` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:20.328712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=5e8531fbfa9941e1bb0f5a45cb2d59db)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.331752 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:20.331752 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:28:20.331752 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:20.336077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.398510 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-191928651. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:20.398510 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:20.398510 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:20.437955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:20.473518 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2003/4029] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 31 05:28:20 2022] PATCH /identity/v3/endpoints/5e8531fbfa9941e1bb0f5a45cb2d59db => generated 362 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:20.476201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.495344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f336-72f7-4656-9da2-f1059f19d719 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:20.563048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:20.563743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:20.565198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:20.565485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-191928651` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:20.570436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-191928651)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.572258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.581326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2027/4030] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 31 05:28:20 2022] GET /identity/v3/regions/tempest-region-191928651 => generated 178 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:28:20.586262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.623388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4cf3-f5ff-48e2-bf8e-438d12ea74ed tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:20.643720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:20.647346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:20.647868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:20.648161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/5e8531fbfa9941e1bb0f5a45cb2d59db` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:20.664110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5e8531fbfa9941e1bb0f5a45cb2d59db)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.665914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.696977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5e8531fbfa9941e1bb0f5a45cb2d59db', 'request_id': 'req-f22bfc3c-8d88-4748-928c-6c372474ab6f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:20.731778 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2004/4031] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:28:20 2022] DELETE /identity/v3/endpoints/5e8531fbfa9941e1bb0f5a45cb2d59db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:20.736356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.756141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704e93-4a17-47c8-893a-55ec1a0b102a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:20.794958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:20.795809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:20.796209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:20.796494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-191928651` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:20.797418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-191928651)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.799694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.831599 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-191928651. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:20.831599 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:20.831599 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:20.839697 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2028/4032] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:28:20 2022] DELETE /identity/v3/regions/tempest-region-191928651 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:20.844081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.867711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bfc3c-8d88-4748-928c-6c372474ab6f tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:20.909160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:20.909824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:20.910111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:20.910451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-1770900985` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:20.911058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1770900985)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:20.912087 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:20.912087 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:28:20.912087 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:20.912991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:20.969366 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2005/4033] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 31 05:28:20 2022] DELETE /identity/v3/regions/tempest-region-1770900985 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:20.972361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:20.989898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2620-878f-4a1e-b8fd-cdfdef22ac5e tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.031802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.033340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.037719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.038216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/services/3015ddec3d9a405cb8d0583ab29dec8e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.039040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3015ddec3d9a405cb8d0583ab29dec8e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.041756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.095879 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2029/4034] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:20 2022] DELETE /identity/v3/services/3015ddec3d9a405cb8d0583ab29dec8e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:21.100963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:21.117052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4319-1e3a-4f2b-ae97-6ea4e1132755 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.190199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.190916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.190916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.192610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/34f2d948508b46b7a5b3a826eaa7b64d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.218872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=34f2d948508b46b7a5b3a826eaa7b64d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.222047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.240419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '34f2d948508b46b7a5b3a826eaa7b64d', 'request_id': 'req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:21.269467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2006/4035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/endpoints/34f2d948508b46b7a5b3a826eaa7b64d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:21.274203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:21.303161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a897802-16a7-4c4c-b0a1-6b959755c1fa tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.381876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.382906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.383194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.387039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-467398882` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.389667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-467398882)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.398272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.436188 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-467398882. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:21.436188 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:21.436188 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:21.458585 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2030/4036] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/regions/tempest-region-467398882 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:21.459080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:21.473731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebc0a5-ff1e-4bf9-95c6-94c792056c2b tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.526286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.527761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.528065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.528349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/services/15f88ba1abd54763b9672fe078370b3d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.539403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_service(service_id=15f88ba1abd54763b9672fe078370b3d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.541110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.597629 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2007/4037] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/services/15f88ba1abd54763b9672fe078370b3d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:28:21.599825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:21.631381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9f2a-3fea-4c0b-b634-6920ebdbc5ad tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.661598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.662491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.662910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.663319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/endpoints/37037453ba514376831c63f45d559471` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.678640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=37037453ba514376831c63f45d559471)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.681336 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:28:21.681336 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:28:21.681336 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:28:21.682735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.702126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '37037453ba514376831c63f45d559471', 'request_id': 'req-79bd97df-5f17-42a4-ae58-927c295f47e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:21.722393 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2031/4038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/endpoints/37037453ba514376831c63f45d559471 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:21.726497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:21.750401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cb793-e524-4dc9-80c1-a35ff8fafa5d tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.780526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.781174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.781462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.781742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/regions/tempest-region-1577663349` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.782384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1577663349)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.784581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.816886 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1577663349. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:28:21.816886 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:28:21.816886 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:28:21.827366 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2008/4039] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/regions/tempest-region-1577663349 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:21.828627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:21.851113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd97df-5f17-42a4-ae58-927c295f47e2 tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:21.891004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac96dc-bde7-4e79-8078-b05f8c20755a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c40e1552f98a46d59844da6e8e74dac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d43c9a49a634cb4a01e8accf6eddefa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:21.892910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac96dc-bde7-4e79-8078-b05f8c20755a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:21.896310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac96dc-bde7-4e79-8078-b05f8c20755a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:21.896826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac96dc-bde7-4e79-8078-b05f8c20755a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] PATH_INFO: `/v3/services/8b6a4f2e42f843afb974b7c6a29cf072` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:21.897654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac96dc-bde7-4e79-8078-b05f8c20755a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8b6a4f2e42f843afb974b7c6a29cf072)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:21.899903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac96dc-bde7-4e79-8078-b05f8c20755a tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:21.973577 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2032/4040] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/services/8b6a4f2e42f843afb974b7c6a29cf072 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:21.980724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:22.134711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:UPDATE=1,keystone:SELECT=91,keystone:DELETE=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:22.153764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bed12-0210-48af-bad9-c00f762eabee tempest-EndPointsTestJSON-587460640 tempest-EndPointsTestJSON-587460640-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:22.191169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:22.191758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:22.192050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:22.192321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] PATH_INFO: `/v3/users/a9ea6447229148d5a707ed188c83c66c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:22.193633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ea6447229148d5a707ed188c83c66c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:22.200440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:22.337414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ea6447229148d5a707ed188c83c66c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:22.365269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ea6447229148d5a707ed188c83c66c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:22.365987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ea6447229148d5a707ed188c83c66c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:22.366755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ea6447229148d5a707ed188c83c66c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:22.388296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ea6447229148d5a707ed188c83c66c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:22.435433 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2009/4041] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:21 2022] DELETE /identity/v3/users/a9ea6447229148d5a707ed188c83c66c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:22.436461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd87d9-e243-4530-b43a-5bd49d4c2de2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:22.436964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd87d9-e243-4530-b43a-5bd49d4c2de2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:22.437378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd87d9-e243-4530-b43a-5bd49d4c2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:22.504397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dcdd87d9-e243-4530-b43a-5bd49d4c2de2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:22.505914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dcdd87d9-e243-4530-b43a-5bd49d4c2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:22.531088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:22.650968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2033/4042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:22.736795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:22.738599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:22.939300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266f8da-cfcc-492a-a539-fff9e65cc5ef admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:22.945417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31cab9-a143-45eb-a80d-44f70327304c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:22.946123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31cab9-a143-45eb-a80d-44f70327304c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:22.946541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31cab9-a143-45eb-a80d-44f70327304c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:22.946785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31cab9-a143-45eb-a80d-44f70327304c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:22.966979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31cab9-a143-45eb-a80d-44f70327304c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:22.968518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31cab9-a143-45eb-a80d-44f70327304c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:22.999204 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2010/4043] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:24.127851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:24.128309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:24.128422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:24.184498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] MFA Rules not processed for user `535a335d59cc400fb6d573f536fa808e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:24.185701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:24.348258 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2034/4044] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:24.359459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:24.359960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:24.360054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:24.399442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] MFA Rules not processed for user `535a335d59cc400fb6d573f536fa808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:24.401425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:24.440723 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2011/4045] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:24.454754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:24.456732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:24.661820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a17b-6394-49a0-9dca-1f8f1c0a0894 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:24.669566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:24.670587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:24.670587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:24.671173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:24.681749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:24.688452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:24.714710 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2035/4046] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:26.139598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:26.141574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:26.177621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caab6d-bbfa-486c-85d2-db31ba601ee2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:26.198664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:26.199569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:26.200472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:26.201027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] PATH_INFO: `/v3/projects/68a141a840f94d448c9e680bb3b53c17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:26.203032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a141a840f94d448c9e680bb3b53c17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:26.208769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:26.316535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:26.327879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a141a840f94d448c9e680bb3b53c17', 'request_id': 'req-35248a2e-7e7b-4833-adfa-98c1c1213a3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.341261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a141a840f94d448c9e680bb3b53c17', 'request_id': 'req-35248a2e-7e7b-4833-adfa-98c1c1213a3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.364009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a141a840f94d448c9e680bb3b53c17', 'request_id': 'req-35248a2e-7e7b-4833-adfa-98c1c1213a3a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.390765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] The token cache is being invalidate because project 68a141a840f94d448c9e680bb3b53c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:26.391067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.391742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.394691 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2012/4047] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:26 2022] DELETE /identity/v3/projects/68a141a840f94d448c9e680bb3b53c17 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:26.398366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:26.415041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578ba04-f6e6-43dc-84fb-7c4b29725fba service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:26.486342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:26.651116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:26.651792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:26.652076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:26.654755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] PATH_INFO: `/v3/users/c40e1552f98a46d59844da6e8e74dac3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:26.656079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40e1552f98a46d59844da6e8e74dac3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:26.666888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:26.788976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40e1552f98a46d59844da6e8e74dac3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.821861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40e1552f98a46d59844da6e8e74dac3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.822877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40e1552f98a46d59844da6e8e74dac3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.824709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40e1552f98a46d59844da6e8e74dac3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.840996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de6b5449-795d-4804-be59-69e8ce599c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40e1552f98a46d59844da6e8e74dac3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:26.871917 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2036/4048] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:26 2022] DELETE /identity/v3/users/c40e1552f98a46d59844da6e8e74dac3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:26.895708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:26.898770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:27.040860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35248a2e-7e7b-4833-adfa-98c1c1213a3a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:27.136679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:27.137580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:27.138030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:27.138470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:27.140824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:27.154460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:27.157280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:27.174473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2013/4049] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:29.406977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438d452-ade6-401f-a2ab-96b7fe736106 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:29.407446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438d452-ade6-401f-a2ab-96b7fe736106 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:29.407888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438d452-ade6-401f-a2ab-96b7fe736106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:29.446845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c438d452-ade6-401f-a2ab-96b7fe736106 None None] MFA Rules not processed for user `535a335d59cc400fb6d573f536fa808e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:29.446845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c438d452-ade6-401f-a2ab-96b7fe736106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:29.589505 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2037/4050] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:30.821662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:30.823926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:31.087990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff5bb-3d59-463e-b6cb-6210ca115c2c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:31.121408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:31.122283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:31.124823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:31.127934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] PATH_INFO: `/v3/projects/5d43c9a49a634cb4a01e8accf6eddefa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:31.137078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d43c9a49a634cb4a01e8accf6eddefa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:31.144894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:31.279412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:31.319528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d43c9a49a634cb4a01e8accf6eddefa', 'request_id': 'req-a6e939f8-3fed-4df6-92f6-0777df9ca910'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:31.330212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d43c9a49a634cb4a01e8accf6eddefa', 'request_id': 'req-a6e939f8-3fed-4df6-92f6-0777df9ca910'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:31.351727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d43c9a49a634cb4a01e8accf6eddefa', 'request_id': 'req-a6e939f8-3fed-4df6-92f6-0777df9ca910'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:31.388363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] The token cache is being invalidate because project 5d43c9a49a634cb4a01e8accf6eddefa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:31.388669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:31.390722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a6e939f8-3fed-4df6-92f6-0777df9ca910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:31.411117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:31.413035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:31.413466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:31.413605 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2014/4051] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:30 2022] DELETE /identity/v3/projects/5d43c9a49a634cb4a01e8accf6eddefa => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:31.462506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:31.466637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:31.550500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:31.665171 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2038/4052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:31.671949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:31.672244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:31.672513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:31.712261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:31.713529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:31.748985 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2015/4053] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:31.755722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:31.772369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b356fa-a054-4909-9da1-017fcddfcc8c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:31.788593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:31.789611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:31.790919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:31.791361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:31.792782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:31.796522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:31.816005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:31.846346 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2039/4054] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:31.852873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:31.863301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6902-ddb4-4ec6-9ac4-2ee7e8778783 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:31.882419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:31.883295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:31.883721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:31.884162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:31.885012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:31.887103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:31.994824 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2016/4055] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:31 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:31.998987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:32.010807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087e52-39a1-495b-ab91-311e4e8df929 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:32.297369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:32.298419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:32.298825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:32.299210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:32.299995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:32.304060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:32.339862 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2040/4056] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:31 2022] POST /identity/v3/users => generated 289 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:32.344528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:32.366389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4866f-3431-49b8-94d6-3c388300ca98 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:32.384248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:32.384912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:32.385430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:32.385560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:32.386225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:32.393225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:32.434995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:32.435434 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2017/4057] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:32.453546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8df75-d018-48fa-bbcc-df35d481a3a5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:32.468518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f761bc5-978b-4c95-83ce-b9aa609e5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:32.471195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f761bc5-978b-4c95-83ce-b9aa609e5688 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:32.472611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f761bc5-978b-4c95-83ce-b9aa609e5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:32.473066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f761bc5-978b-4c95-83ce-b9aa609e5688 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:32.474652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f761bc5-978b-4c95-83ce-b9aa609e5688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:32.479740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f761bc5-978b-4c95-83ce-b9aa609e5688 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:32.512402 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2041/4058] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:28:32.517321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:32.535945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38293a-6598-4b77-b39a-daa1b85d93bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:32.562717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:32.564338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:32.564725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:32.565716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] PATH_INFO: `/v3/projects/49c8e2a9486248b9968e7756b68286e7/users/5d2f6c9756f24a549a87912952b6bc57/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:32.604938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c8e2a9486248b9968e7756b68286e7, user_id=5d2f6c9756f24a549a87912952b6bc57, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:32.616400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:32.668378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:32.668662 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2018/4059] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:32 2022] PUT /identity/v3/projects/49c8e2a9486248b9968e7756b68286e7/users/5d2f6c9756f24a549a87912952b6bc57/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:32.669267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:32.669704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:32.757059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] MFA Rules not processed for user `5d2f6c9756f24a549a87912952b6bc57`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:32.758904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:32.888910 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2042/4060] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:32.895466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:33.086499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfef921-d2a4-4663-8b94-dc455c8c230a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:33.105170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:33.108147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.111489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.112798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.115233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:33.128635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:33.217223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2019/4061] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:32 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:33.222294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:33.240556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519b0e-f908-4684-aa7e-e78fc0b30a30 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:33.356666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:33.422927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:33.424330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.424634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.424903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.425584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:33.427571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:33.479436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2043/4062] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:33 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:33.483146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:33.506433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0fab7-03dd-4d36-9b0c-7322a4554b80 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:33.519352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:33.519989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.520274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.520546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.521214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:33.522949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:33.535930 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2020/4063] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:33.539772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:33.566222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a647e-1c5c-4359-aa90-24ee1e88859a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:33.579002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:33.579968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.580890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.581299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] PATH_INFO: `/v3/projects/6a4d2697317d4b62bb4d3b1619389122/users/97000684f62c427785ef8613de02ef13/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.606032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4d2697317d4b62bb4d3b1619389122, user_id=97000684f62c427785ef8613de02ef13, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:33.612417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:33.641681 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2044/4064] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:33 2022] PUT /identity/v3/projects/6a4d2697317d4b62bb4d3b1619389122/users/97000684f62c427785ef8613de02ef13/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:33.647269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:33.668047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c991-c7c3-41c0-934a-13e118939d73 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:33.724635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:33.770912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa1d8-1b39-45fe-88fd-78b9c333f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:33.772602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa1d8-1b39-45fe-88fd-78b9c333f465 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.772889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa1d8-1b39-45fe-88fd-78b9c333f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.773170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa1d8-1b39-45fe-88fd-78b9c333f465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.777001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fa1d8-1b39-45fe-88fd-78b9c333f465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:33.781224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fa1d8-1b39-45fe-88fd-78b9c333f465 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:33.805497 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2021/4065] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:33.809742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:33.847117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075afb-c4b1-4314-a63b-9bfa0113d3f8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:33.879655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:33.880364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.881199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.882002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] PATH_INFO: `/v3/projects/6a4d2697317d4b62bb4d3b1619389122/users/97000684f62c427785ef8613de02ef13/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.891139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4d2697317d4b62bb4d3b1619389122, user_id=97000684f62c427785ef8613de02ef13, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:33.899334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:33.926231 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2045/4066] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:33 2022] PUT /identity/v3/projects/6a4d2697317d4b62bb4d3b1619389122/users/97000684f62c427785ef8613de02ef13/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:33.936819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:33.937293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:33.937433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:33.991581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] MFA Rules not processed for user `97000684f62c427785ef8613de02ef13`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:33.993459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:34.176985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:34.177412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2022/4067] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:34.191371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39835dd-af54-4e19-b793-c2b2dd2c54d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:34.200955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:34.201908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:34.202833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:34.203224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:34.204187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:34.207735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:34.298377 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2046/4068] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:34 2022] POST /identity/v3/projects => generated 334 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:34.300344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:34.313025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc4fc0-61f9-45b4-aebe-6f766c471ffc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:34.487636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:34.489261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:34.489783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:34.490298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:34.491678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:34.496856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:34.594252 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2023/4069] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:28:34 2022] POST /identity/v3/projects => generated 332 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:34.594889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:34.610538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922159ab-3996-4436-a9d4-da2e45232f4a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:34.731621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:34.732289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:34.732583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:34.732858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:34.735992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:34.740502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:34.846207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2047/4070] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:34 2022] POST /identity/v3/projects => generated 358 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:34.850929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:34.868356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29393a83-c1ad-49ce-b959-ab014ffd7628 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:34.941079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:34.976858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:34.977787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:34.978126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:34.978700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:34.981754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:34.985248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:35.021332 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2024/4071] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:28:34 2022] GET /identity/v3/projects => generated 7584 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:35.022891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:35.039806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1206-00ec-4d27-9efb-b612977b297d tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:35.052709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:35.053373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:35.053657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:35.053963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:35.054654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:35.054968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:35.057041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:35.104954 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2048/4072] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 31 05:28:35 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:35.106557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:35.121602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eae571-749a-49fc-913c-80c6fef296f8 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:35.140470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:35.141215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:35.141396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:35.142247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:35.142937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Adding query filter params (parent_id=98660f882fe14fa6af920c544f123b11) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:35.143239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:35.145211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:35.189984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2025/4073] 10.222.0.23 () {58 vars in 1216 bytes} [Mon Oct 31 05:28:35 2022] GET /identity/v3/projects?parent_id=98660f882fe14fa6af920c544f123b11 => generated 498 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:35.195891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:35.211646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324ab3-73ce-4842-8930-a950855fb449 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:35.220124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:35.221722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:35.222075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:35.225212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects/24eeb8a85d2e427dbf847964002a259f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:35.228055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24eeb8a85d2e427dbf847964002a259f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:35.238605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:35.308110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:35.342470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24eeb8a85d2e427dbf847964002a259f', 'request_id': 'req-466d3b53-db61-4088-a340-5900e4d2571a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.350172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24eeb8a85d2e427dbf847964002a259f', 'request_id': 'req-466d3b53-db61-4088-a340-5900e4d2571a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.364442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24eeb8a85d2e427dbf847964002a259f', 'request_id': 'req-466d3b53-db61-4088-a340-5900e4d2571a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.389933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] The token cache is being invalidate because project 24eeb8a85d2e427dbf847964002a259f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:35.390290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.392873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.396675 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2049/4074] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:35 2022] DELETE /identity/v3/projects/24eeb8a85d2e427dbf847964002a259f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:35.400460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:35.402704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:35.426950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5302ed-4f57-462d-b556-f348e0f45de3 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:35.574186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:35.574884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:35.579122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:35.580019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects/98660f882fe14fa6af920c544f123b11` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:35.581404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:delete_project(project_id=98660f882fe14fa6af920c544f123b11)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:35.583463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:35.755262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98660f882fe14fa6af920c544f123b11', 'request_id': 'req-e95cc977-a734-4cef-947f-a2cab8a55d48'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.778486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98660f882fe14fa6af920c544f123b11', 'request_id': 'req-e95cc977-a734-4cef-947f-a2cab8a55d48'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.807921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98660f882fe14fa6af920c544f123b11', 'request_id': 'req-e95cc977-a734-4cef-947f-a2cab8a55d48'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.838936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] The token cache is being invalidate because project 98660f882fe14fa6af920c544f123b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:35.839251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.840129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:35.843717 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2026/4075] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:35 2022] DELETE /identity/v3/projects/98660f882fe14fa6af920c544f123b11 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:35.848018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:35.870493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d3b53-db61-4088-a340-5900e4d2571a tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:36.087265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97000684f62c427785ef8613de02ef13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4d2697317d4b62bb4d3b1619389122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:36.088114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:36.088568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:36.088972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] PATH_INFO: `/v3/projects/a36849591f204e75a0e398fd612f5b13` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:36.091153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a36849591f204e75a0e398fd612f5b13)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:36.094440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:36.221261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36849591f204e75a0e398fd612f5b13', 'request_id': 'req-5205defa-4323-42c2-9e1d-bf14b4f19a45'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:36.230581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36849591f204e75a0e398fd612f5b13', 'request_id': 'req-5205defa-4323-42c2-9e1d-bf14b4f19a45'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:36.246287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36849591f204e75a0e398fd612f5b13', 'request_id': 'req-5205defa-4323-42c2-9e1d-bf14b4f19a45'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:36.276857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] The token cache is being invalidate because project a36849591f204e75a0e398fd612f5b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:36.281066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:36.285172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5205defa-4323-42c2-9e1d-bf14b4f19a45 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:36.289851 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2050/4076] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:35 2022] DELETE /identity/v3/projects/a36849591f204e75a0e398fd612f5b13 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:36.293852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:36.295708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:36.446854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:36.465595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cc977-a734-4cef-947f-a2cab8a55d48 tempest-ListProjectsTestJSON-1030595980 tempest-ListProjectsTestJSON-1030595980-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:36.721413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:36.722363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:36.725557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:36.727819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] PATH_INFO: `/v3/users/5d2f6c9756f24a549a87912952b6bc57` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:36.743599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2f6c9756f24a549a87912952b6bc57)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:36.745861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:37.039794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2f6c9756f24a549a87912952b6bc57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:37.061538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2f6c9756f24a549a87912952b6bc57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:37.062452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2f6c9756f24a549a87912952b6bc57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:37.063476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2f6c9756f24a549a87912952b6bc57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:37.092060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2f6c9756f24a549a87912952b6bc57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:37.140740 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2027/4077] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:36 2022] DELETE /identity/v3/users/5d2f6c9756f24a549a87912952b6bc57 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:37.145886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:37.146385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:37.146524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:37.185362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:37.191190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:37.301221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:37.356789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2051/4078] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:37.427489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:37.429136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:37.596622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45125f9-6ee3-4a60-ac2f-d2c45e5d376f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:37.620891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:37.621711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:37.622108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:37.622517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:37.649694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:37.660401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:37.690449 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2028/4079] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:39.601785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:39.604298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:39.644478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec6ee-0516-4073-9e9c-c76f88c70363 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:39.668014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:39.671654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:39.673495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:39.677381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] PATH_INFO: `/v3/projects/49c8e2a9486248b9968e7756b68286e7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:39.686649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c8e2a9486248b9968e7756b68286e7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:39.699089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:39.852013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c8e2a9486248b9968e7756b68286e7', 'request_id': 'req-21f8f764-0f85-4c94-91e1-a13b6a292533'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:39.862018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c8e2a9486248b9968e7756b68286e7', 'request_id': 'req-21f8f764-0f85-4c94-91e1-a13b6a292533'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:39.872915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c8e2a9486248b9968e7756b68286e7', 'request_id': 'req-21f8f764-0f85-4c94-91e1-a13b6a292533'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:39.906172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] The token cache is being invalidate because project 49c8e2a9486248b9968e7756b68286e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:39.906461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:39.909931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:39.924567 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2052/4080] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:39 2022] DELETE /identity/v3/projects/49c8e2a9486248b9968e7756b68286e7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:39.925414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:39.935472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e281c-9f6e-4c1c-994c-0693753e2494 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:39.981822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:40.128971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:40.129640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:40.129925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:40.130227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] PATH_INFO: `/v3/users/97000684f62c427785ef8613de02ef13` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:40.133196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97000684f62c427785ef8613de02ef13)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:40.135201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:40.243944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97000684f62c427785ef8613de02ef13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:40.260613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97000684f62c427785ef8613de02ef13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:40.261472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97000684f62c427785ef8613de02ef13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:40.262173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97000684f62c427785ef8613de02ef13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:40.290661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97000684f62c427785ef8613de02ef13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:40.322981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2029/4081] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:39 2022] DELETE /identity/v3/users/97000684f62c427785ef8613de02ef13 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:42.857716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:42.859956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:42.895795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f764-0f85-4c94-91e1-a13b6a292533 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:43.064756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:43.066911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:43.204344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:43.206561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.207567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.207867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] PATH_INFO: `/v3/users/d55e71c267f34f2da01691b5066b924a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.218180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55e71c267f34f2da01691b5066b924a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:43.229142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:43.299931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e81a5-a3b1-47d8-bb0d-ce15bfcc018a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:43.319632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:43.320431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.320853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.321364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] PATH_INFO: `/v3/projects/6a4d2697317d4b62bb4d3b1619389122` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.323504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4d2697317d4b62bb4d3b1619389122)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:43.328817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:43.377531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55e71c267f34f2da01691b5066b924a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.422716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55e71c267f34f2da01691b5066b924a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.427590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55e71c267f34f2da01691b5066b924a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.432916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55e71c267f34f2da01691b5066b924a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.451329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:43.453566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55e71c267f34f2da01691b5066b924a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.457019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:43.494057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2053/4082] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:42 2022] DELETE /identity/v3/users/d55e71c267f34f2da01691b5066b924a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:43.495786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:43.500464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:43.510798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4d2697317d4b62bb4d3b1619389122', 'request_id': 'req-43220c8b-6aae-4c6c-ba43-98a186b4d224'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.541228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4d2697317d4b62bb4d3b1619389122', 'request_id': 'req-43220c8b-6aae-4c6c-ba43-98a186b4d224'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.560725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4d2697317d4b62bb4d3b1619389122', 'request_id': 'req-43220c8b-6aae-4c6c-ba43-98a186b4d224'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.581276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] The token cache is being invalidate because project 6a4d2697317d4b62bb4d3b1619389122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:43.582132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.583123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-43220c8b-6aae-4c6c-ba43-98a186b4d224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.585171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2030/4083] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:43 2022] DELETE /identity/v3/projects/6a4d2697317d4b62bb4d3b1619389122 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:43.591288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa6ed-6bdf-4b33-baf6-cf26b0eb3aae None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.591858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa6ed-6bdf-4b33-baf6-cf26b0eb3aae None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.592202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa6ed-6bdf-4b33-baf6-cf26b0eb3aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.638032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-57afa6ed-6bdf-4b33-baf6-cf26b0eb3aae None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:43.639665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57afa6ed-6bdf-4b33-baf6-cf26b0eb3aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:43.669228 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2031/4084] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:43.670973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.671448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395463-f78a-4250-8c74-f7636e194136 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:43.671584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.672060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.678773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:43.679439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.679725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.680003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] PATH_INFO: `/v3/users/03aebbee7e224b96830248fd9f0eb0bc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.683080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03aebbee7e224b96830248fd9f0eb0bc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:43.685073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:43.711487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:43.713373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:43.737958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2032/4085] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:43.744452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:43.775505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d0555-9bcc-4081-9948-c39462a7ff02 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:43.811558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:43.813003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.816364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.816686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.819686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:43.819686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:43.823639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:43.833255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03aebbee7e224b96830248fd9f0eb0bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.855794 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2033/4086] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:43.861364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:43.870207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03aebbee7e224b96830248fd9f0eb0bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.875195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03aebbee7e224b96830248fd9f0eb0bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.877429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03aebbee7e224b96830248fd9f0eb0bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.894251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8ac47-465c-4198-88cf-1a2ecd54af17 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:43.898472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03aebbee7e224b96830248fd9f0eb0bc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:43.909992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:43.911722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:43.912067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:43.912396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:43.913289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:43.916575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:43.935613 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2054/4087] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:43 2022] DELETE /identity/v3/users/03aebbee7e224b96830248fd9f0eb0bc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:44.003530 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2034/4088] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:43 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:44.007964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:44.010004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:44.152050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:44.154086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:44.198127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423bd33-1de8-4728-b886-e0e8938fc6e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:44.235700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:44.347304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acc912-fa8f-41db-90c5-d4962ba59971 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:44.370004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:44.371737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:44.371737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:44.371737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] PATH_INFO: `/v3/projects/3d6cd9a722ec4d899b4c4ad4457c3647` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:44.372616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6cd9a722ec4d899b4c4ad4457c3647)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:44.374574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:44.375371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:44.378459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:44.378749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:44.379026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:44.379964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:44.389451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:44.458648 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2055/4089] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:44 2022] POST /identity/v3/users => generated 284 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:44.463101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:44.489495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c112-1178-4ccc-b4f2-8cfe55403ac8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:44.506529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6cd9a722ec4d899b4c4ad4457c3647', 'request_id': 'req-f1cc01b4-fca4-4506-895a-200439d4c5cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:44.522751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6cd9a722ec4d899b4c4ad4457c3647', 'request_id': 'req-f1cc01b4-fca4-4506-895a-200439d4c5cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:44.540941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6cd9a722ec4d899b4c4ad4457c3647', 'request_id': 'req-f1cc01b4-fca4-4506-895a-200439d4c5cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:44.564522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] The token cache is being invalidate because project 3d6cd9a722ec4d899b4c4ad4457c3647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:44.564916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:44.567793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1cc01b4-fca4-4506-895a-200439d4c5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:44.574645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2035/4090] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:44 2022] DELETE /identity/v3/projects/3d6cd9a722ec4d899b4c4ad4457c3647 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:44.576090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:44.578541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:44.578863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:44.630403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:44.631793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:44.645060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:44.664045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:44.664444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:44.664734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:44.665016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:44.683635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:44.691530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:44.731892 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2056/4091] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:44.732883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:44.735844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:44.770756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d752e3-01f0-4d29-9840-67f2deb24aa0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:44.809009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:44.809674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:44.809955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:44.810262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] PATH_INFO: `/v3/projects/1038634cc3ab468fa156c393bacbc932` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:44.817691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1038634cc3ab468fa156c393bacbc932)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:44.819768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:44.853071 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2036/4092] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:44.862106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:44.868691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:44.911717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f7e9-c175-4714-9867-a84c2bcbdbb4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:44.941364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74ef3-cece-4ae8-80fd-6d343fc963ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:44.942080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74ef3-cece-4ae8-80fd-6d343fc963ef admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:44.943336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74ef3-cece-4ae8-80fd-6d343fc963ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:44.943622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74ef3-cece-4ae8-80fd-6d343fc963ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:44.944294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d74ef3-cece-4ae8-80fd-6d343fc963ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:44.945917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d74ef3-cece-4ae8-80fd-6d343fc963ef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:45.002697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1038634cc3ab468fa156c393bacbc932', 'request_id': 'req-f98f86aa-085a-447c-b4e1-50c7622f6216'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:45.024190 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2037/4093] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:45.035006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf05d-edfc-4819-820c-4c66776748b2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.035318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf05d-edfc-4819-820c-4c66776748b2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.035564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf05d-edfc-4819-820c-4c66776748b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.046930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1038634cc3ab468fa156c393bacbc932', 'request_id': 'req-f98f86aa-085a-447c-b4e1-50c7622f6216'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:45.089628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1038634cc3ab468fa156c393bacbc932', 'request_id': 'req-f98f86aa-085a-447c-b4e1-50c7622f6216'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:45.123960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d97bf05d-edfc-4819-820c-4c66776748b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:45.130118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d97bf05d-edfc-4819-820c-4c66776748b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:45.130271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] The token cache is being invalidate because project 1038634cc3ab468fa156c393bacbc932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:45.130551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:45.134812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:45.139344 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2057/4094] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:44 2022] DELETE /identity/v3/projects/1038634cc3ab468fa156c393bacbc932 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:45.144843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:45.151231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:45.274864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:45.363789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f86aa-085a-447c-b4e1-50c7622f6216 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:45.370693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:45.371835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.372405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.372929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] PATH_INFO: `/v3/projects/b8346a256f2e47bf917e22a980dbc3f2/users/ae996f43fff44f438b19ab49b716ab59/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.389724 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2038/4095] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:45.394879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a40bff-9d38-411e-965a-569125f53af1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.395320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a40bff-9d38-411e-965a-569125f53af1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.395676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a40bff-9d38-411e-965a-569125f53af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.414424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8346a256f2e47bf917e22a980dbc3f2, user_id=ae996f43fff44f438b19ab49b716ab59, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:45.429609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:45.443202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b8a40bff-9d38-411e-965a-569125f53af1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:45.444227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b8a40bff-9d38-411e-965a-569125f53af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:45.482472 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2039/4096] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:45.489773 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2058/4097] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:45 2022] PUT /identity/v3/projects/b8346a256f2e47bf917e22a980dbc3f2/users/ae996f43fff44f438b19ab49b716ab59/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:45.489773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:45.492491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.492787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.493073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.556275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:45.559216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:45.708486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa467-a397-47d8-9c2f-d78fc9e8eed1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:45.718929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:45.727850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.728359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.729896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.734909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:45.735972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:45.743181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870543-1ec9-44cd-b0e1-2a8b28a0c8e5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:45.779137 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2059/4098] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:45.780789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.784291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.784827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.789287 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2040/4099] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:45.797684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:45.836690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb1a1-0403-4efa-a6c4-91edb3c10b98 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:45.856661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:45.857352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:45.857629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:45.858284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:45.858600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:45.866343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:45.879728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] MFA Rules not processed for user `ae996f43fff44f438b19ab49b716ab59`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:45.880992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:45.966606 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2041/4100] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:45 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:45.967800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.007563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:46.169478 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2060/4101] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:46.171979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2610cf3-bde9-448a-bdd3-206d7b23fc9d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.175713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.187054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.187697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.187985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.188266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.189275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:46.189772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.196045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.216211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08eb56-d1d0-49ae-8a1b-6230ea251f73 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.228646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.229453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.230985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.231481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.232285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.236600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.250587 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2042/4102] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:46.255464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.262076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:46.290639 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2061/4103] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:46 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:46.290639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.312168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134da18-3e96-455a-bb27-022d06754c74 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.328158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.329878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.330376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.330764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.331521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.333771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.386356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:46.412514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2062/4104] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:46 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:46.413751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.551465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cf5ed-cd7f-46fe-8c7e-31da7c65bbd1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.622125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04effbfa-bf91-4754-84a6-73634f5d768b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.639417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.640066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.640349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.640641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.641320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.650698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.687140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2063/4105] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:46.693587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.715836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.716485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.723287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.723447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.733700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336b142-b476-4a56-b5e2-542bf097d1d9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.751331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.752061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.752346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.752625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.757705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.759747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.842968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2064/4106] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:46 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:46.846820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.878440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc04c-cb34-45d0-ac24-cba1f306aba5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.892771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:46.893510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:46.893774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:46.894057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:46.894747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.896396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.917981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:46.923235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:46.926073 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2065/4107] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:46.927068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.949125 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2043/4108] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:46.950401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:46.964783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a3a0-cc4f-4e26-abd9-2f1a79d612b7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:46.979516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741465-449b-47fb-b2b7-c8fb94942641 service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:47.000791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:47.001624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.002695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.003341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.004729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:47.006058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:47.008257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.008544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.009842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:47.011570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] PATH_INFO: `/v3/projects/e5ea8c38c76d4d82913bdd70b27bcdf1/users/3a419667460b461a8089f13bc6ffc8d3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.038789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:47.100739 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2066/4109] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:47.103545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:47.134385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ea8c38c76d4d82913bdd70b27bcdf1, user_id=3a419667460b461a8089f13bc6ffc8d3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:47.151021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:47.165751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061c0d-cc78-47fb-a1bb-6ca1b4ef9a67 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:47.191283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f92e1-613b-486a-8b32-15c44eb10735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:47.192238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f92e1-613b-486a-8b32-15c44eb10735 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.192623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f92e1-613b-486a-8b32-15c44eb10735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.193314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f92e1-613b-486a-8b32-15c44eb10735 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.194987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f92e1-613b-486a-8b32-15c44eb10735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:47.206018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f92e1-613b-486a-8b32-15c44eb10735 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:47.210089 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2044/4110] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:46 2022] PUT /identity/v3/projects/e5ea8c38c76d4d82913bdd70b27bcdf1/users/3a419667460b461a8089f13bc6ffc8d3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:47.211161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:47.229337 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2067/4111] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:47.232923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.233325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.236518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.317186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] MFA Rules not processed for user `3a419667460b461a8089f13bc6ffc8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:47.323256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:47.419771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fabc-4848-41f1-a878-5f3bea581097 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:47.433091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:47.433678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.433960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.434268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] PATH_INFO: `/v3/users/ae996f43fff44f438b19ab49b716ab59` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.437492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae996f43fff44f438b19ab49b716ab59)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:47.443292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:47.519858 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2068/4112] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:47.520736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:47.546292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d3a9-9031-4851-8e22-677136569cee None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:47.552499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df303f0-107e-4355-9bb5-588ec981367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:47.553267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df303f0-107e-4355-9bb5-588ec981367b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.553554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df303f0-107e-4355-9bb5-588ec981367b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.554495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df303f0-107e-4355-9bb5-588ec981367b admin admin] PATH_INFO: `/v3/projects/a4d0af5ae1c54808bb2c6b558a055703/users/b2cc46e061cd48f69b718871d39f51f7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.577998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae996f43fff44f438b19ab49b716ab59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:47.601505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df303f0-107e-4355-9bb5-588ec981367b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d0af5ae1c54808bb2c6b558a055703, user_id=b2cc46e061cd48f69b718871d39f51f7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:47.605380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae996f43fff44f438b19ab49b716ab59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:47.605585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df303f0-107e-4355-9bb5-588ec981367b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:47.607230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae996f43fff44f438b19ab49b716ab59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:47.609810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae996f43fff44f438b19ab49b716ab59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:47.636104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2069/4113] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:47 2022] PUT /identity/v3/projects/a4d0af5ae1c54808bb2c6b558a055703/users/b2cc46e061cd48f69b718871d39f51f7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:47.640689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d6d28e6-11d8-4475-a829-df74d162bebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae996f43fff44f438b19ab49b716ab59'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:47.643555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce49d2-05a1-4704-af7a-0ae5963c0b3d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.646399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce49d2-05a1-4704-af7a-0ae5963c0b3d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.646399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce49d2-05a1-4704-af7a-0ae5963c0b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.665754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:47.696795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e9ce49d2-05a1-4704-af7a-0ae5963c0b3d None None] MFA Rules not processed for user `3a419667460b461a8089f13bc6ffc8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:47.699257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9ce49d2-05a1-4704-af7a-0ae5963c0b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:47.702975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2045/4114] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:47 2022] DELETE /identity/v3/users/ae996f43fff44f438b19ab49b716ab59 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:47.705562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f096a1f-15ed-4b1b-8e37-1bb8391bf069 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.706425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f096a1f-15ed-4b1b-8e37-1bb8391bf069 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.706858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f096a1f-15ed-4b1b-8e37-1bb8391bf069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.747453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f096a1f-15ed-4b1b-8e37-1bb8391bf069 None None] MFA Rules not processed for user `b2cc46e061cd48f69b718871d39f51f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:47.748922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f096a1f-15ed-4b1b-8e37-1bb8391bf069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:47.837234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:47.861838 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2046/4115] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:47.864475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.864783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.865069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.889441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:47.890687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:47.910769 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2070/4116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:47.913584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:47.913871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:47.914156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:47.977040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] MFA Rules not processed for user `b2cc46e061cd48f69b718871d39f51f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:47.978366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:48.000617 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2071/4117] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:48.000866 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2047/4118] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:48.052557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:48.054469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:48.130407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:48.130407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:48.262054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943d2a4-fbdc-461c-8aec-8b5c1192c3ff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:48.277276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:48.279222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:48.279518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:48.279800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:48.309283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:48.314612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:48.339924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2072/4119] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:48.358043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48bb0-82ac-4073-9f83-5cb98cd423ba None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:48.365081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:48.365726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:48.366069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:48.366391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:48.368184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:48.381941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:48.383845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28de5-3c5e-4025-9f20-9a0c4acba4bf service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:48.404521 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2048/4120] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:48.832917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:48.849206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68bd43-8db5-4a5a-9be2-7fc7d4a3392e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:48.856114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325c23-8fc7-4d7f-97aa-e3e113cce3fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:48.856993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325c23-8fc7-4d7f-97aa-e3e113cce3fe service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:48.857416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325c23-8fc7-4d7f-97aa-e3e113cce3fe service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:48.857972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325c23-8fc7-4d7f-97aa-e3e113cce3fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:48.867688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79325c23-8fc7-4d7f-97aa-e3e113cce3fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:48.870682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79325c23-8fc7-4d7f-97aa-e3e113cce3fe service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:48.894547 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2073/4121] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:48 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:48.916282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68160b5f-b146-4f7a-acd7-41bd3ec520be None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:48.916739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68160b5f-b146-4f7a-acd7-41bd3ec520be None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:48.916739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68160b5f-b146-4f7a-acd7-41bd3ec520be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:48.938243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-68160b5f-b146-4f7a-acd7-41bd3ec520be None None] MFA Rules not processed for user `b2cc46e061cd48f69b718871d39f51f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:48.939657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68160b5f-b146-4f7a-acd7-41bd3ec520be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:48.952532 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2049/4122] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:49.398435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:49.398986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:49.399141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:49.422353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] MFA Rules not processed for user `4eff9d64a7c84373ace007cd34d1809c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:49.463806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:49.470062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591e99-97db-4662-9f44-9bad4ab66687 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:49.470236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591e99-97db-4662-9f44-9bad4ab66687 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:49.470694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591e99-97db-4662-9f44-9bad4ab66687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:49.516186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-64591e99-97db-4662-9f44-9bad4ab66687 None None] MFA Rules not processed for user `b2cc46e061cd48f69b718871d39f51f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:49.522526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64591e99-97db-4662-9f44-9bad4ab66687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:49.541981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2050/4123] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:49.592802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2074/4124] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:49.596541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e9f61-4328-4bc9-83ec-b173fdfaacb8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:49.596885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e9f61-4328-4bc9-83ec-b173fdfaacb8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:49.597264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e9f61-4328-4bc9-83ec-b173fdfaacb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:49.638947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1a0e9f61-4328-4bc9-83ec-b173fdfaacb8 None None] MFA Rules not processed for user `4eff9d64a7c84373ace007cd34d1809c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:49.640263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1a0e9f61-4328-4bc9-83ec-b173fdfaacb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:49.664282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2051/4125] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:49.921560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:49.922808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:49.962205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700256-6bc1-499c-a5d4-139a9e51c10a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:49.962762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700256-6bc1-499c-a5d4-139a9e51c10a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:49.962762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700256-6bc1-499c-a5d4-139a9e51c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:49.981696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b1653-9f4f-4c12-b215-ceeab520a0e0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.000670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.002487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.003192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.014965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] PATH_INFO: `/v3/projects/b8346a256f2e47bf917e22a980dbc3f2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.021146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8346a256f2e47bf917e22a980dbc3f2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.029008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:50.030754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-48700256-6bc1-499c-a5d4-139a9e51c10a None None] MFA Rules not processed for user `b2cc46e061cd48f69b718871d39f51f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:50.031915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-48700256-6bc1-499c-a5d4-139a9e51c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:50.048802 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2052/4126] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:50.088196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfa817-5108-42fe-a56d-1e6bd675b402 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.088497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfa817-5108-42fe-a56d-1e6bd675b402 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.088839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfa817-5108-42fe-a56d-1e6bd675b402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.134645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:50.138799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-72cfa817-5108-42fe-a56d-1e6bd675b402 None None] MFA Rules not processed for user `b2cc46e061cd48f69b718871d39f51f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:50.140393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-72cfa817-5108-42fe-a56d-1e6bd675b402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:50.175363 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2053/4127] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:50.181859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8346a256f2e47bf917e22a980dbc3f2', 'request_id': 'req-3e279c30-1cbf-4061-8414-d82829b886b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:50.189154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8346a256f2e47bf917e22a980dbc3f2', 'request_id': 'req-3e279c30-1cbf-4061-8414-d82829b886b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:50.197773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8346a256f2e47bf917e22a980dbc3f2', 'request_id': 'req-3e279c30-1cbf-4061-8414-d82829b886b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:50.221173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] The token cache is being invalidate because project b8346a256f2e47bf917e22a980dbc3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:50.222111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:50.223323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3e279c30-1cbf-4061-8414-d82829b886b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:50.226421 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2075/4128] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:49 2022] DELETE /identity/v3/projects/b8346a256f2e47bf917e22a980dbc3f2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:50.231441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.232987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.233676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.291565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:50.296148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:50.403574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:50.442039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2054/4129] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:50.449455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.450974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.451408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.479933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:50.481839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:50.495446 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2076/4130] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:50.499444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:50.551546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e2792-3838-4f6d-80a1-32fb1378abd3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.564036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.566114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.566446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.567211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.567414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:50.567795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.569337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:50.587668 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2055/4131] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:50.592267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:50.604045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a504d7a-3aa7-43a3-9101-779f0f074799 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.624770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.625041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.625457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.626493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.627622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.630724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:50.669952 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2077/4132] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:50 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:28:50.674792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:50.687022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b2c3-135c-4265-a7bd-343e336e0f37 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.765261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.766033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.766594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.766956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.767663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.771495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:50.802308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2056/4133] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:50 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:50.807020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:50.819599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0a94d-591c-41b9-95a3-a8fb744052ff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.825027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.825731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.826314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.826659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.827371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.830171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:50.846901 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2078/4134] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:50.863436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:50.923761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:50.929401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:50.956819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ee8e-5bdd-4521-89cf-d01046057a88 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.969317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.970867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.971567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.972222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.973067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.975431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:50.978489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2e20d-9300-44b1-b540-bc43e320f5db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:50.989854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:50.990773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:50.991224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:50.991640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] PATH_INFO: `/v3/users/b2cc46e061cd48f69b718871d39f51f7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:50.992985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2cc46e061cd48f69b718871d39f51f7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:50.995413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:51.004862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2057/4135] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:51.005973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:51.024441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f831-6dce-4118-86d7-84d7b9cb7d23 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:51.030250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d3810-ca5a-44f2-aaaf-3acdfa2beba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:51.031122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3810-ca5a-44f2-aaaf-3acdfa2beba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:51.031406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3810-ca5a-44f2-aaaf-3acdfa2beba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:51.031756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3810-ca5a-44f2-aaaf-3acdfa2beba0 admin admin] PATH_INFO: `/v3/projects/72d542e684ed40c7a99cd7e19fb77d4b/users/b42b26df3ccc408684af291b3b1a2fd8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:51.057749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d3810-ca5a-44f2-aaaf-3acdfa2beba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d542e684ed40c7a99cd7e19fb77d4b, user_id=b42b26df3ccc408684af291b3b1a2fd8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:51.060316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d3810-ca5a-44f2-aaaf-3acdfa2beba0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:51.112600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2058/4136] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:51 2022] PUT /identity/v3/projects/72d542e684ed40c7a99cd7e19fb77d4b/users/b42b26df3ccc408684af291b3b1a2fd8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:51.132864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:51.136362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:51.137320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:51.141281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2cc46e061cd48f69b718871d39f51f7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:51.176779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2cc46e061cd48f69b718871d39f51f7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:51.178303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2cc46e061cd48f69b718871d39f51f7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:51.179353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2cc46e061cd48f69b718871d39f51f7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:51.193943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59224556-f95a-4a62-a73b-ae2c3ab1c31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2cc46e061cd48f69b718871d39f51f7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:51.200300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] MFA Rules not processed for user `b42b26df3ccc408684af291b3b1a2fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:51.201961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:51.223659 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2079/4137] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:50 2022] DELETE /identity/v3/users/b2cc46e061cd48f69b718871d39f51f7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:51.228100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:51.228661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:51.229220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:51.274951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:51.276057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:51.350838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:51.353683 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2059/4138] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:51.371149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:51.372201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:51.417392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2080/4139] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:51.422061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:51.459068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:51.461712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:51.519597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3601c5-6c15-446b-acb0-4affeafc6207 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:51.551361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8db95f-ce8c-425a-a33a-46f54d00d4c3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:51.556277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:51.557032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:51.557427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:51.557815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:51.582019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24e61-ea2b-474c-abec-306e1837a855 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:51.582961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24e61-ea2b-474c-abec-306e1837a855 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:51.583388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24e61-ea2b-474c-abec-306e1837a855 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:51.583816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24e61-ea2b-474c-abec-306e1837a855 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:51.593518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:51.601050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:51.629906 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2081/4140] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:51.675183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24e61-ea2b-474c-abec-306e1837a855 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:51.677101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24e61-ea2b-474c-abec-306e1837a855 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:51.690669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2060/4141] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:28:52.080134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:52.082045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:52.111502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc916-39c1-40df-829e-995e01ee301b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:52.128282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:52.130235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:52.131798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:52.134935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] PATH_INFO: `/v3/users/b42b26df3ccc408684af291b3b1a2fd8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:52.137132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42b26df3ccc408684af291b3b1a2fd8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:52.142873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:52.276979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42b26df3ccc408684af291b3b1a2fd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.314818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42b26df3ccc408684af291b3b1a2fd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.315790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42b26df3ccc408684af291b3b1a2fd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.316435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42b26df3ccc408684af291b3b1a2fd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.330512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42b26df3ccc408684af291b3b1a2fd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.355472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2082/4142] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:28:52 2022] DELETE /identity/v3/users/b42b26df3ccc408684af291b3b1a2fd8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:52.359733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:52.360792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:52.360792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:52.415565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:52.417824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:52.518976 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2061/4143] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:52.535496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:52.538877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:52.683408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c091941-9fd3-41b3-8149-37f37de6515e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:52.688747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29343425-74f0-4a6d-83ac-ad34be10dd4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:52.689658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343425-74f0-4a6d-83ac-ad34be10dd4b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:52.690138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343425-74f0-4a6d-83ac-ad34be10dd4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:52.690465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343425-74f0-4a6d-83ac-ad34be10dd4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:52.704209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29343425-74f0-4a6d-83ac-ad34be10dd4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:52.706501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29343425-74f0-4a6d-83ac-ad34be10dd4b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:52.719071 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2083/4144] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:52.836145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:52.837685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:52.850397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9426f-a4a0-468a-bc0d-a8f93f8f6eff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:52.856195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:52.863481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:52.863712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:52.864002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] PATH_INFO: `/v3/projects/a4d0af5ae1c54808bb2c6b558a055703` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:52.867560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d0af5ae1c54808bb2c6b558a055703)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:52.870090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:52.916594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:52.957559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d0af5ae1c54808bb2c6b558a055703', 'request_id': 'req-b34802d4-e6f0-4b24-bf3c-3eece842c93a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.964247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d0af5ae1c54808bb2c6b558a055703', 'request_id': 'req-b34802d4-e6f0-4b24-bf3c-3eece842c93a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.973257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d0af5ae1c54808bb2c6b558a055703', 'request_id': 'req-b34802d4-e6f0-4b24-bf3c-3eece842c93a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.995129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] The token cache is being invalidate because project a4d0af5ae1c54808bb2c6b558a055703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:52.995129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.996048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b34802d4-e6f0-4b24-bf3c-3eece842c93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:52.997893 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2062/4145] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:52 2022] DELETE /identity/v3/projects/a4d0af5ae1c54808bb2c6b558a055703 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:53.005129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.005329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.005543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.015328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:53.030703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:53.033592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.129979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2084/4146] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:53.134578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.135136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.135452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.158375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:53.159622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.182506 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2063/4147] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:53.188159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.208999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece66c-d89f-48ef-b424-76b2f3259bcb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.215896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.217194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.218343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.218695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.221016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:53.221996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.223753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.245202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2085/4148] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:28:53.249844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.272017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70261-7ba0-4560-bf70-2b6bf0316337 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.276927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.277634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.277982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.278351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.279058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.281510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.327917 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2064/4149] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:53.332067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.347817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8afcb0-0322-4955-87bd-c0f47f094d3b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.428418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.429272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.429822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.430270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.432709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.434866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.467411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2086/4150] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:53.472102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.484237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf287f2-77db-46a5-a5a4-0d92a5b45334 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.490127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.491003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.491356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.491705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.492558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.495496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.513240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.515059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.515204 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2065/4151] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:53.516073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.526530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73615fe0-d27a-4069-b8ef-195cc022fa2e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.530123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335a8d8-9913-4bd6-842d-ca96cc931300 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.532862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.533788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.534334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.535112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.535969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.536180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.536827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.537860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.538165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] PATH_INFO: `/v3/projects/72d542e684ed40c7a99cd7e19fb77d4b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.539048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.539544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d542e684ed40c7a99cd7e19fb77d4b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.541707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.552269 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2066/4152] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:53.556720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.581114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82b48b-b056-4817-b88b-0d044be9d5a3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.594402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f4bb-0a1a-4f2e-86c3-c1a9e54390c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.596205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f4bb-0a1a-4f2e-86c3-c1a9e54390c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.596516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f4bb-0a1a-4f2e-86c3-c1a9e54390c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.602564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f4bb-0a1a-4f2e-86c3-c1a9e54390c8 admin admin] PATH_INFO: `/v3/projects/37fd8b31dcb0478c9c06841eaf8b47f8/users/480eb3dfe5a0479b96ba8e5f48438b22/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.630372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190f4bb-0a1a-4f2e-86c3-c1a9e54390c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fd8b31dcb0478c9c06841eaf8b47f8, user_id=480eb3dfe5a0479b96ba8e5f48438b22, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.632341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d542e684ed40c7a99cd7e19fb77d4b', 'request_id': 'req-2845d2ad-a60c-4992-8563-4d32bb77229e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:53.634572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190f4bb-0a1a-4f2e-86c3-c1a9e54390c8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.639928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d542e684ed40c7a99cd7e19fb77d4b', 'request_id': 'req-2845d2ad-a60c-4992-8563-4d32bb77229e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:53.648272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d542e684ed40c7a99cd7e19fb77d4b', 'request_id': 'req-2845d2ad-a60c-4992-8563-4d32bb77229e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:53.654868 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2067/4153] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:53 2022] PUT /identity/v3/projects/37fd8b31dcb0478c9c06841eaf8b47f8/users/480eb3dfe5a0479b96ba8e5f48438b22/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:53.661636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.663024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.663633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.665715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] The token cache is being invalidate because project 72d542e684ed40c7a99cd7e19fb77d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:28:53.666136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:53.667082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2845d2ad-a60c-4992-8563-4d32bb77229e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:28:53.668985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2087/4154] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:28:53 2022] DELETE /identity/v3/projects/72d542e684ed40c7a99cd7e19fb77d4b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:28:53.674995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f92c9-cd79-4911-996c-ebfd97df79aa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.675507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f92c9-cd79-4911-996c-ebfd97df79aa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.675875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f92c9-cd79-4911-996c-ebfd97df79aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.685761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:53.694884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:53.696922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.706117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-006f92c9-cd79-4911-996c-ebfd97df79aa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:53.708204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-006f92c9-cd79-4911-996c-ebfd97df79aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.804667 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2068/4155] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:53.816415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.817821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.824936 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2088/4156] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:53.826509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.826797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.827073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.852556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:53.853743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:53.864033 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2089/4157] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:53.868417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.879753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2464a7-61c5-4140-a0c2-9bb6c790dcb3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.884978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:53.887005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.887964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.888221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.888684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.889658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:28:53.889967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.893556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.911332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e4e0-67a1-4911-b093-bcf13bc95fa8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.912147 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2090/4158] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:28:53.913001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:53.915556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.916447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.917045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.917425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.931399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223e9a-9d3e-4ada-9fde-31a076d165c5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:53.942573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.946566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:53.947129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.948395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:53.950889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:53.951367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:53.952095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:53.959493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:53.972171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2069/4159] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:54.012977 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2091/4160] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:53 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:54.017475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.033466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de88f3-93c9-43e4-a248-f7d4477237c9 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.121834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.122528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.123084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.123382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.124048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.128237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.170834 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2070/4161] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:54 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:54.172798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.196457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb72a63-2da4-454f-8543-e7245903595c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.209356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.210905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.211557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.212278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.213770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.225470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.259114 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2092/4162] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:54.260759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.279639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5d17-6355-4c40-8d6f-b00549bd02d5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.295176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096176-13c5-4924-b7e3-1728b0191fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.295845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096176-13c5-4924-b7e3-1728b0191fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.296126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096176-13c5-4924-b7e3-1728b0191fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.296405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096176-13c5-4924-b7e3-1728b0191fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.297085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096176-13c5-4924-b7e3-1728b0191fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.299489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096176-13c5-4924-b7e3-1728b0191fe7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.337310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2071/4163] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:54.341007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.356675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f97855-51d7-4e8b-b01c-5c0efbf469e5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.365093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.365796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.366344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.366769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] PATH_INFO: `/v3/projects/dd9d061664854aa4b0225646e32f7193/users/0e38c98761b54e58b0945b80ca392b5f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.415578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9d061664854aa4b0225646e32f7193, user_id=0e38c98761b54e58b0945b80ca392b5f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.420865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.453356 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2093/4164] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:54 2022] PUT /identity/v3/projects/dd9d061664854aa4b0225646e32f7193/users/0e38c98761b54e58b0945b80ca392b5f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:54.465857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.466175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.466480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.533832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] MFA Rules not processed for user `0e38c98761b54e58b0945b80ca392b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:54.536018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:54.618200 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2072/4165] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:28:54.622809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.708861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1c680-5728-4b46-99ef-405d58caf206 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.713816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.714571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.714918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.715257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.716532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.720383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.758007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2094/4166] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:54 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:54.759484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.771705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc77b6-6417-4712-bf78-bdd0b159627d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.867205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:54.903744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.904483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.907686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.908011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.909146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.912195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.945261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2073/4167] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:54 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:28:54.949118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:54.964187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209edf9-1302-4b06-b603-31d9d1266489 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:54.969279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:54.970719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:54.971257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:54.971398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:54.972104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:54.973857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:54.979914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:54.991842 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2095/4168] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:28:54.993386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.008512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918e807-0dee-4b7b-834b-6ebca7a97d69 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.014918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253d93-1552-4f6d-85b8-a637e9d77f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.015665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253d93-1552-4f6d-85b8-a637e9d77f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.015957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253d93-1552-4f6d-85b8-a637e9d77f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.016316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253d93-1552-4f6d-85b8-a637e9d77f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.017755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253d93-1552-4f6d-85b8-a637e9d77f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.019556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253d93-1552-4f6d-85b8-a637e9d77f97 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.032732 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2074/4169] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:55.037946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.065978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90d3c-f168-4352-a7f7-68a4881c7dd7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.073395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.074080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.074415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.074693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] PATH_INFO: `/v3/projects/d61f252dd6c54c4cab9ad862efb8c6f3/users/20e595c570ed4e098dae2d1d8dde36ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.094193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61f252dd6c54c4cab9ad862efb8c6f3, user_id=20e595c570ed4e098dae2d1d8dde36ae, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.098002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.139153 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2096/4170] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:55 2022] PUT /identity/v3/projects/d61f252dd6c54c4cab9ad862efb8c6f3/users/20e595c570ed4e098dae2d1d8dde36ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:55.151815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.152586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.153115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.201077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] MFA Rules not processed for user `20e595c570ed4e098dae2d1d8dde36ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:55.202878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:55.214615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.374734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2075/4171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:55.381420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.394260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92becfce-2e81-448a-8dbf-69961eb1d84e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.401718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.402439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.402930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.404488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.411197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:55.488892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bccb-3ca5-442a-a2da-9687f8c25832 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.519430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.520077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.520361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.520635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.525669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.531018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.587204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.588803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.600840 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2076/4172] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:28:55 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:55.604815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.614719 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2097/4173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:28:55.674519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:55.707671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba543-f2a8-423c-9435-097dfc4ce37d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.713389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.714332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.714814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.715331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.716182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.718921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.759362 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2077/4174] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:28:55 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:28:55.761196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.782865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3374d-dad5-4795-bc80-e6d19b4436df service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.788517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.789225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.789572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.789911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.790687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.792373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.809046 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2098/4175] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:55.814479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.828482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0eff0-59ba-4efb-8f3d-a2fc757b3a78 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:55.845559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:55.846726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:55.847220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:55.847697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] PATH_INFO: `/v3/projects/bbca8b46522645f6bacb9da01061ba6a/users/279407c35f9d4f98a8789e68e89f6f22/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:55.888336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbca8b46522645f6bacb9da01061ba6a, user_id=279407c35f9d4f98a8789e68e89f6f22, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:55.899004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:55.924765 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2078/4176] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:55 2022] PUT /identity/v3/projects/bbca8b46522645f6bacb9da01061ba6a/users/279407c35f9d4f98a8789e68e89f6f22/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:55.928813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:55.944182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f9ab1-7232-4c9e-8e5e-a9a3d5c252e8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:56.062889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aaf90-c09e-40bf-b86c-c85a81577294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:56.063824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aaf90-c09e-40bf-b86c-c85a81577294 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:56.064962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aaf90-c09e-40bf-b86c-c85a81577294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:56.065381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aaf90-c09e-40bf-b86c-c85a81577294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:56.066602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aaf90-c09e-40bf-b86c-c85a81577294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:56.070816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aaf90-c09e-40bf-b86c-c85a81577294 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:56.097455 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2099/4177] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:28:56.101285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:56.116699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d16dd-2d8c-4a2b-a29b-fba007799043 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:56.127276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:56.128364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:56.128855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:56.129394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] PATH_INFO: `/v3/projects/bbca8b46522645f6bacb9da01061ba6a/users/279407c35f9d4f98a8789e68e89f6f22/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:56.132942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbca8b46522645f6bacb9da01061ba6a, user_id=279407c35f9d4f98a8789e68e89f6f22, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:56.137796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:56.161339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2079/4178] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:28:56 2022] PUT /identity/v3/projects/bbca8b46522645f6bacb9da01061ba6a/users/279407c35f9d4f98a8789e68e89f6f22/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:28:56.172191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b7fd9-b768-4d75-b203-55010898ea57 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:56.174862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b7fd9-b768-4d75-b203-55010898ea57 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:56.174862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b7fd9-b768-4d75-b203-55010898ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:56.181385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:28:56.224508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-833b7fd9-b768-4d75-b203-55010898ea57 None None] MFA Rules not processed for user `279407c35f9d4f98a8789e68e89f6f22`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:28:56.225923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-833b7fd9-b768-4d75-b203-55010898ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:28:56.388218 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2100/4179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:28:56.454472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:28:56.579972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6371f1a-a802-4062-90d7-da43f71e3020 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:28:56.586077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a74a68-140b-49d7-b020-8f718a9b9edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:28:56.587047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a74a68-140b-49d7-b020-8f718a9b9edf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:28:56.587333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a74a68-140b-49d7-b020-8f718a9b9edf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:28:56.587612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a74a68-140b-49d7-b020-8f718a9b9edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:28:56.705795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a74a68-140b-49d7-b020-8f718a9b9edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:28:56.707408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a74a68-140b-49d7-b020-8f718a9b9edf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:28:56.718898 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2080/4180] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:28:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:06.372198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=33 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:06.713795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=73,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:08.622385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:08.622765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:08.622950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:08.715456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] MFA Rules not processed for user `480eb3dfe5a0479b96ba8e5f48438b22`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:08.716717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:09.034176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2101/4181] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:09.035381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:09.035824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:09.036012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:09.085860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] MFA Rules not processed for user `480eb3dfe5a0479b96ba8e5f48438b22`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:09.098059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:09.124032 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2081/4182] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:09.333951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:09.335760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:09.565882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5364a8-a04b-410f-b688-b1fad2fca833 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:09.576332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:09.576808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:09.577206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:09.579065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:09.609439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:09.611985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:09.646059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2102/4183] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:19.073243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:19.633631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:23.178764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:23.180507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:23.214980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdbd46-7eae-46ba-9d09-fe9cb5e3b0b2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:23.240636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bd951-d74c-4c01-8d81-b3d0850a1d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:23.241432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd951-d74c-4c01-8d81-b3d0850a1d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:23.241843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd951-d74c-4c01-8d81-b3d0850a1d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:23.242302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd951-d74c-4c01-8d81-b3d0850a1d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:23.272210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bd951-d74c-4c01-8d81-b3d0850a1d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:23.274111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bd951-d74c-4c01-8d81-b3d0850a1d61 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:23.294646 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2082/4184] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:29.753473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:29.756997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:29.890500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4b98b-3936-4152-b856-aa2fac0c0c90 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:29.897655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:29.898578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:29.899080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:29.899461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:29.901398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:29.917055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:29.919081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:29.933221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2103/4185] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:33.295952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:34.879610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d095c-5186-46b5-abee-3111238278a0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:34.880214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d095c-5186-46b5-abee-3111238278a0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:34.881225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d095c-5186-46b5-abee-3111238278a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:34.939897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-349d095c-5186-46b5-abee-3111238278a0 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:34.943321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-349d095c-5186-46b5-abee-3111238278a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:35.092995 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2083/4186] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:35.158009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:35.159517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:35.329095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a80fe-9722-4804-8097-4a62c732308f service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:35.335095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:35.335748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:35.336011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:35.336350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:35.348865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:35.351141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:35.383954 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2104/4187] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:29:35.950762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d095c-5186-46b5-abee-3111238278a0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:35.966243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d095c-5186-46b5-abee-3111238278a0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:35.978159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:35.979096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:35.979531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:35.981168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:36.103771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:36.105589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:36.117219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2084/4188] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:37.735075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:37.736363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:37.848689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:37.891930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd369d3-3dea-41e0-aba4-9fa99af260c0 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:37.908942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:37.909677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:37.909965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:37.910275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] PATH_INFO: `/v3/users/3a419667460b461a8089f13bc6ffc8d3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:37.911911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a419667460b461a8089f13bc6ffc8d3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:37.915608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:38.011154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:38.027761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0015-7af1-4a51-9788-3a37129e8fda service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:38.034642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:38.035793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:38.036141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:38.036421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:38.038417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:38.044610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a419667460b461a8089f13bc6ffc8d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:38.052954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:38.054742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfd4c4-d3b4-42d2-8520-b4dc0931908b service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:38.066324 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2085/4189] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:38.072789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a419667460b461a8089f13bc6ffc8d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:38.073694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a419667460b461a8089f13bc6ffc8d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:38.076887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a419667460b461a8089f13bc6ffc8d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:38.094541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a419667460b461a8089f13bc6ffc8d3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:38.170244 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2105/4190] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:29:37 2022] DELETE /identity/v3/users/3a419667460b461a8089f13bc6ffc8d3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:38.170438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:38.170438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:38.170438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:38.217186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:38.222520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:38.393039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2086/4191] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:38.428301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:38.429953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:38.603993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41472-7866-46ea-8183-709f441a8ba2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:38.612048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80c3d-27fc-4148-9a5d-8f61de6bfe0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:38.612686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80c3d-27fc-4148-9a5d-8f61de6bfe0f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:38.612970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80c3d-27fc-4148-9a5d-8f61de6bfe0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:38.613376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80c3d-27fc-4148-9a5d-8f61de6bfe0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:38.654074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80c3d-27fc-4148-9a5d-8f61de6bfe0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:38.657736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80c3d-27fc-4148-9a5d-8f61de6bfe0f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:38.704302 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2106/4192] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:40.321696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:40.325262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:40.348908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d370a8-b92b-4f44-a112-0aacc25ed528 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:40.354946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:40.356072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:40.356561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:40.357263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] PATH_INFO: `/v3/projects/e5ea8c38c76d4d82913bdd70b27bcdf1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:40.358704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ea8c38c76d4d82913bdd70b27bcdf1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:40.361509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:40.376214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:40.441676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ea8c38c76d4d82913bdd70b27bcdf1', 'request_id': 'req-70b91a98-9191-44fe-99ca-b4ca710b0429'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.450162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ea8c38c76d4d82913bdd70b27bcdf1', 'request_id': 'req-70b91a98-9191-44fe-99ca-b4ca710b0429'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.467659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ea8c38c76d4d82913bdd70b27bcdf1', 'request_id': 'req-70b91a98-9191-44fe-99ca-b4ca710b0429'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.504961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] The token cache is being invalidate because project e5ea8c38c76d4d82913bdd70b27bcdf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:29:40.505561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.506554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.509308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2087/4193] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:29:40 2022] DELETE /identity/v3/projects/e5ea8c38c76d4d82913bdd70b27bcdf1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:40.514067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b9bd6-fcf7-4316-abcd-5eeefe76677b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:40.514567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b9bd6-fcf7-4316-abcd-5eeefe76677b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:40.514645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b9bd6-fcf7-4316-abcd-5eeefe76677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:40.567688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:40.569114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:40.587143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d28b9bd6-fcf7-4316-abcd-5eeefe76677b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:40.588384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d28b9bd6-fcf7-4316-abcd-5eeefe76677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:40.721296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b91a98-9191-44fe-99ca-b4ca710b0429 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:40.734614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:40.735936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:40.736592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:40.737538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] PATH_INFO: `/v3/users/2512010236034319952ea34c2a76a96b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:40.740493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2512010236034319952ea34c2a76a96b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:40.743397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:40.757872 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2107/4194] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:40.760269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:40.760458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:40.760743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:40.775665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:40.832161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:40.836495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:40.853924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2512010236034319952ea34c2a76a96b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.858205 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2108/4195] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:40.863229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:40.877301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2512010236034319952ea34c2a76a96b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.878451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2512010236034319952ea34c2a76a96b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.879397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2512010236034319952ea34c2a76a96b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.895287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4e01b-0ac5-46b2-a1a2-bd132d8b3a6d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:40.897212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2512010236034319952ea34c2a76a96b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:40.910063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:40.911725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:40.912533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:40.914305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:40.916324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:29:40.916781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:40.921339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:40.958918 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2088/4196] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:29:40 2022] DELETE /identity/v3/users/2512010236034319952ea34c2a76a96b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:40.962195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2109/4197] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:29:40.965928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:40.967557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:41.013640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:41.083788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768b46-0eb1-49c8-8dda-9c5e2662ce5c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.090587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.091398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.091689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.091971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.105697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.108151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.155597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2089/4198] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:29:40 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:29:41.160202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.176247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b5d57-be96-4a8f-89c7-e445a5b9fe70 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.316307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.317779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.318059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:41.320549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.321080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.322256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.323075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.331607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.345136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa75e49-8f9d-44b8-8668-cd25f4dd558a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.358998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.359920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.360154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.360430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] PATH_INFO: `/v3/projects/b87eb1c13bdb4d99beb479e9c284c983` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.361714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87eb1c13bdb4d99beb479e9c284c983)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.363627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.383591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2110/4199] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:29:41 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:29:41.385099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.411180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a92d8-f8af-4632-a92c-dc6a6eeb4b95 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.424861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.427001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.428904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.429183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.430469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.431609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.448729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87eb1c13bdb4d99beb479e9c284c983', 'request_id': 'req-8425c8fc-9e03-4ab4-b89d-33a666e32183'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.455752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87eb1c13bdb4d99beb479e9c284c983', 'request_id': 'req-8425c8fc-9e03-4ab4-b89d-33a666e32183'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.465075 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2111/4200] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:29:41.469654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87eb1c13bdb4d99beb479e9c284c983', 'request_id': 'req-8425c8fc-9e03-4ab4-b89d-33a666e32183'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.484235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] The token cache is being invalidate because project b87eb1c13bdb4d99beb479e9c284c983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:29:41.484605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.485342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.490011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.490644 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2090/4201] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:29:41 2022] DELETE /identity/v3/projects/b87eb1c13bdb4d99beb479e9c284c983 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:41.491530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.493196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:41.496957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:41.514896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a242-c634-41ac-b777-e93e10e423ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.593341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.594055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.594378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.594785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.595437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.597099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.599210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425c8fc-9e03-4ab4-b89d-33a666e32183 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.604775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.605654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.606137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.606619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] PATH_INFO: `/v3/users/69281416d1db40c991e25af0d9438aa2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.608173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=69281416d1db40c991e25af0d9438aa2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.610048 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2112/4202] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:29:41.611469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.614013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.625835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a107b7-71a7-4604-9409-befeeada50d4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:41.631332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562e6cc-7357-41f7-8e4b-9525e85805eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:41.632034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e6cc-7357-41f7-8e4b-9525e85805eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.632269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e6cc-7357-41f7-8e4b-9525e85805eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.638197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e6cc-7357-41f7-8e4b-9525e85805eb admin admin] PATH_INFO: `/v3/projects/f485776c510f4668b6a6cbf386cfd8d4/users/17b04cbba9fe48debca4d0e5f49ce0e1/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.659569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562e6cc-7357-41f7-8e4b-9525e85805eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f485776c510f4668b6a6cbf386cfd8d4, user_id=17b04cbba9fe48debca4d0e5f49ce0e1, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:41.662498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562e6cc-7357-41f7-8e4b-9525e85805eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:41.663435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:41.687976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2113/4203] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:29:41 2022] PUT /identity/v3/projects/f485776c510f4668b6a6cbf386cfd8d4/users/17b04cbba9fe48debca4d0e5f49ce0e1/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:29:41.701614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:41.701994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:41.704992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69281416d1db40c991e25af0d9438aa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.706122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:41.722753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69281416d1db40c991e25af0d9438aa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.723990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69281416d1db40c991e25af0d9438aa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.725041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69281416d1db40c991e25af0d9438aa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.736926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69281416d1db40c991e25af0d9438aa2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:41.757181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:41.761516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:41.764972 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2091/4204] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:29:41 2022] DELETE /identity/v3/users/69281416d1db40c991e25af0d9438aa2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:41.814831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:41.884607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2114/4205] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:41.904834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:41.908953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:42.006178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f3216-fd03-42d2-a93a-609729c96fdc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:42.013112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:42.015156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:42.015531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:42.015915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:42.037242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:42.040171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:42.054224 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2092/4206] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:42.459015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:42.464120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:42.586104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79962839-7ca9-4b39-9057-39177df8f59c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:42.593087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:42.594542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:42.595031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:42.595503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:42.599884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:42.618906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:42.620422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07b55-d66b-41c9-b164-ac45e43ea143 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:42.637670 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2115/4207] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:42.818686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:42.821275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:42.878272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb6dac-0a1b-4cc7-b17b-4980f36538f3 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:42.892616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:42.894431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:42.895173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:42.895831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] PATH_INFO: `/v3/projects/515fabf459b241bf97980e2bac960bab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:42.900467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=515fabf459b241bf97980e2bac960bab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:42.903737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.036198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515fabf459b241bf97980e2bac960bab', 'request_id': 'req-aa2bd277-f1d8-49e3-a0cc-88767213b02b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:43.049181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515fabf459b241bf97980e2bac960bab', 'request_id': 'req-aa2bd277-f1d8-49e3-a0cc-88767213b02b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:43.064456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515fabf459b241bf97980e2bac960bab', 'request_id': 'req-aa2bd277-f1d8-49e3-a0cc-88767213b02b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:43.089688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] The token cache is being invalidate because project 515fabf459b241bf97980e2bac960bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:29:43.091209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:43.112314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa2bd277-f1d8-49e3-a0cc-88767213b02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:43.115054 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2093/4208] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:29:42 2022] DELETE /identity/v3/projects/515fabf459b241bf97980e2bac960bab => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:29:43.122585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.123099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.123523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.158606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:43.160678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:43.305255 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2116/4209] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:43.313654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.314103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.314618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.349840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:43.351408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:43.364829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2094/4210] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:43.369443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:43.385478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ffdd-0760-4700-bcc5-705f2be424bf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:43.392571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:43.393297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.393615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.393887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.394585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:29:43.394886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:43.397192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.421417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:43.426645 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2117/4211] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:29:43.441107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b17fa-1d67-4807-a4e4-2a5bb5d9c50a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:43.451506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:43.453037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.453329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.453616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.454534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:43.460452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.505153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:43.526945 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2095/4212] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:29:43 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:29:43.528056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:43.544202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c68b-fd18-4829-b540-0f48cb2449fb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:43.676638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:43.696928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:43.697910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.698399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.698954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.700069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:43.702866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.760791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:43.771508 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2118/4213] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:29:43 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:29:43.780994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fa497-b520-44e2-86c8-e33ce4d2c753 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:43.829636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:43.831359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.832447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.832811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.834845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:43.841309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.869741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:43.879996 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2096/4214] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:29:43.886130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908a688-3efb-4a51-99bd-941d90101459 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:43.894754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9587-92fe-4d99-8bc4-0258f49f1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:43.895351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9587-92fe-4d99-8bc4-0258f49f1d66 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.895782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9587-92fe-4d99-8bc4-0258f49f1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.896186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9587-92fe-4d99-8bc4-0258f49f1d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.896927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9587-92fe-4d99-8bc4-0258f49f1d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:43.898861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9587-92fe-4d99-8bc4-0258f49f1d66 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.912046 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2119/4215] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:29:43.918201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:43.929234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21185d-6433-4d29-bb12-644c381c2a17 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:43.934178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:43.934992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:43.935379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:43.935753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] PATH_INFO: `/v3/projects/1a468874f9bf4718a80faa0c564153ed/users/9428e150a39244798cc947b43df08ae9/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:43.954523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a468874f9bf4718a80faa0c564153ed, user_id=9428e150a39244798cc947b43df08ae9, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:43.959868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:43.997019 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2097/4216] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:29:43 2022] PUT /identity/v3/projects/1a468874f9bf4718a80faa0c564153ed/users/9428e150a39244798cc947b43df08ae9/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:44.021712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:44.022107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:44.022525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:44.070289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:44.071568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:44.233438 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2120/4217] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:44.258265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:44.260057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:44.402257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdff58c-63dd-44b8-82e3-c478cd7b4aa1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:44.408475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4485-a365-46a2-9f7c-70e1b15fb182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:44.409760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4485-a365-46a2-9f7c-70e1b15fb182 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:44.410123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4485-a365-46a2-9f7c-70e1b15fb182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:44.411119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4485-a365-46a2-9f7c-70e1b15fb182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:44.436536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4485-a365-46a2-9f7c-70e1b15fb182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:44.438652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4485-a365-46a2-9f7c-70e1b15fb182 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:44.450430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2098/4218] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:45.336160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:45.337915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:45.361842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46740a-e2c8-4ca8-9a82-fe688e1e39cc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:45.379161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:45.380208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:45.380759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:45.383354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] PATH_INFO: `/v3/users/7f20ecd9e6c54278bf387ea307918158` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:45.385447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f20ecd9e6c54278bf387ea307918158)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:45.389345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:45.482841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f20ecd9e6c54278bf387ea307918158'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:45.503120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f20ecd9e6c54278bf387ea307918158'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:45.504176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f20ecd9e6c54278bf387ea307918158'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:45.504608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f20ecd9e6c54278bf387ea307918158'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:45.514912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f20ecd9e6c54278bf387ea307918158'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:45.542200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2121/4219] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:29:45 2022] DELETE /identity/v3/users/7f20ecd9e6c54278bf387ea307918158 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:45.543139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:45.543953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:45.544236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:45.579841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:45.581082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:45.690284 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2099/4220] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:45.717546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:45.725237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:45.814288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:45.829440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb14d2c-3828-4138-a32a-bb089c2d4bf2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:45.834676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909663a1-c870-4a31-b0fa-15db1bfb67ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:45.836190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909663a1-c870-4a31-b0fa-15db1bfb67ec service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:45.836583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909663a1-c870-4a31-b0fa-15db1bfb67ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:45.837052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909663a1-c870-4a31-b0fa-15db1bfb67ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:45.850517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909663a1-c870-4a31-b0fa-15db1bfb67ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:45.852240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909663a1-c870-4a31-b0fa-15db1bfb67ec service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:45.869032 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2122/4221] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:46.697455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:46.698936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:46.720809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35adbc-b4af-4e95-a756-2b1bedf6aaa0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:46.731804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:46.733840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:46.734595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:46.735665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] PATH_INFO: `/v3/projects/209e3887b05e4c09986bb188c1bb6be6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:46.737108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=209e3887b05e4c09986bb188c1bb6be6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:46.740020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:46.864749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209e3887b05e4c09986bb188c1bb6be6', 'request_id': 'req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:46.874718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209e3887b05e4c09986bb188c1bb6be6', 'request_id': 'req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:46.886882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:46.894902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209e3887b05e4c09986bb188c1bb6be6', 'request_id': 'req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:46.914558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] The token cache is being invalidate because project 209e3887b05e4c09986bb188c1bb6be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:29:46.914873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:46.915538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-edf76c4a-6596-4ea0-a1e4-8e03c815d9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:29:46.917606 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2100/4222] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:29:46 2022] DELETE /identity/v3/projects/209e3887b05e4c09986bb188c1bb6be6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:46.924424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:46.925599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:46.926356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:46.964470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:46.968270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:47.057998 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2123/4223] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:47.065600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.065905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.066184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.102098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:47.103403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:47.119500 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2101/4224] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:47.124204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:47.146399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d076f64-3e4d-472c-b108-b8edb88edfd5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:47.164457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:47.170021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.173032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.173980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.177781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:29:47.178243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:47.180838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:47.231592 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2124/4225] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:29:47.236361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:47.248981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dde1a-b06a-4bbc-a12f-ab3cdea91c76 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:47.257562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:47.258505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.259162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.259579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.260538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:47.274732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:47.331097 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2102/4226] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:29:47 2022] POST /identity/v3/projects => generated 359 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:29:47.335638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:47.354756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab50c-9edd-4837-8908-02dd96f9a170 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:47.513238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:47.516456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.516760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.517032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.517688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:47.523970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:47.590445 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2125/4227] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:29:47 2022] POST /identity/v3/users => generated 280 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:29:47.595883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:47.616087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b224b-8280-4bf0-b5f4-10eb729f82fa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:47.667219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:47.668014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.668401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.668778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.669777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:47.672202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:47.694201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2103/4228] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:29:47.700135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:47.725876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d115a-a94d-4994-9a42-d00a6202d00d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:47.738874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf40bf-8be4-49ca-8c44-6b240fec5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:47.740245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf40bf-8be4-49ca-8c44-6b240fec5dcf admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.740532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf40bf-8be4-49ca-8c44-6b240fec5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.741285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf40bf-8be4-49ca-8c44-6b240fec5dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.741494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf40bf-8be4-49ca-8c44-6b240fec5dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:47.743110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf40bf-8be4-49ca-8c44-6b240fec5dcf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:47.771203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2126/4229] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:29:47.775385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:47.793982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1ec3-5de0-4e41-b627-830d5b332655 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:47.813704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:47.814909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.816057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.816675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] PATH_INFO: `/v3/projects/6196425d8d4649cf89da0fbb9951a229/users/f2d7fc80a0ed4dd7b384cfe83659b48c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.850322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6196425d8d4649cf89da0fbb9951a229, user_id=f2d7fc80a0ed4dd7b384cfe83659b48c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:47.853327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:47.881990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2104/4230] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:29:47 2022] PUT /identity/v3/projects/6196425d8d4649cf89da0fbb9951a229/users/f2d7fc80a0ed4dd7b384cfe83659b48c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:29:47.896384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897914-3bce-476a-95d2-9702bdec0047 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:47.897297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897914-3bce-476a-95d2-9702bdec0047 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:47.897776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897914-3bce-476a-95d2-9702bdec0047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:47.946408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6c897914-3bce-476a-95d2-9702bdec0047 None None] MFA Rules not processed for user `f2d7fc80a0ed4dd7b384cfe83659b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:47.947604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c897914-3bce-476a-95d2-9702bdec0047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:48.011015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:29:48.053242 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2127/4231] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:48.068367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:29:48.075728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:48.179300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61222a-d251-4312-a4c0-7432d1e39e51 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:29:48.194289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:29:48.195994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:48.196564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:48.197003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:48.207970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:29:48.209455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:29:48.237324 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2105/4232] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:29:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:29:56.469488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7961e-b3c7-4415-aeef-672500d4ff4a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:29:56.470570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7961e-b3c7-4415-aeef-672500d4ff4a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:29:56.471008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7961e-b3c7-4415-aeef-672500d4ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:29:56.572863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8bd7961e-b3c7-4415-aeef-672500d4ff4a None None] MFA Rules not processed for user `17b04cbba9fe48debca4d0e5f49ce0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:29:56.595136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8bd7961e-b3c7-4415-aeef-672500d4ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:29:56.871875 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2128/4233] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:29:58.216012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:00.474187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:00.476304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:00.762948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2508708-bd07-4278-a649-11c344c199ae service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:00.769050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:00.769746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:00.770036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:00.770611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] PATH_INFO: `/v3/users/0e38c98761b54e58b0945b80ca392b5f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:00.772554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e38c98761b54e58b0945b80ca392b5f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:00.775519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:00.870859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e38c98761b54e58b0945b80ca392b5f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:00.899285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e38c98761b54e58b0945b80ca392b5f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:00.900608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e38c98761b54e58b0945b80ca392b5f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:00.901283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e38c98761b54e58b0945b80ca392b5f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:00.920437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e38c98761b54e58b0945b80ca392b5f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:00.962733 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2106/4234] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:00 2022] DELETE /identity/v3/users/0e38c98761b54e58b0945b80ca392b5f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:00.967995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:00.969018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:00.969098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:01.016213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:01.018273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:01.154894 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2129/4235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:01.165183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:01.166864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:01.373763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4857-0229-4628-86d7-c595a4479617 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:01.394683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67fd85-7ef0-4e8a-b97f-82dbe1ae11df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:01.395359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67fd85-7ef0-4e8a-b97f-82dbe1ae11df service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:01.395644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67fd85-7ef0-4e8a-b97f-82dbe1ae11df service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:01.396335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67fd85-7ef0-4e8a-b97f-82dbe1ae11df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:01.457416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67fd85-7ef0-4e8a-b97f-82dbe1ae11df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:01.465687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67fd85-7ef0-4e8a-b97f-82dbe1ae11df service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:01.509701 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2107/4236] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:02.781617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:02.783920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:02.804649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab626-b8d1-41f8-8fb4-f8e30b77eb3d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:02.830400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:02.831103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:02.831392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:02.831669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] PATH_INFO: `/v3/projects/dd9d061664854aa4b0225646e32f7193` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:02.833078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9d061664854aa4b0225646e32f7193)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:02.835461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:02.992818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:02.993295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:02.993295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:03.006082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:03.088232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9d061664854aa4b0225646e32f7193', 'request_id': 'req-ff6807cc-ad36-433e-aef6-90ecc372ba33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.105930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] MFA Rules not processed for user `9428e150a39244798cc947b43df08ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:03.107209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9d061664854aa4b0225646e32f7193', 'request_id': 'req-ff6807cc-ad36-433e-aef6-90ecc372ba33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.107928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:03.128224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:03.134108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9d061664854aa4b0225646e32f7193', 'request_id': 'req-ff6807cc-ad36-433e-aef6-90ecc372ba33'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.162801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] The token cache is being invalidate because project dd9d061664854aa4b0225646e32f7193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:03.163520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.165534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.167486 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2130/4237] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:02 2022] DELETE /identity/v3/projects/dd9d061664854aa4b0225646e32f7193 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:03.173903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:03.181222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:03.306650 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2108/4238] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:03.318072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:03.334842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:03.442377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6807cc-ad36-433e-aef6-90ecc372ba33 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:03.459226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:03.463166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:03.467086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:03.467542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] PATH_INFO: `/v3/users/20e595c570ed4e098dae2d1d8dde36ae` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:03.470957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e595c570ed4e098dae2d1d8dde36ae)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:03.484514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:03.640697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e595c570ed4e098dae2d1d8dde36ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.716931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9586171-ad63-4352-966e-a1e3563362d2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:03.717725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e595c570ed4e098dae2d1d8dde36ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.720602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e595c570ed4e098dae2d1d8dde36ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.721976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e595c570ed4e098dae2d1d8dde36ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.757201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:03.757971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:03.758470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:03.758929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:03.762718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e595c570ed4e098dae2d1d8dde36ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:03.763673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:03.794251 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2131/4239] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:03 2022] DELETE /identity/v3/users/20e595c570ed4e098dae2d1d8dde36ae => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:03.828081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:03.839036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:03.870535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2109/4240] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:04.013448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:04.015783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:04.169260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc5246-a239-4990-9990-9ed8c22af2ca admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:04.179058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:04.179954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:04.180419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:04.181218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:04.190815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:04.219209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:04.309313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:04.310830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:04.345473 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2132/4241] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:06.661893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:06.663602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:06.687825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0fde6-a4b7-4514-9077-f3504847400f service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:06.699549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:06.701525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:06.701816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:06.703316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] PATH_INFO: `/v3/projects/d61f252dd6c54c4cab9ad862efb8c6f3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:06.706390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61f252dd6c54c4cab9ad862efb8c6f3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:06.710823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:06.847683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61f252dd6c54c4cab9ad862efb8c6f3', 'request_id': 'req-fc69d791-445c-4c2c-8feb-68f269b0d5fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:06.853627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:06.861959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61f252dd6c54c4cab9ad862efb8c6f3', 'request_id': 'req-fc69d791-445c-4c2c-8feb-68f269b0d5fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:06.885274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61f252dd6c54c4cab9ad862efb8c6f3', 'request_id': 'req-fc69d791-445c-4c2c-8feb-68f269b0d5fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:06.907456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] The token cache is being invalidate because project d61f252dd6c54c4cab9ad862efb8c6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:06.907456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:06.911049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:06.916104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2110/4242] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:06 2022] DELETE /identity/v3/projects/d61f252dd6c54c4cab9ad862efb8c6f3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:06.921238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:06.933025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb4d1-3d93-4465-98b4-68ef0cbdbbf6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:07.024481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:07.025299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:07.025655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:07.026006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] PATH_INFO: `/v3/users/279407c35f9d4f98a8789e68e89f6f22` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:07.027283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279407c35f9d4f98a8789e68e89f6f22)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:07.031226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:07.105773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279407c35f9d4f98a8789e68e89f6f22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:07.124708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279407c35f9d4f98a8789e68e89f6f22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:07.126115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279407c35f9d4f98a8789e68e89f6f22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:07.127143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279407c35f9d4f98a8789e68e89f6f22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:07.137316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7fec9cd-d2f1-4eca-8404-db6b42a8b1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279407c35f9d4f98a8789e68e89f6f22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:07.162571 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2133/4243] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:06 2022] DELETE /identity/v3/users/279407c35f9d4f98a8789e68e89f6f22 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:08.808347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:08.811605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:08.848787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d791-445c-4c2c-8feb-68f269b0d5fc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:09.113226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:09.114460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:09.114744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:09.115249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] PATH_INFO: `/v3/projects/bbca8b46522645f6bacb9da01061ba6a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:09.117569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbca8b46522645f6bacb9da01061ba6a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:09.119765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:09.306796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbca8b46522645f6bacb9da01061ba6a', 'request_id': 'req-35f264c3-2ef3-4e14-8bc0-2513292e395f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:09.339339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbca8b46522645f6bacb9da01061ba6a', 'request_id': 'req-35f264c3-2ef3-4e14-8bc0-2513292e395f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:09.354189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbca8b46522645f6bacb9da01061ba6a', 'request_id': 'req-35f264c3-2ef3-4e14-8bc0-2513292e395f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:09.416760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] The token cache is being invalidate because project bbca8b46522645f6bacb9da01061ba6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:09.418778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:09.422462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35f264c3-2ef3-4e14-8bc0-2513292e395f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:09.455384 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2111/4244] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:08 2022] DELETE /identity/v3/projects/bbca8b46522645f6bacb9da01061ba6a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:09.460856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:09.462190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:09.462661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:09.591428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:09.594375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:09.632833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:09.719998 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2134/4245] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:09.730558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:09.731583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:09.732071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:09.774955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:09.776377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:09.787665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2112/4246] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:09.793291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:09.807474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859f0cf-d1ca-46cb-a13f-1ec3acc37b45 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:09.824007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:09.828666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:09.828986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:09.829231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:09.829935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:09.830282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:09.831983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:09.873751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:09.874423 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2135/4247] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:09.888500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc501d6-af66-4da7-aeb3-65a50ecc2c55 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:09.910624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:09.912202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:09.913192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:09.914389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:09.915111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:09.928146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:10.028096 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2113/4248] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:09 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:30:10.029747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:10.050600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9183b-4f98-4444-9081-ed5fd81bfa7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:10.232167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:10.233062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:10.234048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:10.235011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:10.235877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:10.239972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:10.317124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2136/4249] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:10 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:10.319939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:10.339539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15841-dade-4a51-b30d-74bec944d2ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:10.353026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:10.353719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:10.354191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:10.355814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:10.357059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:10.371474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:10.404307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:10.414485 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2114/4250] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:10.421821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fe32d-95ed-457c-90e9-3c6b636630b6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:10.445628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac48fc-a179-48ac-9dfe-cd75a0b612de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:10.446337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac48fc-a179-48ac-9dfe-cd75a0b612de admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:10.446625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac48fc-a179-48ac-9dfe-cd75a0b612de admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:10.446903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac48fc-a179-48ac-9dfe-cd75a0b612de admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:10.447576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac48fc-a179-48ac-9dfe-cd75a0b612de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:10.449751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac48fc-a179-48ac-9dfe-cd75a0b612de admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:10.466380 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2137/4251] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:10.467561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:10.494945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17012b07-1398-4cd7-a4d1-bfe35f1d3002 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:10.507221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:10.508205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:10.508682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:10.509158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] PATH_INFO: `/v3/projects/2d45a26d56064359bcd66a20fe90f54b/users/ad53210ab52747419138d7d95c93f314/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:10.541558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d45a26d56064359bcd66a20fe90f54b, user_id=ad53210ab52747419138d7d95c93f314, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:10.545096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:10.589600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2115/4252] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:10 2022] PUT /identity/v3/projects/2d45a26d56064359bcd66a20fe90f54b/users/ad53210ab52747419138d7d95c93f314/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:10.603095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:10.603379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:10.603818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:10.674606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] MFA Rules not processed for user `ad53210ab52747419138d7d95c93f314`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:10.675869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:10.869456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:10.871722 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2138/4253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:10.884999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:11.018041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468d12e-7e16-4ded-a87b-c56c75fdda81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.026981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.028038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.028038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.028441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.029261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.032049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.107667 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2116/4254] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:10 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:30:11.113701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.128092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a1eda-baeb-46ca-86fb-a524dac4f983 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.171692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:11.242505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.243107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.243388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.243665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.244309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.246947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.291419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.296748 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2139/4255] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:11 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:11.306842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e87aaf-4b22-415e-8c59-c9a297bbc3c1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.318709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.321440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.322647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.322943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.325991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.331296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.360845 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2117/4256] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:11.363963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.379885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb19aa-3517-44b0-9c93-12198083c37f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.397165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.397378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.397773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.398200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] PATH_INFO: `/v3/projects/d15a25b785ae4e6c899f5a3a0f976f1f/users/eab9adc2f06441b6b2a314745d4e8215/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.423742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15a25b785ae4e6c899f5a3a0f976f1f, user_id=eab9adc2f06441b6b2a314745d4e8215, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.428245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.452076 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2140/4257] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:11 2022] PUT /identity/v3/projects/d15a25b785ae4e6c899f5a3a0f976f1f/users/eab9adc2f06441b6b2a314745d4e8215/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:11.456918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.483235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37283d-bde4-4838-a27a-0f7f2b8f6883 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.614769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9efb88-7d0e-4701-acef-b09316d70195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.616241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9efb88-7d0e-4701-acef-b09316d70195 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.617743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9efb88-7d0e-4701-acef-b09316d70195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.618159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9efb88-7d0e-4701-acef-b09316d70195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.620203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9efb88-7d0e-4701-acef-b09316d70195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.638833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9efb88-7d0e-4701-acef-b09316d70195 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.654112 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2118/4258] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:11.655702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.676685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dfe17-f2a5-4fa4-9c64-7e18103250fe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.683373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.683906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.684369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.684795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] PATH_INFO: `/v3/projects/d15a25b785ae4e6c899f5a3a0f976f1f/users/eab9adc2f06441b6b2a314745d4e8215/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.695777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15a25b785ae4e6c899f5a3a0f976f1f, user_id=eab9adc2f06441b6b2a314745d4e8215, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.698499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.713902 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2141/4259] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:11 2022] PUT /identity/v3/projects/d15a25b785ae4e6c899f5a3a0f976f1f/users/eab9adc2f06441b6b2a314745d4e8215/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:11.726508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.727080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.728294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.772758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] MFA Rules not processed for user `eab9adc2f06441b6b2a314745d4e8215`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:11.774657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:11.916653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2119/4260] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:11.921731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.938517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb6c66-2c3d-4624-9977-e0d15c247c06 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:11.946711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab9adc2f06441b6b2a314745d4e8215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:11.947718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:11.948192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:11.948707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:11.949769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:11.950337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:11.954544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:11.975423 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2142/4261] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:30:11.979846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:11.987882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:11.994978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a95e7-3dab-4c1a-9a06-c67f72ee8d76 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:12.005804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab9adc2f06441b6b2a314745d4e8215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:12.007995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:12.008566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:12.009210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:12.012724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:12.029949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:12.089142 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2120/4262] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:11 2022] POST /identity/v3/projects => generated 349 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:12.091923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:12.110719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ead31-be7d-4f53-8111-f7efafdbbf42 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:12.273200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab9adc2f06441b6b2a314745d4e8215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:12.274408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:12.274825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:12.275180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:12.276116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:12.276536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:12.278677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:12.305933 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2143/4263] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:12.387757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:12.390305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:12.533054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c644f-7d06-42a8-8053-9f34ba8480a4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:12.543059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:12.544978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:12.546854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:12.547449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:12.561914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:12.564065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:12.577940 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2121/4264] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:14.177378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:14.179205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:14.305998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:14.339851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6234-919c-4959-b027-14df98f1b6d4 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:14.352710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:14.353385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:14.353668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:14.353943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] PATH_INFO: `/v3/users/4adcdf3712b443c18ff496cf5ff735ca` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:14.356815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adcdf3712b443c18ff496cf5ff735ca)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:14.361393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:14.427411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:14.429038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:14.449449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370d606-2f3f-414d-a3d3-ff31f4959d7a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:14.474036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:14.476588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:14.477506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:14.479035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] PATH_INFO: `/v3/users/17b04cbba9fe48debca4d0e5f49ce0e1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:14.479607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adcdf3712b443c18ff496cf5ff735ca'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.481767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b04cbba9fe48debca4d0e5f49ce0e1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:14.495161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:14.496102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adcdf3712b443c18ff496cf5ff735ca'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.497042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adcdf3712b443c18ff496cf5ff735ca'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.498300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adcdf3712b443c18ff496cf5ff735ca'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.508950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adcdf3712b443c18ff496cf5ff735ca'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.534419 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2144/4265] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:14 2022] DELETE /identity/v3/users/4adcdf3712b443c18ff496cf5ff735ca => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:14.652651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b04cbba9fe48debca4d0e5f49ce0e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.677378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b04cbba9fe48debca4d0e5f49ce0e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.678110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b04cbba9fe48debca4d0e5f49ce0e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.679427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b04cbba9fe48debca4d0e5f49ce0e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.714085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b04cbba9fe48debca4d0e5f49ce0e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:14.758881 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2122/4266] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:14 2022] DELETE /identity/v3/users/17b04cbba9fe48debca4d0e5f49ce0e1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:30:15.484206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:15.487099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:15.547689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:15.549146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:15.666958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:15.713928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff79805-de6f-499e-9059-d5caff30ff59 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:15.722188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:15.724040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:15.724690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:15.725162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] PATH_INFO: `/v3/projects/887866504aae4c5cb785afff8e63e3ab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:15.728476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=887866504aae4c5cb785afff8e63e3ab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:15.736098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:15.808921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4a45c-1b8e-423c-a287-8a9ed5081dfb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:15.820012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:15.822710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:15.822710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:15.823213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] PATH_INFO: `/v3/projects/f485776c510f4668b6a6cbf386cfd8d4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:15.824812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f485776c510f4668b6a6cbf386cfd8d4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:15.828632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:15.879142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887866504aae4c5cb785afff8e63e3ab', 'request_id': 'req-acf70c99-0b75-4fda-9b2d-e36c715ba20b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.899524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887866504aae4c5cb785afff8e63e3ab', 'request_id': 'req-acf70c99-0b75-4fda-9b2d-e36c715ba20b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.923524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887866504aae4c5cb785afff8e63e3ab', 'request_id': 'req-acf70c99-0b75-4fda-9b2d-e36c715ba20b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.945919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] The token cache is being invalidate because project 887866504aae4c5cb785afff8e63e3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:15.946331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.947814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f485776c510f4668b6a6cbf386cfd8d4', 'request_id': 'req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.948963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acf70c99-0b75-4fda-9b2d-e36c715ba20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.951700 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2123/4267] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:15 2022] DELETE /identity/v3/projects/887866504aae4c5cb785afff8e63e3ab => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:15.956946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f485776c510f4668b6a6cbf386cfd8d4', 'request_id': 'req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.957650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef96e-75e2-48e8-877a-1017335bbaef None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:15.958079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef96e-75e2-48e8-877a-1017335bbaef None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:15.958551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef96e-75e2-48e8-877a-1017335bbaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:15.964513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f485776c510f4668b6a6cbf386cfd8d4', 'request_id': 'req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.986494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:15.989961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] The token cache is being invalidate because project f485776c510f4668b6a6cbf386cfd8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:15.990555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.991671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9342132-4bf0-47a4-bf8f-50ba1d58f4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:15.994079 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2145/4268] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:15 2022] DELETE /identity/v3/projects/f485776c510f4668b6a6cbf386cfd8d4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:16.002057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0303-3b30-41f7-a520-d733890818e7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.004239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0303-3b30-41f7-a520-d733890818e7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.004946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0303-3b30-41f7-a520-d733890818e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.010595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2b6ef96e-75e2-48e8-877a-1017335bbaef None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:16.012004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b6ef96e-75e2-48e8-877a-1017335bbaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:16.051047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fcfa0303-3b30-41f7-a520-d733890818e7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:16.053300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fcfa0303-3b30-41f7-a520-d733890818e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:16.148675 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2146/4269] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:16.156504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2124/4270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:16.165311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.165469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.165643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.165735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.165887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.165977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.197343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:16.199534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:16.215710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:16.217459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:16.218938 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2125/4271] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:16.225727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.242825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec219-cfba-4590-a707-743db94e83d9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.250399 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2147/4272] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:16.251097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.251853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.252245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.252643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.253443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:16.253860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.255268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.255903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.274321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f6d5-fa75-43cf-863c-38775ce1a2f3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.294070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.295084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.295512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.296572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.297464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:16.297917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.299742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.312167 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2126/4273] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:30:16.316629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.329753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2148/4274] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:16.334356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.336029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8eb2-e0a8-4a6b-926b-ad308de5d2ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.351599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e4ba-11ef-4668-8ac2-29f5e7faf1e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.354242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.355095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.355523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.355931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.356931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.360460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.370049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.371214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.371691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.372141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.373231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.377033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.424812 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2127/4275] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:16.429157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.450014 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2149/4276] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:16.454757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.531555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:16.584125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb88d5-c858-48b7-bb5c-df308a998334 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.587106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f95c1-cb47-4867-847f-f67774e2f769 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.597180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.597982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.598717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.599547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.600071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.600460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.600954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.601299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.602662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.602932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.605772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.607226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.676467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2128/4277] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:16.677599 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2150/4278] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:30:16.680299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.682312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.705421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f692b-61f0-4b37-9d88-55fcf655f1bd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.708346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72df8-4fb3-479e-b3a1-d0ef3ab89749 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.714481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.717121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.718492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.719457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.720288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.722738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.722958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.724129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.725046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.725457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.726388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.731791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.742045 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2151/4279] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:16.746614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.754777 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2129/4280] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:16.759042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.770714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd851e2-de2f-4302-b222-df274ca3b489 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.773651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89303d9f-b26f-4134-bf29-bc9b362ed793 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.777117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.778081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.778250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.778634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.779387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.782280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.782432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.783187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.783659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.784116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.785116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.787439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.796913 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2130/4281] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:16.800578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.801794 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2152/4282] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:16.805551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:16.814535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acda66-a384-4789-86e5-449d72ae9978 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.818521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79ef9-fba2-44df-9f8d-e03feff4acb7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:16.822779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d136c4-18d7-4ac1-bcdf-7593191e69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.823828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d136c4-18d7-4ac1-bcdf-7593191e69a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.824454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d136c4-18d7-4ac1-bcdf-7593191e69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.824559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d136c4-18d7-4ac1-bcdf-7593191e69a2 admin admin] PATH_INFO: `/v3/projects/0c064c36769442798f18fd62bdf45669/users/3e16b803125f408c9a5d32a3dba1b4a5/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.827843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f53c4-2067-4f1c-a410-28cf2f6d3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:16.828787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f53c4-2067-4f1c-a410-28cf2f6d3c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.832212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f53c4-2067-4f1c-a410-28cf2f6d3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.834013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f53c4-2067-4f1c-a410-28cf2f6d3c69 admin admin] PATH_INFO: `/v3/projects/341ae8e17f46410dbf4d6262a274f4af/users/beab4c70c0f24a579364db8deb17998f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.849284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d136c4-18d7-4ac1-bcdf-7593191e69a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c064c36769442798f18fd62bdf45669, user_id=3e16b803125f408c9a5d32a3dba1b4a5, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.852586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d136c4-18d7-4ac1-bcdf-7593191e69a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.866464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f53c4-2067-4f1c-a410-28cf2f6d3c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341ae8e17f46410dbf4d6262a274f4af, user_id=beab4c70c0f24a579364db8deb17998f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:16.869783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f53c4-2067-4f1c-a410-28cf2f6d3c69 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:16.881323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2131/4283] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:16 2022] PUT /identity/v3/projects/0c064c36769442798f18fd62bdf45669/users/3e16b803125f408c9a5d32a3dba1b4a5/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:16.883366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.883820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.884236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.896393 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2153/4284] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:16 2022] PUT /identity/v3/projects/341ae8e17f46410dbf4d6262a274f4af/users/beab4c70c0f24a579364db8deb17998f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:30:16.907394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027128-b250-4494-b9dc-859c02561949 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:16.907975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027128-b250-4494-b9dc-859c02561949 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:16.908528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027128-b250-4494-b9dc-859c02561949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:16.914798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:16.916392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:16.922378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:16.958811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ce027128-b250-4494-b9dc-859c02561949 None None] MFA Rules not processed for user `beab4c70c0f24a579364db8deb17998f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:16.960277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce027128-b250-4494-b9dc-859c02561949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:17.084855 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2154/4285] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:17.175720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:17.176020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:17.176307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:17.250863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] MFA Rules not processed for user `535a335d59cc400fb6d573f536fa808e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:17.263024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:17.303757 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2132/4286] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:17.318856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:17.320581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:17.440369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d754ec-6f98-454b-b5e6-c01dde7f0eaa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:17.448898 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2155/4287] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:17.456806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:17.457800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:17.458304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:17.458788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:17.483068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:17.485775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:17.511900 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2133/4288] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:30:17.904322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:17.906326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:18.055451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123a99b-55d3-4f16-99b5-9e7a69b7a828 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:18.061340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:18.064062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:18.064419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:18.064655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:18.099603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:18.101266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:18.126000 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2156/4289] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:18.656163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:18.658130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:18.743947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:18.832904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a78fb-e6ce-4a85-b3b4-1f7ab5b96ecf service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:18.846455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eab9adc2f06441b6b2a314745d4e8215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:18.849364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:18.849602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:18.849892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] PATH_INFO: `/v3/projects/4f081317db85480e9ec60dddc7532a27` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:18.853018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f081317db85480e9ec60dddc7532a27)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:18.856115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:18.934876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f081317db85480e9ec60dddc7532a27', 'request_id': 'req-22a7698d-2c9e-435c-af0a-104667bf0ea8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:18.941559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f081317db85480e9ec60dddc7532a27', 'request_id': 'req-22a7698d-2c9e-435c-af0a-104667bf0ea8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:18.954998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f081317db85480e9ec60dddc7532a27', 'request_id': 'req-22a7698d-2c9e-435c-af0a-104667bf0ea8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:18.971642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] The token cache is being invalidate because project 4f081317db85480e9ec60dddc7532a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:18.972931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:18.974205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22a7698d-2c9e-435c-af0a-104667bf0ea8 tempest-QuotasNegativeTest-545171984 tempest-QuotasNegativeTest-545171984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:18.976998 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2134/4290] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:18 2022] DELETE /identity/v3/projects/4f081317db85480e9ec60dddc7532a27 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:18.984693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:18.986946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:19.012821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c4dd-cbd2-46c6-b0e6-742f7c885bf6 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:19.053166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:19.113009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:19.113816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:19.114186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:19.114614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] PATH_INFO: `/v3/users/ad53210ab52747419138d7d95c93f314` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:19.116278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad53210ab52747419138d7d95c93f314)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:19.119885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:19.189537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad53210ab52747419138d7d95c93f314'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:19.208095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad53210ab52747419138d7d95c93f314'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:19.211711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad53210ab52747419138d7d95c93f314'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:19.211711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad53210ab52747419138d7d95c93f314'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:19.221475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad53210ab52747419138d7d95c93f314'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:19.246999 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2157/4291] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:18 2022] DELETE /identity/v3/users/ad53210ab52747419138d7d95c93f314 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:19.249284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:19.249504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:19.249793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:19.292325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:19.294967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:19.431077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2135/4292] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:19.470742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:19.470742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:19.576349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc2b0-d805-47a4-babd-0695f8559421 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:19.588857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:19.589651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:19.590034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:19.590454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:19.611960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:19.616955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:19.641025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2158/4293] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:20.531914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:20.534875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:20.556753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264310e-2a05-490c-a09d-10736b7d7fb5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:20.570601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:20.571271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:20.571554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:20.571830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] PATH_INFO: `/v3/projects/2d45a26d56064359bcd66a20fe90f54b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:20.574277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d45a26d56064359bcd66a20fe90f54b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:20.576670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:20.699219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:20.708235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d45a26d56064359bcd66a20fe90f54b', 'request_id': 'req-ba57b3dc-b592-4430-abc5-a06256ee5043'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:20.720409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d45a26d56064359bcd66a20fe90f54b', 'request_id': 'req-ba57b3dc-b592-4430-abc5-a06256ee5043'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:20.738012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d45a26d56064359bcd66a20fe90f54b', 'request_id': 'req-ba57b3dc-b592-4430-abc5-a06256ee5043'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:20.771815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] The token cache is being invalidate because project 2d45a26d56064359bcd66a20fe90f54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:20.771943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:20.772705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:20.774654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2136/4294] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:20 2022] DELETE /identity/v3/projects/2d45a26d56064359bcd66a20fe90f54b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:20.778549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:20.799968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a892-8c27-4637-b21d-c900d112dfd6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:20.888412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:20.892136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:20.897287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:20.953696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:20.954983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:20.955401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:20.962214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] PATH_INFO: `/v3/users/eab9adc2f06441b6b2a314745d4e8215` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:20.964258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab9adc2f06441b6b2a314745d4e8215)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:20.965810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:21.028393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57b3dc-b592-4430-abc5-a06256ee5043 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:21.037430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:21.038174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:21.038459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:21.039031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] PATH_INFO: `/v3/users/beab4c70c0f24a579364db8deb17998f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:21.040273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=beab4c70c0f24a579364db8deb17998f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:21.047368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:21.087931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab9adc2f06441b6b2a314745d4e8215'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.121782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab9adc2f06441b6b2a314745d4e8215'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.126193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab9adc2f06441b6b2a314745d4e8215'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.128091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab9adc2f06441b6b2a314745d4e8215'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.143784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b04d625-6e3a-412a-b25d-1d8e07760b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab9adc2f06441b6b2a314745d4e8215'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.185918 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2159/4295] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:20 2022] DELETE /identity/v3/users/eab9adc2f06441b6b2a314745d4e8215 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:21.187068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beab4c70c0f24a579364db8deb17998f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.203970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beab4c70c0f24a579364db8deb17998f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.204751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beab4c70c0f24a579364db8deb17998f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.205411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beab4c70c0f24a579364db8deb17998f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.225808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beab4c70c0f24a579364db8deb17998f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:21.282459 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2137/4296] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:20 2022] DELETE /identity/v3/users/beab4c70c0f24a579364db8deb17998f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:21.283760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:21.284072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:21.284351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:21.313314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:21.315198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:21.444542 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2160/4297] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:21.466865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:21.468556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:21.572357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584d5d-87c2-4586-a77d-d15f65e45e9e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:21.576045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286c35-5bef-4ce3-8500-d065cb80fa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:21.576950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286c35-5bef-4ce3-8500-d065cb80fa02 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:21.577877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286c35-5bef-4ce3-8500-d065cb80fa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:21.578303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286c35-5bef-4ce3-8500-d065cb80fa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:21.590736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286c35-5bef-4ce3-8500-d065cb80fa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:21.593051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2286c35-5bef-4ce3-8500-d065cb80fa02 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:21.599225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:21.611580 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2138/4298] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:22.602972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:22.611148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:22.634007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3eef3-3894-4f0a-b4a1-82c8427673c4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:22.641242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:22.641916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:22.642235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:22.642521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] PATH_INFO: `/v3/projects/d15a25b785ae4e6c899f5a3a0f976f1f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:22.643695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15a25b785ae4e6c899f5a3a0f976f1f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:22.645641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:22.736084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'request_id': 'req-152a603e-4ef0-4ea3-aea6-51f968ca417a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:22.744915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'request_id': 'req-152a603e-4ef0-4ea3-aea6-51f968ca417a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:22.755217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:22.763500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15a25b785ae4e6c899f5a3a0f976f1f', 'request_id': 'req-152a603e-4ef0-4ea3-aea6-51f968ca417a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:22.796220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] The token cache is being invalidate because project d15a25b785ae4e6c899f5a3a0f976f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:22.796746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:22.797568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-152a603e-4ef0-4ea3-aea6-51f968ca417a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:22.803453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2161/4299] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:22 2022] DELETE /identity/v3/projects/d15a25b785ae4e6c899f5a3a0f976f1f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:22.805837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:22.806292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:22.806487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:22.850001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:22.855647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:23.095108 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2139/4300] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:23.097058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.097424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.097705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.165594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:23.167781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:23.186025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2162/4301] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:23.189529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:23.208492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241b41f-4bf7-4d2f-ad43-0f5150d22d16 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:23.216968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:23.219340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.221277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.221854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.222900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:23.225364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:23.229277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:23.252369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:23.252735 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2140/4302] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:23.279789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898566c-1d24-4f54-b886-81a521122d6e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:23.291435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:23.296838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.309582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.309908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.310636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:23.317219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:23.342427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:23.345937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:23.372061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2163/4303] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:23 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:23.376455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:23.378732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b189-2a35-42ca-b6fc-26963ee7f5cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:23.535133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:23.539676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.541069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.541470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] PATH_INFO: `/v3/projects/341ae8e17f46410dbf4d6262a274f4af` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.543932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=341ae8e17f46410dbf4d6262a274f4af)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:23.552377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:23.566926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb204241-c9fe-4e8f-81ec-5a582a519f9a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:23.596851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:23.597517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.597976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.598318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.599142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:23.601140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:23.664424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2164/4304] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:23 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:30:23.668404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:23.674371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341ae8e17f46410dbf4d6262a274f4af', 'request_id': 'req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:23.681726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341ae8e17f46410dbf4d6262a274f4af', 'request_id': 'req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:23.692216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb557bd-7b7f-4651-9312-d224d3a59146 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:23.696677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341ae8e17f46410dbf4d6262a274f4af', 'request_id': 'req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:23.721813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] The token cache is being invalidate because project 341ae8e17f46410dbf4d6262a274f4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:23.723807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:23.727627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3b845f4e-f4cc-450b-8c8d-5b1e81ec5b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:23.735425 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2141/4305] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:23 2022] DELETE /identity/v3/projects/341ae8e17f46410dbf4d6262a274f4af => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:23.741800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e417-4d3e-492e-abca-dced9219a0a1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.742937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e417-4d3e-492e-abca-dced9219a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.743399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e417-4d3e-492e-abca-dced9219a0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.790613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0828e417-4d3e-492e-abca-dced9219a0a1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:23.794697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0828e417-4d3e-492e-abca-dced9219a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:23.840875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:23.852960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:23.854798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.856123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.857556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.859477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:23.861605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:23.907187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2165/4306] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:23.922555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:23.922910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:23.938028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aa3c5-923d-4ab2-a64e-8675dcf46cd1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:23.962957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:23.963773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.964439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.964979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:23.965474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:23.968943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:23.980411 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2142/4307] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:23.989441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:23.989797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:23.990085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.024143 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2166/4308] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:30:24.030690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.035197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:24.040359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:24.055326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46abc9-90a1-4b8f-a701-2777cb582277 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.065080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2143/4309] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:24.070278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a96f4-6031-4140-a18d-e9ccc039d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.071232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.075793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a96f4-6031-4140-a18d-e9ccc039d8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.076127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a96f4-6031-4140-a18d-e9ccc039d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.077962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a96f4-6031-4140-a18d-e9ccc039d8fe admin admin] PATH_INFO: `/v3/projects/c8247b4ae3c740dba9a9abf4fba30846/users/bb1b327b2e524b72bbbd21624aa4dc1e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.099201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603cdc-ca08-4d6d-87f0-dd5f805507a0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.115060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.115703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.115916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.119959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.121970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:24.122257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.127937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.129064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a96f4-6031-4140-a18d-e9ccc039d8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8247b4ae3c740dba9a9abf4fba30846, user_id=bb1b327b2e524b72bbbd21624aa4dc1e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.131773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a96f4-6031-4140-a18d-e9ccc039d8fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.154334 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2144/4310] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:24.158952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.187906 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2167/4311] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:24 2022] PUT /identity/v3/projects/c8247b4ae3c740dba9a9abf4fba30846/users/bb1b327b2e524b72bbbd21624aa4dc1e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:24.188360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d7f8-5dd8-4318-aff4-d2874ebfe953 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.189834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.190125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.193128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.230388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:24.243328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] MFA Rules not processed for user `bb1b327b2e524b72bbbd21624aa4dc1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:24.245992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:24.328706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.329343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.329636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.329965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.330603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.332528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.385443 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2145/4312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:24 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:24.386684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.399658 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2168/4313] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:24.410300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.431675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8b5ae-392e-4c5d-8585-6cec786a88eb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.519326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.519968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.520253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.520532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.521354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.523844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.558733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49fa96-64fe-45b3-9cb8-dd63f80e3db2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.571457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.573483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.575513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.578011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.581884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.589709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.601769 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2169/4314] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:24 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:24.605431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.633127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2146/4315] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:24 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:24.638235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.655404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ef5d3-cc38-430d-898e-ac46d6711c46 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.668217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:24.777416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.778548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.779008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.779428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.780951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.782955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.801843 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2147/4316] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:24.803000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.815631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd0523-43fc-491c-ba22-2390d75c74c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.829541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.830784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.831180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.831462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.832173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.839514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.860955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e4080-3b45-41fb-906d-afdb5ad451c1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.867495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.868348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.868878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.870299 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2148/4317] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:24.871312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.872182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.875018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.875893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.891934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb45a4-ad91-483e-988d-fbbfb846b82e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.900974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062976b0-8c60-4e8b-ac9c-cba2476e741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:24.901898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062976b0-8c60-4e8b-ac9c-cba2476e741a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.902578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062976b0-8c60-4e8b-ac9c-cba2476e741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.903162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062976b0-8c60-4e8b-ac9c-cba2476e741a admin admin] PATH_INFO: `/v3/projects/7f36273a077f4a2d98feddf0aba2eb0b/users/a754fb09bb6c4c01b6d19027330fa0c7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:24.908252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2170/4318] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:24 2022] POST /identity/v3/users => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:24.913111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:24.926377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062976b0-8c60-4e8b-ac9c-cba2476e741a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f36273a077f4a2d98feddf0aba2eb0b, user_id=a754fb09bb6c4c01b6d19027330fa0c7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:24.930839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062976b0-8c60-4e8b-ac9c-cba2476e741a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:24.954616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7dec-b0d9-420a-9c31-747b2484b3f1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:24.974670 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2149/4319] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:24 2022] PUT /identity/v3/projects/7f36273a077f4a2d98feddf0aba2eb0b/users/a754fb09bb6c4c01b6d19027330fa0c7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:24.977820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:24.977947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:24.978161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:24.978943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.031623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] MFA Rules not processed for user `a754fb09bb6c4c01b6d19027330fa0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:25.033578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:25.145191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:25.145191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:25.145555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:25.145555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.146378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:25.152783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:25.169884 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2171/4320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:25.176880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:25.197926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705a007-d4e6-43be-9861-37c93c313ca5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:25.215302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:25.216861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:25.219356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:25.219819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] PATH_INFO: `/v3/projects/858b103fa6264eb2ab3db04b0e344c8e/users/84a4b35b6c574f4eb9145f6f3fd19f14/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.222356 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2150/4321] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:25.248301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858b103fa6264eb2ab3db04b0e344c8e, user_id=84a4b35b6c574f4eb9145f6f3fd19f14, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:25.254826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:25.291223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2172/4322] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:25 2022] PUT /identity/v3/projects/858b103fa6264eb2ab3db04b0e344c8e/users/84a4b35b6c574f4eb9145f6f3fd19f14/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:25.291958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:25.310706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14a435-fa30-4eaf-abef-ce0b71c4ea0e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:25.435069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818c759-3c1c-4d68-9b4b-c90ef09ed2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:25.435647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818c759-3c1c-4d68-9b4b-c90ef09ed2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:25.436894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818c759-3c1c-4d68-9b4b-c90ef09ed2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:25.438344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818c759-3c1c-4d68-9b4b-c90ef09ed2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.439941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818c759-3c1c-4d68-9b4b-c90ef09ed2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:25.443950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818c759-3c1c-4d68-9b4b-c90ef09ed2e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:25.447419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:25.461663 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2151/4323] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:25.465416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:25.481914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbf22-e4a0-48aa-8eb3-c2de3e4fab94 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:25.498023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:25.500087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:25.500672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:25.501033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] PATH_INFO: `/v3/projects/858b103fa6264eb2ab3db04b0e344c8e/users/84a4b35b6c574f4eb9145f6f3fd19f14/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.505900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858b103fa6264eb2ab3db04b0e344c8e, user_id=84a4b35b6c574f4eb9145f6f3fd19f14, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:25.510175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:25.536777 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2173/4324] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:25 2022] PUT /identity/v3/projects/858b103fa6264eb2ab3db04b0e344c8e/users/84a4b35b6c574f4eb9145f6f3fd19f14/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:25.553522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:25.553979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:25.554383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.611470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] MFA Rules not processed for user `84a4b35b6c574f4eb9145f6f3fd19f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:25.612711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:25.723145 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2152/4325] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:25.758095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:25.767863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:25.889315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d71d4-2b59-4664-8876-60b552b07195 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:25.895005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:25.895806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:25.896191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:25.896590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:25.909469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:25.912843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:25.929997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2174/4326] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:27.247595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:27.251271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:27.394641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af77b6-9e05-42b7-bd35-05f970ccfe9a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:27.402754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67253-5df5-46f1-8a25-936b82955fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:27.403672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67253-5df5-46f1-8a25-936b82955fab service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:27.404238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67253-5df5-46f1-8a25-936b82955fab service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:27.404916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67253-5df5-46f1-8a25-936b82955fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:27.501744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67253-5df5-46f1-8a25-936b82955fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:27.505045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67253-5df5-46f1-8a25-936b82955fab service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:27.518303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2153/4327] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:34.029430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:34.151106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2c938-dd9a-4b2c-b755-d194afff9ac6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:34.158841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:34.159813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:34.160103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:34.160380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] PATH_INFO: `/v3/users/bb1b327b2e524b72bbbd21624aa4dc1e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:34.161626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1b327b2e524b72bbbd21624aa4dc1e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:34.166996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:34.188802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:34.277735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1b327b2e524b72bbbd21624aa4dc1e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:34.291384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6ec2-7cc0-41a7-a8cb-57e577a36615 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:34.292228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6ec2-7cc0-41a7-a8cb-57e577a36615 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:34.292677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6ec2-7cc0-41a7-a8cb-57e577a36615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:34.332648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1b327b2e524b72bbbd21624aa4dc1e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:34.332648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1b327b2e524b72bbbd21624aa4dc1e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:34.333209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1b327b2e524b72bbbd21624aa4dc1e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:34.348215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bb17eba-db5d-4b54-bc4b-813083b290cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1b327b2e524b72bbbd21624aa4dc1e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:34.382630 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2175/4328] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:34 2022] DELETE /identity/v3/users/bb1b327b2e524b72bbbd21624aa4dc1e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:34.394542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:34.394542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:34.394542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:34.411691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-38fc6ec2-7cc0-41a7-a8cb-57e577a36615 None None] MFA Rules not processed for user `3e16b803125f408c9a5d32a3dba1b4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:34.412964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38fc6ec2-7cc0-41a7-a8cb-57e577a36615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:34.453536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:34.462736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:34.463263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:34.653680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2176/4329] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:34.716078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:34.720323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:34.794818 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2154/4330] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:34.796540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:34.796827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:34.797104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:34.846392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] MFA Rules not processed for user `3e16b803125f408c9a5d32a3dba1b4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:34.850495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:34.897783 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2155/4331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:34.959195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf269bb-44c7-411f-8334-8d4436efccc4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:34.973350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:34.973668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:34.973806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:34.974079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:35.018867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:35.020419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:35.046773 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2177/4332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:35.480686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:35.482726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:35.664888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aa880-0cbc-470a-806b-982c133a3c0c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:35.684484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:35.685295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:35.685681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:35.686243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:35.705470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:35.706981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:35.727660 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2156/4333] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:37.760694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:37.761993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:37.784510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459bcf-c4e7-4d72-b31f-d188bc74e87e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:37.797149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:37.797814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:37.798097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:37.798419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] PATH_INFO: `/v3/projects/c8247b4ae3c740dba9a9abf4fba30846` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:37.799864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8247b4ae3c740dba9a9abf4fba30846)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:37.801821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:37.878141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:37.911014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8247b4ae3c740dba9a9abf4fba30846', 'request_id': 'req-985c5d6b-7420-4f39-9f36-24ccd8f845dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:37.941845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8247b4ae3c740dba9a9abf4fba30846', 'request_id': 'req-985c5d6b-7420-4f39-9f36-24ccd8f845dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:37.958005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8247b4ae3c740dba9a9abf4fba30846', 'request_id': 'req-985c5d6b-7420-4f39-9f36-24ccd8f845dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:37.987701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] The token cache is being invalidate because project c8247b4ae3c740dba9a9abf4fba30846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:37.989062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:37.989957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:37.993543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2178/4334] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:37 2022] DELETE /identity/v3/projects/c8247b4ae3c740dba9a9abf4fba30846 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:38.003893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:38.029309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e86e-e7d9-4995-89aa-84356b7c313f service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:38.203965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:38.204706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:38.205006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:38.205304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] PATH_INFO: `/v3/users/84a4b35b6c574f4eb9145f6f3fd19f14` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:38.211248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a4b35b6c574f4eb9145f6f3fd19f14)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:38.214630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:38.298234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:38.349554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a4b35b6c574f4eb9145f6f3fd19f14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:38.366833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a4b35b6c574f4eb9145f6f3fd19f14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:38.367478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a4b35b6c574f4eb9145f6f3fd19f14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:38.368275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a4b35b6c574f4eb9145f6f3fd19f14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:38.393110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f865988-10fd-4cd7-82d4-574615e5cd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a4b35b6c574f4eb9145f6f3fd19f14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:38.438244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2157/4335] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:37 2022] DELETE /identity/v3/users/84a4b35b6c574f4eb9145f6f3fd19f14 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:39.672010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:39.677100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:39.731515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c5d6b-7420-4f39-9f36-24ccd8f845dd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:39.968486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:39.971453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:39.973254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:39.974941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] PATH_INFO: `/v3/projects/858b103fa6264eb2ab3db04b0e344c8e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:39.978252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] RBAC: Authorizing `identity:delete_project(project_id=858b103fa6264eb2ab3db04b0e344c8e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:39.985356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:40.137197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858b103fa6264eb2ab3db04b0e344c8e', 'request_id': 'req-25be3a65-d78b-419a-a2bf-4926f9fa012d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:40.150050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858b103fa6264eb2ab3db04b0e344c8e', 'request_id': 'req-25be3a65-d78b-419a-a2bf-4926f9fa012d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:40.159691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858b103fa6264eb2ab3db04b0e344c8e', 'request_id': 'req-25be3a65-d78b-419a-a2bf-4926f9fa012d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:40.188504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] The token cache is being invalidate because project 858b103fa6264eb2ab3db04b0e344c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:40.188877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:40.190289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-25be3a65-d78b-419a-a2bf-4926f9fa012d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:40.193538 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2179/4336] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:39 2022] DELETE /identity/v3/projects/858b103fa6264eb2ab3db04b0e344c8e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:40.199439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.199923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.200017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.237178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:40.238477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:40.427857 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2158/4337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:40.437787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.437787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.438405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.494639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:40.496124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:40.520292 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2180/4338] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:40.526988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:40.543333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9b687-81a2-4d06-b152-5915766e293f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:40.549596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:40.551179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.551179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.551179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.552202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:40.552603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:40.554385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:40.576252 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2159/4339] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:30:40.578665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:40.591350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5154b-1677-4f56-affd-e03103a263e7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:40.598845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:40.599993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.600717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.601126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.602409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:40.605677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:40.666207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2181/4340] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:40 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:40.667643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:40.688498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fe396-09c8-484d-8e28-be9cf27f9963 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:40.828721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:40.829416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.829767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.830191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.830885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:40.833134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:40.880720 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2160/4341] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:40 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:40.884005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:40.902383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41a04-fdb7-4643-a3f0-00a9f3dc163e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:40.911074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:40.913816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.914328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.914767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.916177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:40.918114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:40.948291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:40.966847 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2182/4342] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:40.975985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecb92-eff8-431a-9b61-36d057cb04a7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:40.991183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f8e5b-3f98-4c6d-bce7-a77d7f50505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:40.991835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f8e5b-3f98-4c6d-bce7-a77d7f50505b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:40.992121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f8e5b-3f98-4c6d-bce7-a77d7f50505b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:40.992400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f8e5b-3f98-4c6d-bce7-a77d7f50505b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:40.993068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f8e5b-3f98-4c6d-bce7-a77d7f50505b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:40.994715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f8e5b-3f98-4c6d-bce7-a77d7f50505b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:41.031066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2161/4343] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:41.033250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:41.061268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24641c1f-3b3f-43e0-9283-fad43c2c729c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:41.068152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:41.068601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:41.068883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:41.069158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] PATH_INFO: `/v3/projects/918038b1d01846faa081a3326118fbf1/users/750a6e11223943ac967b4a77893ff882/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:41.082566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:41.099265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918038b1d01846faa081a3326118fbf1, user_id=750a6e11223943ac967b4a77893ff882, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:41.103864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:41.129789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2183/4344] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:41 2022] PUT /identity/v3/projects/918038b1d01846faa081a3326118fbf1/users/750a6e11223943ac967b4a77893ff882/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:41.142335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:41.143035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:41.143851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:41.214929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:41.222835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] MFA Rules not processed for user `750a6e11223943ac967b4a77893ff882`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:41.229652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:41.405396 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2162/4345] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:41.420006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:41.422519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:41.637375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231a8c-278c-4481-8f50-689c23eeb964 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:41.654629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1791-34f4-459c-b81e-c83eb9370b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:41.656929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1791-34f4-459c-b81e-c83eb9370b1f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:41.657226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1791-34f4-459c-b81e-c83eb9370b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:41.657712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1791-34f4-459c-b81e-c83eb9370b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:41.671582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1791-34f4-459c-b81e-c83eb9370b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:41.673347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1791-34f4-459c-b81e-c83eb9370b1f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:41.700818 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2184/4346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:48.095374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:48.098272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:48.292956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21740-1d0a-415f-bd8a-13d0b958cf72 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:48.304575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:48.305427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:48.305905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:48.306402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] PATH_INFO: `/v3/users/a754fb09bb6c4c01b6d19027330fa0c7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:48.310440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a754fb09bb6c4c01b6d19027330fa0c7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:48.313977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:48.424966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a754fb09bb6c4c01b6d19027330fa0c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:48.442708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a754fb09bb6c4c01b6d19027330fa0c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:48.443356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a754fb09bb6c4c01b6d19027330fa0c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:48.443978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a754fb09bb6c4c01b6d19027330fa0c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:48.462323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a754fb09bb6c4c01b6d19027330fa0c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:48.523815 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2163/4347] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:48 2022] DELETE /identity/v3/users/a754fb09bb6c4c01b6d19027330fa0c7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:48.524649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:48.525294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:48.525294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:48.641957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:48.648469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:48.859912 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2185/4348] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:48.880686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:48.882900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:48.983847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:49.066803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9529d-ec71-47e3-a4c2-10e461c94bdf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:49.069870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d868d-0e18-43fa-8914-4a1ecc19cab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:49.070532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d868d-0e18-43fa-8914-4a1ecc19cab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:49.070868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d868d-0e18-43fa-8914-4a1ecc19cab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:49.071159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d868d-0e18-43fa-8914-4a1ecc19cab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:49.095519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d868d-0e18-43fa-8914-4a1ecc19cab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:49.098849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d868d-0e18-43fa-8914-4a1ecc19cab4 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:49.124636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2164/4349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:50.585053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:50.589399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:50.619080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf41b35-7969-4d22-9fd7-2e8b3fd753bd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:50.627852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:50.628995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:50.629430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:50.630246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] PATH_INFO: `/v3/projects/7f36273a077f4a2d98feddf0aba2eb0b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:50.649520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f36273a077f4a2d98feddf0aba2eb0b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:50.652163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:50.878827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f36273a077f4a2d98feddf0aba2eb0b', 'request_id': 'req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:50.894684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f36273a077f4a2d98feddf0aba2eb0b', 'request_id': 'req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:50.945746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f36273a077f4a2d98feddf0aba2eb0b', 'request_id': 'req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:50.992819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] The token cache is being invalidate because project 7f36273a077f4a2d98feddf0aba2eb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:50.995531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:50.997622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6dd210aa-bd2b-4c3b-b03a-06d3be72fdab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:51.005159 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2186/4350] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:50 2022] DELETE /identity/v3/projects/7f36273a077f4a2d98feddf0aba2eb0b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:51.010327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.011159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.011588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.056911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:51.058198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:51.179458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.180533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.180990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.190786 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2165/4351] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:51.223849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:51.225173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:51.239514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2187/4352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:51.244422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:51.277424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c61927-3249-4c35-953a-41bb20a7dc96 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:51.290345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:51.290974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.291255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.291562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.294126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:51.295311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:51.297649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:51.333898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:51.335139 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2166/4353] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:51.345532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f889a52-4c5c-460f-8403-9928661418e9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:51.356922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:51.358346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.358692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.359037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.366173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:51.368266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:51.382967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:51.430335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2188/4354] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:51 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:30:51.431913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:51.444359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce81c8-d87e-4ad6-971b-8f2e1842a7a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:51.582327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58876-355e-4287-9316-75e284c182de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:51.585214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58876-355e-4287-9316-75e284c182de admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.585610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58876-355e-4287-9316-75e284c182de admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.585895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58876-355e-4287-9316-75e284c182de admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.586740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c58876-355e-4287-9316-75e284c182de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:51.589346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c58876-355e-4287-9316-75e284c182de admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:51.640418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:51.656229 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2167/4355] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:51 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:51.665928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d043a-e47d-467b-963d-d230e4496051 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:51.675910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:51.679257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.679907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.680336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.682959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:51.688084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:51.740938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58876-355e-4287-9316-75e284c182de admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:51.741257 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2189/4356] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:51.762924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58876-355e-4287-9316-75e284c182de admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:51.771733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad823bc-fb76-41fb-b8eb-97ced52a8f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:51.772450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad823bc-fb76-41fb-b8eb-97ced52a8f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.773208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad823bc-fb76-41fb-b8eb-97ced52a8f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.773487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad823bc-fb76-41fb-b8eb-97ced52a8f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.774185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad823bc-fb76-41fb-b8eb-97ced52a8f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:51.777575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad823bc-fb76-41fb-b8eb-97ced52a8f8d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:51.812248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:51.834433 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2168/4357] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:30:51.878274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0996921-0725-4ad4-9d00-521406597062 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:51.883927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:51.884905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.885303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.885711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] PATH_INFO: `/v3/projects/c424634fffe642e4ba2c51270a5b98c5/users/f5a57418e24a43a89059ad514fdb639c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:51.921655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c424634fffe642e4ba2c51270a5b98c5, user_id=f5a57418e24a43a89059ad514fdb639c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:51.926341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:51.961452 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2190/4358] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:51 2022] PUT /identity/v3/projects/c424634fffe642e4ba2c51270a5b98c5/users/f5a57418e24a43a89059ad514fdb639c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:51.968501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:51.970445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:51.971107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:52.033765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] MFA Rules not processed for user `f5a57418e24a43a89059ad514fdb639c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:52.048963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:52.086229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:52.156659 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2169/4359] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:52.172049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:52.174386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:52.303222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b08a-15ce-40cd-906d-af9c13afaf9d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:52.312405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:52.313765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:52.313765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:52.313765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:52.323070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:52.324658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:52.337223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:52.339809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:52.345335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2191/4360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:52.514680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1e048-96e4-4724-975a-0727decbf35d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:52.528055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:52.528055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:52.528510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:52.528886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:52.532818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:52.572485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:52.574284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9004b-4c7f-48e7-8a31-e0690e30c2b0 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:52.615832 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2170/4361] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:30:52.655258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:52.776663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44647176-e2ed-4486-97f5-c5f90c7cd5ee service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:52.786722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:52.788154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:52.789395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:52.789876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] PATH_INFO: `/v3/users/f5a57418e24a43a89059ad514fdb639c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:52.792506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a57418e24a43a89059ad514fdb639c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:52.797511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:52.850820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:52.866112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a57418e24a43a89059ad514fdb639c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:52.887372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a57418e24a43a89059ad514fdb639c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:52.888262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a57418e24a43a89059ad514fdb639c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:52.889844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a57418e24a43a89059ad514fdb639c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:52.899340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a57418e24a43a89059ad514fdb639c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:52.935166 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2192/4362] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:52 2022] DELETE /identity/v3/users/f5a57418e24a43a89059ad514fdb639c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:52.939594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:52.939880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:52.940179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:52.971890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:52.973889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:53.057615 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2171/4363] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:53.089279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:53.090807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:53.188392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7b63-fea4-4e06-b802-04579d0d5ef8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:53.194284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:53.195374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:53.195806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:53.196265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:53.211008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:53.213044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:53.227926 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2193/4364] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:53.644075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:53.645942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:53.667271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c28b-632e-4e0e-8f18-0ebc5bcc05de None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:53.673941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:53.674761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:53.675112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:53.675459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] PATH_INFO: `/v3/users/480eb3dfe5a0479b96ba8e5f48438b22` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:53.676757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] RBAC: Authorizing `identity:delete_user(user_id=480eb3dfe5a0479b96ba8e5f48438b22)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:53.678966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:53.756594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:53.758610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480eb3dfe5a0479b96ba8e5f48438b22'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:53.769884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480eb3dfe5a0479b96ba8e5f48438b22'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:53.770809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480eb3dfe5a0479b96ba8e5f48438b22'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:53.771783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480eb3dfe5a0479b96ba8e5f48438b22'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:53.782929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480eb3dfe5a0479b96ba8e5f48438b22'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:53.827656 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2172/4365] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:53 2022] DELETE /identity/v3/users/480eb3dfe5a0479b96ba8e5f48438b22 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:54.569174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:54.589270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca28006-e0af-41d7-b75a-49d3e00e124c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:54.753965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:54.754932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:54.755402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:54.755872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] PATH_INFO: `/v3/projects/37fd8b31dcb0478c9c06841eaf8b47f8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:54.757362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fd8b31dcb0478c9c06841eaf8b47f8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:54.759814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:54.910079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fd8b31dcb0478c9c06841eaf8b47f8', 'request_id': 'req-346247ca-f610-49a5-96c7-0445eeaf5ec6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:54.925194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fd8b31dcb0478c9c06841eaf8b47f8', 'request_id': 'req-346247ca-f610-49a5-96c7-0445eeaf5ec6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:54.957420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:54.962389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fd8b31dcb0478c9c06841eaf8b47f8', 'request_id': 'req-346247ca-f610-49a5-96c7-0445eeaf5ec6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:54.999404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.001689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:55.007379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] The token cache is being invalidate because project 37fd8b31dcb0478c9c06841eaf8b47f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:55.007712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.008493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-346247ca-f610-49a5-96c7-0445eeaf5ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.023053 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2194/4366] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:54 2022] DELETE /identity/v3/projects/37fd8b31dcb0478c9c06841eaf8b47f8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:55.024721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0bc5-7f45-46b9-b748-1cf5e946dbfd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.025207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0bc5-7f45-46b9-b748-1cf5e946dbfd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.025621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0bc5-7f45-46b9-b748-1cf5e946dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.035736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2fee-fb51-4e3d-9c3d-aa2d40a7160c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.061833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a62d0bc5-7f45-46b9-b748-1cf5e946dbfd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:55.063123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a62d0bc5-7f45-46b9-b748-1cf5e946dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:55.178771 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2195/4367] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:55.180388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.180682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.184611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.188951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.189833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.190467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.190977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] PATH_INFO: `/v3/projects/c424634fffe642e4ba2c51270a5b98c5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.193400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c424634fffe642e4ba2c51270a5b98c5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.198929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.212241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:55.213916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:55.229935 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2196/4368] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:55.235566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.249427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dbb4c-3017-47b4-ae5f-047b163b2bf2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.257150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.257150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.257617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.257940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.258838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:55.259174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.263478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.280717 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2197/4369] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:55.286241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.295659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c424634fffe642e4ba2c51270a5b98c5', 'request_id': 'req-75abf214-d7d3-487a-809e-dba0bae9fd4b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.303599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c424634fffe642e4ba2c51270a5b98c5', 'request_id': 'req-75abf214-d7d3-487a-809e-dba0bae9fd4b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.305866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311a90-18f8-4447-9f1c-8e63e651cf9e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.314996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c424634fffe642e4ba2c51270a5b98c5', 'request_id': 'req-75abf214-d7d3-487a-809e-dba0bae9fd4b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.335690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] The token cache is being invalidate because project c424634fffe642e4ba2c51270a5b98c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:55.336563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.337803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75abf214-d7d3-487a-809e-dba0bae9fd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:55.344226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2173/4370] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:30:54 2022] DELETE /identity/v3/projects/c424634fffe642e4ba2c51270a5b98c5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:30:55.357364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe9fb-7491-4dd8-8f75-4bc9fefe8be3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.358231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe9fb-7491-4dd8-8f75-4bc9fefe8be3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.359017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe9fb-7491-4dd8-8f75-4bc9fefe8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.392460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-072fe9fb-7491-4dd8-8f75-4bc9fefe8be3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:55.393805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-072fe9fb-7491-4dd8-8f75-4bc9fefe8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:55.430015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.431184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.431892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.432171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.433290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.436483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.508751 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2198/4371] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:55.510720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.512700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:55.516780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:55.557116 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2174/4372] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:55.564316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.564619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.564925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.616302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:55.621109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:55.634594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:55.667953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7972e-cbda-4750-aa7b-52d2dfc9e50c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.683052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.683695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.684185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.684484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.685230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.689624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.746449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2199/4373] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:30:55.748299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.763956 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2175/4374] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:55.766172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2c4e-794e-4ee9-9bb7-9f67a4b538c6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.768942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.777415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.778549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.779137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.780207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.781570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.783655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.791091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d26f8b-1d20-4f06-b0bc-16dfd5e90679 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.800985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.800985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.800985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.800985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.801782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:30:55.802161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.803105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2200/4375] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:55.804413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.809837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.818414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558ae68-a617-406a-ad8f-a2becb1f7a9e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.826331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.828258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.828989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.829479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.830431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.832928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.842247 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2176/4376] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:30:55.844825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.874987 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2201/4377] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:55.880758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:55.884223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715591c-ea75-4417-a65e-a22047cf91a0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.892887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611311-f308-4ae1-a75d-a3f94436e2e5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:55.898196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.899401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188e14-8780-4ed9-8580-d7b83134d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:55.899949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.900099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188e14-8780-4ed9-8580-d7b83134d184 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.900345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188e14-8780-4ed9-8580-d7b83134d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.900631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188e14-8780-4ed9-8580-d7b83134d184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.901067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.901353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5188e14-8780-4ed9-8580-d7b83134d184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.901739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] PATH_INFO: `/v3/projects/dd0c162c9947480aa28ab4b5ed5d5d7e/users/7e156f3aff8346f08b118506130261c2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.903333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5188e14-8780-4ed9-8580-d7b83134d184 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.924968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0c162c9947480aa28ab4b5ed5d5d7e, user_id=7e156f3aff8346f08b118506130261c2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:55.928087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:55.955704 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2202/4378] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:55 2022] PUT /identity/v3/projects/dd0c162c9947480aa28ab4b5ed5d5d7e/users/7e156f3aff8346f08b118506130261c2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:55.959111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2177/4379] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:55.959973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:55.960539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:55.960958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:55.962821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:56.013550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:56.017676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:56.069673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7475d7-8ac5-4049-a69f-dff6ce32a46b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:56.161098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:56.161744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.162643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.162937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.163595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:56.170008 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2178/4380] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:56.175685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:56.221497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:56.223371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:56.223750 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2203/4381] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:55 2022] POST /identity/v3/users => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:56.228352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:56.253197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857098-3ddf-4f84-a942-02b9ccee612a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:56.264960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:56.265871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.266420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.266556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.267305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:56.269408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:56.298505 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2204/4382] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:56.299852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:56.317787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e44112-db7d-44e2-b339-a67ed87cdc1e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:56.336076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:56.336716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.336998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.337274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.338107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:56.346783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:56.363095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26ae9a-52dc-4c6e-a828-b1f5d3bc7bea None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:56.370201 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2205/4383] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:30:56.372452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:56.375040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555af20-8e3d-47e6-99be-b389ced7735b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:56.375905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555af20-8e3d-47e6-99be-b389ced7735b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.376352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555af20-8e3d-47e6-99be-b389ced7735b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.376788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555af20-8e3d-47e6-99be-b389ced7735b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.388611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d95595-024c-4044-8285-04ebd351415f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:56.395253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:56.396754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.397187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.397474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] PATH_INFO: `/v3/projects/f80bf8db6bb2457ea7080b95db1ce36f/users/4b32c8ddd2b64dcca7ba768536e8da1c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.411475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:56.419824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555af20-8e3d-47e6-99be-b389ced7735b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:56.421895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555af20-8e3d-47e6-99be-b389ced7735b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:56.427728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80bf8db6bb2457ea7080b95db1ce36f, user_id=4b32c8ddd2b64dcca7ba768536e8da1c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:56.430780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:56.447057 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2179/4384] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:30:56.466690 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2206/4385] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:56 2022] PUT /identity/v3/projects/f80bf8db6bb2457ea7080b95db1ce36f/users/4b32c8ddd2b64dcca7ba768536e8da1c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:30:56.469099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.469410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.469704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.485954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:56.572018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] MFA Rules not processed for user `4b32c8ddd2b64dcca7ba768536e8da1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:56.604363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:56.819679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2180/4386] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:56.825574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:56.949867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c492b-0573-4678-9968-63b925192bd1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:56.961245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:56.962436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:56.963182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:56.963863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:56.965203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:56.970562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.017187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2207/4387] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:30:56 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:57.021099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.039748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522048c6-32d8-45d8-84a7-857fd3c56c25 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.139405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.140052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.140471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.140600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.141695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:57.145033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.191064 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2181/4388] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:30:57 2022] POST /identity/v3/users => generated 308 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:57.192562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.211998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256db9a-0585-4b19-8ae4-c6ae637727ec admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.217956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.219098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.219593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.220067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.220939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:57.227703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.251554 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2208/4389] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:57.252821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.272775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5330f0-9f9a-485c-b69f-e99d20733371 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.330469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.331184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.331472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.331753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] PATH_INFO: `/v3/projects/d0350409c7c54285b92f0cf7aa52f33b/users/583325b76e374afcae6be7128ea14b02/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.375842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0350409c7c54285b92f0cf7aa52f33b, user_id=583325b76e374afcae6be7128ea14b02, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:57.378790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.406399 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2182/4390] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:57 2022] PUT /identity/v3/projects/d0350409c7c54285b92f0cf7aa52f33b/users/583325b76e374afcae6be7128ea14b02/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:30:57.410375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.424438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29596a5-b6c9-4f6f-86ed-89d76a8d6871 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.557893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656a26c-3bee-4fc1-995a-4b7b912cd017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.559018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656a26c-3bee-4fc1-995a-4b7b912cd017 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.559307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656a26c-3bee-4fc1-995a-4b7b912cd017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.559587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656a26c-3bee-4fc1-995a-4b7b912cd017 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.560250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656a26c-3bee-4fc1-995a-4b7b912cd017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:57.562282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656a26c-3bee-4fc1-995a-4b7b912cd017 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.588080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2209/4391] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:30:57.590476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.603720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea074a-29d9-4d9a-b728-f660db6798a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.609087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804034e-0dd4-4674-ab0d-8cf587310862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.610085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804034e-0dd4-4674-ab0d-8cf587310862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.610403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804034e-0dd4-4674-ab0d-8cf587310862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.610683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804034e-0dd4-4674-ab0d-8cf587310862 admin admin] PATH_INFO: `/v3/projects/d0350409c7c54285b92f0cf7aa52f33b/users/583325b76e374afcae6be7128ea14b02/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.612815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804034e-0dd4-4674-ab0d-8cf587310862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0350409c7c54285b92f0cf7aa52f33b, user_id=583325b76e374afcae6be7128ea14b02, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:57.615594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804034e-0dd4-4674-ab0d-8cf587310862 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.638233 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2183/4392] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:57 2022] PUT /identity/v3/projects/d0350409c7c54285b92f0cf7aa52f33b/users/583325b76e374afcae6be7128ea14b02/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:57.646649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.647198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.647729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.687023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] MFA Rules not processed for user `583325b76e374afcae6be7128ea14b02`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:57.692625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:57.781475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:57.798488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005060ab-c2ba-4b81-8114-c3562f415c23 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.798790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005060ab-c2ba-4b81-8114-c3562f415c23 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.799080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005060ab-c2ba-4b81-8114-c3562f415c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.868958 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2210/4393] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:57.870561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.889430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-005060ab-c2ba-4b81-8114-c3562f415c23 None None] MFA Rules not processed for user `7e156f3aff8346f08b118506130261c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:57.891420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-005060ab-c2ba-4b81-8114-c3562f415c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:57.895425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5a83e-3b58-4a3a-9c5b-a5fa0a71d68b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.912087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '583325b76e374afcae6be7128ea14b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0350409c7c54285b92f0cf7aa52f33b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.912732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.913018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.913347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.913977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:57.922832 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:30:57.922832 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:30:57.922832 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:30:57.923773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:57.958176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2211/4394] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:30:57 2022] POST /identity/v3/roles => generated 240 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:57.965569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:57.977513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cf4cc-836c-4302-a165-49a307869ea0 tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:57.987866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '583325b76e374afcae6be7128ea14b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0350409c7c54285b92f0cf7aa52f33b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:57.987866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:57.988234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:57.988440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] PATH_INFO: `/v3/projects/f80bf8db6bb2457ea7080b95db1ce36f/users/4b32c8ddd2b64dcca7ba768536e8da1c/roles/e98c82e5b6564617b9b0d25f774e2b42` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:57.994711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f80bf8db6bb2457ea7080b95db1ce36f, user_id=4b32c8ddd2b64dcca7ba768536e8da1c, role_id=e98c82e5b6564617b9b0d25f774e2b42)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:58.006176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:58.006984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:58.042733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2212/4395] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:30:57 2022] PUT /identity/v3/projects/f80bf8db6bb2457ea7080b95db1ce36f/users/4b32c8ddd2b64dcca7ba768536e8da1c/roles/e98c82e5b6564617b9b0d25f774e2b42 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:58.048349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:58.086198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2184/4396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:30:58.089903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:58.090497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:58.090984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:58.131133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] MFA Rules not processed for user `7e156f3aff8346f08b118506130261c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:58.133583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:58.202992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c3ef-f9e1-4666-9ba1-aa562b5db9fe tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:58.224322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a063076-1bb7-4b65-b417-63b03fa8cffa tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b32c8ddd2b64dcca7ba768536e8da1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f80bf8db6bb2457ea7080b95db1ce36f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1286144701'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:58.225006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a063076-1bb7-4b65-b417-63b03fa8cffa tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:58.229513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a063076-1bb7-4b65-b417-63b03fa8cffa tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:58.229513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a063076-1bb7-4b65-b417-63b03fa8cffa tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] PATH_INFO: `/v3/users/4b32c8ddd2b64dcca7ba768536e8da1c/application_credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:58.230043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a063076-1bb7-4b65-b417-63b03fa8cffa tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] RBAC: Authorizing `identity:create_application_credential(user_id=4b32c8ddd2b64dcca7ba768536e8da1c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:58.231290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a063076-1bb7-4b65-b417-63b03fa8cffa tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:58.253137 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2185/4397] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:58.266817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:58.270034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:58.387399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7391a6f-171e-46de-ac16-2db9b5e638f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:58.400834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:58.401691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:58.402648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:58.402964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:58.421605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:58.421970 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2213/4398] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Oct 31 05:30:58 2022] POST /identity/v3/users/4b32c8ddd2b64dcca7ba768536e8da1c/application_credentials => generated 659 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:30:58.422068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:58.423924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:58.424317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:58.424666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:58.443040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2186/4399] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:58.497289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] MFA Rules not processed for user `4b32c8ddd2b64dcca7ba768536e8da1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:58.499702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:58.562252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:58.694420 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2214/4400] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:58 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 05:30:58.698539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:58.709901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167582-7cce-4ae9-8e64-7b70ebba7ba8 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:58.715007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b32c8ddd2b64dcca7ba768536e8da1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f80bf8db6bb2457ea7080b95db1ce36f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1286144701'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:58.715995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:58.716280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:58.716564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] PATH_INFO: `/v3/users/4b32c8ddd2b64dcca7ba768536e8da1c/application_credentials/978e4350083c40c3819b9fc7e52c5325` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:58.718570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4b32c8ddd2b64dcca7ba768536e8da1c, application_credential_id=978e4350083c40c3819b9fc7e52c5325)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:58.720084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:58.757457 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2187/4401] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:30:58 2022] DELETE /identity/v3/users/4b32c8ddd2b64dcca7ba768536e8da1c/application_credentials/978e4350083c40c3819b9fc7e52c5325 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:58.761804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:58.896388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec019b-0e3c-446e-bfd5-bc2e7eb7fcc2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:58.904261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '583325b76e374afcae6be7128ea14b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0350409c7c54285b92f0cf7aa52f33b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:58.905190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:58.905597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:58.905980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] PATH_INFO: `/v3/roles/e98c82e5b6564617b9b0d25f774e2b42` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:58.907754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e98c82e5b6564617b9b0d25f774e2b42)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:58.908943 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:30:58.908943 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:30:58.908943 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:30:58.910670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:58.988132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Invalidating the token cache because role e98c82e5b6564617b9b0d25f774e2b42 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:30:58.988677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:58.989717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d732d4fa-2534-4e2f-af4b-6d67e4b3464a tempest-ApplicationCredentialsV3AdminTest-1205723474 tempest-ApplicationCredentialsV3AdminTest-1205723474-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:58.992360 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2215/4402] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:58 2022] DELETE /identity/v3/roles/e98c82e5b6564617b9b0d25f774e2b42 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:58.999012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:59.002322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:59.095067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:59.130877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0e402-2891-438b-83da-bfd9eac777d4 tempest-ApplicationCredentialsV3AdminTest-1753023579 tempest-ApplicationCredentialsV3AdminTest-1753023579-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:59.212676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:59.214927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:59.215521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:59.215891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] PATH_INFO: `/v3/users/4b32c8ddd2b64dcca7ba768536e8da1c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:59.219081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b32c8ddd2b64dcca7ba768536e8da1c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:59.224794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:59.352207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b32c8ddd2b64dcca7ba768536e8da1c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:59.362566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b32c8ddd2b64dcca7ba768536e8da1c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:59.364721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b32c8ddd2b64dcca7ba768536e8da1c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:59.365724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b32c8ddd2b64dcca7ba768536e8da1c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:59.388127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b32c8ddd2b64dcca7ba768536e8da1c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:30:59.421697 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2188/4403] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:58 2022] DELETE /identity/v3/users/4b32c8ddd2b64dcca7ba768536e8da1c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:30:59.423378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:59.424113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:59.424961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:59.453111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:30:59.454790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:59.524468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:30:59.539273 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2216/4404] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:30:59.556104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:59.561673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:59.663979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca7ae6-cae7-4416-ac19-71967505e297 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:59.669520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:59.670840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:59.671229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:59.671614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:59.711949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:59.713995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:30:59.729860 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2189/4405] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:30:59.849827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:30:59.851603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:30:59.878592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0fc3-3a4e-4e96-aafc-13ba54271b24 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:30:59.892257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:30:59.893859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:30:59.895279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:30:59.896843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] PATH_INFO: `/v3/users/7e156f3aff8346f08b118506130261c2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:30:59.900683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e156f3aff8346f08b118506130261c2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:30:59.910270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:00.011937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e156f3aff8346f08b118506130261c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:00.034706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e156f3aff8346f08b118506130261c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:00.037600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e156f3aff8346f08b118506130261c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:00.038544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e156f3aff8346f08b118506130261c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:00.052638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e156f3aff8346f08b118506130261c2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:00.077467 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2217/4406] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:30:59 2022] DELETE /identity/v3/users/7e156f3aff8346f08b118506130261c2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:00.745529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:00.747256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:00.766819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d744926-38e8-469d-a034-0ed0c5a2875c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:00.780906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:00.945647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:00.946512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:00.946832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:00.947090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] PATH_INFO: `/v3/projects/f80bf8db6bb2457ea7080b95db1ce36f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:00.949929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80bf8db6bb2457ea7080b95db1ce36f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:00.954336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:01.076025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80bf8db6bb2457ea7080b95db1ce36f', 'request_id': 'req-c03bc77b-8ba1-457e-a282-b1a059a8de0d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.094225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80bf8db6bb2457ea7080b95db1ce36f', 'request_id': 'req-c03bc77b-8ba1-457e-a282-b1a059a8de0d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.115581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80bf8db6bb2457ea7080b95db1ce36f', 'request_id': 'req-c03bc77b-8ba1-457e-a282-b1a059a8de0d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.136989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] The token cache is being invalidate because project f80bf8db6bb2457ea7080b95db1ce36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:01.137324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.141645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.147508 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2190/4407] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:00 2022] DELETE /identity/v3/projects/f80bf8db6bb2457ea7080b95db1ce36f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:01.148992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:01.151073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:01.176298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb01658-a5ad-4338-8701-c7af5088d2ef admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:01.302743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:01.304178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:01.361126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:01.362224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:01.364010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:01.364503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] PATH_INFO: `/v3/users/583325b76e374afcae6be7128ea14b02` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:01.368452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=583325b76e374afcae6be7128ea14b02)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:01.376200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:01.444521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc77b-8ba1-457e-a282-b1a059a8de0d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:01.475565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:01.476236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:01.476523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:01.476799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] PATH_INFO: `/v3/projects/dd0c162c9947480aa28ab4b5ed5d5d7e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:01.478268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583325b76e374afcae6be7128ea14b02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.478495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0c162c9947480aa28ab4b5ed5d5d7e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:01.480413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:01.509169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583325b76e374afcae6be7128ea14b02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.510307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583325b76e374afcae6be7128ea14b02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.511375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583325b76e374afcae6be7128ea14b02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.522228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:01.529260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65c8d2a9-2a02-4c0f-a745-bf0737c5c87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583325b76e374afcae6be7128ea14b02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.571766 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2218/4408] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:01 2022] DELETE /identity/v3/users/583325b76e374afcae6be7128ea14b02 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:01.574511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:01.587214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0c162c9947480aa28ab4b5ed5d5d7e', 'request_id': 'req-6f30bfd6-4888-44ef-9a4f-636accb644e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.598299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0c162c9947480aa28ab4b5ed5d5d7e', 'request_id': 'req-6f30bfd6-4888-44ef-9a4f-636accb644e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.622525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0c162c9947480aa28ab4b5ed5d5d7e', 'request_id': 'req-6f30bfd6-4888-44ef-9a4f-636accb644e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.657463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] The token cache is being invalidate because project dd0c162c9947480aa28ab4b5ed5d5d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:01.658878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.661337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f30bfd6-4888-44ef-9a4f-636accb644e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:01.665597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2191/4409] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:01 2022] DELETE /identity/v3/projects/dd0c162c9947480aa28ab4b5ed5d5d7e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:01.673014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:01.673014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:01.673752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:01.715895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:01.717839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:01.852688 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2219/4410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:01.864113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:01.865103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:01.865424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:01.913221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:01.915418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:01.927368 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2192/4411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:01.931355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:01.964495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875543f-1527-460e-94ac-b1d465e64a91 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:01.980249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:01.981133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:01.981622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:01.985634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:01.986734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:01.987200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:01.989284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.006107 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2220/4412] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:31:02.010223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.027799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35eecb-8b06-45df-b436-324f3b79eccd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.037153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.037153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.037153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.037153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.037937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.040416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.091808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2193/4413] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:02 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:02.100386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.120344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92bc1-62d3-435d-8f20-b859920fd4d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.230517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.231175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.231440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.231719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.232480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.235445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.293556 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2221/4414] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:02 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:02.294354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.306463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7397-ca7c-4530-b3e5-9207181b8c54 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.315303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.316383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.316778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.317167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.318075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.319893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.343878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.357229 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2194/4415] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:02.368746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887f0a4-38c0-485f-9177-66056c299e4b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.374464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb9c1-207e-4251-acb7-4a01eff1a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.375270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb9c1-207e-4251-acb7-4a01eff1a556 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.375632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb9c1-207e-4251-acb7-4a01eff1a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.375981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb9c1-207e-4251-acb7-4a01eff1a556 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.376714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb9c1-207e-4251-acb7-4a01eff1a556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.379321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb9c1-207e-4251-acb7-4a01eff1a556 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.398110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.398443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2222/4416] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:02.411668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fabf3-5972-4d69-885e-dc896b6bdd95 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.416984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.417677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.417957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.418546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] PATH_INFO: `/v3/projects/23cbfb7d36aa489e8ff4b80d6eca9af0/users/0b80262470174f089095460a99b91563/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.441804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cbfb7d36aa489e8ff4b80d6eca9af0, user_id=0b80262470174f089095460a99b91563, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.445469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.468748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2195/4417] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:02 2022] PUT /identity/v3/projects/23cbfb7d36aa489e8ff4b80d6eca9af0/users/0b80262470174f089095460a99b91563/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:02.476201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.476489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.476762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.503428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:02.505087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:02.586210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:02.609252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2223/4418] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:02.633653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.635964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:02.759585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c523c-7932-4403-861e-61fb25ff8dd4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.769045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51af206-c030-46cc-8138-e38adf1cc0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.769487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51af206-c030-46cc-8138-e38adf1cc0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.769779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51af206-c030-46cc-8138-e38adf1cc0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.770056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51af206-c030-46cc-8138-e38adf1cc0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.825070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51af206-c030-46cc-8138-e38adf1cc0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.831827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51af206-c030-46cc-8138-e38adf1cc0f9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:02.862676 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2196/4419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:02.863609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:02.865260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:02.887319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54e39d-216c-468c-91b4-bba510eb24d3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:02.894644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76807229-1923-4184-b216-6001122069df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:02.896697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807229-1923-4184-b216-6001122069df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:02.896938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807229-1923-4184-b216-6001122069df admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:02.897887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807229-1923-4184-b216-6001122069df admin admin] PATH_INFO: `/v3/projects/d0350409c7c54285b92f0cf7aa52f33b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:02.899267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76807229-1923-4184-b216-6001122069df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0350409c7c54285b92f0cf7aa52f33b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:02.902268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76807229-1923-4184-b216-6001122069df admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:03.019711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76807229-1923-4184-b216-6001122069df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0350409c7c54285b92f0cf7aa52f33b', 'request_id': 'req-76807229-1923-4184-b216-6001122069df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:03.028616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76807229-1923-4184-b216-6001122069df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0350409c7c54285b92f0cf7aa52f33b', 'request_id': 'req-76807229-1923-4184-b216-6001122069df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:03.036688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76807229-1923-4184-b216-6001122069df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0350409c7c54285b92f0cf7aa52f33b', 'request_id': 'req-76807229-1923-4184-b216-6001122069df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:03.065069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76807229-1923-4184-b216-6001122069df admin admin] The token cache is being invalidate because project d0350409c7c54285b92f0cf7aa52f33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:03.065987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76807229-1923-4184-b216-6001122069df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:03.067052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-76807229-1923-4184-b216-6001122069df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:03.071749 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2224/4420] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:02 2022] DELETE /identity/v3/projects/d0350409c7c54285b92f0cf7aa52f33b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:03.078825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.079438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.080086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.123691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:03.129710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:03.254896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.255467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.255584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.261805 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2197/4421] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:03.289291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:03.290765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:03.307296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.319116 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2225/4422] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:03.323568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933125-f633-4c10-af90-91a833e702c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:03.340349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:03.341189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.341619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.342675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.344227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:03.344692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:03.346825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:03.363022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:03.377560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.389770 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2198/4423] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:03.392430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da8632-dae6-4144-8389-a4f847fb145f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:03.400238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:03.401608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.402114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.402667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.404491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:03.407655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:03.494775 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2226/4424] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:03 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:03.501798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.545842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b1ab-7c2a-4e54-9edb-b062085808ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:03.737168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:03.737898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.738204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.738488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.739153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:03.741307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:03.782455 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2199/4425] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:03 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:03.785736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.800859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f172d-d534-4dea-b2af-467c6f08a260 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:03.821016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:03.821916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.822378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.822723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.823539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:03.829127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:03.881977 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2227/4426] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:03.882231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.898678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c9039-10bf-4fae-a8cd-7dcf1c13ab52 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:03.911918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:03.912687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.914476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.914874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:03.916756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:03.921318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:03.949006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2200/4427] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:03.952642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.958833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:03.961336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:03.966978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ca8f-e53b-4b38-ba31-50eae9b57ce0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:03.982652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:03.984451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:03.984802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:03.985478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] PATH_INFO: `/v3/projects/9247d16b390e43adb4b51b275fd43876/users/a860fea5468e442b874734ef6e5444f6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.027838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9247d16b390e43adb4b51b275fd43876, user_id=a860fea5468e442b874734ef6e5444f6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.031874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.070942 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2228/4428] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:03 2022] PUT /identity/v3/projects/9247d16b390e43adb4b51b275fd43876/users/a860fea5468e442b874734ef6e5444f6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:04.084797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:04.086726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.124616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22408759-0379-41ec-97c9-0e24fd3ae5c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.197288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708838c9-56ad-4d6b-9da7-b18173fc4a00 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.206610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.209338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.209733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.210174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] PATH_INFO: `/v3/users/9428e150a39244798cc947b43df08ae9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.214190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9428e150a39244798cc947b43df08ae9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.217523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.240763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:04.245697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.247807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.248882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.249344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.252271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.270468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.272690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3713e-3ce3-48d7-bc8d-287ed819d35c service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.287985 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2201/4429] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:04.302423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9428e150a39244798cc947b43df08ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.303641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.304104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.304434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.325020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9428e150a39244798cc947b43df08ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.326996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9428e150a39244798cc947b43df08ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.327705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9428e150a39244798cc947b43df08ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.335130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:04.341895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9428e150a39244798cc947b43df08ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.356719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] MFA Rules not processed for user `a860fea5468e442b874734ef6e5444f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:04.358866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.365880 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2229/4430] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:04 2022] DELETE /identity/v3/users/9428e150a39244798cc947b43df08ae9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:04.462229 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2202/4431] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:04.469172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:04.470873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.589458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:04.591621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.594308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840df0-ad48-49d5-aa81-c595a483e321 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.600892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.601604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.601972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.602551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.603526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.605545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.639681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d02e-c1af-4e9a-8798-ca73d688cb80 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.639819 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2230/4432] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:04 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:04.643880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:04.731045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.731905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.732259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.732787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] PATH_INFO: `/v3/projects/1a468874f9bf4718a80faa0c564153ed` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.736160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a468874f9bf4718a80faa0c564153ed)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.740004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.752582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54e29-0b93-46ec-b195-55fd08da116b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.759751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.760926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.761416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.761918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.763183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.766965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.804858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a468874f9bf4718a80faa0c564153ed', 'request_id': 'req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.805556 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2231/4433] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:04 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:04.812297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:04.815382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a468874f9bf4718a80faa0c564153ed', 'request_id': 'req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.826811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eee2-8120-4ec9-8064-3968d9a991ac admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.828166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a468874f9bf4718a80faa0c564153ed', 'request_id': 'req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.835473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:04.845986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] The token cache is being invalidate because project 1a468874f9bf4718a80faa0c564153ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:04.846344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.849214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae53f69b-eb7e-4ab6-957b-e164b7cacc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:04.854413 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2203/4434] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:04 2022] DELETE /identity/v3/projects/1a468874f9bf4718a80faa0c564153ed => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:04.856226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848839a-9bc5-45a9-858b-b6e85740ad06 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.856603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848839a-9bc5-45a9-858b-b6e85740ad06 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.856794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848839a-9bc5-45a9-858b-b6e85740ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.881184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7848839a-9bc5-45a9-858b-b6e85740ad06 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:04.882495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7848839a-9bc5-45a9-858b-b6e85740ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.922340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:04.930021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.930645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.930992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.931348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.932541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:04.934223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:04.964249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2232/4435] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:04.965355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:04.968337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:04.985395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77574f5-f2ee-417a-9435-06bfaf814dbe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:04.991748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:04.992812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:04.993104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:04.993549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] PATH_INFO: `/v3/projects/9d09c6c70c2b471682fd8dd759c4a5e1/users/133f130f27be47e3ab09f03a858db60f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:04.998719 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2204/4436] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:05.012092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.013128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.013643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.019984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d09c6c70c2b471682fd8dd759c4a5e1, user_id=133f130f27be47e3ab09f03a858db60f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.035892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.046835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:05.048638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:05.074625 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2233/4437] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:04 2022] PUT /identity/v3/projects/9d09c6c70c2b471682fd8dd759c4a5e1/users/133f130f27be47e3ab09f03a858db60f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:05.087316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.231260 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2205/4438] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:05.234676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.251482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ebde9-bd86-47e5-9de0-36e1166c2635 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.267186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.268344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc9c3-e340-49af-b2fe-0a5d2da8096e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.274091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.274779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.275073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.275446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.276111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.277943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.279086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.280403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.281135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.282079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:05.282785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.288126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.301594 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2234/4439] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:05.305438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.313624 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2206/4440] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:05.318640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.326845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6ab6-d2de-41ac-b5b1-fc5cb3024300 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.333083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96c9a-9ad7-4432-acb1-441c3c7c23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.333791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96c9a-9ad7-4432-acb1-441c3c7c23af admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.334743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96c9a-9ad7-4432-acb1-441c3c7c23af admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.335036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96c9a-9ad7-4432-acb1-441c3c7c23af admin admin] PATH_INFO: `/v3/projects/9d09c6c70c2b471682fd8dd759c4a5e1/users/133f130f27be47e3ab09f03a858db60f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.338081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96c9a-9ad7-4432-acb1-441c3c7c23af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d09c6c70c2b471682fd8dd759c4a5e1, user_id=133f130f27be47e3ab09f03a858db60f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.341123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96c9a-9ad7-4432-acb1-441c3c7c23af admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.344606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff80eb5-988a-4e31-8ec6-c8291f770fdd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.354728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.355730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.356209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.368029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2235/4441] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:05 2022] PUT /identity/v3/projects/9d09c6c70c2b471682fd8dd759c4a5e1/users/133f130f27be47e3ab09f03a858db60f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:05.368245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.368245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.368245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.368844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.369322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.369682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.414981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] MFA Rules not processed for user `133f130f27be47e3ab09f03a858db60f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:05.416255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:05.425038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2207/4442] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:05 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:05.429598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.500424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:05.531248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2236/4443] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:05.532199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.551334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab939c-c879-45ca-bba5-fcb49e6d7c32 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.570463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3c9da-f936-41ea-8a51-645e78b719a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.585012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.585733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.586138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.589268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.590294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.593354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.637474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.638099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2208/4444] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:05 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:05.642266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.642568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.642859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.643017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.644022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.645756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.655722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933efd32-02a7-4192-9c1c-f4824941b86c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.668646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.669751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.670867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2237/4445] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:31:05 2022] POST /identity/v3/domains => generated 276 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:05.671465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.671780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.672922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.675708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.676836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.703079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2209/4446] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:05.707865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.723668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a511bb-fcc1-4f56-bf47-314a5440145b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.738080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:05.788185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1417-0250-4d73-91cd-71d8c573b656 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.803573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.804355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.806218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.806980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.809127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.812824 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:05.812824 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:31:05.812824 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:31:05.818512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.837753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.839168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.839617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.840598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.841406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.845401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.868407 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2210/4447] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:05.877267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.881594 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2238/4448] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:05 2022] POST /identity/v3/groups => generated 280 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:05.892644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:05.907905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5409fbe-8baa-4c7f-b767-712d183417f5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.912997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226829-6b32-4de6-bee0-bbedd6cab1e7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:05.919401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.921573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.922507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.922858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] PATH_INFO: `/v3/projects/eb83497b67824e9ab4409bd5c51b1a9f/users/c0ad1c9279a04adfa7f10b1d2e344be4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.925747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:05.926375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:05.928195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:05.928932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/9ed465fdd7424ef7aad6407cf143f819` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:05.947066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:update_group(group_id=9ed465fdd7424ef7aad6407cf143f819)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.949281 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:05.949281 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:31:05.949281 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:31:05.952365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff648169-6fd0-415a-94d3-1c4af5552223 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:05.970026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb83497b67824e9ab4409bd5c51b1a9f, user_id=c0ad1c9279a04adfa7f10b1d2e344be4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:05.985075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.021800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2239/4449] 10.222.0.23 () {60 vars in 1247 bytes} [Mon Oct 31 05:31:05 2022] PATCH /identity/v3/groups/9ed465fdd7424ef7aad6407cf143f819 => generated 290 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:06.033631 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2211/4450] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:05 2022] PUT /identity/v3/projects/eb83497b67824e9ab4409bd5c51b1a9f/users/c0ad1c9279a04adfa7f10b1d2e344be4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:06.033631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.041862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.042350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.042828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.129585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] MFA Rules not processed for user `c0ad1c9279a04adfa7f10b1d2e344be4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:06.130969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:06.171036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1bcf-7437-4e90-af0b-9f2b060961ae admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.185205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.187248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.189173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.189781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/9ed465fdd7424ef7aad6407cf143f819` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.207440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:get_group(group_id=9ed465fdd7424ef7aad6407cf143f819)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.212706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.218402 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2212/4451] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:06 2022] GET /identity/v3/groups/9ed465fdd7424ef7aad6407cf143f819 => generated 290 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:06.223064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.223772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:06.250504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6f43-78f7-46ae-8222-1e25b2eaa97e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.262789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.266947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.267218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.268246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/9ed465fdd7424ef7aad6407cf143f819` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.272926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:update_group(group_id=9ed465fdd7424ef7aad6407cf143f819)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.276102 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:06.276102 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:06.276102 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:06.278614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.289647 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2240/4452] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:06.308283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.311863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:06.322036 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2213/4453] 10.222.0.23 () {60 vars in 1246 bytes} [Mon Oct 31 05:31:06 2022] PATCH /identity/v3/groups/9ed465fdd7424ef7aad6407cf143f819 => generated 307 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:06.323424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.347216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad4c0a-03ea-474b-90ba-006ccd8135f9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.360637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.361486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.361829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.363779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/9ed465fdd7424ef7aad6407cf143f819` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.378603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9ed465fdd7424ef7aad6407cf143f819)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.379733 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:06.379733 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:06.379733 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:06.383014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.470574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a724-6c83-4139-b6c1-04d738925062 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.481550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.481990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.482872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.484837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.497005 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2214/4454] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:06 2022] DELETE /identity/v3/groups/9ed465fdd7424ef7aad6407cf143f819 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:06.503559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.506742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.508695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.527733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2241/4455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:06.540466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:06.669759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce7ba-6f7a-45b6-885f-5fed0d9fe58b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.682925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.683587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.683881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.684170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.684909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.686665 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:06.686665 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:06.686665 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:06.687952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.718712 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2215/4456] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:06 2022] POST /identity/v3/groups => generated 326 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:06.720186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.733646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f5f7-19a9-4e26-813c-ebf4b711e9b6 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.743917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.745345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.745646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.746698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.747583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.750104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.796643 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2242/4457] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:06 2022] POST /identity/v3/users => generated 323 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:06.800989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.823882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793a44-a60d-4eff-ad9d-42582a05e97a tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:06.839423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:06.840113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:06.840430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:06.840714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/fbe18eccf11b4eb9b0e6e0dfab4db844` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:06.879412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=fbe18eccf11b4eb9b0e6e0dfab4db844)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:06.880774 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:06.880774 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:06.880774 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:06.882500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:06.967304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2216/4458] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:31:06 2022] PUT /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/fbe18eccf11b4eb9b0e6e0dfab4db844 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:06.973412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:06.996881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823581aa-076a-4b89-8e6a-8d19526b144e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:07.153013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:07.168279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:07.168600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:07.168896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:07.169723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:07.173592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:07.243649 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2243/4459] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:06 2022] POST /identity/v3/users => generated 321 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:07.245384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:07.283422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36195-f4a2-40ef-9d92-7ca44f673051 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:07.301967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:07.303177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:07.303532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:07.303842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/5d1d244a02c54a9bb009b1b81e96db81` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:07.353637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=5d1d244a02c54a9bb009b1b81e96db81)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:07.362338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:07.370100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:07.441305 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2217/4460] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:31:07 2022] PUT /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/5d1d244a02c54a9bb009b1b81e96db81 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:07.445340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:07.516067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:07.588139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabe6e-2fe2-49b8-aad5-be74ed41a0ae tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:07.618439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b462-deb9-47a3-8a22-8463d0d009dc tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:07.634492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:07.635277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:07.635564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:07.635849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:07.639354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:07.641401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:07.686766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:07.687627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:07.688013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:07.688575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] PATH_INFO: `/v3/users/c0ad1c9279a04adfa7f10b1d2e344be4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:07.689781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ad1c9279a04adfa7f10b1d2e344be4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:07.692445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:07.705363 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2218/4461] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:07 2022] POST /identity/v3/users => generated 321 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:07.707025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:07.729822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb36e1-322a-4884-9812-ffff0e65e8dd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:07.738720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:07.739637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:07.739982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:07.740438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/15ba3c8c455c4493ad5794b12e91dba2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:07.765325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=15ba3c8c455c4493ad5794b12e91dba2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:07.768329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:07.774922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ad1c9279a04adfa7f10b1d2e344be4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:07.788236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:07.803800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ad1c9279a04adfa7f10b1d2e344be4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:07.804878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ad1c9279a04adfa7f10b1d2e344be4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:07.806843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ad1c9279a04adfa7f10b1d2e344be4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:07.809841 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2219/4462] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:31:07 2022] PUT /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/15ba3c8c455c4493ad5794b12e91dba2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:07.814603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:07.817271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:07.823843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6ba58071-1427-4ca7-a4b4-af672425b6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ad1c9279a04adfa7f10b1d2e344be4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:07.855271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2244/4463] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:07 2022] DELETE /identity/v3/users/c0ad1c9279a04adfa7f10b1d2e344be4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:07.859664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:07.860383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:07.861771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:07.892632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:07.896009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:07.927312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6844fa-3203-4ac6-889f-5ba0ac780b21 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.023634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.027428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.027715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.027992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.029702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=c88b645b089a454cb287c96dbafc92b3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.030875 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:08.030875 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:08.030875 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:08.032386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.036501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2245/4464] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:31:08.056735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.058462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:08.066939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:08.074554 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2220/4465] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:31:07 2022] GET /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users => generated 1081 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:08.075432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.098116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fd326-21c5-4d37-9e1b-7763e3905dda tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.124579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.126602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.126910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.127195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/fbe18eccf11b4eb9b0e6e0dfab4db844` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.134329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=fbe18eccf11b4eb9b0e6e0dfab4db844)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.135624 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:08.135624 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:08.135624 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:08.136840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.178175 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2221/4466] 10.222.0.23 () {58 vars in 1342 bytes} [Mon Oct 31 05:31:08 2022] HEAD /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/fbe18eccf11b4eb9b0e6e0dfab4db844 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:08.182316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.243572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3aa57-7425-4a3a-ad05-d466cc87bd94 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.272324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.274096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.274594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba259e7f-9030-45fe-835b-482f1d719420 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.280969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.282494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/fbe18eccf11b4eb9b0e6e0dfab4db844` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.322887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=fbe18eccf11b4eb9b0e6e0dfab4db844)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.330685 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:08.330685 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:08.330685 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:08.331981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.334130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.336601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.336601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.336896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.356685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fbe18eccf11b4eb9b0e6e0dfab4db844'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:08.368213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.369554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.386177 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2222/4467] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:31:08 2022] DELETE /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/fbe18eccf11b4eb9b0e6e0dfab4db844 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:08.391837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.404941 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2246/4468] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:31:08.563578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966fb7-8f0e-4394-9e47-0b992d1c1f9c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.578263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.578977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.579272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.579666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/5d1d244a02c54a9bb009b1b81e96db81` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.581638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=5d1d244a02c54a9bb009b1b81e96db81)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.606048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.608369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:08.644227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2223/4469] 10.222.0.23 () {58 vars in 1342 bytes} [Mon Oct 31 05:31:08 2022] HEAD /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/5d1d244a02c54a9bb009b1b81e96db81 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:08.648455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.664121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6cc65-1eff-41ba-9455-fd88197ecb52 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.679130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.679734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.680603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.680603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/5d1d244a02c54a9bb009b1b81e96db81` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.682293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=5d1d244a02c54a9bb009b1b81e96db81)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.683565 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:08.683565 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:31:08.683565 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:31:08.686674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.713011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5d1d244a02c54a9bb009b1b81e96db81'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:08.744914 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2247/4470] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:31:08 2022] DELETE /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/5d1d244a02c54a9bb009b1b81e96db81 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:08.751341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.777177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f22d-e614-4e54-9861-ecb01e254c38 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.905468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:08.905796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:08.906004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:08.906446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/15ba3c8c455c4493ad5794b12e91dba2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:08.912544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=15ba3c8c455c4493ad5794b12e91dba2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:08.914809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:08.948000 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2224/4471] 10.222.0.23 () {58 vars in 1342 bytes} [Mon Oct 31 05:31:08 2022] HEAD /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/15ba3c8c455c4493ad5794b12e91dba2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:08.952204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:08.971698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4752-3f26-4aac-b0f1-f14ea29f9307 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:08.997549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:09.001486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:09.001784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:09.002074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/15ba3c8c455c4493ad5794b12e91dba2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:09.009190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c88b645b089a454cb287c96dbafc92b3, user_id=15ba3c8c455c4493ad5794b12e91dba2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:09.014499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:09.034505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '15ba3c8c455c4493ad5794b12e91dba2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.065458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2248/4472] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:31:08 2022] DELETE /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users/15ba3c8c455c4493ad5794b12e91dba2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:09.067107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:09.084896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7adc-aeac-48d1-b9b9-0ae3a3c15e6d tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:09.198943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:09.199956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:09.200303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:09.200697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:09.203209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=c88b645b089a454cb287c96dbafc92b3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:09.206190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:09.221562 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2225/4473] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:31:09 2022] GET /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3/users => generated 145 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:09.225479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:09.242552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aacc8e-b9b9-40a6-9dec-d96b6fc98314 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:09.249628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:09.250463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:09.251662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:09.251662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users/15ba3c8c455c4493ad5794b12e91dba2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:09.253687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_user(user_id=15ba3c8c455c4493ad5794b12e91dba2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:09.262966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:09.334643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ba3c8c455c4493ad5794b12e91dba2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.367238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ba3c8c455c4493ad5794b12e91dba2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.368745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ba3c8c455c4493ad5794b12e91dba2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.371653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ba3c8c455c4493ad5794b12e91dba2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.391170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ba3c8c455c4493ad5794b12e91dba2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.418110 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2249/4474] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:09 2022] DELETE /identity/v3/users/15ba3c8c455c4493ad5794b12e91dba2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:09.419463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:09.421981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:09.439775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73706179-bf33-4ff9-ba4e-11a4f78c610e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:09.555519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:09.557899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:09.558293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:09.558765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users/5d1d244a02c54a9bb009b1b81e96db81` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:09.560198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5d1d244a02c54a9bb009b1b81e96db81)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:09.563896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:09.597375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:09.664751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1d244a02c54a9bb009b1b81e96db81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.676767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1d244a02c54a9bb009b1b81e96db81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.678259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1d244a02c54a9bb009b1b81e96db81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.678923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1d244a02c54a9bb009b1b81e96db81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.706270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1d244a02c54a9bb009b1b81e96db81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:09.712036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:09.713150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:09.778952 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2226/4475] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:09 2022] DELETE /identity/v3/users/5d1d244a02c54a9bb009b1b81e96db81 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:09.784371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:09.802890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:09.806839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:09.870636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7642b-6835-45a3-b739-131b37cf039c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.004070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fdedf-b6ee-47b0-9bab-10220c3974d0 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.022041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.022805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.023088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.023204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.023385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] PATH_INFO: `/v3/projects/eb83497b67824e9ab4409bd5c51b1a9f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.023965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.026744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.027255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users/fbe18eccf11b4eb9b0e6e0dfab4db844` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.030228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fbe18eccf11b4eb9b0e6e0dfab4db844)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.031132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb83497b67824e9ab4409bd5c51b1a9f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.033439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.036424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.146110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe18eccf11b4eb9b0e6e0dfab4db844'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.147950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb83497b67824e9ab4409bd5c51b1a9f', 'request_id': 'req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.165702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe18eccf11b4eb9b0e6e0dfab4db844'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.167121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe18eccf11b4eb9b0e6e0dfab4db844'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.169110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe18eccf11b4eb9b0e6e0dfab4db844'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.171601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb83497b67824e9ab4409bd5c51b1a9f', 'request_id': 'req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.188212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe18eccf11b4eb9b0e6e0dfab4db844'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.189152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb83497b67824e9ab4409bd5c51b1a9f', 'request_id': 'req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.231378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] The token cache is being invalidate because project eb83497b67824e9ab4409bd5c51b1a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:10.231880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.234928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-600f78cf-870e-454e-8acb-b5a2b2f5bb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:10.252324 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2250/4476] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:09 2022] DELETE /identity/v3/projects/eb83497b67824e9ab4409bd5c51b1a9f => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:10.258283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f78fb-0a3b-4f93-8be7-c9cbb9df97e4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.258283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f78fb-0a3b-4f93-8be7-c9cbb9df97e4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.258283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f78fb-0a3b-4f93-8be7-c9cbb9df97e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.263440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2227/4477] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:09 2022] DELETE /identity/v3/users/fbe18eccf11b4eb9b0e6e0dfab4db844 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:10.266650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.271545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:10.311462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8b4f78fb-0a3b-4f93-8be7-c9cbb9df97e4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:10.314030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b4f78fb-0a3b-4f93-8be7-c9cbb9df97e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:10.314948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:10.376600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0dbb9-7695-4007-9681-8d3237218213 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.382678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.383463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.384009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.384397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c88b645b089a454cb287c96dbafc92b3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.386274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c88b645b089a454cb287c96dbafc92b3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.389118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.441102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2251/4478] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:10.443074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.443373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.443659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.483867 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2228/4479] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:10 2022] DELETE /identity/v3/groups/c88b645b089a454cb287c96dbafc92b3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:10.492208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.492541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:10.494082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:10.494252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:10.507095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:10.631870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2252/4480] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:10.639491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.653385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4559f-d440-4bf3-9a4c-4dc5560f76d4 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.666072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c759c8-7bdb-4369-9a9a-d21f3e6399ef None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.667429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.669481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.670821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.671566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.672242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.674624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.681928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.682598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.682876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.683153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.683817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:10.684119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.686781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.709875 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2229/4481] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/groups => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:10.717419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.720069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2253/4482] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:10.720977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.737022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794014-0f31-4266-b523-f946b4d82eee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.741814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e510c-2ee1-4332-ba98-013a68d23c52 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.749925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.750599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.750905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.751289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.752006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.753944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.755889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.756741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.757259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.757806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.758970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.761666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.778039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2230/4483] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/groups => generated 326 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:10.782267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.796195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91baf1b-0365-4b57-8a1c-4e22d8477508 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.801843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.802388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.802768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.803058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.803710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.806711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.826309 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2231/4484] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/groups => generated 325 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:10.829896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2254/4485] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:10.833578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.837025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:10.846435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46cf8a-bec8-4f66-8eeb-7fc5bada00a5 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:10.921461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:10.964069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:10.964723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:10.965017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:10.965549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:10.966230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:10.972968 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:10.972968 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:31:10.972968 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:31:10.975037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:10.986090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2232/4486] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 31 05:31:10 2022] GET /identity/v3/groups => generated 1488 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:10.990029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.002088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14630d-c01f-431f-a4c1-4dfba42c8618 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.008433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.009389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.009927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.010448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/0198a50b93fe481eab80a128c345d268` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.010975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca50107-e38d-4dfe-8cc0-a70bc4802f25 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.019558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0198a50b93fe481eab80a128c345d268)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.022303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.024000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.025355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.025661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.025943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.030062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.032758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.097589 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2233/4487] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:10 2022] DELETE /identity/v3/groups/0198a50b93fe481eab80a128c345d268 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:11.099119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2255/4488] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:10 2022] POST /identity/v3/users => generated 284 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:11.100254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.101725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.117803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1a91-e2c9-40cb-bc30-1ac0b2a90b17 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.218244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee799d37-ffc8-4adc-9393-1262ab6ab9cd tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.228036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.229316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.229857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.229857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.230562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.237027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.245146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.246055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.246382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.246665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/4518c94e427d4102b7cac673774db588` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.265398 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2234/4489] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:11.265618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4518c94e427d4102b7cac673774db588)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.265707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.265784 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:31:11.265784 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:31:11.265784 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:31:11.267318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.281749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:11.301300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ef71-a071-4e77-97b2-192ea4a743c7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.308246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.309239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.309753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.314837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.316517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.319426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.333529 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2235/4490] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:11.339229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.354546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37683f8-c337-4d30-a043-62bc09f94dc5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.362659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04301ad-b2ad-44e8-81ac-71328ec4c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.362659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04301ad-b2ad-44e8-81ac-71328ec4c278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.363909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04301ad-b2ad-44e8-81ac-71328ec4c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.364362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04301ad-b2ad-44e8-81ac-71328ec4c278 admin admin] PATH_INFO: `/v3/projects/eee27fda19744cecbe58216734789994/users/872baa14b3cc4791b7fca28a4e4d4a31/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.383747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04301ad-b2ad-44e8-81ac-71328ec4c278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee27fda19744cecbe58216734789994, user_id=872baa14b3cc4791b7fca28a4e4d4a31, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.386666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04301ad-b2ad-44e8-81ac-71328ec4c278 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.389855 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2256/4491] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:11 2022] DELETE /identity/v3/groups/4518c94e427d4102b7cac673774db588 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:11.394623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.420298 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2236/4492] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:11 2022] PUT /identity/v3/projects/eee27fda19744cecbe58216734789994/users/872baa14b3cc4791b7fca28a4e4d4a31/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:11.423676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.423965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.425855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.469659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:11.478166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:11.544902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115325dc-de6f-4634-b337-ee8f38af528b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.555926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:11.592603 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2237/4493] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:11.633452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.635819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:11.674766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.675498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.675791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.676075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/ea72d605b6bd45adb7c0bea7eb625f8d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.691322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ea72d605b6bd45adb7c0bea7eb625f8d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.693336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.786731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39de7da-1e14-456a-8a55-f3c1e844a99c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.790519 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2257/4494] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:11 2022] DELETE /identity/v3/groups/ea72d605b6bd45adb7c0bea7eb625f8d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:11.795743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:11.839054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:11.880099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.881049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.881550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.882017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.903678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5741ac-37a3-4d1e-9a36-cbaf21b81dad tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:11.913290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:11.913949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:11.914248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:11.914539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:11.915195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:11.921934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:11.996512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2258/4495] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:11 2022] POST /identity/v3/users => generated 323 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:12.000198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.029276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea26b54-bec9-413b-b2cd-b4c6c0c4131b tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:12.032204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.035743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.039486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:12.040158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:12.040866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:12.042355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:12.042913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.054047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2238/4496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:31:12.058077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.093419 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2259/4497] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:11 2022] POST /identity/v3/groups => generated 326 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:12.097164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.125783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9aebb-41c3-4950-9b50-44ee19abe926 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:12.137199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:12.139149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:12.139764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:12.141615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c822cbf4754f4379a517c677b904843b/users/d370be65f7f841d88505abc15f049cbd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:12.188093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c822cbf4754f4379a517c677b904843b, user_id=d370be65f7f841d88505abc15f049cbd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.190130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.258936 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2239/4498] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:31:12 2022] PUT /identity/v3/groups/c822cbf4754f4379a517c677b904843b/users/d370be65f7f841d88505abc15f049cbd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:12.260994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.293682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a089-7125-4987-9599-ca6be7fed61c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:12.437622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:12.438671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:12.439071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:12.439533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:12.441723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.444256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.473777 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2260/4499] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:31:12 2022] POST /identity/v3/groups => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:12.477777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.497531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9429-fc2f-48c1-b07f-232492e10e0e tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:12.504213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:12.504909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:12.505199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:12.505488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/9ff00c24a29949d89ba08a89f741c8a6/users/d370be65f7f841d88505abc15f049cbd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:12.520934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9ff00c24a29949d89ba08a89f741c8a6, user_id=d370be65f7f841d88505abc15f049cbd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.524296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.549654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:12.579162 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2240/4500] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:31:12 2022] PUT /identity/v3/groups/9ff00c24a29949d89ba08a89f741c8a6/users/d370be65f7f841d88505abc15f049cbd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:12.583072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.598796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c3e5-d896-4d74-8383-65235aebb02c tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:12.726833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:12.728656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:12.729021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:12.729317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users/d370be65f7f841d88505abc15f049cbd/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:12.734378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=d370be65f7f841d88505abc15f049cbd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.740430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.807329 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2261/4501] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:31:12 2022] GET /identity/v3/users/d370be65f7f841d88505abc15f049cbd/groups => generated 839 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:12.808981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.829470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e57a3-aa23-4203-a112-0127802e5b35 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:12.845309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:12.846626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:12.847135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:12.847631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/9ff00c24a29949d89ba08a89f741c8a6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:12.849181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9ff00c24a29949d89ba08a89f741c8a6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:12.859662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:12.958362 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2241/4502] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:12 2022] DELETE /identity/v3/groups/9ff00c24a29949d89ba08a89f741c8a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:12.959539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:12.986282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337085-025d-4118-8b32-ba6d3ce6d0ee tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:13.048054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:13.162834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81dbe-9ed1-4634-9cb4-663fc93330d3 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:13.164640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81dbe-9ed1-4634-9cb4-663fc93330d3 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:13.165474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81dbe-9ed1-4634-9cb4-663fc93330d3 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:13.165771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81dbe-9ed1-4634-9cb4-663fc93330d3 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/groups/c822cbf4754f4379a517c677b904843b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:13.167581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81dbe-9ed1-4634-9cb4-663fc93330d3 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c822cbf4754f4379a517c677b904843b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:13.169960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81dbe-9ed1-4634-9cb4-663fc93330d3 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:13.278659 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2262/4503] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:31:12 2022] DELETE /identity/v3/groups/c822cbf4754f4379a517c677b904843b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:13.283246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:13.309152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed9940-64fd-4e0e-a9ac-1015df02d4e1 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:13.484216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:13.485698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:13.485996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:13.486403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/users/d370be65f7f841d88505abc15f049cbd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:13.487656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d370be65f7f841d88505abc15f049cbd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:13.489721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:13.515447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:13.515718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:13.516016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:13.581695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd370be65f7f841d88505abc15f049cbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.583395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] MFA Rules not processed for user `0b80262470174f089095460a99b91563`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:13.585902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:13.602178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd370be65f7f841d88505abc15f049cbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.603069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd370be65f7f841d88505abc15f049cbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.604221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd370be65f7f841d88505abc15f049cbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.620367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd370be65f7f841d88505abc15f049cbd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.675592 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2242/4504] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:13 2022] DELETE /identity/v3/users/d370be65f7f841d88505abc15f049cbd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:13.681479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:13.683887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:13.750287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2263/4505] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:13.754634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:SELECT=84,keystone:DELETE=14 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:13.760254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:13.762225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:13.829293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b1cc4-a1ad-42ba-8292-b01fb388bed9 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:13.838886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:13.839699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:13.840190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:13.840481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/domains/f5f67925715e43cc92befb9643059784` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:13.843244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f5f67925715e43cc92befb9643059784)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:13.850653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:13.917117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f5f67925715e43cc92befb9643059784'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.918339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f5f67925715e43cc92befb9643059784'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:13.941755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58660-7c70-417e-88e9-96477f4333c7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:13.962887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:14.037240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f5f67925715e43cc92befb9643059784'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.039169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f5f67925715e43cc92befb9643059784'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.047605 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2243/4506] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:31:13 2022] PATCH /identity/v3/domains/f5f67925715e43cc92befb9643059784 => generated 277 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:14.051504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:14.053572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:14.124745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:14.125442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:14.125728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:14.126024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:14.130284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:14.227590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060b4e7-5348-4b59-b0af-e8dcb91f0d19 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:14.253749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133f130f27be47e3ab09f03a858db60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d09c6c70c2b471682fd8dd759c4a5e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:14.255276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:14.255631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:14.255902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] PATH_INFO: `/v3/domains/f5f67925715e43cc92befb9643059784` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:14.291646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f5f67925715e43cc92befb9643059784)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:14.293951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:14.306263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:14.313593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:14.329401 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2264/4507] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:31:14.364773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f5f67925715e43cc92befb9643059784'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.391226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f5f67925715e43cc92befb9643059784'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.500819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f67925715e43cc92befb9643059784', 'request_id': 'req-1154c5c4-e193-468e-b68c-5d08aaab86c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.511094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:14.515523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f67925715e43cc92befb9643059784', 'request_id': 'req-1154c5c4-e193-468e-b68c-5d08aaab86c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.529783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f67925715e43cc92befb9643059784', 'request_id': 'req-1154c5c4-e193-468e-b68c-5d08aaab86c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.560120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] The token cache is being invalidate because project f5f67925715e43cc92befb9643059784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:14.561271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.563772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.581049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f5f67925715e43cc92befb9643059784', 'request_id': 'req-1154c5c4-e193-468e-b68c-5d08aaab86c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.582481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f5f67925715e43cc92befb9643059784', 'request_id': 'req-1154c5c4-e193-468e-b68c-5d08aaab86c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.583378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1154c5c4-e193-468e-b68c-5d08aaab86c7 tempest-GroupsV3TestJSON-87866396 tempest-GroupsV3TestJSON-87866396-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f5f67925715e43cc92befb9643059784', 'request_id': 'req-1154c5c4-e193-468e-b68c-5d08aaab86c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:14.610795 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2244/4508] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:31:14 2022] DELETE /identity/v3/domains/f5f67925715e43cc92befb9643059784 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:14.616141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:14.617631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:14.806961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688470a-d39a-4faa-8455-8f6309302de7 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:14.950479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:14.965075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:14.966054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:14.966518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:14.967154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] PATH_INFO: `/v3/users/a860fea5468e442b874734ef6e5444f6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:14.968821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a860fea5468e442b874734ef6e5444f6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:14.972232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:15.077900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a860fea5468e442b874734ef6e5444f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:15.097887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a860fea5468e442b874734ef6e5444f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:15.099055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a860fea5468e442b874734ef6e5444f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:15.099692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a860fea5468e442b874734ef6e5444f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:15.109061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a860fea5468e442b874734ef6e5444f6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:15.137568 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2265/4509] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:14 2022] DELETE /identity/v3/users/a860fea5468e442b874734ef6e5444f6 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:15.138968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:15.139266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:15.139544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:15.176256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:15.179259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:15.339488 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2245/4510] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:31:15.351549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:15.355246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:15.476907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd0e8-656d-4521-ae8c-5de630ecc6a8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:15.491091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:15.492029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:15.492471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:15.492902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:15.509855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:15.511567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:15.524382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2266/4511] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:17.523385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:17.526800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:17.563212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec493511-83d8-4036-9810-97ff2b353d89 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:17.574207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:17.577858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:17.579079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:17.579379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] PATH_INFO: `/v3/projects/9247d16b390e43adb4b51b275fd43876` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:17.583572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9247d16b390e43adb4b51b275fd43876)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:17.585593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:17.743420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9247d16b390e43adb4b51b275fd43876', 'request_id': 'req-1560aac2-4ab0-406f-bbc5-302add23cd68'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:17.757605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9247d16b390e43adb4b51b275fd43876', 'request_id': 'req-1560aac2-4ab0-406f-bbc5-302add23cd68'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:17.778749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9247d16b390e43adb4b51b275fd43876', 'request_id': 'req-1560aac2-4ab0-406f-bbc5-302add23cd68'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:17.803088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] The token cache is being invalidate because project 9247d16b390e43adb4b51b275fd43876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:17.803514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:17.804215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:17.812732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:17.814361 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2246/4512] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:17 2022] DELETE /identity/v3/projects/9247d16b390e43adb4b51b275fd43876 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:17.832003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d333bd8-4918-4c00-a868-c1c6d47e61d8 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:17.949169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:17.949787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:17.950068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:17.950370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] PATH_INFO: `/v3/users/133f130f27be47e3ab09f03a858db60f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:17.959923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133f130f27be47e3ab09f03a858db60f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:17.962133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:18.050288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:18.134629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133f130f27be47e3ab09f03a858db60f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:18.181205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133f130f27be47e3ab09f03a858db60f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:18.182240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133f130f27be47e3ab09f03a858db60f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:18.183689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133f130f27be47e3ab09f03a858db60f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:18.206337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7082230b-2e77-4505-b0f3-178f7c7bf1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133f130f27be47e3ab09f03a858db60f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:18.236707 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2267/4513] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:17 2022] DELETE /identity/v3/users/133f130f27be47e3ab09f03a858db60f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:20.056097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:20.057740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:20.087940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560aac2-4ab0-406f-bbc5-302add23cd68 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:20.211911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:20.269284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:20.271812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:20.272112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:20.272379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] PATH_INFO: `/v3/projects/9d09c6c70c2b471682fd8dd759c4a5e1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:20.280095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d09c6c70c2b471682fd8dd759c4a5e1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:20.290903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:20.391735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d09c6c70c2b471682fd8dd759c4a5e1', 'request_id': 'req-d8f9a548-b3ed-4fa5-9f83-071e5a900543'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:20.398457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d09c6c70c2b471682fd8dd759c4a5e1', 'request_id': 'req-d8f9a548-b3ed-4fa5-9f83-071e5a900543'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:20.422036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d09c6c70c2b471682fd8dd759c4a5e1', 'request_id': 'req-d8f9a548-b3ed-4fa5-9f83-071e5a900543'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:20.449597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] The token cache is being invalidate because project 9d09c6c70c2b471682fd8dd759c4a5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:20.449974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:20.451452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8f9a548-b3ed-4fa5-9f83-071e5a900543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:20.458062 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2247/4514] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:20 2022] DELETE /identity/v3/projects/9d09c6c70c2b471682fd8dd759c4a5e1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:20.459978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:20.460512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:20.460611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:20.502921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:20.504186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:20.723332 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2268/4515] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:20.733077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:20.733695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:20.733941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:20.769572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:20.772090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:20.800366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:20.824798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2248/4516] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:20.829214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c63570-fb07-43e7-a77b-cd5088116c34 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:20.844072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:20.845097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:20.845464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:20.845866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:20.846655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:20.847036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:20.849796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:20.899873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2269/4517] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:20.901328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:20.914090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4dcc4-7166-4b9b-89ed-18ffc4fc39db None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:20.921189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:20.921840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:20.922127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:20.922446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:20.923136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:20.925387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:21.001662 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2249/4518] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:20 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:21.003603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.020543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399caf-5464-452a-b141-8e26560a5b8b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.156467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.157260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.157680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.158060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.159014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:21.162564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:21.203982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.204950 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2270/4519] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:21 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:21.221389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944aad3-c8bd-418b-b1e2-a25154a8f383 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.228821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.229793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.230081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.230422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.231869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:21.233765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:21.249948 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2250/4520] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:31:21.254195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.270020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ec17-76d3-41be-934a-ea24197a3235 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.281222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d293c-c240-4dcf-a585-014a205f8e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.282292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d293c-c240-4dcf-a585-014a205f8e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.282794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d293c-c240-4dcf-a585-014a205f8e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.283368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d293c-c240-4dcf-a585-014a205f8e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.284232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d293c-c240-4dcf-a585-014a205f8e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:21.286775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d293c-c240-4dcf-a585-014a205f8e0a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:21.366339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:21.416060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.431743 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2271/4521] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:21.439699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa5da8-6e84-4897-8be4-231ad9b925c9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.456979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76707fa2-29ed-4078-ba46-2ae44258d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.458350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76707fa2-29ed-4078-ba46-2ae44258d494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.458912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76707fa2-29ed-4078-ba46-2ae44258d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.459571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76707fa2-29ed-4078-ba46-2ae44258d494 admin admin] PATH_INFO: `/v3/projects/e87d3825b2404e59a924f6d6e8506179/users/5ba1dd1a41a54b5097f9649599e78204/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.500509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76707fa2-29ed-4078-ba46-2ae44258d494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87d3825b2404e59a924f6d6e8506179, user_id=5ba1dd1a41a54b5097f9649599e78204, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:21.505494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76707fa2-29ed-4078-ba46-2ae44258d494 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:21.532779 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2251/4522] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:21 2022] PUT /identity/v3/projects/e87d3825b2404e59a924f6d6e8506179/users/5ba1dd1a41a54b5097f9649599e78204/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:21.545286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.546526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.547085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.596549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] MFA Rules not processed for user `5ba1dd1a41a54b5097f9649599e78204`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:21.598231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:21.720979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.721226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.721328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.755886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] MFA Rules not processed for user `0b80262470174f089095460a99b91563`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:21.757288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:21.788661 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2272/4523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:21.790442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.809048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c93f-6c63-44ed-896e-a36c0138b685 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.834883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5419969-6680-4af8-bfdd-7a9645ae14ec tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba1dd1a41a54b5097f9649599e78204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e87d3825b2404e59a924f6d6e8506179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.835524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5419969-6680-4af8-bfdd-7a9645ae14ec tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.836749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5419969-6680-4af8-bfdd-7a9645ae14ec tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.836749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5419969-6680-4af8-bfdd-7a9645ae14ec tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] PATH_INFO: `/v3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.842233 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2273/4524] 10.222.0.23 () {58 vars in 1104 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/v3 => generated 255 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:21.845366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5419969-6680-4af8-bfdd-7a9645ae14ec tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.881755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5419969-6680-4af8-bfdd-7a9645ae14ec tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.892274 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2252/4525] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:21.905424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef766607-ea3d-49d8-986e-202199f13ad2 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba1dd1a41a54b5097f9649599e78204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e87d3825b2404e59a924f6d6e8506179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.906353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766607-ea3d-49d8-986e-202199f13ad2 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.907036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766607-ea3d-49d8-986e-202199f13ad2 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.909100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766607-ea3d-49d8-986e-202199f13ad2 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] PATH_INFO: `/v3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.914442 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2274/4526] 10.222.0.23 () {58 vars in 1104 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/v3 => generated 255 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:21.915635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:21.938322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db952cb-b850-4ff2-819b-049fc52b274d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:21.963114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf11ac-c4ab-4dd8-85cd-2db5ccd41e01 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba1dd1a41a54b5097f9649599e78204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e87d3825b2404e59a924f6d6e8506179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:21.969840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf11ac-c4ab-4dd8-85cd-2db5ccd41e01 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.970167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf11ac-c4ab-4dd8-85cd-2db5ccd41e01 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.970465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf11ac-c4ab-4dd8-85cd-2db5ccd41e01 tempest-TestApiDiscovery-930009495 tempest-TestApiDiscovery-930009495-project] PATH_INFO: `/v3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.975692 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2253/4527] 10.222.0.23 () {58 vars in 1104 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/v3 => generated 255 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:31:21.977420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b06e-626f-45a5-a2f4-9fbf838ceb5c None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.977894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b06e-626f-45a5-a2f4-9fbf838ceb5c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.978410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b06e-626f-45a5-a2f4-9fbf838ceb5c None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.979950 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2275/4528] 10.222.0.23 () {56 vars in 895 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:31:21.985955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2acad-4253-4d67-81cf-d535803d3c2c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:21.987481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2acad-4253-4d67-81cf-d535803d3c2c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:21.987797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2acad-4253-4d67-81cf-d535803d3c2c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:21.996796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62b06e-626f-45a5-a2f4-9fbf838ceb5c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:22.000368 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2254/4529] 10.222.0.23 () {56 vars in 895 bytes} [Mon Oct 31 05:31:21 2022] GET /identity/ => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:31:22.184386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62b06e-626f-45a5-a2f4-9fbf838ceb5c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:22.196819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:22.197548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:22.197835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:22.198101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] PATH_INFO: `/v3/users/5ba1dd1a41a54b5097f9649599e78204` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:22.199887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba1dd1a41a54b5097f9649599e78204)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:22.212539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:22.335421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba1dd1a41a54b5097f9649599e78204'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:22.382270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba1dd1a41a54b5097f9649599e78204'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:22.386659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba1dd1a41a54b5097f9649599e78204'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:22.389201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba1dd1a41a54b5097f9649599e78204'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:22.409349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba1dd1a41a54b5097f9649599e78204'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:22.448863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:22.455023 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2276/4530] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:21 2022] DELETE /identity/v3/users/5ba1dd1a41a54b5097f9649599e78204 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:22.456792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:22.457850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:22.458314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:22.517945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:22.521230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:22.550099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:22.663576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2255/4531] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:22.703097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:22.704598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:22.822730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:22.839768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddd695-6b57-4d1d-9556-8851ec4dbbc0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:22.849408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:22.850100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:22.850392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:22.850667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:22.855798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:22.865494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf622-09df-4e5d-b883-3fc50e708e80 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:22.884883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:22.885683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:22.886090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:22.887086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:22.932227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:22.939288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:22.966979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2277/4532] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:23.042110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:23.043634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:23.065944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2256/4533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:23.805680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:23.807548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:23.834564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9cff-e77b-4300-a8e0-6864238dcf50 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:23.854331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:23.856641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:23.857757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:23.858177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:23.864953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:23.895272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:23.900524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a832-5f15-48e2-b78c-b88eb6c34fa4 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:23.938355 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2278/4534] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:23.942223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:23.943759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:23.978067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87631b-8617-4571-aac8-94502ee6f445 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:24.001046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:24.002263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:24.002701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:24.003231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] PATH_INFO: `/v3/projects/e87d3825b2404e59a924f6d6e8506179` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:24.019022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87d3825b2404e59a924f6d6e8506179)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:24.021039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:24.203347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87d3825b2404e59a924f6d6e8506179', 'request_id': 'req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:24.219268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87d3825b2404e59a924f6d6e8506179', 'request_id': 'req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:24.244319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87d3825b2404e59a924f6d6e8506179', 'request_id': 'req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:24.284758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] The token cache is being invalidate because project e87d3825b2404e59a924f6d6e8506179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:24.285058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:24.289971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c02d0d-f5ae-49b9-8b1b-1b4f01cc9415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:24.293296 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2257/4535] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:23 2022] DELETE /identity/v3/projects/e87d3825b2404e59a924f6d6e8506179 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:24.298223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:24.298756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:24.299226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:24.387084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:24.389194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:24.564677 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2279/4536] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:24.573338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:24.573338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:24.573573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:24.629248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:24.630521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:24.673469 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2258/4537] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:24.676993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:24.695945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2ca1-d635-4383-ac9f-dc7434f3e1af None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:24.720781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:24.721432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:24.721714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:24.721988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:24.722709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:24.723015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:24.730872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:24.776581 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2280/4538] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:24.781780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:24.801508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788b2c1-a6b0-40ff-a391-41e69c781755 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:24.814743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:24.815620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:24.816107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:24.816586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:24.817480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:24.822869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:24.884488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:24.937440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2259/4539] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:24 2022] POST /identity/v3/projects => generated 393 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:24.941377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:24.956936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93070a-09dc-4390-ab97-043ef50fbfad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:25.167901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:25.170490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:25.170807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:25.171097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:25.171770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:25.179276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:25.239258 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2281/4540] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:24 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:25.240781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:25.260936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f60cc-09b5-4299-97f5-83113858c1a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:25.282592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:25.283363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:25.285223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:25.286013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:25.288196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:25.296194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:25.325040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2260/4541] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:25.329820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:25.344853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2e4e1-8129-4a80-b776-d26a7b2f45be admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:25.358653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78ed94-929a-4942-83a8-cc67842b498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:25.359390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78ed94-929a-4942-83a8-cc67842b498e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:25.359796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78ed94-929a-4942-83a8-cc67842b498e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:25.360144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78ed94-929a-4942-83a8-cc67842b498e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:25.362541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78ed94-929a-4942-83a8-cc67842b498e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:25.368408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78ed94-929a-4942-83a8-cc67842b498e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:25.370337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:25.396629 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2282/4542] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:25.400825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:25.416263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334967-1577-48c1-bb1a-0a9064d1a6f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:25.426676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:25.429042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:25.430616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:25.431009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] PATH_INFO: `/v3/projects/b7f5756c06d34c1db9d904886adc5e21/users/9e0d548aecdf4774b44defd9278e9e6e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:25.501394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f5756c06d34c1db9d904886adc5e21, user_id=9e0d548aecdf4774b44defd9278e9e6e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:25.505023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:25.528564 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2261/4543] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:25 2022] PUT /identity/v3/projects/b7f5756c06d34c1db9d904886adc5e21/users/9e0d548aecdf4774b44defd9278e9e6e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:25.540092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:25.540858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:25.541428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:25.609399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] MFA Rules not processed for user `9e0d548aecdf4774b44defd9278e9e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:25.617973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:25.808379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:25.809984 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2283/4544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:25.837819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52862a-b712-402e-9f76-54f878b1d2f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:25.915124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90155-a076-47c5-8cbb-b1ec984f8c95 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:25.915815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90155-a076-47c5-8cbb-b1ec984f8c95 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:25.916106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90155-a076-47c5-8cbb-b1ec984f8c95 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:25.916388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90155-a076-47c5-8cbb-b1ec984f8c95 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:25.917071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90155-a076-47c5-8cbb-b1ec984f8c95 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:25.925102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90155-a076-47c5-8cbb-b1ec984f8c95 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:26.092563 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2262/4545] 10.222.0.23 () {60 vars in 1314 bytes} [Mon Oct 31 05:31:25 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 788 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:26.097270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:26.110843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c552879-6763-4771-b0d6-f52f9d6391d7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:26.124529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:26.125548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:26.125837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:26.126215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/f06e2fbb535d449682d12894ee74bb22` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:26.146796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:get_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=f06e2fbb535d449682d12894ee74bb22)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:26.148800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:26.157164 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2284/4546] 10.222.0.23 () {58 vars in 1392 bytes} [Mon Oct 31 05:31:26 2022] GET /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/f06e2fbb535d449682d12894ee74bb22 => generated 688 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:26.159219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:26.160473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:26.160985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:26.188107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] MFA Rules not processed for user `9e0d548aecdf4774b44defd9278e9e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:26.192639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:26.356313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:26.362539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:26.440772 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2263/4547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:26 2022] POST /identity/v3/auth/tokens => generated 3426 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 05:31:26.441783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:26.458959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:26.476327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0e4af-de9d-4f2f-8ab6-ba2012ddefaa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:26.491146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:26.491841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:26.494021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:26.494427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/f06e2fbb535d449682d12894ee74bb22` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:26.498287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=f06e2fbb535d449682d12894ee74bb22)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:26.499898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:26.558092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2264/4548] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:26 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/f06e2fbb535d449682d12894ee74bb22 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:26.562430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:26.563636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2d08-ffb5-4b16-85d6-eeb54e376a82 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:26.608732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:26.612104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:26.612423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:26.612710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] PATH_INFO: `/v3/users/3e16b803125f408c9a5d32a3dba1b4a5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:26.616197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e16b803125f408c9a5d32a3dba1b4a5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:26.621476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b3add-d988-4c16-935f-9971278b9a78 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:26.624517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:26.634524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:26.635512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:26.636009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:26.636302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:26.637631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:26.643280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:26.769553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e16b803125f408c9a5d32a3dba1b4a5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:26.813701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e16b803125f408c9a5d32a3dba1b4a5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:26.814626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e16b803125f408c9a5d32a3dba1b4a5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:26.815521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e16b803125f408c9a5d32a3dba1b4a5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:26.832607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e16b803125f408c9a5d32a3dba1b4a5'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:26.837121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:26.863287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2285/4549] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:26 2022] DELETE /identity/v3/users/3e16b803125f408c9a5d32a3dba1b4a5 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:27.039004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:27.040132 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2265/4550] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Oct 31 05:31:26 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 920 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:27.040518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:27.226218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047bf14-8a40-4498-a2c1-7488b393b244 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:27.237142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:27.238256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:27.238767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:27.239275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/22106e22bc1149dcacf9aafe82ddcc32` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:27.270488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=22106e22bc1149dcacf9aafe82ddcc32)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:27.272467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:27.321112 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2286/4551] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:27 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/22106e22bc1149dcacf9aafe82ddcc32 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:27.327419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:27.340567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7fd7-a903-4499-a97f-8f3144cb110a tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:27.358897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:27.362069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:27.362681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:27.363202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:27.364173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:27.366811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:27.505191 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2266/4552] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Oct 31 05:31:27 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 812 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:27.505962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:27.520554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c507d7-4d82-4560-886e-2c60b9750a7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:27.531707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:27.532539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:27.532923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:27.533304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/a19d14b839cb498aa52448e1ca549250` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:27.555642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=a19d14b839cb498aa52448e1ca549250)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:27.557126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:27.605089 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2287/4553] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:27 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/a19d14b839cb498aa52448e1ca549250 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:27.608165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:27.626083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa9cb-fcd7-473a-bfba-04065d4fbd7f tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:27.630925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:27.631666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:27.631960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:27.632342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:27.633312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:27.634944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:27.802245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=2,keystone:INSERT=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:27.823246 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2267/4554] 10.222.0.23 () {60 vars in 1314 bytes} [Mon Oct 31 05:31:27 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 789 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:27.827669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:27.844512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17dcf4-1396-4497-8a32-e1407296b017 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:27.856394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:27.857535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:27.872196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:27.873744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:27.873957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:27.875190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:27.975021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:27.976819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:28.027020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2288/4555] 10.222.0.23 () {60 vars in 1314 bytes} [Mon Oct 31 05:31:27 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 789 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:28.027988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.053707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bcaa1-550a-40e9-ae6c-acc67dd41926 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.063711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.066370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.066651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.066928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.068498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.074062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.098284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2289/4556] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 31 05:31:28 2022] GET /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 1502 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:28.104011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.127865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5251473-c4a3-446a-a0a7-91880a8c3cba tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.139746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.140422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.140705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.140983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/ba0d222b06f440629593b427f6f42025` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.147013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860915e4-ff2a-46d6-8d1c-8b3b4beca3cf tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.156517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=ba0d222b06f440629593b427f6f42025)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.159308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.159981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.160260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.160533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] PATH_INFO: `/v3/projects/0c064c36769442798f18fd62bdf45669` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.161410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.163074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c064c36769442798f18fd62bdf45669)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.164977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.168010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:DELETE=6,keystone:SELECT=91 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:28.210716 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2290/4557] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:28 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/ba0d222b06f440629593b427f6f42025 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:28.211686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.244545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8aaa7-3597-4db1-bafd-98a9b6f477cb tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.254040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.254681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.254966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.255307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/e3c35d2ffd4947cb8f6422768f0c0577` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.279351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=e3c35d2ffd4947cb8f6422768f0c0577)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.280874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.295345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c064c36769442798f18fd62bdf45669', 'request_id': 'req-f7229d32-3447-48f8-990e-66775d4356e9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:28.306163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c064c36769442798f18fd62bdf45669', 'request_id': 'req-f7229d32-3447-48f8-990e-66775d4356e9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:28.321097 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2291/4558] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:28 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/e3c35d2ffd4947cb8f6422768f0c0577 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:28.329013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c064c36769442798f18fd62bdf45669', 'request_id': 'req-f7229d32-3447-48f8-990e-66775d4356e9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:28.330256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.350490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255e74-cfe9-4f4c-a78e-0dbfb1ed88a1 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.353357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] The token cache is being invalidate because project 0c064c36769442798f18fd62bdf45669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:28.354137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:28.355373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f7229d32-3447-48f8-990e-66775d4356e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:28.363796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2268/4559] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:27 2022] DELETE /identity/v3/projects/0c064c36769442798f18fd62bdf45669 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:28.365504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7f48-870f-4d02-9043-ff8c5b4b9ef9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.386438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7f48-870f-4d02-9043-ff8c5b4b9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.391351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7f48-870f-4d02-9043-ff8c5b4b9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.471766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9d0d7f48-870f-4d02-9043-ff8c5b4b9ef9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:28.478648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9d0d7f48-870f-4d02-9043-ff8c5b4b9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:28.584249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.585262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.585711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.586169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.587034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.588475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.660187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2269/4560] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:28.668536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.669067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.669263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.746861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:28.754233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:28.762027 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2292/4561] 10.222.0.23 () {60 vars in 1314 bytes} [Mon Oct 31 05:31:28 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 788 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:28.763482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.768417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:28.776276 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2270/4562] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:28.782945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.796165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae604-c5f8-499f-bd1a-488c7713a5d4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.806876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.807432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550d85-4903-4cb0-80e4-3e2c9ceaf3a8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.807762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.808146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.808546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.809323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:create_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.811495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.826380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.827254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.827526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.827805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.835178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:28.835741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.840612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.872223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2271/4563] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:28.876714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.904231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993811a0-f20d-4a97-9738-c7fb01f4bebc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.916248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.917465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.921769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.922567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.923446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:28.925534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:28.942859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:28.955569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:28.966132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2293/4564] 10.222.0.23 () {60 vars in 1314 bytes} [Mon Oct 31 05:31:28 2022] POST /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials => generated 789 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:28.967336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:28.988884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ffaec-0dd0-4a60-95fe-755ef2620f11 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:28.997814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:28.998656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:28.998942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:28.999222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:28.999877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Adding query filter params (name=tempest-application_credential-1386695111) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:29.000197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.005655 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2272/4565] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:28 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:29.007053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.010243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.053735 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2294/4566] 10.222.0.23 () {58 vars in 1386 bytes} [Mon Oct 31 05:31:28 2022] GET /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials?name=tempest-application_credential-1386695111 => generated 887 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:29.054768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.090500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e3cd-7679-4b70-8ab1-e06d0d76a302 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.180590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfd78e-01c0-4b28-9113-336140cd491c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.200601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.201707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.202563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.202963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.203731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.206613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.243469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.244172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.244461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.244745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/bfae6ada0c3f4931a11408771d800f66` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.262486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2273/4567] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:29 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:29.263572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.268543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=bfae6ada0c3f4931a11408771d800f66)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.270592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.295309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299f88a-03d2-4f79-b494-0fa8cb75dadb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.305083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.306758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.307838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.308631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.311439 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2295/4568] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:29 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/bfae6ada0c3f4931a11408771d800f66 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:29.315095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.315644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.317824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.334734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d2c3e-0a2e-408c-b9cb-c25697e18295 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.352461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0d548aecdf4774b44defd9278e9e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7f5756c06d34c1db9d904886adc5e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.353149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.353433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.353710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/a75580267dff49ce9e5c9e5dfda102c5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.362507 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2274/4569] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:29.363793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.373295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9e0d548aecdf4774b44defd9278e9e6e, application_credential_id=a75580267dff49ce9e5c9e5dfda102c5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.375781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.388413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687768-f8b8-4c88-9a16-71f987a6a643 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.406427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.408393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.410300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.410652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.414291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.416247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.428444 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2296/4570] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:31:29 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e/application_credentials/a75580267dff49ce9e5c9e5dfda102c5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:29.435712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.437708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:29.445556 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2275/4571] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:29.447035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.470450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeee4c-9320-4222-a651-46cf5d21534a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.474864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1db05-5767-4866-baab-0dc8489d4fd4 tempest-ApplicationCredentialsV3Test-1778815060 tempest-ApplicationCredentialsV3Test-1778815060-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:29.478820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62798-ba6e-49a3-838f-73c183d9d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.479723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62798-ba6e-49a3-838f-73c183d9d67f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.480260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62798-ba6e-49a3-838f-73c183d9d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.480868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62798-ba6e-49a3-838f-73c183d9d67f admin admin] PATH_INFO: `/v3/projects/e4f08b6c32e6462a8a4e75d9152ea49a/users/e43d96b4e15e444da73b993abe43a1d8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.493142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:29.493727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.494258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.494518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] PATH_INFO: `/v3/users/9e0d548aecdf4774b44defd9278e9e6e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.503052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0d548aecdf4774b44defd9278e9e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.510968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba62798-ba6e-49a3-838f-73c183d9d67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f08b6c32e6462a8a4e75d9152ea49a, user_id=e43d96b4e15e444da73b993abe43a1d8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:29.515587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.517787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba62798-ba6e-49a3-838f-73c183d9d67f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:29.563891 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2276/4572] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:29 2022] PUT /identity/v3/projects/e4f08b6c32e6462a8a4e75d9152ea49a/users/e43d96b4e15e444da73b993abe43a1d8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:29.570132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fc31-e474-4c39-a978-13bf2cebd4e3 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.570856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fc31-e474-4c39-a978-13bf2cebd4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.571508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fc31-e474-4c39-a978-13bf2cebd4e3 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.574294 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2277/4573] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:31:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:31:29.577126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e162d-5722-40b6-b3f2-16ec8f15e4e4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.578125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e162d-5722-40b6-b3f2-16ec8f15e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.578637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e162d-5722-40b6-b3f2-16ec8f15e4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.622101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b70e162d-5722-40b6-b3f2-16ec8f15e4e4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:29.624104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b70e162d-5722-40b6-b3f2-16ec8f15e4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:29.641016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0d548aecdf4774b44defd9278e9e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:29.707065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0d548aecdf4774b44defd9278e9e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:29.710633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0d548aecdf4774b44defd9278e9e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:29.713645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0d548aecdf4774b44defd9278e9e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:29.733404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-340bc5d1-b568-42f3-a71e-c07654436778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0d548aecdf4774b44defd9278e9e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:29.759155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2297/4574] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:29 2022] DELETE /identity/v3/users/9e0d548aecdf4774b44defd9278e9e6e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:29.759155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.759155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.759155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.765830 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2278/4575] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:29.767826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:29.768542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:29.769002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:29.769426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:29.815231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:29.816630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:29.855648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:29.858762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:29.874886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:29.958029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2279/4576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:29.959004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:29.960516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:29.982746 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2298/4577] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:30.081311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7457-160f-4f11-b5bb-1b36d8a03764 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:30.082623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:30.084934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:30.087512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:30.088336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:30.089697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:30.090335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:30.106839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67d30d-7f6c-47e4-952f-d41c87141ef1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:30.114182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:30.120898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:30.123602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:30.124499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:30.124924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:30.125213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:30.150012 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2280/4578] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:30.151077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:30.165384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3434c4-3718-4655-9991-37e96a6b30fc service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:30.173099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f5972-4db3-4f8a-9ef3-2e2fc43dc5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:30.176109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5972-4db3-4f8a-9ef3-2e2fc43dc5bd service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:30.176405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5972-4db3-4f8a-9ef3-2e2fc43dc5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:30.176684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5972-4db3-4f8a-9ef3-2e2fc43dc5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:30.179759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:30.181227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:30.201945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f5972-4db3-4f8a-9ef3-2e2fc43dc5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:30.206076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f5972-4db3-4f8a-9ef3-2e2fc43dc5bd service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:30.207996 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2299/4579] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:30.236098 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2281/4580] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:32.291706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:32.294341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:32.315978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f9d1-1817-4e26-b327-8d4d0d845ba3 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:32.332480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:32.333522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:32.333890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:32.334277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] PATH_INFO: `/v3/projects/b7f5756c06d34c1db9d904886adc5e21` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:32.336322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f5756c06d34c1db9d904886adc5e21)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:32.338948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:32.457622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f5756c06d34c1db9d904886adc5e21', 'request_id': 'req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:32.476038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f5756c06d34c1db9d904886adc5e21', 'request_id': 'req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:32.510432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f5756c06d34c1db9d904886adc5e21', 'request_id': 'req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:32.537283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] The token cache is being invalidate because project b7f5756c06d34c1db9d904886adc5e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:32.537860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:32.539735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f99d87b-f3d4-4e0c-b8ff-cff4213f0243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:32.542539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2300/4581] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:32 2022] DELETE /identity/v3/projects/b7f5756c06d34c1db9d904886adc5e21 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:32.552133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:32.552620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:32.553238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:32.610727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:32.612031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:32.774014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2282/4582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:32.776685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:32.777589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:32.778028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:32.994282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:32.995949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:33.007146 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2301/4583] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:33.011226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.022180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68b79-eb54-454f-9f3f-6ea4b54e3c58 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.027473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.028122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.028411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.029398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.030085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:33.030431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.032095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.051474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2283/4584] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:33.051869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.063980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b96c6-963c-4623-984a-306d742e0e8b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.070507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.071313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.071599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.071872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.072522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.074536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.118847 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2302/4585] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:33 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:33.120363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.132886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510b9aa-37fb-426c-b3cf-856a20e00071 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.191092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:33.207968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.209136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.209673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.210380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.211279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.213797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.278227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2284/4586] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:33 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:33.283491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.300784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36e8c-020f-42e7-b835-ac2ac7c58879 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.316300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.317561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.318157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.318465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.327232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.337151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.349309 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2303/4587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:33.353648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.364809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40035cdb-b8f6-4e24-983e-ac5f8d0d7813 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.369823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.370476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.370763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.371291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] PATH_INFO: `/v3/projects/eda31412ec544c02a3a864940023a083/users/3a321800dffa4a46a95c6ac5879f6c05/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.387573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda31412ec544c02a3a864940023a083, user_id=3a321800dffa4a46a95c6ac5879f6c05, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.391108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.417312 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2285/4588] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:33 2022] PUT /identity/v3/projects/eda31412ec544c02a3a864940023a083/users/3a321800dffa4a46a95c6ac5879f6c05/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:33.419247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.431710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2bb7b-f699-4eb5-967d-41bd672eb19b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.473885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:33.519080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b9d75-f8cb-4160-9497-f06a6861da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.519983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b9d75-f8cb-4160-9497-f06a6861da99 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.520237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b9d75-f8cb-4160-9497-f06a6861da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.520765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b9d75-f8cb-4160-9497-f06a6861da99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.521849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b9d75-f8cb-4160-9497-f06a6861da99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.523640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b9d75-f8cb-4160-9497-f06a6861da99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.536124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2304/4589] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:33.541188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.554854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca5e2-abe3-4c1f-a4a7-a56844a657c7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.561609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.562337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.562629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.562915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] PATH_INFO: `/v3/projects/eda31412ec544c02a3a864940023a083/users/3a321800dffa4a46a95c6ac5879f6c05/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.565724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda31412ec544c02a3a864940023a083, user_id=3a321800dffa4a46a95c6ac5879f6c05, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.568926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.582323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2286/4590] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:33 2022] PUT /identity/v3/projects/eda31412ec544c02a3a864940023a083/users/3a321800dffa4a46a95c6ac5879f6c05/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:33.594287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.594706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.595085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.630497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] MFA Rules not processed for user `3a321800dffa4a46a95c6ac5879f6c05`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:33.632272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:33.720898 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2305/4591] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:33.725290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.822113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd4b1-5adb-40d3-9b7b-412657bfec57 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.830040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.830817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.831111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.838946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.839721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.844289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:33.894268 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2287/4592] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:33 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:33.899673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:33.914708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422a3c-6dc1-4660-b213-7f2c488a89c6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:33.993854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:33.994084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:33.994356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:33.994542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:33.995981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:33.998009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:34.037239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:34.039833 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2306/4593] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:33 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:34.056710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c515-98d8-4fd6-8524-23f02c045ea1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:34.063222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:34.063860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:34.064145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:34.064421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:34.065188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:34.067370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:34.094206 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2288/4594] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:34.098618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:34.112992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1318-e223-4c33-8aa6-aee55099dfa4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:34.121624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1747c3-2504-46e6-96a7-c3c6db7b1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:34.123269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1747c3-2504-46e6-96a7-c3c6db7b1b26 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:34.123269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1747c3-2504-46e6-96a7-c3c6db7b1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:34.123717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1747c3-2504-46e6-96a7-c3c6db7b1b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:34.125097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1747c3-2504-46e6-96a7-c3c6db7b1b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:34.128384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1747c3-2504-46e6-96a7-c3c6db7b1b26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:34.162284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2307/4595] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:34.165897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:34.190377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4539eac-9f49-4c57-8fb0-c637d6e1b12d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:34.197343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:34.198383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:34.199488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:34.200086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] PATH_INFO: `/v3/projects/0ee082dfb37e44a7831e8e96ab2ca28d/users/679b860cee60499cbab98fb3fbaeef89/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:34.222535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee082dfb37e44a7831e8e96ab2ca28d, user_id=679b860cee60499cbab98fb3fbaeef89, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:34.227504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:34.275695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2289/4596] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:34 2022] PUT /identity/v3/projects/0ee082dfb37e44a7831e8e96ab2ca28d/users/679b860cee60499cbab98fb3fbaeef89/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:34.277495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:34.277850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:34.278130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:34.324919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] MFA Rules not processed for user `679b860cee60499cbab98fb3fbaeef89`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:34.326861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:34.372210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:34.476479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2308/4597] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:34.493569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:34.496532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:34.630756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:34.658099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d96e76-befb-40ea-9c9a-f2e086f3ab45 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:34.662871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a186-dac3-4cd2-bf1e-e35464c51f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:34.665299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a186-dac3-4cd2-bf1e-e35464c51f55 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:34.665901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a186-dac3-4cd2-bf1e-e35464c51f55 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:34.666369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a186-dac3-4cd2-bf1e-e35464c51f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:34.853033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70a186-dac3-4cd2-bf1e-e35464c51f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:34.854843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70a186-dac3-4cd2-bf1e-e35464c51f55 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:34.868257 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2290/4598] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:35.737115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:35.850624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1420-191c-4f47-8c9a-6b20865d5cf3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:35.884985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:35.886509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:35.886904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:35.887281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] PATH_INFO: `/v3/users/3a321800dffa4a46a95c6ac5879f6c05` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:35.891106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a321800dffa4a46a95c6ac5879f6c05)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:35.906804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:35.985533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a321800dffa4a46a95c6ac5879f6c05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:36.010916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a321800dffa4a46a95c6ac5879f6c05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:36.011933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a321800dffa4a46a95c6ac5879f6c05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:36.012613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a321800dffa4a46a95c6ac5879f6c05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:36.024858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a321800dffa4a46a95c6ac5879f6c05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:36.051030 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2309/4599] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:35 2022] DELETE /identity/v3/users/3a321800dffa4a46a95c6ac5879f6c05 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:36.055285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf67de-5b5c-41ca-aece-e106581feef5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:36.055752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf67de-5b5c-41ca-aece-e106581feef5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:36.055859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf67de-5b5c-41ca-aece-e106581feef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:36.087727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e7bf67de-5b5c-41ca-aece-e106581feef5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:36.089116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7bf67de-5b5c-41ca-aece-e106581feef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:36.248230 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2291/4600] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:31:36.295155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:36.299177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:36.369686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:36.406794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30993ec-f2d2-49ad-a9da-6e3a1310fffd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:36.413784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:36.414650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:36.415610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:36.416224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:36.444658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:36.446118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:36.459413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2310/4601] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:36.522043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:36.522367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:36.522646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:36.627016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] MFA Rules not processed for user `872baa14b3cc4791b7fca28a4e4d4a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:36.632163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:36.807219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2292/4602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:36.828055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:36.829489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:37.004797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd386e8-e317-4de7-93a3-e4dc3e9e5b3e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:37.024787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:37.029297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:37.029680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:37.029959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:37.047003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:37.048617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:37.070448 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2311/4603] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:37.793854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:37.795937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:37.818939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c51b-391c-417b-838e-bd18cb566216 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:37.829386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:37.830064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:37.830377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:37.830660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] PATH_INFO: `/v3/projects/eda31412ec544c02a3a864940023a083` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:37.836487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda31412ec544c02a3a864940023a083)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:37.839185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:37.877116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:37.962628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda31412ec544c02a3a864940023a083', 'request_id': 'req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:37.976009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda31412ec544c02a3a864940023a083', 'request_id': 'req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:37.990251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda31412ec544c02a3a864940023a083', 'request_id': 'req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.009930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] The token cache is being invalidate because project eda31412ec544c02a3a864940023a083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:38.010641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.011909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.015182 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2293/4604] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:37 2022] DELETE /identity/v3/projects/eda31412ec544c02a3a864940023a083 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:38.019477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:38.035314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7553d-1543-46ef-91dd-08528edc79aa service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:38.174394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:38.176435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:38.176989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:38.177531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] PATH_INFO: `/v3/users/679b860cee60499cbab98fb3fbaeef89` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:38.179268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679b860cee60499cbab98fb3fbaeef89)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:38.182670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:38.317644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679b860cee60499cbab98fb3fbaeef89'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.352857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679b860cee60499cbab98fb3fbaeef89'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.364903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679b860cee60499cbab98fb3fbaeef89'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.366365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679b860cee60499cbab98fb3fbaeef89'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.372875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:38.419363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd3707a-1801-44a7-bdf6-89fe52957f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679b860cee60499cbab98fb3fbaeef89'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:38.457678 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2312/4605] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:38 2022] DELETE /identity/v3/users/679b860cee60499cbab98fb3fbaeef89 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:40.023581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:40.025033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:40.051296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1965bb-5d59-4885-a7e7-dba86f1c0e47 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:40.197544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:40.198923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:40.199532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:40.200087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] PATH_INFO: `/v3/projects/0ee082dfb37e44a7831e8e96ab2ca28d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:40.209122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee082dfb37e44a7831e8e96ab2ca28d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:40.215839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:40.321452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee082dfb37e44a7831e8e96ab2ca28d', 'request_id': 'req-41d7db9d-8177-408c-9d55-b39aa95f9469'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:40.329387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee082dfb37e44a7831e8e96ab2ca28d', 'request_id': 'req-41d7db9d-8177-408c-9d55-b39aa95f9469'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:40.364794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee082dfb37e44a7831e8e96ab2ca28d', 'request_id': 'req-41d7db9d-8177-408c-9d55-b39aa95f9469'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:40.386399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] The token cache is being invalidate because project 0ee082dfb37e44a7831e8e96ab2ca28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:40.386883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:40.387731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-41d7db9d-8177-408c-9d55-b39aa95f9469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:40.390644 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2294/4606] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:40 2022] DELETE /identity/v3/projects/0ee082dfb37e44a7831e8e96ab2ca28d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:40.395980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:40.396391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:40.398998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:40.454291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:40.456196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:40.644000 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2313/4607] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:40.650494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:40.651095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:40.651714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:40.688780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:40.690315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:40.731825 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2295/4608] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:31:40.737800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:40.760616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832f0c-ee21-49f5-8622-6201026b8fdd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:40.788339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:40.788982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:40.789401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:40.789682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:40.790379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:40.792178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:40.798297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:40.860425 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2314/4609] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:40.864995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:40.897843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812762c0-d4d6-4e76-9a61-dc27e75ec386 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:40.910950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:40.912944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:40.913292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:40.913776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:40.917007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:40.921568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:40.980347 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2296/4610] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:40 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:40.984650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:41.000318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46778cb-753c-47a2-bc01-af496dde758f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:41.150754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:41.151700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:41.152405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:41.153816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:41.155059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:41.157438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:41.209392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2315/4611] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:40 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:41.213797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:41.223957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:41.239847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c444-bfa0-4bf8-8fe1-66988f9bfe91 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:41.257307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:41.259226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:41.259724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:41.260179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:41.261282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:41.264068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:41.285915 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2297/4612] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:41.290321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:41.318065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea940fc6-1234-4871-aa14-9763e6d4472a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:41.330132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfe9a1-69c0-45bf-b229-f6f1c9efc37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:41.330818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfe9a1-69c0-45bf-b229-f6f1c9efc37d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:41.331102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfe9a1-69c0-45bf-b229-f6f1c9efc37d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:41.331376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfe9a1-69c0-45bf-b229-f6f1c9efc37d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:41.332194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfe9a1-69c0-45bf-b229-f6f1c9efc37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:41.333836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfe9a1-69c0-45bf-b229-f6f1c9efc37d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:41.362840 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2316/4613] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:41.365034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:41.378712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22c78a-5cdf-4360-b8d1-fc5232b5581f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:41.396251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:41.396956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:41.397389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:41.397670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] PATH_INFO: `/v3/projects/21391ec6f1c74249a314d2185176f18a/users/f632b52f161d4f01bb0632fc1aca1ade/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:41.420477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21391ec6f1c74249a314d2185176f18a, user_id=f632b52f161d4f01bb0632fc1aca1ade, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:41.423459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:41.455300 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2298/4614] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:41 2022] PUT /identity/v3/projects/21391ec6f1c74249a314d2185176f18a/users/f632b52f161d4f01bb0632fc1aca1ade/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:41.459467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:41.459951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:41.464455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:41.545675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] MFA Rules not processed for user `f632b52f161d4f01bb0632fc1aca1ade`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:41.548650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:41.694580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:41.753352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2317/4615] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:41.754245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:41.756331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:41.912031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b069a-598e-4dc9-b8b1-b8410e3f7f5c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:41.916069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bc06-86ff-4394-a2da-47f854801a25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:41.917248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bc06-86ff-4394-a2da-47f854801a25 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:41.917828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bc06-86ff-4394-a2da-47f854801a25 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:41.918401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bc06-86ff-4394-a2da-47f854801a25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:41.950327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bc06-86ff-4394-a2da-47f854801a25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:41.953207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bc06-86ff-4394-a2da-47f854801a25 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:41.989943 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2299/4616] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:42.540245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:42.648832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff0cd-7b2d-4e35-8941-ce533321eb61 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:42.656524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:42.657458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:42.657953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:42.658362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] PATH_INFO: `/v3/users/f632b52f161d4f01bb0632fc1aca1ade` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:42.660056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f632b52f161d4f01bb0632fc1aca1ade)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:42.662073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:42.758790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f632b52f161d4f01bb0632fc1aca1ade'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:42.783646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f632b52f161d4f01bb0632fc1aca1ade'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:42.784569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f632b52f161d4f01bb0632fc1aca1ade'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:42.785595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f632b52f161d4f01bb0632fc1aca1ade'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:42.796074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f632b52f161d4f01bb0632fc1aca1ade'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:42.817584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2318/4617] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:31:42 2022] DELETE /identity/v3/users/f632b52f161d4f01bb0632fc1aca1ade => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:42.823202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a7bc-8634-4fe8-ac10-69deb917abfa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:42.824282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a7bc-8634-4fe8-ac10-69deb917abfa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:42.826060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a7bc-8634-4fe8-ac10-69deb917abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:42.857073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c137a7bc-8634-4fe8-ac10-69deb917abfa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:42.859279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c137a7bc-8634-4fe8-ac10-69deb917abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:42.951333 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2300/4618] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:43.021256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:43.022761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:43.166687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8bfb1-2063-4380-b91f-aa97737b59ec admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:43.172239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:43.172866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:43.173141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:43.173409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:43.202847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:43.204320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:43.235753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2319/4619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:44.023315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4946f8-6bbc-48b6-8843-1d661c98071f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:44.024181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4946f8-6bbc-48b6-8843-1d661c98071f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:44.024550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4946f8-6bbc-48b6-8843-1d661c98071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:44.059023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6d4946f8-6bbc-48b6-8843-1d661c98071f None None] MFA Rules not processed for user `872baa14b3cc4791b7fca28a4e4d4a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:44.061929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d4946f8-6bbc-48b6-8843-1d661c98071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:44.237503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2301/4620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:45.160215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:45.162201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:45.177536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:45.183269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4710fc-34a3-4175-a958-7b12a026c3e8 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:45.201810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:45.202508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.203959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.203959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] PATH_INFO: `/v3/projects/21391ec6f1c74249a314d2185176f18a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.207319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] RBAC: Authorizing `identity:delete_project(project_id=21391ec6f1c74249a314d2185176f18a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:45.209364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:45.340673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21391ec6f1c74249a314d2185176f18a', 'request_id': 'req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:45.357184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21391ec6f1c74249a314d2185176f18a', 'request_id': 'req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:45.372406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21391ec6f1c74249a314d2185176f18a', 'request_id': 'req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:45.400518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] The token cache is being invalidate because project 21391ec6f1c74249a314d2185176f18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:31:45.400827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:45.401797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7c952b0-6e70-4864-8fc9-9cf13fa7077d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:31:45.403523 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2320/4621] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:31:45 2022] DELETE /identity/v3/projects/21391ec6f1c74249a314d2185176f18a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:45.409201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.409716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.409825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.438511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:45.440735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:45.456102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:45.539044 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2302/4622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:45.540138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.540428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.540708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.589673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:45.591254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:45.612410 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2321/4623] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:45.616691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:45.643709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9262cb-f0f5-4072-8060-9a30082502a8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:45.650851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:45.651769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.652206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.652812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.653748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:31:45.654353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:45.656276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:45.681522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2303/4624] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:31:45.682569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:45.695187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cddc6e-0e96-474b-bacc-1a2e703e276b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:45.709251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:45.709995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.710587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.710962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.711851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:45.715670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:45.784927 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2322/4625] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:45 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:45.788901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:45.806697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e37e-557b-4ee6-86c8-a0562b95d61d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:45.894951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:45.896235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.896695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.897139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.897994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:45.900892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:45.934402 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2304/4626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:45 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:45.939095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:45.958574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c4426-c1ed-4789-906d-de1c65a52b47 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:45.964949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:45.965901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:45.975858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:45.976196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:45.976851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:45.978748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:45.998671 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2323/4627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:46.003232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:46.021251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7335-a8e5-46dc-8622-35fe69fbfb85 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:46.054317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9d169-8c12-48ba-a5e9-c546b71c4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:46.055031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9d169-8c12-48ba-a5e9-c546b71c4030 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:46.055321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9d169-8c12-48ba-a5e9-c546b71c4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:46.055519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9d169-8c12-48ba-a5e9-c546b71c4030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:46.056202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9d169-8c12-48ba-a5e9-c546b71c4030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:46.058805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9d169-8c12-48ba-a5e9-c546b71c4030 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:46.085904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:46.088302 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2305/4628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:46.097076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af08932-0c2e-40ba-9e57-3e61d3f8e02e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:46.116758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:46.117458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:46.117743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:46.118021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] PATH_INFO: `/v3/projects/3999489df2df42f99a3e47921666fc7d/users/2ccb1cfa86b5452895fec45a49a1fbd8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:46.150007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3999489df2df42f99a3e47921666fc7d, user_id=2ccb1cfa86b5452895fec45a49a1fbd8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:46.152733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:46.182204 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2324/4629] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:46 2022] PUT /identity/v3/projects/3999489df2df42f99a3e47921666fc7d/users/2ccb1cfa86b5452895fec45a49a1fbd8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:31:46.199842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:46.200034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:46.200336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:46.276540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] MFA Rules not processed for user `2ccb1cfa86b5452895fec45a49a1fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:46.278328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:46.548562 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2306/4630] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:46.553307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:46.765649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f2b9f-3487-43bc-80bc-f134bff9a02c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:46.797000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:46.797000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:46.797344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:46.797636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:46.805147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:46.807236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:46.933249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2325/4631] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:31:46 2022] POST /identity/v3/projects => generated 391 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:31:46.936708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:46.956895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa57d8-aa40-4010-95fc-1175e98c517c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:47.009125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:47.053835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:47.057072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:47.088518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:47.170394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:47.171479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.171672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.172091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.172854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:47.175319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:47.273275 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2307/4632] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:31:46 2022] POST /identity/v3/users => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:31:47.279805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:47.314002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3c6c-b408-45fb-ab9c-817f3aaccf74 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:47.358687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:47.359350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.368686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.368686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.368686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:47.379898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:47.385018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296fda-6eab-41ac-9675-ab734d3ef39b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:47.406457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:47.407115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.407396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.407672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.417071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:47.418331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2308/4633] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:47.425473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:47.443581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de381dba-121c-4675-8d6e-bc30405daf08 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:47.456911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:47.463751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:47.464876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:47.466518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.467241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.469083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] PATH_INFO: `/v3/projects/f9785089fe624622a26c78741f54d5a1/users/d479d879656349fbb3e413bf239d9768/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.488769 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2326/4634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:31:47.523470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9785089fe624622a26c78741f54d5a1, user_id=d479d879656349fbb3e413bf239d9768, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:47.526734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:47.550248 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2309/4635] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:47 2022] PUT /identity/v3/projects/f9785089fe624622a26c78741f54d5a1/users/d479d879656349fbb3e413bf239d9768/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:47.554725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:47.577746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176c56-5f65-45da-8acf-8af3f25b7444 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:47.676381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490dae4-e2ef-40bd-9c81-11b1aa0b71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:47.677042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490dae4-e2ef-40bd-9c81-11b1aa0b71a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.677332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490dae4-e2ef-40bd-9c81-11b1aa0b71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.677611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490dae4-e2ef-40bd-9c81-11b1aa0b71a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.679177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490dae4-e2ef-40bd-9c81-11b1aa0b71a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:47.681118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490dae4-e2ef-40bd-9c81-11b1aa0b71a1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:47.697254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2327/4636] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:31:47.701263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:47.717468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bdf02-a983-4ac7-b7f9-e85b90194842 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:47.734223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:47.735699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.735699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.735699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] PATH_INFO: `/v3/projects/f9785089fe624622a26c78741f54d5a1/users/d479d879656349fbb3e413bf239d9768/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.737596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9785089fe624622a26c78741f54d5a1, user_id=d479d879656349fbb3e413bf239d9768, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:47.740612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:47.782436 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2310/4637] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:31:47 2022] PUT /identity/v3/projects/f9785089fe624622a26c78741f54d5a1/users/d479d879656349fbb3e413bf239d9768/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:31:47.803333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043ebfb-1d3f-476d-8aa6-f68800e1f2ad None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:47.808497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043ebfb-1d3f-476d-8aa6-f68800e1f2ad None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:47.808965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043ebfb-1d3f-476d-8aa6-f68800e1f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:47.868387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3043ebfb-1d3f-476d-8aa6-f68800e1f2ad None None] MFA Rules not processed for user `d479d879656349fbb3e413bf239d9768`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:47.869516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3043ebfb-1d3f-476d-8aa6-f68800e1f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:48.104920 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2328/4638] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:48.144157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:48.146017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:48.228611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906b0a5-0abc-4b91-af69-1ccadff207d4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:48.236063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c378b-7a1b-49d6-b0ed-53a581946d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:48.237169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c378b-7a1b-49d6-b0ed-53a581946d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:48.237964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c378b-7a1b-49d6-b0ed-53a581946d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:48.239071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c378b-7a1b-49d6-b0ed-53a581946d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:48.392222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c378b-7a1b-49d6-b0ed-53a581946d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:48.393840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c378b-7a1b-49d6-b0ed-53a581946d0c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:48.462799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2311/4639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:51.195902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:51.196386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:51.197123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:51.235885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:51.237971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:51.244431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:51.356588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2329/4640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:51.358686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:51.359151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:51.359248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:51.381489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:31:51.383028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:51.391509 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2312/4641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:31:51.402882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:51.404432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:51.507426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4673b6-7ebd-45ea-8ace-1a30c137ac78 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:51.517119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:51.517986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:51.518445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:51.518902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:51.530011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:51.533674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:51.568898 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2330/4642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:53.321359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:53.327099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:31:53.338442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973dd6-9215-40b6-8660-a91ae7afc6f2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:53.349507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:53.350588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:53.352697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:53.353146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:53.364368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:53.419628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:53.428055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:53.462927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2313/4643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:57.020445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:57.041119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5d5f4-3bc6-4b86-b8df-2189665b441f service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:57.057168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:57.058060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:57.058534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:57.058965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:57.061616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:31:57.087276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:57.089148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:57.123205 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2331/4644] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:31:58.792696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:31:58.827757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cc2ec-4eb8-4c4c-96ad-a7cbae9bfdfe service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:31:58.837092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ac839-3642-4f11-aa19-d6f2261b1bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:31:58.837921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ac839-3642-4f11-aa19-d6f2261b1bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:31:58.838410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ac839-3642-4f11-aa19-d6f2261b1bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:31:58.838846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ac839-3642-4f11-aa19-d6f2261b1bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:31:58.874135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ac839-3642-4f11-aa19-d6f2261b1bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:31:58.875587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ac839-3642-4f11-aa19-d6f2261b1bf6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:31:58.937236 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2314/4645] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:31:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:06.713866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:06.854902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45dae5-c81e-482a-b2fd-d9384c55bbcb service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:06.858296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:06.858966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:06.859249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:06.859523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] PATH_INFO: `/v3/users/2ccb1cfa86b5452895fec45a49a1fbd8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:06.860676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccb1cfa86b5452895fec45a49a1fbd8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:06.864562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:06.922512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:06.977723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccb1cfa86b5452895fec45a49a1fbd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:07.045804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccb1cfa86b5452895fec45a49a1fbd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:07.049476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccb1cfa86b5452895fec45a49a1fbd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:07.050914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccb1cfa86b5452895fec45a49a1fbd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:07.079826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccb1cfa86b5452895fec45a49a1fbd8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:07.123802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2332/4646] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:06 2022] DELETE /identity/v3/users/2ccb1cfa86b5452895fec45a49a1fbd8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:07.128046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:07.128561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:07.128792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:07.168309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:07.170259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:07.255946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2315/4647] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:07.274011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:07.276821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:07.428084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc354c-c361-434e-b29a-6da8759aa9f2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:07.442804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:07.443461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:07.443745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:07.444020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:07.466885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:07.469729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:07.499417 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2333/4648] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:08.405096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:08.410810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:08.476506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:08.477981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:08.503361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f50ae-1713-4a85-9373-b58bfb7df769 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:08.517815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:08.518922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:08.519393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:08.520365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] PATH_INFO: `/v3/projects/3999489df2df42f99a3e47921666fc7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:08.522425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3999489df2df42f99a3e47921666fc7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:08.531661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:08.568455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5c8f-e07c-4a2f-88c1-9b5a119a4768 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:08.580440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:08.581361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:08.582668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:08.583259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:08.592972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:08.614646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:08.619070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:08.642430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2316/4649] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:08.667895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3999489df2df42f99a3e47921666fc7d', 'request_id': 'req-7bce412a-5216-43b0-a233-e0e43e37ea11'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:08.678120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3999489df2df42f99a3e47921666fc7d', 'request_id': 'req-7bce412a-5216-43b0-a233-e0e43e37ea11'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:08.685970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3999489df2df42f99a3e47921666fc7d', 'request_id': 'req-7bce412a-5216-43b0-a233-e0e43e37ea11'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:08.709979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] The token cache is being invalidate because project 3999489df2df42f99a3e47921666fc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:08.710569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:08.711601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:08.715194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2334/4650] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:08 2022] DELETE /identity/v3/projects/3999489df2df42f99a3e47921666fc7d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:08.719564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:08.766296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df6fa-7bb2-4eb1-9b63-c8a5b0d5f73a service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:08.923701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:08.924526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:08.925026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:08.925487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] PATH_INFO: `/v3/users/d479d879656349fbb3e413bf239d9768` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:08.927441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d479d879656349fbb3e413bf239d9768)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:08.931007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:08.937247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:09.018220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd479d879656349fbb3e413bf239d9768'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:09.039105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd479d879656349fbb3e413bf239d9768'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:09.039997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd479d879656349fbb3e413bf239d9768'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:09.040805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd479d879656349fbb3e413bf239d9768'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:09.052049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3565a5bb-4d92-4464-b438-1a4f2696b360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd479d879656349fbb3e413bf239d9768'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:09.135034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2317/4651] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:08 2022] DELETE /identity/v3/users/d479d879656349fbb3e413bf239d9768 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:10.248112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:10.249625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:10.289923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce412a-5216-43b0-a233-e0e43e37ea11 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:10.373199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:10.509066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:10.509773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:10.510091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:10.510809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] PATH_INFO: `/v3/projects/f9785089fe624622a26c78741f54d5a1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:10.514814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9785089fe624622a26c78741f54d5a1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:10.519339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:10.657731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9785089fe624622a26c78741f54d5a1', 'request_id': 'req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:10.677155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9785089fe624622a26c78741f54d5a1', 'request_id': 'req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:10.713640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9785089fe624622a26c78741f54d5a1', 'request_id': 'req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:10.738514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] The token cache is being invalidate because project f9785089fe624622a26c78741f54d5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:10.738862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:10.741743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a5eda82c-96db-48dd-8029-36d0c8e4c6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:10.755665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2335/4652] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:10 2022] DELETE /identity/v3/projects/f9785089fe624622a26c78741f54d5a1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:10.758043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:10.758810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:10.758972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:10.833972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:10.835274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:10.937467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2318/4653] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:10.945845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:10.946395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:10.946855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.004940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:11.006216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:11.031742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2336/4654] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:11.035175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.052073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b03c-8844-482d-8e4c-6884f8766a10 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:11.058337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:11.058930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.059940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.060462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.061214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:32:11.061599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:11.063444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:11.085833 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2319/4655] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:32:11.089405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.104297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08946f49-6fa4-44ce-805e-93a615525a58 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:11.111227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:11.112000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.112529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.113063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.114452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:11.117084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:11.176517 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2337/4656] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:11 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:11.178288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.188923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e286-a0ac-4b86-ab7b-878dac78c7d2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:11.345449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:11.348300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.348300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.348300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.348587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:11.350363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:11.388500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:11.395132 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2320/4657] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:11 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:11.399385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.423715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c6684-b08c-4edb-89d1-59879475cbc7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:11.459783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:11.459783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.459783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.459783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.460277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:11.460546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:11.479870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2338/4658] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:11.484599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.503077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7db7-724b-4bc7-bf7b-72e11880bc40 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:11.522035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e899-cf4e-4f1f-9840-9c80b33385ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:11.522701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e899-cf4e-4f1f-9840-9c80b33385ac admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.523008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e899-cf4e-4f1f-9840-9c80b33385ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.523260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e899-cf4e-4f1f-9840-9c80b33385ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.523929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e899-cf4e-4f1f-9840-9c80b33385ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:11.525566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e899-cf4e-4f1f-9840-9c80b33385ac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:11.570737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.572246 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2321/4659] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:11.590980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53244efb-3257-491e-8219-4b5b4092f50b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:11.597931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:11.599226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.599838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.614404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] PATH_INFO: `/v3/projects/0e4126d38b7c487d8f662afa73c0af7d/users/502fb6ff356c4e8892a05f10a8c7c7ed/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.672106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4126d38b7c487d8f662afa73c0af7d, user_id=502fb6ff356c4e8892a05f10a8c7c7ed, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:11.675345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:11.720074 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2339/4660] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:11 2022] PUT /identity/v3/projects/0e4126d38b7c487d8f662afa73c0af7d/users/502fb6ff356c4e8892a05f10a8c7c7ed/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:11.721804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94816c4a-e426-473b-9282-70bf0ab231ba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:11.722103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94816c4a-e426-473b-9282-70bf0ab231ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:11.722407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94816c4a-e426-473b-9282-70bf0ab231ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:11.807439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-94816c4a-e426-473b-9282-70bf0ab231ba None None] MFA Rules not processed for user `502fb6ff356c4e8892a05f10a8c7c7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:11.808963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94816c4a-e426-473b-9282-70bf0ab231ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:11.948811 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2322/4661] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:11.989514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:11.991707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:12.137256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3256abf-b8d6-4a44-aa35-1e2721ba0cb9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:12.147543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c136f-fea3-41ee-a306-15425a0ee529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:12.148338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c136f-fea3-41ee-a306-15425a0ee529 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:12.148625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c136f-fea3-41ee-a306-15425a0ee529 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:12.148957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c136f-fea3-41ee-a306-15425a0ee529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:12.161950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:12.171818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c136f-fea3-41ee-a306-15425a0ee529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:12.173717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c136f-fea3-41ee-a306-15425a0ee529 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:12.204208 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2340/4662] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:16.332065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:16.333106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:16.333601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:16.378110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] MFA Rules not processed for user `535a335d59cc400fb6d573f536fa808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:16.379453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:16.500122 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2323/4663] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:17.001271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:17.002172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:17.002603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:17.035328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:17.037644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:17.196521 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2341/4664] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:17.958919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:17.973342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085c55f-ac0d-41a7-99b6-56d490a59b1c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:17.982318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:17.982968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:17.983254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:17.985991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:17.990322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:18.011893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:18.014673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:18.048016 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2324/4665] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:23.089976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:23.106607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e2f4-6623-403e-8552-ddb250512d9d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:23.116308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:23.118012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:23.118621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:23.119360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:23.122515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:23.146882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:23.148648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:23.167522 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2342/4666] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:24.805014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:24.806553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:24.936871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec4d97-b86d-4d45-8935-a264f1a68cea service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:24.945357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:24.946403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:24.946917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:24.947449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:24.950798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:24.967441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:24.979939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:24.982967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176fda5-214c-4709-970b-d4c7bfbc312b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:25.013517 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2325/4667] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:26.841175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:27.032155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffd41e-573b-472a-9198-32864e997ff9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:27.046673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:27.047344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:27.047642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:27.047914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] PATH_INFO: `/v3/users/502fb6ff356c4e8892a05f10a8c7c7ed` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:27.049096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502fb6ff356c4e8892a05f10a8c7c7ed)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:27.051081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:27.161657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502fb6ff356c4e8892a05f10a8c7c7ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:27.187116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502fb6ff356c4e8892a05f10a8c7c7ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:27.188363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502fb6ff356c4e8892a05f10a8c7c7ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:27.189180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502fb6ff356c4e8892a05f10a8c7c7ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:27.206820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502fb6ff356c4e8892a05f10a8c7c7ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:27.241774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2343/4668] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:26 2022] DELETE /identity/v3/users/502fb6ff356c4e8892a05f10a8c7c7ed => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:27.246076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:27.250931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:27.251450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:27.316142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:27.319644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:27.436145 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2326/4669] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:27.476660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:27.478140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:27.486326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:27.583655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a160252-c01c-44c3-b1cd-af7f87194872 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:27.587850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e395-ecde-4146-819c-fcd93b38f1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:27.588592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e395-ecde-4146-819c-fcd93b38f1bf service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:27.588982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e395-ecde-4146-819c-fcd93b38f1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:27.589255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e395-ecde-4146-819c-fcd93b38f1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:27.603075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e395-ecde-4146-819c-fcd93b38f1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:27.605397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e395-ecde-4146-819c-fcd93b38f1bf service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:27.618911 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2344/4670] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:27.941753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:27.943385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:27.978627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933fdba-1174-4ee8-94a9-40696871b4fb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.011214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.014962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.015217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.015494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] PATH_INFO: `/v3/projects/0e4126d38b7c487d8f662afa73c0af7d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.034131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4126d38b7c487d8f662afa73c0af7d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.037947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:28.186187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4126d38b7c487d8f662afa73c0af7d', 'request_id': 'req-6878a507-4e3f-460b-888d-260c9b9501f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:28.196828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4126d38b7c487d8f662afa73c0af7d', 'request_id': 'req-6878a507-4e3f-460b-888d-260c9b9501f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:28.212654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4126d38b7c487d8f662afa73c0af7d', 'request_id': 'req-6878a507-4e3f-460b-888d-260c9b9501f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:28.230457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] The token cache is being invalidate because project 0e4126d38b7c487d8f662afa73c0af7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:28.231444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:28.232617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6878a507-4e3f-460b-888d-260c9b9501f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:28.234822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2327/4671] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:27 2022] DELETE /identity/v3/projects/0e4126d38b7c487d8f662afa73c0af7d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:28.240197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.240753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.240860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.277354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:28.279207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:28.432935 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2345/4672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:28.441316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.441865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.443085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.485999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:28.486763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:28.496522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2328/4673] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:28.501472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:28.520135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a189d-c92d-49fa-b533-7b7ca7c92f77 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.528139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.529222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.529797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.530724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.532291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:32:28.532781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.535425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:28.570581 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2346/4674] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:32:28.574884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:28.593265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c215db-4eaf-48bb-89cc-c70f70d25514 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.610703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.611370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.611650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.611919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.612581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.616363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:28.673337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2329/4675] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:28 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:28.677150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:28.690407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fa4eb-806a-4048-96af-adf94ea76b42 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.772080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.772895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.773255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.773657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.774446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.777557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:28.815379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2347/4676] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:28 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:28.820956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:28.834819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e35d7-af2c-4630-8062-8e813fe467b3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.843905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.844579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.845279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.845574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.861050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.868792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:28.899125 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2330/4677] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:28.901003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:28.913014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171e8c6-9d16-430c-b8c3-0e3fb44afa4a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.920174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d2006-723f-42bf-bb2a-ac8071dcd7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.920448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d2006-723f-42bf-bb2a-ac8071dcd7ae admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.920733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d2006-723f-42bf-bb2a-ac8071dcd7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.921009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d2006-723f-42bf-bb2a-ac8071dcd7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.921780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d2006-723f-42bf-bb2a-ac8071dcd7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.923745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d2006-723f-42bf-bb2a-ac8071dcd7ae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:28.939968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2348/4678] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:32:28.941450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:28.954222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96c9f8-6b9a-4144-b66d-fecde5ab2e06 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:28.964687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:28.966517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:28.966951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:28.967255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] PATH_INFO: `/v3/projects/b967463951554f38bd1c4c12429383c9/users/01cd7b61375b41f487927bf647a14947/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:28.989846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b967463951554f38bd1c4c12429383c9, user_id=01cd7b61375b41f487927bf647a14947, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:28.993252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:29.038176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2331/4679] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:28 2022] PUT /identity/v3/projects/b967463951554f38bd1c4c12429383c9/users/01cd7b61375b41f487927bf647a14947/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:29.130291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:29.130697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:29.131078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:29.208617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:29.216948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] MFA Rules not processed for user `01cd7b61375b41f487927bf647a14947`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:29.229826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:29.378461 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2349/4680] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:29.383052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:29.399833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:29.478273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def79d4-cb49-49a9-a7d2-aaa8edd82f41 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:29.485536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:29.486436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:29.486942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:29.487317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:29.488079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:29.490176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:29.532311 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2332/4681] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:29 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:29.536010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:29.554661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae486-d685-480c-b4b0-c3ad4d19dabd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:29.697858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:29.698838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:29.698838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:29.699081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:29.700432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:29.702877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:29.742885 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2350/4682] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:29 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:29.744268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:29.764363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934b641-c485-4aa9-9a57-123341c6f566 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:29.793457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:29.794422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:29.794714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:29.794996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:29.795663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:29.800326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:29.816658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2333/4683] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:29.820962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:29.834438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da381-65ee-4add-a130-c6cd9e2b1c03 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:29.844056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:29.844989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:29.846046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:29.846464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] PATH_INFO: `/v3/projects/17015957f4364aa9be26b3ba7e53a6ee/users/a5959f258e3a4082b1840ff96ee991bb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:29.872788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17015957f4364aa9be26b3ba7e53a6ee, user_id=a5959f258e3a4082b1840ff96ee991bb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:29.876457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:29.900533 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2351/4684] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:29 2022] PUT /identity/v3/projects/17015957f4364aa9be26b3ba7e53a6ee/users/a5959f258e3a4082b1840ff96ee991bb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:29.905697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:29.917283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0d28-d393-47c6-9cd7-28df179865a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:30.024291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50e47-41b8-49d8-95ac-dc29d6c376cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:30.025127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50e47-41b8-49d8-95ac-dc29d6c376cb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:30.026480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50e47-41b8-49d8-95ac-dc29d6c376cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:30.026841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50e47-41b8-49d8-95ac-dc29d6c376cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:30.028865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50e47-41b8-49d8-95ac-dc29d6c376cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:30.031276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50e47-41b8-49d8-95ac-dc29d6c376cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:30.056044 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2334/4685] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:32:30.060456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:30.080608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51586-7532-4034-b589-2fd2d925a167 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:30.087655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:30.089575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:30.091020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:30.091705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] PATH_INFO: `/v3/projects/17015957f4364aa9be26b3ba7e53a6ee/users/a5959f258e3a4082b1840ff96ee991bb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:30.094705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17015957f4364aa9be26b3ba7e53a6ee, user_id=a5959f258e3a4082b1840ff96ee991bb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:30.098310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:30.114229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2352/4686] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:30 2022] PUT /identity/v3/projects/17015957f4364aa9be26b3ba7e53a6ee/users/a5959f258e3a4082b1840ff96ee991bb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:30.124822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:30.125113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:30.125414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:30.209006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] MFA Rules not processed for user `a5959f258e3a4082b1840ff96ee991bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:30.210348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:30.318066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2335/4687] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:30.335323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:30.338777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:30.425886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:30.462736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db174-61c4-4206-bb9a-0597f996355f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:30.468459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:30.469216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:30.469659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:30.470326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:30.490275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:30.491988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:30.505749 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2353/4688] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:30.565461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:30.569000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:30.582859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419f16-129a-492a-bb3c-21c426fa1a4a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:30.587362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39986f-36e4-4c55-a1b9-e51de732b4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:30.588244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39986f-36e4-4c55-a1b9-e51de732b4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:30.589159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39986f-36e4-4c55-a1b9-e51de732b4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:30.589645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39986f-36e4-4c55-a1b9-e51de732b4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:30.596656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:30.682895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39986f-36e4-4c55-a1b9-e51de732b4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:30.684350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39986f-36e4-4c55-a1b9-e51de732b4a0 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:30.695948 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2336/4689] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:35.260473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:35.368774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84270e-f243-4102-843c-201af8ffba94 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:35.379157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:35.379912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:35.380264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:35.380603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] PATH_INFO: `/v3/users/01cd7b61375b41f487927bf647a14947` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:35.382995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cd7b61375b41f487927bf647a14947)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:35.386642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:35.485543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cd7b61375b41f487927bf647a14947'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:35.517607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cd7b61375b41f487927bf647a14947'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:35.518660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cd7b61375b41f487927bf647a14947'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:35.519522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cd7b61375b41f487927bf647a14947'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:35.530310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cd7b61375b41f487927bf647a14947'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:35.558189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2354/4690] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:35 2022] DELETE /identity/v3/users/01cd7b61375b41f487927bf647a14947 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:35.565292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:35.565771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:35.566103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:35.591439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:35.592762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:35.690186 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2337/4691] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:35.706491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:35.707962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:35.832925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153f5cd-2c85-4863-b00e-57cab5bb87e4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:35.836764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:35.837440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:35.837723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:35.837999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:35.864535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:35.865991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:35.882412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:35.902615 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2355/4692] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:36.803028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:36.805699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:36.829192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0806d7-c65e-4b0d-a514-3f09587503b3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:36.843298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:36.843881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:36.844160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:36.844435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] PATH_INFO: `/v3/projects/b967463951554f38bd1c4c12429383c9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:36.845866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b967463951554f38bd1c4c12429383c9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:36.847921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:36.928705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b967463951554f38bd1c4c12429383c9', 'request_id': 'req-425c4ec9-06f3-4d5a-8b77-739d9113aeff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:36.938632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b967463951554f38bd1c4c12429383c9', 'request_id': 'req-425c4ec9-06f3-4d5a-8b77-739d9113aeff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:36.954402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b967463951554f38bd1c4c12429383c9', 'request_id': 'req-425c4ec9-06f3-4d5a-8b77-739d9113aeff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:36.973232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] The token cache is being invalidate because project b967463951554f38bd1c4c12429383c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:36.973561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:36.974966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:36.977515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2338/4693] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:36 2022] DELETE /identity/v3/projects/b967463951554f38bd1c4c12429383c9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:36.981507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:36.991973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001b4ce-39eb-4aba-abb4-75eedd454dc9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:37.082668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:37.083325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:37.083732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:37.084031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] PATH_INFO: `/v3/users/a5959f258e3a4082b1840ff96ee991bb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:37.085217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5959f258e3a4082b1840ff96ee991bb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:37.088448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:37.162478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5959f258e3a4082b1840ff96ee991bb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:37.179095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5959f258e3a4082b1840ff96ee991bb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:37.181351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5959f258e3a4082b1840ff96ee991bb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:37.181351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5959f258e3a4082b1840ff96ee991bb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:37.190202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b9eeb504-c8ee-4c0d-a875-edbcd9e668d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5959f258e3a4082b1840ff96ee991bb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:37.211077 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2356/4694] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:36 2022] DELETE /identity/v3/users/a5959f258e3a4082b1840ff96ee991bb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:37.899644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:37.902024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:37.977051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4ec9-06f3-4d5a-8b77-739d9113aeff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.055856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:38.102928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.103903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.104342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.104850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] PATH_INFO: `/v3/projects/17015957f4364aa9be26b3ba7e53a6ee` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.107131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17015957f4364aa9be26b3ba7e53a6ee)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.109327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.188046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17015957f4364aa9be26b3ba7e53a6ee', 'request_id': 'req-807e2471-0af6-4739-9d85-3a23cb170a94'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:38.198630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17015957f4364aa9be26b3ba7e53a6ee', 'request_id': 'req-807e2471-0af6-4739-9d85-3a23cb170a94'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:38.213821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17015957f4364aa9be26b3ba7e53a6ee', 'request_id': 'req-807e2471-0af6-4739-9d85-3a23cb170a94'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:38.231997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] The token cache is being invalidate because project 17015957f4364aa9be26b3ba7e53a6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:38.232305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:38.235042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-807e2471-0af6-4739-9d85-3a23cb170a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:38.242075 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2339/4695] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:37 2022] DELETE /identity/v3/projects/17015957f4364aa9be26b3ba7e53a6ee => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:38.242329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.243171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.243452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.276235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:38.281358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:38.369230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2357/4696] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:32:38.380213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.383538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.384116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.410362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:38.411603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:38.422423 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2340/4697] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:38.427462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:38.441888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf102139-89a6-4bce-ba0f-315170ff3ad3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.447112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.447735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.448196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.448630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.449356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:32:38.450304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.452741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.466018 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2358/4698] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:32:38.470567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:38.482064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a43d5-3db8-48ee-97de-9b49939ffcc5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.489296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.490298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.490904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.491538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.492774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.497039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.534875 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2341/4699] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:38.539213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:38.553790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0f62a-359f-4398-81d0-ae9fcfc15db0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.560430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:38.632137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.633275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.633275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.633552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.634338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.636495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.671803 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2359/4700] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:38 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:38.675610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:38.687817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006a69-0920-4f7a-9f26-7e8fd8116e8f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.693563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.694217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.694507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.695021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.695691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.697447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.712451 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2342/4701] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:38.713978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:38.726835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be86ae4-0aac-4069-82d8-fd2fd6234f26 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.733288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e82843-8bb3-4dfc-9ce3-99eaa76d97d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.734207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82843-8bb3-4dfc-9ce3-99eaa76d97d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.734207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82843-8bb3-4dfc-9ce3-99eaa76d97d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.734483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82843-8bb3-4dfc-9ce3-99eaa76d97d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.735114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e82843-8bb3-4dfc-9ce3-99eaa76d97d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.736706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e82843-8bb3-4dfc-9ce3-99eaa76d97d1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.750185 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2360/4702] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:32:38.753380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:38.767545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c36c4-5333-4c63-87cf-724d606d866c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:38.773408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:38.774319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.774621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.774974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] PATH_INFO: `/v3/projects/363bab93e14e44938529b04c111c3486/users/f82b4ccacf3c4ea1b1051a5f76a5e75b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.795836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] RBAC: Authorizing `identity:create_grant(project_id=363bab93e14e44938529b04c111c3486, user_id=f82b4ccacf3c4ea1b1051a5f76a5e75b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:38.798670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:38.822280 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2343/4703] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:38 2022] PUT /identity/v3/projects/363bab93e14e44938529b04c111c3486/users/f82b4ccacf3c4ea1b1051a5f76a5e75b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:38.827167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:38.827357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:38.828186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:38.859834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] MFA Rules not processed for user `f82b4ccacf3c4ea1b1051a5f76a5e75b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:38.860838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:38.956556 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2361/4704] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:38.961492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.049811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:39.055893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cb2d-03e3-44bf-ae30-0f0548f2773e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.067896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.068842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.069288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.070655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.071572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.074298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.118986 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2344/4705] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:39.124667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.145434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22e0d3-8466-46df-9100-e7a0439743b0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.240733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.241367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.241650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.241936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.242668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.244738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.289369 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2362/4706] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:39 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:39.290202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.301021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee60aa-d002-4bba-a8ca-08b75ffbeef9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.306707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.307387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.307675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.307953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.309595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.311280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.329491 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2345/4707] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:39.330779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.337392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:39.342224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928347b-19f7-487f-ba99-07171f961f51 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.349295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.350263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.350692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.351101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] PATH_INFO: `/v3/projects/daca492c08ed4cebbb66d6e4c2167033/users/20ffde4a917b4b208dd8329b19e06bdc/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.372891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daca492c08ed4cebbb66d6e4c2167033, user_id=20ffde4a917b4b208dd8329b19e06bdc, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.375922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.397349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2363/4708] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:39 2022] PUT /identity/v3/projects/daca492c08ed4cebbb66d6e4c2167033/users/20ffde4a917b4b208dd8329b19e06bdc/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:39.398615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.410809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa724ca-746b-4b90-a47a-12b83e9fd6d6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.494974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c4094-2607-4a7c-be07-8295c3ce8192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.495622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c4094-2607-4a7c-be07-8295c3ce8192 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.495900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c4094-2607-4a7c-be07-8295c3ce8192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.496314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c4094-2607-4a7c-be07-8295c3ce8192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.497359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c4094-2607-4a7c-be07-8295c3ce8192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.499659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c4094-2607-4a7c-be07-8295c3ce8192 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.514082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2346/4709] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:39.517875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.530209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324e25-16c9-403f-8594-177566f99959 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.535731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.536474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.536773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.537055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] PATH_INFO: `/v3/projects/daca492c08ed4cebbb66d6e4c2167033/users/20ffde4a917b4b208dd8329b19e06bdc/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.539968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] RBAC: Authorizing `identity:create_grant(project_id=daca492c08ed4cebbb66d6e4c2167033, user_id=20ffde4a917b4b208dd8329b19e06bdc, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.542441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.555951 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2364/4710] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:39 2022] PUT /identity/v3/projects/daca492c08ed4cebbb66d6e4c2167033/users/20ffde4a917b4b208dd8329b19e06bdc/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:39.567717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.568226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.568586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.607563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] MFA Rules not processed for user `20ffde4a917b4b208dd8329b19e06bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:39.609205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:39.709115 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2347/4711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:39.720226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:39.724362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:39.823989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f05eb6-75c6-4948-981a-a2ef5c6d648c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:39.829290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb503ee1-f8fd-4dfb-810b-55877d54f058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:39.830828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb503ee1-f8fd-4dfb-810b-55877d54f058 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:39.831165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb503ee1-f8fd-4dfb-810b-55877d54f058 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:39.831448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb503ee1-f8fd-4dfb-810b-55877d54f058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:39.846936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb503ee1-f8fd-4dfb-810b-55877d54f058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:39.848560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb503ee1-f8fd-4dfb-810b-55877d54f058 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:39.860740 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2365/4712] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:32:39.947046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:40.037164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:40.054632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f5502-2e72-4cde-844f-339f7767ff9a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:40.068163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:40.068999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:40.069250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:40.069509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] PATH_INFO: `/v3/users/f82b4ccacf3c4ea1b1051a5f76a5e75b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:40.079302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82b4ccacf3c4ea1b1051a5f76a5e75b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:40.081975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:40.179641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82b4ccacf3c4ea1b1051a5f76a5e75b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:40.191849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82b4ccacf3c4ea1b1051a5f76a5e75b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:40.192693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82b4ccacf3c4ea1b1051a5f76a5e75b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:40.193665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82b4ccacf3c4ea1b1051a5f76a5e75b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:40.205724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82b4ccacf3c4ea1b1051a5f76a5e75b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:40.236872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2348/4713] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:39 2022] DELETE /identity/v3/users/f82b4ccacf3c4ea1b1051a5f76a5e75b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:40.238705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:40.240143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:40.240430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:40.274768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:40.276300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:40.417743 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2366/4714] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:40.439529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:40.444131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:40.592088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad39b74-1a58-4f62-b23d-21ebb933fc66 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:40.598408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:40.599067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:40.599355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:40.599714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:40.625132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:40.629688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:40.650308 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2349/4715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:41.122465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:41.124317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:41.137951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86dd6-a805-4c19-877b-a250b1405aca None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:41.154513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:41.155218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:41.155488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:41.155766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] PATH_INFO: `/v3/projects/363bab93e14e44938529b04c111c3486` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:41.162396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363bab93e14e44938529b04c111c3486)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:41.164433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:41.232635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363bab93e14e44938529b04c111c3486', 'request_id': 'req-5b51f3cf-8d50-4b4f-88d7-e4453c772926'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.240692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363bab93e14e44938529b04c111c3486', 'request_id': 'req-5b51f3cf-8d50-4b4f-88d7-e4453c772926'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.249289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363bab93e14e44938529b04c111c3486', 'request_id': 'req-5b51f3cf-8d50-4b4f-88d7-e4453c772926'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.253557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:41.274062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] The token cache is being invalidate because project 363bab93e14e44938529b04c111c3486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:41.274553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.275594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.278762 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2367/4716] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:41 2022] DELETE /identity/v3/projects/363bab93e14e44938529b04c111c3486 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:41.283314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:41.295787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acb087-ef1c-48bf-bf6e-c5fbc933cb7b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:41.368934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:41.369593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:41.369880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:41.370175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] PATH_INFO: `/v3/users/20ffde4a917b4b208dd8329b19e06bdc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:41.371681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ffde4a917b4b208dd8329b19e06bdc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:41.373946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:41.393543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:41.435578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ffde4a917b4b208dd8329b19e06bdc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.447149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ffde4a917b4b208dd8329b19e06bdc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.447766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ffde4a917b4b208dd8329b19e06bdc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.449180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ffde4a917b4b208dd8329b19e06bdc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.458879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-87c5349b-4545-47d7-9730-f3d7e5e96a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ffde4a917b4b208dd8329b19e06bdc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:41.481559 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2350/4717] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:41 2022] DELETE /identity/v3/users/20ffde4a917b4b208dd8329b19e06bdc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:41.964156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:41.967786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:42.010085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f3cf-8d50-4b4f-88d7-e4453c772926 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.146709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.147312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.147788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.148077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] PATH_INFO: `/v3/projects/daca492c08ed4cebbb66d6e4c2167033` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.149295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daca492c08ed4cebbb66d6e4c2167033)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.151291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.267181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daca492c08ed4cebbb66d6e4c2167033', 'request_id': 'req-bc754c47-8b13-4a4b-b220-1dda3d2ba613'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:42.279216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daca492c08ed4cebbb66d6e4c2167033', 'request_id': 'req-bc754c47-8b13-4a4b-b220-1dda3d2ba613'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:42.295833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daca492c08ed4cebbb66d6e4c2167033', 'request_id': 'req-bc754c47-8b13-4a4b-b220-1dda3d2ba613'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:42.314552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] The token cache is being invalidate because project daca492c08ed4cebbb66d6e4c2167033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:42.314854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:42.315514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc754c47-8b13-4a4b-b220-1dda3d2ba613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:42.317020 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2368/4718] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:41 2022] DELETE /identity/v3/projects/daca492c08ed4cebbb66d6e4c2167033 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:42.322200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.323116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.323939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.351879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:42.353241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:42.434232 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2351/4719] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:42.441971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.442330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.442555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.469881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:42.471144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:42.480631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2369/4720] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:42.485318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.497212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d6b7f-2cfe-4483-af78-b0e8caa6e0ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.502999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.503615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.503895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.504194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.504870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:32:42.505173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.506827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.522274 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2352/4721] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:32:42.528484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.545362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f8946-032c-4d61-80c9-5262ca38ab12 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.550266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.550964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.551413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.551785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.552662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.554872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.589604 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2370/4722] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:42 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:32:42.593818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.604431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458bd7f-20d3-4149-8afe-b84408b3738d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.668251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.669014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.669301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.669577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.670277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.672199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.697731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2353/4723] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:42 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:32:42.702510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.713801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e7e0-4bc9-44f3-a04f-52ef25c3cb7c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.719226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.719850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.720134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.720411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.721055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.722966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.736908 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2371/4724] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:42.738127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.749890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745dc5d-4745-40d0-aa9f-cd082117a9e5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.756449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c15a-fd95-41c0-826e-c9e7685d2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.757201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c15a-fd95-41c0-826e-c9e7685d2882 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.757345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c15a-fd95-41c0-826e-c9e7685d2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.757797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c15a-fd95-41c0-826e-c9e7685d2882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.758525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4c15a-fd95-41c0-826e-c9e7685d2882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.760112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4c15a-fd95-41c0-826e-c9e7685d2882 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.766466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:42.773346 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2354/4725] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:42.776983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.787380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709b50-05af-4358-af01-48bb1165e31b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:42.792295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:42.793105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.793360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.793657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] PATH_INFO: `/v3/projects/29f92ca6564143d8a1a0d8aca8d6e673/users/c209a27a791a487b9f5859d4e5485d57/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.810678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f92ca6564143d8a1a0d8aca8d6e673, user_id=c209a27a791a487b9f5859d4e5485d57, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:42.813368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:42.828090 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2372/4726] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:42 2022] PUT /identity/v3/projects/29f92ca6564143d8a1a0d8aca8d6e673/users/c209a27a791a487b9f5859d4e5485d57/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:32:42.839073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:42.839390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:42.839670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:42.870098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] MFA Rules not processed for user `c209a27a791a487b9f5859d4e5485d57`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:42.872132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:42.945396 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2355/4727] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:42.950090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:42.973031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:43.020556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ed47-4014-4bf9-b8a5-6505a69ab380 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.025244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.025850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.026126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.026423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.027075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.029537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.056601 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2373/4728] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:42 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:32:43.061265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.072365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38225cdb-b7ab-4cdd-a851-dea76b881a3e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.132056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.132674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.132953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.133230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.133862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.135801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.160939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2356/4729] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:43 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:43.162136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.173507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208836-aa2a-4a04-a781-a3f381a1746b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.178772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.179454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.179748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.180011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.180656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.182377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.197127 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2374/4730] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:32:43.198947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.209915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b393-b6cb-4961-8fdb-3f2bc28f14a4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.214748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce73e8e-2c39-43ec-aebd-75fd1d9e517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.215857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73e8e-2c39-43ec-aebd-75fd1d9e517a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.216172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73e8e-2c39-43ec-aebd-75fd1d9e517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.216461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73e8e-2c39-43ec-aebd-75fd1d9e517a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.217098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce73e8e-2c39-43ec-aebd-75fd1d9e517a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.218854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce73e8e-2c39-43ec-aebd-75fd1d9e517a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.229734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2357/4731] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:43.234815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.246677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789337aa-5f53-4a09-8625-b811aa5612d4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.253233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.254024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.254521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.254822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] PATH_INFO: `/v3/projects/adabe9e4914944d2975d16c371baa143/users/272ff606da4347d09416ef4ed6899bf3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.291689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adabe9e4914944d2975d16c371baa143, user_id=272ff606da4347d09416ef4ed6899bf3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.297694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.316184 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2375/4732] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:43 2022] PUT /identity/v3/projects/adabe9e4914944d2975d16c371baa143/users/272ff606da4347d09416ef4ed6899bf3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:32:43.328311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcc8b7-9ca0-459c-86ea-4d5a7b176fa7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.328897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcc8b7-9ca0-459c-86ea-4d5a7b176fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.329328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcc8b7-9ca0-459c-86ea-4d5a7b176fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.363652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b4bcc8b7-9ca0-459c-86ea-4d5a7b176fa7 None None] MFA Rules not processed for user `272ff606da4347d09416ef4ed6899bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:43.364888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4bcc8b7-9ca0-459c-86ea-4d5a7b176fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:43.439686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:43.451072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.453425 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2358/4733] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:43.493595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.494008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.494501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.519666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:43.521004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:43.523366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbdff-bb5e-4bf3-b9a6-06196e84bd72 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.529809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.530385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.530665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.530934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.531566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.533467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.569089 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2376/4734] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:43 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:43.570374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.597380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2359/4735] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:32:43.652215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:43.660782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7594b-4480-4f72-80a1-4591287a3fb1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.667002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.667856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.668495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.669359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.669511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.671405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.698577 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2377/4736] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:43 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:43.700851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.713909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab8f65-b4ce-4e9c-9901-1a4bb18948e6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.719638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.720274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.720555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.720835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.721488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.723154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.745040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2360/4737] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:32:43.745872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.759860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84d8c7-eef0-4fb5-bb47-65ee3eed2450 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:43.767553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:43.768343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:43.769175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:43.769175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] PATH_INFO: `/v3/projects/c28f61acf3004a239ab47231957e8f01/users/b1b9f6d0f42140129d54528bd5097c0c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:43.794115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28f61acf3004a239ab47231957e8f01, user_id=b1b9f6d0f42140129d54528bd5097c0c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:43.797968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:43.828084 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2378/4738] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:43 2022] PUT /identity/v3/projects/c28f61acf3004a239ab47231957e8f01/users/b1b9f6d0f42140129d54528bd5097c0c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:43.832927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:43.849194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b1c51-1718-4aea-9a6e-cad1a19c6f84 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:44.010312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996681f5-c1b1-427d-94f1-51b46fd2780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:44.011259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996681f5-c1b1-427d-94f1-51b46fd2780d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:44.012250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996681f5-c1b1-427d-94f1-51b46fd2780d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:44.012939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996681f5-c1b1-427d-94f1-51b46fd2780d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:44.013774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996681f5-c1b1-427d-94f1-51b46fd2780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:44.018487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996681f5-c1b1-427d-94f1-51b46fd2780d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:44.031935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2361/4739] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:44.035694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:44.067480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56a4fa-13a2-4d97-a4b6-09aacd3b875a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:44.081984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:44.085377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:44.085670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:44.085957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] PATH_INFO: `/v3/projects/c28f61acf3004a239ab47231957e8f01/users/b1b9f6d0f42140129d54528bd5097c0c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:44.100399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28f61acf3004a239ab47231957e8f01, user_id=b1b9f6d0f42140129d54528bd5097c0c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:44.110611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:44.143153 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2379/4740] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:44 2022] PUT /identity/v3/projects/c28f61acf3004a239ab47231957e8f01/users/b1b9f6d0f42140129d54528bd5097c0c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:44.155156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:44.155492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:44.155728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:44.216497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] MFA Rules not processed for user `b1b9f6d0f42140129d54528bd5097c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:44.217650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:44.371705 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2362/4741] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:44.385476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:44.387564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:44.511586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29d1f-bf07-4f1e-9187-2f1f10dc27c0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:44.518107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81c18-2725-4aa8-993e-9c5704d85996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:44.518878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81c18-2725-4aa8-993e-9c5704d85996 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:44.519264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81c18-2725-4aa8-993e-9c5704d85996 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:44.519645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81c18-2725-4aa8-993e-9c5704d85996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:44.551833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81c18-2725-4aa8-993e-9c5704d85996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:44.554633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81c18-2725-4aa8-993e-9c5704d85996 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:44.580164 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2380/4742] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:45.645125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:45.658126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea1882-feb7-47bf-a7c1-2522298af6f4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:45.672553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfc848-54d7-457c-80e5-1913758c9b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:45.672777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc848-54d7-457c-80e5-1913758c9b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:45.673050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc848-54d7-457c-80e5-1913758c9b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:45.673326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc848-54d7-457c-80e5-1913758c9b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:45.692463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:45.803001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc848-54d7-457c-80e5-1913758c9b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:45.804481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc848-54d7-457c-80e5-1913758c9b7a service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:45.824430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2363/4743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:47.358651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:47.359631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:47.360136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:47.403915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:47.410027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:47.495074 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2381/4744] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:51.157611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19bcd-ba84-4e3e-97fe-6273f133d2c4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:51.158550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19bcd-ba84-4e3e-97fe-6273f133d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:51.158985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19bcd-ba84-4e3e-97fe-6273f133d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:51.191588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dcc19bcd-ba84-4e3e-97fe-6273f133d2c4 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:51.192826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dcc19bcd-ba84-4e3e-97fe-6273f133d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:51.202382 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2364/4745] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:51.729183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:51.737043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:51.873362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:51.881755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6916a-3f8a-43c5-a057-2299b291ddee None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:51.890178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:51.891104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:51.891489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:51.891870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] PATH_INFO: `/v3/users/f2d7fc80a0ed4dd7b384cfe83659b48c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:51.893236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d7fc80a0ed4dd7b384cfe83659b48c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:51.895431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:51.963112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2108-3aec-41ef-8a5c-8a354dc9a78d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:51.963718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2108-3aec-41ef-8a5c-8a354dc9a78d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:51.964273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2108-3aec-41ef-8a5c-8a354dc9a78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:52.005978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f35e2108-3aec-41ef-8a5c-8a354dc9a78d None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:52.008669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f35e2108-3aec-41ef-8a5c-8a354dc9a78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:52.062931 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2365/4746] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:32:52.086178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d7fc80a0ed4dd7b384cfe83659b48c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:52.115557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d7fc80a0ed4dd7b384cfe83659b48c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:52.116409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d7fc80a0ed4dd7b384cfe83659b48c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:52.117178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d7fc80a0ed4dd7b384cfe83659b48c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:52.131421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d7fc80a0ed4dd7b384cfe83659b48c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:52.161073 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2382/4747] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:51 2022] DELETE /identity/v3/users/f2d7fc80a0ed4dd7b384cfe83659b48c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:52.165986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7c55c-a43a-40a7-a35d-a8baa7c2d238 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:52.166870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7c55c-a43a-40a7-a35d-a8baa7c2d238 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:52.166870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7c55c-a43a-40a7-a35d-a8baa7c2d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:52.210667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-44a7c55c-a43a-40a7-a35d-a8baa7c2d238 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:52.211897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44a7c55c-a43a-40a7-a35d-a8baa7c2d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:52.300671 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2366/4748] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:52.349876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:52.353183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:52.490874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed206d-e8da-4789-83f5-f7e0a2bae8c8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:52.498266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:52.499129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:52.499590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:52.500013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:52.514668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:52.516733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:52.531195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2383/4749] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:53.009782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb32105-ead4-4e9f-a117-d720bfcce728 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:53.010075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb32105-ead4-4e9f-a117-d720bfcce728 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:53.010379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb32105-ead4-4e9f-a117-d720bfcce728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:53.018758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:53.022420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:53.045485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d742-1971-4313-8ffa-4a8dbc049ae1 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:53.051174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2bb32105-ead4-4e9f-a117-d720bfcce728 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:53.054597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2bb32105-ead4-4e9f-a117-d720bfcce728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:53.072208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:53.072908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:53.073197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:53.073507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] PATH_INFO: `/v3/projects/6196425d8d4649cf89da0fbb9951a229` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:53.078020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6196425d8d4649cf89da0fbb9951a229)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:53.084074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:53.178691 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2367/4750] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:53.233907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6196425d8d4649cf89da0fbb9951a229', 'request_id': 'req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:53.247922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6196425d8d4649cf89da0fbb9951a229', 'request_id': 'req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:53.266339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6196425d8d4649cf89da0fbb9951a229', 'request_id': 'req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:53.282640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:53.290137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] The token cache is being invalidate because project 6196425d8d4649cf89da0fbb9951a229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:53.290806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:53.291516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5aa1fbfd-8541-49a3-9c11-1d833cd3854f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:53.293176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2384/4751] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:53 2022] DELETE /identity/v3/projects/6196425d8d4649cf89da0fbb9951a229 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:53.298320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:53.299012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:53.299012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:53.349439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:53.353541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:53.479314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:53.531899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2368/4752] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:53.539502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:53.539785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:53.540271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:53.578427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:53.579710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:53.600981 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2385/4753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:53.602137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:53.622683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b9d1-cfa8-4116-9659-6342a4d8756d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:53.628829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:53.629471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:53.629757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:53.630123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:53.630722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:32:53.631028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:53.632651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:53.667595 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2369/4754] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:32:53.672358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:53.685473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b5745-3112-4e8f-a8bb-8216d46acc2a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:53.703764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:53.705048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:53.705536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:53.706045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:53.707318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:53.717342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:53.776158 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2386/4755] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:53 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:53.780441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:53.798472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53267e23-43fc-4c49-a0f2-b00fc2e13d94 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:54.011517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:54.012190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.012472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.012749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.013990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:54.016875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:54.066201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2370/4756] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:53 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:54.068287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:54.080823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b195c-9332-472f-97d4-7303c6fb3476 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:54.088545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:54.090898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.091348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.091776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.092605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:54.094639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:54.112364 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2387/4757] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:54.112689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:54.140570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b64300-6b55-4a64-b713-c1315c2d52da admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:54.158124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e387-7edd-49b0-9824-22cf6eaa2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:54.159061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e387-7edd-49b0-9824-22cf6eaa2eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.162117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e387-7edd-49b0-9824-22cf6eaa2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.162755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e387-7edd-49b0-9824-22cf6eaa2eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.163679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e387-7edd-49b0-9824-22cf6eaa2eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:54.167054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e387-7edd-49b0-9824-22cf6eaa2eeb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:54.204819 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2371/4758] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:32:54.208888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:54.225579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5673c-8442-4308-b38e-1a893854055c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:54.238921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10607166-2a65-421a-9eb4-b0812c167ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:54.239622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10607166-2a65-421a-9eb4-b0812c167ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.240093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10607166-2a65-421a-9eb4-b0812c167ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.240526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10607166-2a65-421a-9eb4-b0812c167ff4 admin admin] PATH_INFO: `/v3/projects/826587df20784793acdf294d4a953c24/users/ba1878aa44db4d9c901e280ccfd22efa/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.272483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10607166-2a65-421a-9eb4-b0812c167ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826587df20784793acdf294d4a953c24, user_id=ba1878aa44db4d9c901e280ccfd22efa, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:54.285768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10607166-2a65-421a-9eb4-b0812c167ff4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:54.312446 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2388/4759] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:54 2022] PUT /identity/v3/projects/826587df20784793acdf294d4a953c24/users/ba1878aa44db4d9c901e280ccfd22efa/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:54.322094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.322476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.322760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.349098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.349808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.350430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.374537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] MFA Rules not processed for user `ba1878aa44db4d9c901e280ccfd22efa`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:54.375820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:54.376459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:54.378242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:54.472640 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2389/4760] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:32:54.514887 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2372/4761] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:54.577635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:54.580274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:54.661797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c946e32-2a91-406a-a9ce-758036df8e15 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:54.666518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082fa18-08d5-4b0c-81dc-ffdff2ca8660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:54.667146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082fa18-08d5-4b0c-81dc-ffdff2ca8660 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.667422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082fa18-08d5-4b0c-81dc-ffdff2ca8660 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.667702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082fa18-08d5-4b0c-81dc-ffdff2ca8660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.678111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082fa18-08d5-4b0c-81dc-ffdff2ca8660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:54.679608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082fa18-08d5-4b0c-81dc-ffdff2ca8660 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:54.692505 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2390/4762] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:54.708367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:54.764797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:54.796463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a461-2937-4835-8416-bf69e513dd57 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:54.804105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:54.805006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:54.805447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:54.805968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] PATH_INFO: `/v3/users/ba1878aa44db4d9c901e280ccfd22efa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:54.807974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1878aa44db4d9c901e280ccfd22efa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:54.811221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:54.916619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1878aa44db4d9c901e280ccfd22efa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:54.936302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1878aa44db4d9c901e280ccfd22efa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:54.936912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1878aa44db4d9c901e280ccfd22efa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:54.937851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1878aa44db4d9c901e280ccfd22efa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:54.954077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21a5c2bd-e0e9-4aee-aa62-0176c65c320c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1878aa44db4d9c901e280ccfd22efa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:55.010951 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2373/4763] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:54 2022] DELETE /identity/v3/users/ba1878aa44db4d9c901e280ccfd22efa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:55.015600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:55.015700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:55.015938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:55.070350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:55.073542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:55.217282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:55.217755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:55.217835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:55.228990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:55.271016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:55.275093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:55.307984 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2391/4764] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:55.314275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:55.319392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:55.375523 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2374/4765] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:32:55.376549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:55.380438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:55.428392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fea7e-a5f1-45db-afd0-97df3cedba1b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:55.438934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:55.439575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:55.439856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:55.440135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:55.444126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:55.532618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e86b06-cd94-4da6-9468-f7b2dbb731c6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:55.537109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:55.537753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:55.538243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:55.538791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:55.550516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:55.551961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:55.568854 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2375/4766] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:55.594673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:55.596822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7374ac-4110-4579-9619-7b68e91c209d service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:55.626835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2392/4767] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:56.229428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:56.231617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:56.253566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca092e3-88db-4e5a-ae54-d6d83314cfa8 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:56.265721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:56.266559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:56.267021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:56.267536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] PATH_INFO: `/v3/projects/826587df20784793acdf294d4a953c24` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:56.269076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] RBAC: Authorizing `identity:delete_project(project_id=826587df20784793acdf294d4a953c24)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:56.274033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:56.280200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:56.338555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2d5d-f1cd-422f-8ca4-ea0e68a05da4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:56.340364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2d5d-f1cd-422f-8ca4-ea0e68a05da4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:56.341583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2d5d-f1cd-422f-8ca4-ea0e68a05da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:56.376105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-257a2d5d-f1cd-422f-8ca4-ea0e68a05da4 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:56.378446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-257a2d5d-f1cd-422f-8ca4-ea0e68a05da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:56.398461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826587df20784793acdf294d4a953c24', 'request_id': 'req-8e775fcf-8f1a-4b97-8346-5cd399be022f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:56.413572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826587df20784793acdf294d4a953c24', 'request_id': 'req-8e775fcf-8f1a-4b97-8346-5cd399be022f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:56.427619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826587df20784793acdf294d4a953c24', 'request_id': 'req-8e775fcf-8f1a-4b97-8346-5cd399be022f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:56.445938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] The token cache is being invalidate because project 826587df20784793acdf294d4a953c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:32:56.456714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:56.462289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e775fcf-8f1a-4b97-8346-5cd399be022f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:32:56.464897 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2376/4768] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:32:56 2022] DELETE /identity/v3/projects/826587df20784793acdf294d4a953c24 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:56.472083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:56.473107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:56.473578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:56.491167 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2393/4769] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:32:56.505025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:56.506562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:56.632398 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2377/4770] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:56.642610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:56.643150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:56.643663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:56.667570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:56.670303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:56.689612 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2394/4771] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:56.694175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:56.711306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc5ea4-6065-4c4a-be3b-77908ddc8b26 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:56.723015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:56.723660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:56.723946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:56.724221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:56.724894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:32:56.725202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:56.727729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:56.759962 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2378/4772] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:32:56.766303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:56.782649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3ab04-ccb9-4fe8-8e71-77ba3992766b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:56.789416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:56.790344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:56.790813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:56.791076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:56.819114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:56.820912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:56.884508 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2395/4773] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:56 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:56.889118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:56.900286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386b85f-1770-4bea-b419-93cd6c1c63f9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.057295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.058167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.059407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.059876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.060900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.066943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:57.118809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:57.129412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2379/4774] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:56 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:57.132122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775913c8-f6e8-4604-a5c1-404178a1eace admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.139651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.140218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.140500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.140823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.141479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.143334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:57.161230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:57.167975 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2396/4775] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:57.173630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5f81-cb7f-4c2d-8aa3-3a9bbce1aeca admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.179061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8b27-1750-4244-a0fe-9d1afc5e4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.179826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8b27-1750-4244-a0fe-9d1afc5e4d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.180718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8b27-1750-4244-a0fe-9d1afc5e4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.181106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8b27-1750-4244-a0fe-9d1afc5e4d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.182390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d8b27-1750-4244-a0fe-9d1afc5e4d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.184265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d8b27-1750-4244-a0fe-9d1afc5e4d42 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:57.185983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:57.208828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:57.218386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:57.219082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2380/4776] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:57.223267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d739264-8683-41be-884e-d29508460db6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.229413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0448f1d-b601-45eb-9b0e-80361ca5567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.231487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0448f1d-b601-45eb-9b0e-80361ca5567e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.232278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0448f1d-b601-45eb-9b0e-80361ca5567e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.232656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0448f1d-b601-45eb-9b0e-80361ca5567e admin admin] PATH_INFO: `/v3/projects/a8a7f74bafb54267b18c886985cdfd5a/users/a5eff04958ed4965b243357e2e3c266f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.252514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0448f1d-b601-45eb-9b0e-80361ca5567e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a7f74bafb54267b18c886985cdfd5a, user_id=a5eff04958ed4965b243357e2e3c266f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.270510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0448f1d-b601-45eb-9b0e-80361ca5567e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:57.302890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2397/4777] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:57 2022] PUT /identity/v3/projects/a8a7f74bafb54267b18c886985cdfd5a/users/a5eff04958ed4965b243357e2e3c266f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:57.312331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.312730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.313153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.313883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.315514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.315965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.346747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] MFA Rules not processed for user `a5eff04958ed4965b243357e2e3c266f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:57.348397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:57.353957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:57.357635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:57.496665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2398/4778] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:57.498648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:57.509217 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2381/4779] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:57.648024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112455-1214-41f4-8218-8e7ba4b8922b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.659050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.660025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.660416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.661169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.662741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.669773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:57.730852 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2399/4780] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:32:57 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:57.731900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:57.750234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ca952-cfc3-472e-a054-569232b64b51 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.891043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.892050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.892662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.893095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.896685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.899965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:57.959054 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2382/4781] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:32:57 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:32:57.969087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:57.982212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972d038-aae2-4590-b6b6-b06b19ec99af admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:57.991439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:57.992235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:57.992520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:57.992844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:57.993575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:57.995425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:58.015234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:58.023069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2400/4782] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:58.026932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322ff7-4082-4979-95f3-ecfb9a8f0802 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:58.033533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:58.034455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:58.034745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:58.035026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] PATH_INFO: `/v3/projects/61c2baa4c8c044bd88354e8af3f3e1d6/users/b8bbe24970f84cefafec5db8c735c07d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:58.053926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c2baa4c8c044bd88354e8af3f3e1d6, user_id=b8bbe24970f84cefafec5db8c735c07d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:58.057330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:58.083673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:58.095117 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2383/4783] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:58 2022] PUT /identity/v3/projects/61c2baa4c8c044bd88354e8af3f3e1d6/users/b8bbe24970f84cefafec5db8c735c07d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:58.100598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf1ebc-ce96-49cf-bd2c-44a1a51db1a4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:58.252804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:58.301464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013b589-7791-47de-a5e6-93db7e565db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:58.302788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b589-7791-47de-a5e6-93db7e565db6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:58.316730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b589-7791-47de-a5e6-93db7e565db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:58.317130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b589-7791-47de-a5e6-93db7e565db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:58.330047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013b589-7791-47de-a5e6-93db7e565db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:58.333494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013b589-7791-47de-a5e6-93db7e565db6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:58.364272 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2401/4784] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:32:58.368858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:58.385054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7dec-4b54-4369-a3c1-16ead6573d55 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:58.397262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:58.398090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:58.399426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:58.401105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] PATH_INFO: `/v3/projects/61c2baa4c8c044bd88354e8af3f3e1d6/users/b8bbe24970f84cefafec5db8c735c07d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:58.405381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c2baa4c8c044bd88354e8af3f3e1d6, user_id=b8bbe24970f84cefafec5db8c735c07d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:58.408426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:58.454219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2384/4785] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:32:58 2022] PUT /identity/v3/projects/61c2baa4c8c044bd88354e8af3f3e1d6/users/b8bbe24970f84cefafec5db8c735c07d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:32:58.465846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab95e-99c2-48bd-a223-1fedb1acc08e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:58.466500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab95e-99c2-48bd-a223-1fedb1acc08e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:58.466966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab95e-99c2-48bd-a223-1fedb1acc08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:58.566489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2b2ab95e-99c2-48bd-a223-1fedb1acc08e None None] MFA Rules not processed for user `b8bbe24970f84cefafec5db8c735c07d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:58.567730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2b2ab95e-99c2-48bd-a223-1fedb1acc08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:58.771142 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2402/4786] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:58.788204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:58.790162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:58.920657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d3a45-8485-4193-945f-3330d36672a6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:58.924652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:58.925341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:58.925628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:58.925917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:58.934863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:32:58.938322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:58.940705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:32:58.954828 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2385/4787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:32:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:32:59.112224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef35669-bcaa-4da1-9ea4-59917e3cc295 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:59.112659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef35669-bcaa-4da1-9ea4-59917e3cc295 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:59.113037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef35669-bcaa-4da1-9ea4-59917e3cc295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:59.164854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1ef35669-bcaa-4da1-9ea4-59917e3cc295 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:32:59.166134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ef35669-bcaa-4da1-9ea4-59917e3cc295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:32:59.283816 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2403/4788] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:32:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:32:59.799639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:32:59.934205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46450c4-fced-41e6-9b6a-52174b70d6fb service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:32:59.944757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:32:59.945619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:32:59.946228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:32:59.946656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] PATH_INFO: `/v3/users/a5eff04958ed4965b243357e2e3c266f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:32:59.963098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5eff04958ed4965b243357e2e3c266f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:32:59.965617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:00.150969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5eff04958ed4965b243357e2e3c266f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:00.171110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5eff04958ed4965b243357e2e3c266f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:00.172425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5eff04958ed4965b243357e2e3c266f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:00.172971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5eff04958ed4965b243357e2e3c266f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:00.206806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5eff04958ed4965b243357e2e3c266f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:00.253073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2386/4789] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:32:59 2022] DELETE /identity/v3/users/a5eff04958ed4965b243357e2e3c266f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:00.257622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:00.258571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:00.258571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:00.295330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:00.296788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:00.523226 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2404/4790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:00.551404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:00.553116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:00.706476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9cbc4-1e95-416c-b9e7-8acd6bc0d1d9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:00.727212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:00.728144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:00.728639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:00.729199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:00.749365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:00.766742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:00.830822 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2387/4791] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:02.207312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:02.209429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:02.233991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812490-e495-475e-ba67-c02be72d1aed None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:02.248930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:02.251338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:02.254354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:02.254676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] PATH_INFO: `/v3/projects/a8a7f74bafb54267b18c886985cdfd5a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:02.273707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a7f74bafb54267b18c886985cdfd5a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:02.283809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:02.310712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:02.440997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a7f74bafb54267b18c886985cdfd5a', 'request_id': 'req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.459247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a7f74bafb54267b18c886985cdfd5a', 'request_id': 'req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.474506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a7f74bafb54267b18c886985cdfd5a', 'request_id': 'req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.505186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] The token cache is being invalidate because project a8a7f74bafb54267b18c886985cdfd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:02.505673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.506678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.509513 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2405/4792] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:02 2022] DELETE /identity/v3/projects/a8a7f74bafb54267b18c886985cdfd5a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:02.513663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:02.529583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf13c-5dea-4a9b-84d9-c61e1acea46c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:02.564548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:02.585022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:02.586659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:02.718141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:02.719047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:02.719590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:02.720196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] PATH_INFO: `/v3/users/b8bbe24970f84cefafec5db8c735c07d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:02.721811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bbe24970f84cefafec5db8c735c07d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:02.733477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:02.777349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3aa5-ef8d-48d9-aff8-a7c160277511 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:02.801245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:02.802074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:02.802370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:02.802649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] PATH_INFO: `/v3/users/c209a27a791a487b9f5859d4e5485d57` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:02.811025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c209a27a791a487b9f5859d4e5485d57)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:02.813025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:02.879282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bbe24970f84cefafec5db8c735c07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.905441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bbe24970f84cefafec5db8c735c07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.907108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bbe24970f84cefafec5db8c735c07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.907794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bbe24970f84cefafec5db8c735c07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.925928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67df6417-d2f8-4581-aff8-92be4ac187b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bbe24970f84cefafec5db8c735c07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.961050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c209a27a791a487b9f5859d4e5485d57'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:02.991468 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2388/4793] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:02 2022] DELETE /identity/v3/users/b8bbe24970f84cefafec5db8c735c07d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:03.000294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c209a27a791a487b9f5859d4e5485d57'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:03.003299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c209a27a791a487b9f5859d4e5485d57'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:03.003950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c209a27a791a487b9f5859d4e5485d57'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:03.018130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c209a27a791a487b9f5859d4e5485d57'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:03.041565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2406/4794] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:02 2022] DELETE /identity/v3/users/c209a27a791a487b9f5859d4e5485d57 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:03.048879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:03.049171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:03.050131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:03.084508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:03.085772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:03.244680 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2389/4795] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:03.302474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:03.305144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:03.340707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:03.474195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbefbb6-8dbb-4698-a7e1-5eb607625c9d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:03.485834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389ec95-a4a7-47e7-a7c9-361b875159ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:03.486689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389ec95-a4a7-47e7-a7c9-361b875159ac service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:03.487125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389ec95-a4a7-47e7-a7c9-361b875159ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:03.488377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389ec95-a4a7-47e7-a7c9-361b875159ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:03.513572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389ec95-a4a7-47e7-a7c9-361b875159ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:03.515518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389ec95-a4a7-47e7-a7c9-361b875159ac service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:03.545776 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2407/4796] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:04.416491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:04.419629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:04.453444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b39b0-a9be-418c-b2bf-8354a58333a6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:04.471271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:04.472760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:04.473261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:04.473718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] PATH_INFO: `/v3/projects/61c2baa4c8c044bd88354e8af3f3e1d6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:04.478944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c2baa4c8c044bd88354e8af3f3e1d6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:04.483730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:04.627312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:04.664237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c2baa4c8c044bd88354e8af3f3e1d6', 'request_id': 'req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:04.680856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c2baa4c8c044bd88354e8af3f3e1d6', 'request_id': 'req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:04.708131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c2baa4c8c044bd88354e8af3f3e1d6', 'request_id': 'req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:04.728370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] The token cache is being invalidate because project 61c2baa4c8c044bd88354e8af3f3e1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:04.728665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:04.729916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b44ab40e-de30-4c8d-8ae4-5e5069cea6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:04.736986 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2390/4797] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:04 2022] DELETE /identity/v3/projects/61c2baa4c8c044bd88354e8af3f3e1d6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:04.746551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:04.748009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:04.748698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:04.775181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:04.777685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:04.869605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:04.870074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:04.870594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:04.884972 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2408/4798] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:04.928698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:04.931589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:04.961152 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2391/4799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:04.966257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:04.983286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c291026-552a-410b-a618-9929f3f3fc66 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:04.996657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:04.999136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:04.999552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:04.999845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.000534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:05.000888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.002998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.020008 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2409/4800] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:05.022615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.035039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1060-9008-49d0-8f1f-bdd6e1ea09d1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.043787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.044573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.044935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.045287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.046028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.048764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.088315 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2392/4801] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:05 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:33:05.093535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.110700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0520-74bd-4c6e-aac0-58b313720015 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.218603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.222128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:05.229798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.232727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.234508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.234852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.236626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.240045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.248679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071420-c5e8-44d4-8db3-827054145176 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.265089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.265918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.266333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.266718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] PATH_INFO: `/v3/projects/29f92ca6564143d8a1a0d8aca8d6e673` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.271764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f92ca6564143d8a1a0d8aca8d6e673)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.275532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.308934 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2410/4802] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:05 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:33:05.313449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.358345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a8fc-faaa-4f5a-91b6-ed44ae6ee076 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.368205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.369067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.370405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.371691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.372860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.377273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.415343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f92ca6564143d8a1a0d8aca8d6e673', 'request_id': 'req-d170e6bd-4f13-4604-b13c-2271f8ce6d07'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.421934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f92ca6564143d8a1a0d8aca8d6e673', 'request_id': 'req-d170e6bd-4f13-4604-b13c-2271f8ce6d07'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.422561 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2411/4803] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:05.427984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.440495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f92ca6564143d8a1a0d8aca8d6e673', 'request_id': 'req-d170e6bd-4f13-4604-b13c-2271f8ce6d07'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.445137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9caf-f2a4-4ee2-9d36-412798444e9c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.465996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] The token cache is being invalidate because project 29f92ca6564143d8a1a0d8aca8d6e673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:05.468525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.471330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.476042 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2393/4804] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:05 2022] DELETE /identity/v3/projects/29f92ca6564143d8a1a0d8aca8d6e673 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:05.480634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.487858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:05.495459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:05.591141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.591784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.592065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.592339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.593001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.594337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170e6bd-4f13-4604-b13c-2271f8ce6d07 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.594662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.601100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.602099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.602633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.603145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] PATH_INFO: `/v3/users/272ff606da4347d09416ef4ed6899bf3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.604562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272ff606da4347d09416ef4ed6899bf3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.607810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.616755 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2412/4805] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:33:05.618158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.619791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:05.633570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:05.645015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e696b9-e01b-4fe9-b2be-7b9419c5a318 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:05.660270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc133-20b0-4527-a3af-a66d77835735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:05.661079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc133-20b0-4527-a3af-a66d77835735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.661316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc133-20b0-4527-a3af-a66d77835735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.661589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc133-20b0-4527-a3af-a66d77835735 admin admin] PATH_INFO: `/v3/projects/3f8f4e1475ac4759ad9bd7122e9d7811/users/e5356d1d65fb4f05bddb3c68a0e786cc/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.695873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc133-20b0-4527-a3af-a66d77835735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8f4e1475ac4759ad9bd7122e9d7811, user_id=e5356d1d65fb4f05bddb3c68a0e786cc, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:05.698503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc133-20b0-4527-a3af-a66d77835735 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:05.703673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272ff606da4347d09416ef4ed6899bf3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.722778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272ff606da4347d09416ef4ed6899bf3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.725181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272ff606da4347d09416ef4ed6899bf3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.725181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272ff606da4347d09416ef4ed6899bf3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.734987 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2413/4806] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:05 2022] PUT /identity/v3/projects/3f8f4e1475ac4759ad9bd7122e9d7811/users/e5356d1d65fb4f05bddb3c68a0e786cc/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:05.744812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:05.745099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:05.745374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:05.752529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272ff606da4347d09416ef4ed6899bf3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:05.798084 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2394/4807] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:05 2022] DELETE /identity/v3/users/272ff606da4347d09416ef4ed6899bf3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:05.835890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] MFA Rules not processed for user `e5356d1d65fb4f05bddb3c68a0e786cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:05.837134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:05.981473 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2414/4808] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:33:05.984161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:05.985795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:06.141039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35223401-56e2-4234-b74e-3e07a53ab607 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:06.162934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:06.163584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.163864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.164136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:06.164855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:06.166822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:06.245516 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2395/4809] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:05 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:06.247682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:06.275412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496eae-e55d-4f06-94a8-da4a86f26c82 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:06.379644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:06.380709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.381313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.381803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:06.383380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:06.386041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:06.440379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2415/4810] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:06 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:06.445333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:06.472512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd281b-fd93-49c7-a5f4-bf69434c75fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:06.482839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:06.483575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.483753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.484029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:06.484687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:06.486435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:06.525502 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2396/4811] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:33:06.526608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:06.541901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb811-ba2e-4996-9693-377fda2cfa4a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:06.551279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:06.551934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.552223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.552529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] PATH_INFO: `/v3/projects/cec831ad9f574d92a7f9a95610348132/users/036f32fcdca746c7893022e57251c4bb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:06.573550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:06.595961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec831ad9f574d92a7f9a95610348132, user_id=036f32fcdca746c7893022e57251c4bb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:06.599493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:06.643843 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2416/4812] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:06 2022] PUT /identity/v3/projects/cec831ad9f574d92a7f9a95610348132/users/036f32fcdca746c7893022e57251c4bb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:06.645323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:06.664880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962688c-fb62-477d-a21a-dd9bc5397b37 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:06.798248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8f526-f4fe-4e41-96bc-0a5d9f73f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:06.798889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f526-f4fe-4e41-96bc-0a5d9f73f361 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.799169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f526-f4fe-4e41-96bc-0a5d9f73f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.799442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f526-f4fe-4e41-96bc-0a5d9f73f361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:06.800088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8f526-f4fe-4e41-96bc-0a5d9f73f361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:06.801701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8f526-f4fe-4e41-96bc-0a5d9f73f361 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:06.830039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2397/4813] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:06.833938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:06.899862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d0246-7fa9-4065-bdd2-3f0012266bb3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:06.940359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:06.942696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.944237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.945877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] PATH_INFO: `/v3/projects/cec831ad9f574d92a7f9a95610348132/users/036f32fcdca746c7893022e57251c4bb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:06.948527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec831ad9f574d92a7f9a95610348132, user_id=036f32fcdca746c7893022e57251c4bb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:06.952791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:06.986666 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2417/4814] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:06 2022] PUT /identity/v3/projects/cec831ad9f574d92a7f9a95610348132/users/036f32fcdca746c7893022e57251c4bb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:06.998592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:06.998908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:06.999156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:07.009351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:07.061314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] MFA Rules not processed for user `036f32fcdca746c7893022e57251c4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:07.067364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:07.193515 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2398/4815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:07.268652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:07.274387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:07.466286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bec2f-42ce-40ed-9b26-f8d1e00c4dea admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:07.481377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:07.482294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:07.482673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:07.483045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] PATH_INFO: `/v3/projects/adabe9e4914944d2975d16c371baa143` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:07.486313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adabe9e4914944d2975d16c371baa143)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:07.488370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:07.634009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adabe9e4914944d2975d16c371baa143', 'request_id': 'req-db0a4034-2b1b-4e29-bb9b-62300abd34e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:07.643054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adabe9e4914944d2975d16c371baa143', 'request_id': 'req-db0a4034-2b1b-4e29-bb9b-62300abd34e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:07.659215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adabe9e4914944d2975d16c371baa143', 'request_id': 'req-db0a4034-2b1b-4e29-bb9b-62300abd34e2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:07.682640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] The token cache is being invalidate because project adabe9e4914944d2975d16c371baa143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:07.683038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:07.684910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:07.690502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2418/4816] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:07 2022] DELETE /identity/v3/projects/adabe9e4914944d2975d16c371baa143 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:07.692748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:07.717669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590d1c8-4193-4278-b1b0-dda270f2f1c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:07.830420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:07.831464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:07.831986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:07.832580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] PATH_INFO: `/v3/users/b1b9f6d0f42140129d54528bd5097c0c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:07.834796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b9f6d0f42140129d54528bd5097c0c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:07.837247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:07.996037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b9f6d0f42140129d54528bd5097c0c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:08.034037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b9f6d0f42140129d54528bd5097c0c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:08.035768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b9f6d0f42140129d54528bd5097c0c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:08.038105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b9f6d0f42140129d54528bd5097c0c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:08.085460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad892bd3-5e29-41a3-a881-b46389781ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b9f6d0f42140129d54528bd5097c0c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:08.169668 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2399/4817] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:07 2022] DELETE /identity/v3/users/b1b9f6d0f42140129d54528bd5097c0c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:08.226553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:08.229653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:08.348091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4034-2b1b-4e29-bb9b-62300abd34e2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:08.398625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:08.463707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:08.467486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:08.468015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:08.469464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:08.472139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:08.628317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:08.628914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:08.628914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:08.664455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:08.665968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:08.671174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:08.671835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:08.677146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:08.709562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2419/4818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:08.820573 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2400/4819] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:09.182053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:09.184361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:09.359908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09030316-2908-4763-9beb-f92ca18cecb5 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:09.371231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:09.375840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:09.376441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:09.378255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] PATH_INFO: `/v3/users/872baa14b3cc4791b7fca28a4e4d4a31` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:09.397920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872baa14b3cc4791b7fca28a4e4d4a31)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:09.400186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:09.596463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872baa14b3cc4791b7fca28a4e4d4a31'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:09.670806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872baa14b3cc4791b7fca28a4e4d4a31'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:09.675590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872baa14b3cc4791b7fca28a4e4d4a31'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:09.689096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872baa14b3cc4791b7fca28a4e4d4a31'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:09.704287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872baa14b3cc4791b7fca28a4e4d4a31'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:09.705462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:09.706873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:09.707553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:09.739817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ad20-136b-423c-8de7-9dcd79019964 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:09.752788 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2420/4820] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:09 2022] DELETE /identity/v3/users/872baa14b3cc4791b7fca28a4e4d4a31 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:09.804814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:09.806811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:09.877216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:09.877876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:09.878175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:09.878456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] PATH_INFO: `/v3/projects/c28f61acf3004a239ab47231957e8f01` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:09.879669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28f61acf3004a239ab47231957e8f01)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:09.881542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:09.948082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee08c6-4c1a-4af2-a312-cde8def19439 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:09.958663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '036f32fcdca746c7893022e57251c4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec831ad9f574d92a7f9a95610348132', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:09.959312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:09.959597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:09.959973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:09.960648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:09.960958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:09.963043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:09.982477 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2421/4821] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:09.983326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:09.992335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28f61acf3004a239ab47231957e8f01', 'request_id': 'req-a7da4a99-fe42-4bc4-8133-afaa2cf57550'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:09.996417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d35ba-ce9e-4a71-acc8-220cddf99f81 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:10.005699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28f61acf3004a239ab47231957e8f01', 'request_id': 'req-a7da4a99-fe42-4bc4-8133-afaa2cf57550'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.021109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28f61acf3004a239ab47231957e8f01', 'request_id': 'req-a7da4a99-fe42-4bc4-8133-afaa2cf57550'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.039611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] The token cache is being invalidate because project c28f61acf3004a239ab47231957e8f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:10.040578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.042444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a7da4a99-fe42-4bc4-8133-afaa2cf57550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.053284 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2401/4822] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:09 2022] DELETE /identity/v3/projects/c28f61acf3004a239ab47231957e8f01 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:10.053284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.053284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.053284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.082966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f8f61-07b7-4a38-8a1d-5709bd424182 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '036f32fcdca746c7893022e57251c4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec831ad9f574d92a7f9a95610348132', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:10.084535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8f61-07b7-4a38-8a1d-5709bd424182 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.084535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8f61-07b7-4a38-8a1d-5709bd424182 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.084535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f8f61-07b7-4a38-8a1d-5709bd424182 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.085123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f8f61-07b7-4a38-8a1d-5709bd424182 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:10.087418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f8f61-07b7-4a38-8a1d-5709bd424182 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:10.089194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:10.091470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.132372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2422/4823] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:09 2022] POST /identity/v3/projects => generated 353 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:10.133884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1a65-ee4e-4a0a-beb1-f8fb52d046bf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.134622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1a65-ee4e-4a0a-beb1-f8fb52d046bf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.135162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1a65-ee4e-4a0a-beb1-f8fb52d046bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.161438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:10.162506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6c9f1a65-ee4e-4a0a-beb1-f8fb52d046bf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:10.164495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c9f1a65-ee4e-4a0a-beb1-f8fb52d046bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.189462 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2402/4824] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:10.190676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:10.194195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.223030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6931a-8cb1-4f5a-bd40-b30882e3200b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:10.317933 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2423/4825] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:10.327167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '036f32fcdca746c7893022e57251c4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec831ad9f574d92a7f9a95610348132', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:10.328449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.328813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.330111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.330111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:10.330339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:10.332297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:10.335836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.336156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.341021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.376082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2403/4826] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:10.430435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:10.431687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.459050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2424/4827] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:10.462823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:10.463520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:10.472761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:10.482805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eafaca-b420-491e-b910-50cb56261c33 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:10.502615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:10.505586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.508328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.512796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.512796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:10.512796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:10.514629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75bed-2056-4000-947d-98a722170072 tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:10.515586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:10.527650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '036f32fcdca746c7893022e57251c4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec831ad9f574d92a7f9a95610348132', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:10.533437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.533736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.534023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] PATH_INFO: `/v3/projects/4831cca61e4d4c60bfb6c111f6e1d1d0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.536526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4831cca61e4d4c60bfb6c111f6e1d1d0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:10.539055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:10.554867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2425/4828] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:10.555757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:10.567090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.591098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f5ba6-bd14-4024-904a-722f4cba1793 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:10.602784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:10.603451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.603737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.604017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] PATH_INFO: `/v3/projects/eee27fda19744cecbe58216734789994` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.606909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee27fda19744cecbe58216734789994)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:10.608865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:10.668369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4831cca61e4d4c60bfb6c111f6e1d1d0', 'request_id': 'req-0209c806-05b0-447d-9b59-542b14914bcd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.680880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4831cca61e4d4c60bfb6c111f6e1d1d0', 'request_id': 'req-0209c806-05b0-447d-9b59-542b14914bcd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.693609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4831cca61e4d4c60bfb6c111f6e1d1d0', 'request_id': 'req-0209c806-05b0-447d-9b59-542b14914bcd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.724721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] The token cache is being invalidate because project 4831cca61e4d4c60bfb6c111f6e1d1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:10.725026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.728230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee27fda19744cecbe58216734789994', 'request_id': 'req-0a0a41eb-aab6-4299-b747-5ceface6b1de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.739928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee27fda19744cecbe58216734789994', 'request_id': 'req-0a0a41eb-aab6-4299-b747-5ceface6b1de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.742572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.750888 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2404/4829] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:10 2022] DELETE /identity/v3/projects/4831cca61e4d4c60bfb6c111f6e1d1d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:10.750888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:10.753765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee27fda19744cecbe58216734789994', 'request_id': 'req-0a0a41eb-aab6-4299-b747-5ceface6b1de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.754189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.772564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] The token cache is being invalidate because project eee27fda19744cecbe58216734789994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:10.773843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.774913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0a41eb-aab6-4299-b747-5ceface6b1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:10.779010 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2426/4830] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:10 2022] DELETE /identity/v3/projects/eee27fda19744cecbe58216734789994 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:10.788724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d684e4-fd9e-407f-8e44-5c88920e3dc6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:10.789209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d684e4-fd9e-407f-8e44-5c88920e3dc6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:10.789590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d684e4-fd9e-407f-8e44-5c88920e3dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:10.823622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-21d684e4-fd9e-407f-8e44-5c88920e3dc6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:10.834932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21d684e4-fd9e-407f-8e44-5c88920e3dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:10.909634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c806-05b0-447d-9b59-542b14914bcd tempest-VolumeQuotaClassesTest-772191457 tempest-VolumeQuotaClassesTest-772191457-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:10.932286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:10.996654 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2427/4831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:11.006198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.006507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.006908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.028475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.029432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.029939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.030428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.031571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.034043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.042394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:11.043990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.062035 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2428/4832] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:11.063010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.078048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e43cd5-c724-49c7-aae1-f74dc495fbff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.089309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.090880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.091147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.091246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.091892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:11.092193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.093829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.104870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2405/4833] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:10 2022] POST /identity/v3/projects => generated 383 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:11.109581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.111999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.116785 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2429/4834] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:11.118027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.138092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33206b3-9043-4253-a8b8-ad4d3dc02fd4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.293718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e77dcd-a77e-477e-baf8-329c6d7681e5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.300879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:11.303699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.304661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.305460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.306496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.307282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.310939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.324266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.325112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.325464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.325793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.326522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.329276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.341069 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2406/4835] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:11 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:33:11.342626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.344582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.365561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f1fa-a84e-431c-9a55-c13e9e84be33 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.372864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.373774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.374263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.374917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] PATH_INFO: `/v3/users/e5356d1d65fb4f05bddb3c68a0e786cc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.376760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5356d1d65fb4f05bddb3c68a0e786cc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.379185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.400029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2430/4836] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:11 2022] POST /identity/v3/projects => generated 389 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:11.401370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.473824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5356d1d65fb4f05bddb3c68a0e786cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:11.487777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5356d1d65fb4f05bddb3c68a0e786cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:11.488818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5356d1d65fb4f05bddb3c68a0e786cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:11.490404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5356d1d65fb4f05bddb3c68a0e786cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:11.501213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5356d1d65fb4f05bddb3c68a0e786cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:11.514581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8da5-d491-454f-b067-3e1b5e27da2a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.519786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:11.522806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ae005-1df3-4f88-898d-541c0402026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.524905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae005-1df3-4f88-898d-541c0402026c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.525190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae005-1df3-4f88-898d-541c0402026c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.525461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae005-1df3-4f88-898d-541c0402026c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.526113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ae005-1df3-4f88-898d-541c0402026c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.529295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2407/4837] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:11 2022] DELETE /identity/v3/users/e5356d1d65fb4f05bddb3c68a0e786cc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:11.530698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ae005-1df3-4f88-898d-541c0402026c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.533314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.535609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.546502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2431/4838] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:11.548819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.549251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.549677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.576275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:11.578865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.654609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9917d3-353f-4c9e-930a-0e23e7190a56 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.660620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.661388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.661660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.661938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.662932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.664866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.698279 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2408/4839] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:11 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:11.698279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.700867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.717717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356908c8-b5e3-4e8f-945d-07c87e4e3e31 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.723211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.723860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.724209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.724597 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2432/4840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:11.724722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.725525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.726517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.735250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.746764 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2409/4841] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:11.750615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea4bea-b24f-4884-9162-af6d7114d8b1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.751350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.755157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:11.763490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.764215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.764569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.764915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.768115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.769991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.798838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2433/4842] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:11.798838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.816243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e419e6-2f34-4dba-b96a-84f263f315dc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.834228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.836094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.836318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.836785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] PATH_INFO: `/v3/projects/962e4a85da704358a440c974015f3142/users/1d73eb08f57e41a89c94fdb1393fe416/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.871283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962e4a85da704358a440c974015f3142, user_id=1d73eb08f57e41a89c94fdb1393fe416, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.872661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f1335-fbc4-43fe-bac0-b6a7c2652c18 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:11.875074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.894204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72f486-718e-47f4-88a1-83f4df3f31eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:11.894896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72f486-718e-47f4-88a1-83f4df3f31eb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.896906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72f486-718e-47f4-88a1-83f4df3f31eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.898776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72f486-718e-47f4-88a1-83f4df3f31eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:11.906031 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2434/4843] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:11 2022] PUT /identity/v3/projects/962e4a85da704358a440c974015f3142/users/1d73eb08f57e41a89c94fdb1393fe416/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:11.906959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:11.921564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72f486-718e-47f4-88a1-83f4df3f31eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:11.924518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72f486-718e-47f4-88a1-83f4df3f31eb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:11.947075 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2410/4844] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:11.951639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:11.952497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:11.953152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.021879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] MFA Rules not processed for user `1d73eb08f57e41a89c94fdb1393fe416`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:12.024474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:12.041862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:12.091177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48404631-845e-4f94-ab83-393a7ab27e26 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.110067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.113988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.114376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.114664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.120687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.126611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.142896 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2411/4845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:12.142896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.154191 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2435/4846] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:12.161866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.175485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ddf45-d4bb-4ca3-8c8a-23de4b4c5399 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.184306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49263d29-cb7c-44e2-9f69-9a906a79950a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.190953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.191645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.191966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.192195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.192841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.195764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.205312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d017fb4-5004-4133-89a8-6a234ce18b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.206008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d017fb4-5004-4133-89a8-6a234ce18b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.206329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d017fb4-5004-4133-89a8-6a234ce18b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.206613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d017fb4-5004-4133-89a8-6a234ce18b78 admin admin] PATH_INFO: `/v3/projects/35238b920cd843fe8a1e86a85fc4f3ad/users/d21096fd76b44434bb2bb0633fc0376c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.214703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:12.242756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d017fb4-5004-4133-89a8-6a234ce18b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35238b920cd843fe8a1e86a85fc4f3ad, user_id=d21096fd76b44434bb2bb0633fc0376c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.246097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d017fb4-5004-4133-89a8-6a234ce18b78 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.262277 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2412/4847] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:12 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:33:12.266484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.275818 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2436/4848] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:12 2022] PUT /identity/v3/projects/35238b920cd843fe8a1e86a85fc4f3ad/users/d21096fd76b44434bb2bb0633fc0376c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:12.281963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.282596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.283126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.330991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:12.333248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:12.446540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df164e-d3ac-4eb8-af69-304a8ad5508c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.522116 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2437/4849] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:33:12.552977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.586816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.587836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.588229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.588812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.589744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.591839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.645298 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2413/4850] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:12 2022] POST /identity/v3/users => generated 298 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:12.649351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.681120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832cc0-8886-47c6-b821-12e333e13dee admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.686521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221dd0-e6a6-4045-9243-6a16a2d2dec5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.694416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.694664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.695313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.695600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.695891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.698280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.698280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.698897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.702329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.710849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.723097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.724706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.745285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2438/4851] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:33:12.751566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2414/4852] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:12.755944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.770218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c889d-1e1b-4fcf-af23-7bcdb55e6a3e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.786548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.787407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.787702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.788482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] PATH_INFO: `/v3/projects/8658386d79b74ab7aeaa0b64450a911b/users/5b7c14bbe8ef4e63acdf3e4ef83a4805/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.807889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.811626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:12.819527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8658386d79b74ab7aeaa0b64450a911b, user_id=5b7c14bbe8ef4e63acdf3e4ef83a4805, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.822234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.832274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ce6e-c2a9-4c1a-a53d-d104d5b361e6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:12.844029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:12.845833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:12.846772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:12.847609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] PATH_INFO: `/v3/projects/3f8f4e1475ac4759ad9bd7122e9d7811` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:12.849876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8f4e1475ac4759ad9bd7122e9d7811)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:12.852035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:12.852513 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2439/4853] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:12 2022] PUT /identity/v3/projects/8658386d79b74ab7aeaa0b64450a911b/users/5b7c14bbe8ef4e63acdf3e4ef83a4805/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:12.854704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:12.954275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:12.968818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8f4e1475ac4759ad9bd7122e9d7811', 'request_id': 'req-5458759e-cb67-4578-af5f-32fa5954f83c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:12.979222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8f4e1475ac4759ad9bd7122e9d7811', 'request_id': 'req-5458759e-cb67-4578-af5f-32fa5954f83c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:12.998732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8f4e1475ac4759ad9bd7122e9d7811', 'request_id': 'req-5458759e-cb67-4578-af5f-32fa5954f83c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.012225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7e20-881f-42f3-b4e5-714320646f55 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:13.037472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:13.054943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] The token cache is being invalidate because project 3f8f4e1475ac4759ad9bd7122e9d7811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:13.055396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.059795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.062782 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2415/4854] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:12 2022] DELETE /identity/v3/projects/3f8f4e1475ac4759ad9bd7122e9d7811 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:13.066243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:13.071427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:13.148805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:13.150504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:13.150861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:13.151181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:13.154881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:13.156170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:13.185141 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2440/4855] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:33:13.186968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:13.189321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:13.222777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74408e-eede-430d-9ba2-e41c68db80e7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:13.244707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7415f-a472-43da-b2be-7656a4fbb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:13.245485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7415f-a472-43da-b2be-7656a4fbb348 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:13.246032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7415f-a472-43da-b2be-7656a4fbb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:13.247441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7415f-a472-43da-b2be-7656a4fbb348 admin admin] PATH_INFO: `/v3/projects/8658386d79b74ab7aeaa0b64450a911b/users/5b7c14bbe8ef4e63acdf3e4ef83a4805/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:13.251968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7415f-a472-43da-b2be-7656a4fbb348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8658386d79b74ab7aeaa0b64450a911b, user_id=5b7c14bbe8ef4e63acdf3e4ef83a4805, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:13.258438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7415f-a472-43da-b2be-7656a4fbb348 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:13.263285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458759e-cb67-4578-af5f-32fa5954f83c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:13.272256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:13.273808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:13.274706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:13.275167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] PATH_INFO: `/v3/users/036f32fcdca746c7893022e57251c4bb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:13.276770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036f32fcdca746c7893022e57251c4bb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:13.280389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:13.291991 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2441/4856] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:13 2022] PUT /identity/v3/projects/8658386d79b74ab7aeaa0b64450a911b/users/5b7c14bbe8ef4e63acdf3e4ef83a4805/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:13.304954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:13.305272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:13.306852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:13.347588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] MFA Rules not processed for user `5b7c14bbe8ef4e63acdf3e4ef83a4805`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:13.351523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:13.383546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036f32fcdca746c7893022e57251c4bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.402412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036f32fcdca746c7893022e57251c4bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.403190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036f32fcdca746c7893022e57251c4bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.403973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036f32fcdca746c7893022e57251c4bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.420950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036f32fcdca746c7893022e57251c4bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:13.466723 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2416/4857] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:13 2022] DELETE /identity/v3/users/036f32fcdca746c7893022e57251c4bb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:13.525148 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2442/4858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:13.557691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:13.563793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:13.698908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa632af5-58db-4b4f-b925-f18b8989f694 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:13.708813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:13.709571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:13.709966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:13.710401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:13.717166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:13.776611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:13.821485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:13.824329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301666c-cc44-4f18-8921-c15c5dd60a1c service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:13.837897 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2417/4859] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:15.646198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:15.648293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:15.833129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:15.863786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433ce9-ed9d-4147-87d9-129f32b89e04 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:15.993261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:15.994041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:15.994813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:15.994813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] PATH_INFO: `/v3/projects/cec831ad9f574d92a7f9a95610348132` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:15.997944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec831ad9f574d92a7f9a95610348132)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:16.003181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:16.156474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec831ad9f574d92a7f9a95610348132', 'request_id': 'req-ddc145bf-1f07-4095-9571-ce0b90719d24'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:16.170266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec831ad9f574d92a7f9a95610348132', 'request_id': 'req-ddc145bf-1f07-4095-9571-ce0b90719d24'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:16.188940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec831ad9f574d92a7f9a95610348132', 'request_id': 'req-ddc145bf-1f07-4095-9571-ce0b90719d24'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:16.223880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] The token cache is being invalidate because project cec831ad9f574d92a7f9a95610348132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:16.224186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:16.224913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ddc145bf-1f07-4095-9571-ce0b90719d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:16.227306 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2443/4860] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:15 2022] DELETE /identity/v3/projects/cec831ad9f574d92a7f9a95610348132 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:16.232099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:16.232979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:16.233328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:16.282978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:16.294937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:16.455135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2418/4861] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:16.463020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:16.463312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:16.463599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:16.545686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:16.547514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:16.569916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2444/4862] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:16.573997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:16.603348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256e040-f08d-48a4-af85-28b52025c43d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:16.628214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:16.629001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:16.629394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:16.630595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:16.630595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:16.631134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:16.632878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:16.663480 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2419/4863] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:16.667067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:16.700126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab54d8-15ca-4445-b1cf-5c19b70de4cc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:16.716283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:16.717229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:16.717687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:16.719635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:16.720571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:16.722803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:16.801203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2445/4864] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:16 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:16.805095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:16.826649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52ca44-3bdc-44aa-9254-92d1293cf35d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:16.968143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:16.971846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:16.972304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:16.972690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:16.975006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:16.979191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:17.055560 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2420/4865] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:16 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:17.055765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:17.087831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01425a4-646c-491b-bd76-3c6dc94ecfce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:17.104633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:17.110107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:17.115633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:17.115633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:17.115633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:17.119152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:17.147529 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2446/4866] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:33:17.150276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:17.163268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e563f1-d884-4203-be73-e76e9e2c3eb9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:17.174731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54007893-aed9-4c9b-9543-c8af67602b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:17.176090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54007893-aed9-4c9b-9543-c8af67602b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:17.176736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54007893-aed9-4c9b-9543-c8af67602b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:17.177926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54007893-aed9-4c9b-9543-c8af67602b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:17.178870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54007893-aed9-4c9b-9543-c8af67602b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:17.182690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54007893-aed9-4c9b-9543-c8af67602b23 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:17.212633 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2421/4867] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:17.214970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:17.228833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ace3-5942-4050-a753-ab172ee162de admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:17.239657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:17.241243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:17.242259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:17.242259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] PATH_INFO: `/v3/projects/dc8ec9f6609e4189abc566f88b3f9ba1/users/5a3b7f84fa80433aba655180fe2eda31/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:17.305711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8ec9f6609e4189abc566f88b3f9ba1, user_id=5a3b7f84fa80433aba655180fe2eda31, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:17.310107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:17.333213 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2447/4868] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:17 2022] PUT /identity/v3/projects/dc8ec9f6609e4189abc566f88b3f9ba1/users/5a3b7f84fa80433aba655180fe2eda31/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:17.345328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:17.345902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:17.345902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:17.462620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] MFA Rules not processed for user `5a3b7f84fa80433aba655180fe2eda31`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:17.465396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:17.579546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:17.721323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2422/4869] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:17.726088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:17.798197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:17.920251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43679437-86b1-4180-934a-56c562e03dfa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:17.942859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:17.943638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:17.944130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:17.944529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:17.945403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:17.951810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:18.008163 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2448/4870] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:17 2022] POST /identity/v3/projects => generated 393 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:18.012533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:18.029999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5c59-370a-49e1-be65-e7cc695728f1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:18.180500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:18.182235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:18.182587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:18.182865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:18.184197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:18.186250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:18.252643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2423/4871] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:18 2022] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:33:18.254500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:18.271627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762707-fa3a-4fea-8638-a0571c5bc918 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:18.293004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:18.293827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:18.302804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:18.303218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:18.303943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:18.309476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:18.335326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2449/4872] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:18.339538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:18.358286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79793f-45af-4d5b-b864-f8f6eacc72ec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:18.383127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:18.383809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:18.384098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:18.384380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] PATH_INFO: `/v3/projects/1021e21dd7574fe7a01e7d112cf770b2/users/e6d9742070af4a59a6f5a7c6ef54c634/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:18.433599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1021e21dd7574fe7a01e7d112cf770b2, user_id=e6d9742070af4a59a6f5a7c6ef54c634, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:18.436450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:18.467313 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2424/4873] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:18 2022] PUT /identity/v3/projects/1021e21dd7574fe7a01e7d112cf770b2/users/e6d9742070af4a59a6f5a7c6ef54c634/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:18.471625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:18.490811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61992415-9c5e-4e1b-89b6-e999194ce729 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:18.594777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd16bc-65bf-408f-85ca-97cabb5e7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:18.595405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd16bc-65bf-408f-85ca-97cabb5e7587 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:18.595684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd16bc-65bf-408f-85ca-97cabb5e7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:18.595954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd16bc-65bf-408f-85ca-97cabb5e7587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:18.596745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd16bc-65bf-408f-85ca-97cabb5e7587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:18.598305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd16bc-65bf-408f-85ca-97cabb5e7587 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:18.613323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2450/4874] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:18.614604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:18.629527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8847-d42d-4d9c-9589-26f7570108e5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:18.642736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:18.643006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:18.643297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:18.643578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] PATH_INFO: `/v3/projects/1021e21dd7574fe7a01e7d112cf770b2/users/e6d9742070af4a59a6f5a7c6ef54c634/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:18.647776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1021e21dd7574fe7a01e7d112cf770b2, user_id=e6d9742070af4a59a6f5a7c6ef54c634, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:18.650834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:18.682693 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2425/4875] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:18 2022] PUT /identity/v3/projects/1021e21dd7574fe7a01e7d112cf770b2/users/e6d9742070af4a59a6f5a7c6ef54c634/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:18.689900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:18.690564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:18.690564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:18.777242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] MFA Rules not processed for user `e6d9742070af4a59a6f5a7c6ef54c634`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:18.788265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:18.974238 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2451/4876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:19.005131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:19.011623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:19.181304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb8c50-0b9b-497d-a934-5fabc728a781 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:19.201317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:19.201583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:19.207896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:19.207896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:19.238470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:19.244309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:19.284253 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2426/4877] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:19.363950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:19.365937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:19.380984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe878d6-0035-4b46-8f4c-1480d184ec57 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:19.385248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:19.386875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:19.387455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:19.388115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:19.410541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:19.494191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:19.497332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:19.512254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2452/4878] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:23.161681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:23.176135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72e4fa-6c11-4950-a816-12552a3f737a service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:23.182915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:23.184918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:23.185305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:23.185654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:23.189757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:23.238205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:23.380174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:23.382131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe09a4-1bb9-40b9-859b-2d124bbb9f14 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:23.417787 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2427/4879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:25.019670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:25.032859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e018-8c2e-473d-9352-14e0bb779762 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:25.038725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:25.039771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:25.040298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:25.041662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:25.051917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:25.253891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:25.262887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dfdba-f05b-4f5f-921c-396510c68c87 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:25.311187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2453/4880] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:28.041931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:28.043438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:28.043963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:28.151042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] MFA Rules not processed for user `d21096fd76b44434bb2bb0633fc0376c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:28.157199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:28.451197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:28.451774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:28.451774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:28.500104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] MFA Rules not processed for user `e43d96b4e15e444da73b993abe43a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:28.501333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:28.515265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2428/4881] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:28.522801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:28.529545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:28.645237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2454/4882] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:28.699174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ef6b-09b2-4c5d-bf9d-37e37c892418 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:28.709904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:28.710574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:28.710857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:28.711133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:28.712625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:28.731564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:28.800047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2429/4883] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:28 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:28.803938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:28.850308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6388e-0c48-4d22-a2dc-23785adb9215 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:29.026085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:29.027082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:29.027491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:29.027771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:29.028688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:29.031483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:29.043608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:29.069135 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2455/4884] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:28 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:29.073338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:29.092278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34be0-0799-4c1f-98b0-164fc3ff2ee8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:29.108135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:29.113653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:29.114105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:29.114512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:29.115308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:29.119649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:29.167692 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2430/4885] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:29.170042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:29.190625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830ede-366f-4ba4-a712-5ad1892edf6e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:29.228502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:29.230009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:29.230808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:29.230808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] PATH_INFO: `/v3/projects/6ae513cf120d4e59a6091b9a0264b1c4/users/27935f3fa953419080b90a3d399348fd/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:29.287253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae513cf120d4e59a6091b9a0264b1c4, user_id=27935f3fa953419080b90a3d399348fd, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:29.305409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:29.345092 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2456/4886] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:29 2022] PUT /identity/v3/projects/6ae513cf120d4e59a6091b9a0264b1c4/users/27935f3fa953419080b90a3d399348fd/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:29.348898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:29.369754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ffc7f-d3fa-4f54-910e-f9397458d023 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:29.453655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:29.608746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:29.609824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:29.612273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:29.612786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:29.613693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:29.615872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:29.658470 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2431/4887] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:29.659043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:29.676823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ddade-87cc-4eca-94df-a60a89dc421a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:29.688661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:29.689506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:29.690042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:29.690596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] PATH_INFO: `/v3/projects/6ae513cf120d4e59a6091b9a0264b1c4/users/27935f3fa953419080b90a3d399348fd/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:29.696484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae513cf120d4e59a6091b9a0264b1c4, user_id=27935f3fa953419080b90a3d399348fd, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:29.700178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:29.728924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2457/4888] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:29 2022] PUT /identity/v3/projects/6ae513cf120d4e59a6091b9a0264b1c4/users/27935f3fa953419080b90a3d399348fd/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:31.975810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:32.004911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30af4b-8854-43b3-b527-dff5495bf918 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:32.203130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:32.203986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:32.204382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:32.214845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] PATH_INFO: `/v3/users/5a3b7f84fa80433aba655180fe2eda31` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:32.222989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3b7f84fa80433aba655180fe2eda31)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:32.225112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:32.344912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:32.346817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:32.370071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3b7f84fa80433aba655180fe2eda31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:32.395341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3b7f84fa80433aba655180fe2eda31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:32.396120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3b7f84fa80433aba655180fe2eda31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:32.396843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3b7f84fa80433aba655180fe2eda31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:32.422630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ffb9481c-87bf-4c1d-87d8-26bcdcd08ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3b7f84fa80433aba655180fe2eda31'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:32.486750 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2432/4889] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:31 2022] DELETE /identity/v3/users/5a3b7f84fa80433aba655180fe2eda31 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:32.488376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:32.490383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:32.490869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:32.531181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:32.534498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:32.555769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1645cd-1766-4aa4-917a-51d4fa757958 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:32.607908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:32.669213 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2433/4890] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:32.689070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:32.690369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:32.690898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:32.691401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:32.693468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:32.716133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:32.718088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:32.803976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:32.835885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:32.843192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:32.880710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0f4d-3f0d-4923-814a-a74a20035ca8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:32.888762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:32.889558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:32.891882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:32.892345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:32.915033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:32.921077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:32.929690 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2458/4891] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:32.945005 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2434/4892] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:35.657709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:35.659341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:35.690836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baebd1d-d881-4e6c-a4fe-ee99dc6a8d68 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:35.698111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:35.700080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:35.700702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:35.701204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] PATH_INFO: `/v3/projects/dc8ec9f6609e4189abc566f88b3f9ba1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:35.704371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8ec9f6609e4189abc566f88b3f9ba1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:35.707126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:35.837282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8ec9f6609e4189abc566f88b3f9ba1', 'request_id': 'req-e45eb376-acfa-436b-a947-9f12f24c6d7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:35.896652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8ec9f6609e4189abc566f88b3f9ba1', 'request_id': 'req-e45eb376-acfa-436b-a947-9f12f24c6d7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:35.921110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8ec9f6609e4189abc566f88b3f9ba1', 'request_id': 'req-e45eb376-acfa-436b-a947-9f12f24c6d7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:35.957034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] The token cache is being invalidate because project dc8ec9f6609e4189abc566f88b3f9ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:35.957242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:35.957906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:35.961171 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2459/4893] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:35 2022] DELETE /identity/v3/projects/dc8ec9f6609e4189abc566f88b3f9ba1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:35.965959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:35.983720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95511d4b-20b2-4f1b-b390-2af198fc7ed9 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:36.189675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:36.190400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:36.190937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:36.191290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] PATH_INFO: `/v3/users/e6d9742070af4a59a6f5a7c6ef54c634` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:36.194406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d9742070af4a59a6f5a7c6ef54c634)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:36.196358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:36.394828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d9742070af4a59a6f5a7c6ef54c634'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:36.425933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d9742070af4a59a6f5a7c6ef54c634'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:36.426808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d9742070af4a59a6f5a7c6ef54c634'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:36.427755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d9742070af4a59a6f5a7c6ef54c634'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:36.457488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20ad06e5-9dfa-4763-9e42-1a47c5e2f469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d9742070af4a59a6f5a7c6ef54c634'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:36.510876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:36.538883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2435/4894] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:35 2022] DELETE /identity/v3/users/e6d9742070af4a59a6f5a7c6ef54c634 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:39.928577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:39.930352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:39.977787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eb376-acfa-436b-a947-9f12f24c6d7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:40.175955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:40.176846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:40.177243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:40.177698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] PATH_INFO: `/v3/projects/1021e21dd7574fe7a01e7d112cf770b2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:40.180720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1021e21dd7574fe7a01e7d112cf770b2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:40.192524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:40.275019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1021e21dd7574fe7a01e7d112cf770b2', 'request_id': 'req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:40.296461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1021e21dd7574fe7a01e7d112cf770b2', 'request_id': 'req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:40.329426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1021e21dd7574fe7a01e7d112cf770b2', 'request_id': 'req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:40.360718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:40.362495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] The token cache is being invalidate because project 1021e21dd7574fe7a01e7d112cf770b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:40.362792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:40.363470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cc86d3b8-a84d-4b81-a60a-5e0c5c8e62be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:40.365315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2460/4895] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:39 2022] DELETE /identity/v3/projects/1021e21dd7574fe7a01e7d112cf770b2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:40.370626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:40.371463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:40.371939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:40.434966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:40.441834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:40.668190 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2436/4896] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:40.674740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:40.675023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:40.675343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:40.715538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:40.717147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:40.734482 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2461/4897] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:40.738544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:40.756086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c606ef-cdef-44c6-9107-7ec7f14720ec None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:40.768329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:40.769244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:40.769647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:40.770037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:40.770854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:40.772466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:40.774619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:40.791779 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2437/4898] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:40.797370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:40.807173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731360d-56dc-45c9-aa76-c7b865e53145 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:40.823096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:40.824579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:40.824579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:40.824824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:40.825445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:40.827565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:40.909270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:40.915812 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2462/4899] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:40 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:40.925901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917162-bfbb-4be1-8960-a9121c669343 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:41.113595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:41.114394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:41.114513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:41.114786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:41.115436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:41.118041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:41.187396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:41.197265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2438/4900] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:40 2022] POST /identity/v3/users => generated 305 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:41.200022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072be177-cf57-4daa-a30b-6ea2b236cfd2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:41.230954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:41.231595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:41.231873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:41.232148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:41.232804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:41.234447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:41.271544 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2463/4901] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:41.275681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:41.305374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96edf06-5433-4891-804d-9278da7af080 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:41.324881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9427-d33f-4ad1-a5d2-fbeea83e1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:41.325523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9427-d33f-4ad1-a5d2-fbeea83e1b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:41.325804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9427-d33f-4ad1-a5d2-fbeea83e1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:41.326223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9427-d33f-4ad1-a5d2-fbeea83e1b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:41.326752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b9427-d33f-4ad1-a5d2-fbeea83e1b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:41.328355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b9427-d33f-4ad1-a5d2-fbeea83e1b76 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:41.358688 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2439/4902] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:41.362871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:41.373378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b3bf-e23b-44a2-b89c-c5c5dceeb3bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:41.399430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:41.400138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:41.400408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:41.400700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] PATH_INFO: `/v3/projects/38f77eedee8b4a43b67a00d98e8d1e45/users/f35b4170e651422b8460b59cf1a8d0e6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:41.459349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f77eedee8b4a43b67a00d98e8d1e45, user_id=f35b4170e651422b8460b59cf1a8d0e6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:41.462426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:41.501230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2464/4903] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:41 2022] PUT /identity/v3/projects/38f77eedee8b4a43b67a00d98e8d1e45/users/f35b4170e651422b8460b59cf1a8d0e6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:33:41.513349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:41.514216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:41.514645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:41.596966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] MFA Rules not processed for user `f35b4170e651422b8460b59cf1a8d0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:41.598414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:41.754138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:41.809643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2440/4904] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:41.814431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:41.929146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83f5c-27a8-4f30-97d3-11fc3f76acce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:41.955184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:41.955862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:41.956139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:41.956453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:41.957310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:41.959480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:42.061047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2465/4905] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:41 2022] POST /identity/v3/projects => generated 405 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:42.062400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:42.084511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f974bb-d993-4af3-8041-f4f6ee4fdac7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:42.320249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:42.321932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:42.322569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:42.323035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:42.325740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:42.328838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:42.399890 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2441/4906] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:42 2022] POST /identity/v3/users => generated 309 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:42.404556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:42.415347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13f78b-7e6c-42eb-bb35-ec46962537db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:42.447318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:42.447956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:42.448810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:42.452947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:42.459489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:42.467991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:42.504658 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2466/4907] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:42.509614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:42.528902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8cb5-495b-4ff3-925c-2c6a031d2dd7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:42.557186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:42.558539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:42.559096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:42.559528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] PATH_INFO: `/v3/projects/b023b080fd4041199df69bd17c0569c4/users/e9f2078296724110b5ecbdcd95b1c0ce/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:42.609972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b023b080fd4041199df69bd17c0569c4, user_id=e9f2078296724110b5ecbdcd95b1c0ce, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:42.613069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:42.644269 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2442/4908] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:42 2022] PUT /identity/v3/projects/b023b080fd4041199df69bd17c0569c4/users/e9f2078296724110b5ecbdcd95b1c0ce/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:42.648710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:42.660276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8f71a-4c7c-46ca-af36-6de3302f606e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:42.794055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76252bdc-2ed4-4cd2-b367-49b8ef86c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:42.794703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76252bdc-2ed4-4cd2-b367-49b8ef86c9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:42.795164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76252bdc-2ed4-4cd2-b367-49b8ef86c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:42.795615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76252bdc-2ed4-4cd2-b367-49b8ef86c9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:42.796412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76252bdc-2ed4-4cd2-b367-49b8ef86c9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:42.803804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76252bdc-2ed4-4cd2-b367-49b8ef86c9e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:42.819150 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2467/4909] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:33:42.824086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:42.843350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a0439-388d-451e-bade-d7724b6fbf09 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:42.862772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:42.865219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:42.866762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:42.867061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] PATH_INFO: `/v3/projects/b023b080fd4041199df69bd17c0569c4/users/e9f2078296724110b5ecbdcd95b1c0ce/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:42.883144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b023b080fd4041199df69bd17c0569c4, user_id=e9f2078296724110b5ecbdcd95b1c0ce, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:42.892052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:42.939865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:42.940365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:42.940814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:42.942572 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2443/4910] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:42 2022] PUT /identity/v3/projects/b023b080fd4041199df69bd17c0569c4/users/e9f2078296724110b5ecbdcd95b1c0ce/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:42.964253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:43.016523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] MFA Rules not processed for user `e9f2078296724110b5ecbdcd95b1c0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:43.018064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:43.207069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2468/4911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:42 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:43.223175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:43.227804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:43.359255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0b4bf-0d7f-4f34-84ce-1edff6bd65d0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:43.372206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:43.379014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:43.379327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:43.380833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:43.431339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:43.448004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:43.481415 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2444/4912] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:43.834933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:43.836392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:43.864934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1960f-8421-478b-8e84-aa19519d8a70 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:43.873251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f42367-8600-46f4-8e5d-2b153851bb10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:43.874307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f42367-8600-46f4-8e5d-2b153851bb10 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:43.874817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f42367-8600-46f4-8e5d-2b153851bb10 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:43.875366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f42367-8600-46f4-8e5d-2b153851bb10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:43.999469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f42367-8600-46f4-8e5d-2b153851bb10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:44.004080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f42367-8600-46f4-8e5d-2b153851bb10 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:44.063453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2469/4913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:45.789739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:45.793627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:45.989807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:46.043874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc2f1b-6171-4c3a-9a30-d0bf5015cf5d service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:46.062522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:46.063260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:46.068551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:46.068551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] PATH_INFO: `/v3/users/1d73eb08f57e41a89c94fdb1393fe416` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:46.068551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d73eb08f57e41a89c94fdb1393fe416)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:46.069096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:46.227850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d73eb08f57e41a89c94fdb1393fe416'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:46.252356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d73eb08f57e41a89c94fdb1393fe416'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:46.253038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d73eb08f57e41a89c94fdb1393fe416'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:46.253690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d73eb08f57e41a89c94fdb1393fe416'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:46.273243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d73eb08f57e41a89c94fdb1393fe416'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:46.375564 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2445/4914] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:45 2022] DELETE /identity/v3/users/1d73eb08f57e41a89c94fdb1393fe416 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:46.380054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90150ed-d963-4d75-87b0-860dde5e45fb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:46.380959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90150ed-d963-4d75-87b0-860dde5e45fb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:46.381473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90150ed-d963-4d75-87b0-860dde5e45fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:46.488969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e90150ed-d963-4d75-87b0-860dde5e45fb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:46.500281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e90150ed-d963-4d75-87b0-860dde5e45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:46.763991 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2470/4915] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:46.833632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:46.837003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:47.030532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878062-5f78-40e9-9f16-3ae932c308e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:47.040513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:47.042468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:47.044265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:47.045834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:47.076865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:47.080994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:47.110009 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2446/4916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:49.269160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:49.269724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:49.269724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:49.382901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:49.391158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:49.392421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:49.556287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2471/4917] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:33:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:49.666557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:49.668642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:49.944414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:49.956712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe7c56-e093-45a5-8486-95c7e4869feb service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:49.976555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:49.977407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:49.977700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:49.984986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:50.033044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:50.035670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:50.051147 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2447/4918] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:33:50.351355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:50.353519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:50.389294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca15343-33c2-4e45-b20f-d0c53e8e1847 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:50.400209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:50.401500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:50.402289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:50.404187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] PATH_INFO: `/v3/projects/962e4a85da704358a440c974015f3142` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:50.406773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] RBAC: Authorizing `identity:delete_project(project_id=962e4a85da704358a440c974015f3142)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:50.416916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:50.582415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962e4a85da704358a440c974015f3142', 'request_id': 'req-0bd05d99-2b4e-4651-aab6-c16cd791494e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:50.603625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962e4a85da704358a440c974015f3142', 'request_id': 'req-0bd05d99-2b4e-4651-aab6-c16cd791494e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:50.616184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962e4a85da704358a440c974015f3142', 'request_id': 'req-0bd05d99-2b4e-4651-aab6-c16cd791494e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:50.642613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] The token cache is being invalidate because project 962e4a85da704358a440c974015f3142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:50.643337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:50.644969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0bd05d99-2b4e-4651-aab6-c16cd791494e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:50.667856 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2472/4919] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:50 2022] DELETE /identity/v3/projects/962e4a85da704358a440c974015f3142 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:50.669223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:50.689950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afaaf8-d32a-4d74-ade8-ec9aac8cffc7 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:50.954505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:50.955229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:50.955519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:50.955795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] PATH_INFO: `/v3/users/5b7c14bbe8ef4e63acdf3e4ef83a4805` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:50.960346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7c14bbe8ef4e63acdf3e4ef83a4805)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:50.962670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:51.140374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7c14bbe8ef4e63acdf3e4ef83a4805'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:51.154208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7c14bbe8ef4e63acdf3e4ef83a4805'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:51.155089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7c14bbe8ef4e63acdf3e4ef83a4805'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:51.157697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7c14bbe8ef4e63acdf3e4ef83a4805'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:51.177168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7c14bbe8ef4e63acdf3e4ef83a4805'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:51.217451 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2448/4920] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:33:50 2022] DELETE /identity/v3/users/5b7c14bbe8ef4e63acdf3e4ef83a4805 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:51.642195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:51.642654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:51.642773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:51.736885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] MFA Rules not processed for user `27935f3fa953419080b90a3d399348fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:51.740418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:51.919102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2473/4921] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:51.941351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:51.943691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:52.177974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af9d49-5c0e-4767-a474-cd167dd4c2fa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:52.191258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:52.191960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:52.192247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:52.192526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:52.196574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:52.282956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:52.389730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:52.395071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:52.421231 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2449/4922] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:33:53.571229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:53.573451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:53.583952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:53.586587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:53.641218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:53.750024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5db23-661c-45a8-bc05-fe40792c642d service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:53.759769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:53.761661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa4e65-f185-4471-820e-621cbcf0cc7d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:53.762799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:53.763985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:53.764418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:53.768297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:53.773906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:53.779464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:53.780005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:53.780778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] PATH_INFO: `/v3/projects/8658386d79b74ab7aeaa0b64450a911b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:53.784020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8658386d79b74ab7aeaa0b64450a911b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:53.790790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:53.802987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:53.804706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61a4a-f500-44d2-87b5-be5c6a691b06 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:53.833140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2450/4923] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:33:53.921253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8658386d79b74ab7aeaa0b64450a911b', 'request_id': 'req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:53.930857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8658386d79b74ab7aeaa0b64450a911b', 'request_id': 'req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:53.955186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8658386d79b74ab7aeaa0b64450a911b', 'request_id': 'req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:54.018461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] The token cache is being invalidate because project 8658386d79b74ab7aeaa0b64450a911b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:33:54.020918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:54.022211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7a3ba1a-d7b4-4ddc-aafc-2e14b9dc6940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:33:54.027259 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2474/4924] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:33:53 2022] DELETE /identity/v3/projects/8658386d79b74ab7aeaa0b64450a911b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:54.033146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:54.033420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:54.033901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:54.083317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:54.090871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:54.280237 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2451/4925] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:54.289414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:54.289414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:54.289951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:54.338352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:54.341482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:54.366487 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2475/4926] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:54.370009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:54.384868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654b26-15da-4e25-8fe7-cc1752150c03 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:54.396462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:54.397118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:54.397406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:54.397690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:54.401105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:33:54.403701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:54.407374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:54.450070 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2452/4927] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:33:54.452689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:54.471824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fd4d-27ed-4a40-adf3-927fe8e1a643 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:54.482831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:54.483518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:54.483805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:54.484079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:54.489153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:54.492204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:54.559513 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2476/4928] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:54 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:54.563002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:54.593751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89089-71e8-4112-a315-34b17004673c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:54.802701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:54.839819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:54.842474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:54.849168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:54.851061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:54.852754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:54.867632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:54.977905 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2453/4929] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:54 2022] POST /identity/v3/users => generated 293 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:54.984939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:55.006764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7c1b-e77a-4a5b-a39e-5e0fdc362d78 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:55.012485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:55.013123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:55.013411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:55.013691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:55.014372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:55.027700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:55.043076 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2477/4930] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:55.046856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:55.080062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cafa1-f5bc-48c9-b697-68cb30fee67d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:55.102203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a10c-144e-4120-a265-591458156a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:55.103155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a10c-144e-4120-a265-591458156a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:55.103612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a10c-144e-4120-a265-591458156a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:55.104837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a10c-144e-4120-a265-591458156a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:55.105804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a10c-144e-4120-a265-591458156a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:55.107693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a10c-144e-4120-a265-591458156a93 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:55.141459 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2454/4931] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:55.144545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:55.168317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2169-c0c7-4dfe-9746-4a6cba5b5e78 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:55.184345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:55.185549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:55.186005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:55.186488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] PATH_INFO: `/v3/projects/5b5edf8c75f848d09ab2d3724c4f26b3/users/b7ccaa94c0bd4f308ffda2a5cfa679f0/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:55.236740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5edf8c75f848d09ab2d3724c4f26b3, user_id=b7ccaa94c0bd4f308ffda2a5cfa679f0, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:55.243714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:55.280743 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2478/4932] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:55 2022] PUT /identity/v3/projects/5b5edf8c75f848d09ab2d3724c4f26b3/users/b7ccaa94c0bd4f308ffda2a5cfa679f0/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:55.294117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:55.294428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:55.294716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:55.339021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] MFA Rules not processed for user `b7ccaa94c0bd4f308ffda2a5cfa679f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:55.340763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:55.483454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:55.525027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2455/4933] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:55.673671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:55.735607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec3ba-2589-4fcc-bed3-528da9a22f56 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:55.761265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:55.763410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:55.764608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:55.765160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:55.767631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:55.774116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:55.859855 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2479/4934] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:55 2022] POST /identity/v3/projects => generated 383 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:55.863986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:55.886132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52734-9be0-42a9-8a19-6e673cf73e61 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:56.049994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:56.052861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:56.055362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:56.055725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:56.064390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:56.070216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:56.129844 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2456/4935] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:55 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:56.135200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:56.149170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa8db-babf-4578-b54c-47471a29befb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:56.161246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:56.163487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:56.164534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:56.164932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:56.168209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:56.175225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:56.207937 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2480/4936] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:56.210070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:56.225103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b90e-0f20-470b-a02b-aca0861522c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:56.237122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031e09-29c0-4659-9328-8c9b27301bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:56.237938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031e09-29c0-4659-9328-8c9b27301bea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:56.239626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031e09-29c0-4659-9328-8c9b27301bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:56.240043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031e09-29c0-4659-9328-8c9b27301bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:56.240823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031e09-29c0-4659-9328-8c9b27301bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:56.243655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031e09-29c0-4659-9328-8c9b27301bea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:56.273612 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2457/4937] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:56.278128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:56.296401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16656fc-7b32-46d9-b268-b7ee30301117 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:56.312348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:56.313344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:56.313730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:56.314114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] PATH_INFO: `/v3/projects/3303f5ae541141fe8188ce65b2840f3d/users/d4274d6c1a4f40208a867f356395be78/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:56.350440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3303f5ae541141fe8188ce65b2840f3d, user_id=d4274d6c1a4f40208a867f356395be78, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:56.353447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:56.383940 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2481/4938] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:56 2022] PUT /identity/v3/projects/3303f5ae541141fe8188ce65b2840f3d/users/d4274d6c1a4f40208a867f356395be78/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:56.395744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:56.396175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:56.396583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:56.486046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] MFA Rules not processed for user `d4274d6c1a4f40208a867f356395be78`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:56.489415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:56.613245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:56.759780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2458/4939] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:56.765119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:56.923858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8df39-6c7b-4338-b2c5-c4e29e3593fe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:56.942471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:56.943126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:56.943412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:56.943691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:56.944352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:56.946330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:57.085157 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2482/4940] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:33:56 2022] POST /identity/v3/projects => generated 385 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:57.086931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:57.105354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45afe3e-9b46-47ad-beb7-cc659a084f9a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:57.325335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:57.325979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:57.326306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:57.326587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:57.327248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:57.335512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:57.394648 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2459/4941] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:33:57 2022] POST /identity/v3/users => generated 299 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:33:57.398952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:57.412838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d6b8-6925-400f-a9c8-c76d09d5dc46 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:57.447188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:57.448391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:57.448703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:57.449037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:57.449683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:57.451379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:57.486861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:57.492169 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2483/4942] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:57.501366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d835aa5-f33d-4e16-bedc-df6341a84242 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:57.512690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:57.513487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:57.513658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:57.513933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] PATH_INFO: `/v3/projects/b9f861e4a364472c9ba92d801f0d870c/users/fae66b69381948a5b23b530a00d1599d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:57.561213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f861e4a364472c9ba92d801f0d870c, user_id=fae66b69381948a5b23b530a00d1599d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:57.564035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:57.603048 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2460/4943] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:57 2022] PUT /identity/v3/projects/b9f861e4a364472c9ba92d801f0d870c/users/fae66b69381948a5b23b530a00d1599d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:57.604937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:57.623227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3193a-f1dd-44ff-b73a-e604f161d5e5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:57.785245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541000-9b12-42da-b28c-6f58b5fa8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:57.786323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541000-9b12-42da-b28c-6f58b5fa8894 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:57.789691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541000-9b12-42da-b28c-6f58b5fa8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:57.790176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541000-9b12-42da-b28c-6f58b5fa8894 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:57.790881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541000-9b12-42da-b28c-6f58b5fa8894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:57.814789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541000-9b12-42da-b28c-6f58b5fa8894 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:57.856902 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2484/4944] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:33:57.861134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:57.898222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f63aa-c655-46ba-b8d9-0b51f56ec4c9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:57.937318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:57.937997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:57.938310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:57.938587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] PATH_INFO: `/v3/projects/b9f861e4a364472c9ba92d801f0d870c/users/fae66b69381948a5b23b530a00d1599d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:57.950403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f861e4a364472c9ba92d801f0d870c, user_id=fae66b69381948a5b23b530a00d1599d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:57.953559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:58.015051 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2461/4945] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:33:57 2022] PUT /identity/v3/projects/b9f861e4a364472c9ba92d801f0d870c/users/fae66b69381948a5b23b530a00d1599d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:33:58.028700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:58.028998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:58.029260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:58.094375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:58.159260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] MFA Rules not processed for user `fae66b69381948a5b23b530a00d1599d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:33:58.161180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:58.410702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2485/4946] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:33:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:33:58.424746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:33:58.426555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:33:58.672943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b684b4-d7e9-4fe5-920e-77f49cdf9bfa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:33:58.685015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:33:58.688357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:33:58.688926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:33:58.691348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:33:58.820964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:33:58.938454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:33:58.939942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:33:58.995899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2462/4947] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:33:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:04.425614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:04.438387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c532c-1400-4eda-a8a2-78ed77485294 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:04.455155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:04.455989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:04.456594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:04.456991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:04.536190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:04.537829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:04.579890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2486/4948] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:06.428291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:06.435204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:06.461789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:06.473076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020b389-9413-49e3-b987-f5cade7fad52 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:06.494490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:06.496952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:06.497410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:06.499584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:06.527196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:06.530174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:06.575562 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2487/4949] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:06.748185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584da3c-41d1-430a-bd00-cc61aa514ecb service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:06.759132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:06.760836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:06.761277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:06.761855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] PATH_INFO: `/v3/users/535a335d59cc400fb6d573f536fa808e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:06.763376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=535a335d59cc400fb6d573f536fa808e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:06.781918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:06.921825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '535a335d59cc400fb6d573f536fa808e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:06.944004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '535a335d59cc400fb6d573f536fa808e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:06.944721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '535a335d59cc400fb6d573f536fa808e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:06.945380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '535a335d59cc400fb6d573f536fa808e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:06.961403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '535a335d59cc400fb6d573f536fa808e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:07.014094 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2463/4950] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:06 2022] DELETE /identity/v3/users/535a335d59cc400fb6d573f536fa808e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:34:07.587155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:07.642592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84842-4799-4fcc-a6ed-1f087954354a service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:07.772254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:07.775180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:07.847384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:07.848045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:07.848325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:07.848596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] PATH_INFO: `/v3/projects/7b7a441b95c747e082a84cd7fda57903` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:07.849844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7a441b95c747e082a84cd7fda57903)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:07.875411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:07.991967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:08.092488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:08.121758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1851a-ebdf-48e4-bfaf-af5d999b0c0f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:08.139750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7a441b95c747e082a84cd7fda57903', 'request_id': 'req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.187840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7a441b95c747e082a84cd7fda57903', 'request_id': 'req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.244245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7a441b95c747e082a84cd7fda57903', 'request_id': 'req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.323690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] The token cache is being invalidate because project 7b7a441b95c747e082a84cd7fda57903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:08.324034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.327855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-79dda6ee-2927-46fd-a284-fdd3d37cf2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.334431 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2488/4951] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:07 2022] DELETE /identity/v3/projects/7b7a441b95c747e082a84cd7fda57903 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:08.336078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430ae5-e032-47db-83bf-9071d222de61 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:08.336360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430ae5-e032-47db-83bf-9071d222de61 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:08.347683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430ae5-e032-47db-83bf-9071d222de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:08.421864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-75430ae5-e032-47db-83bf-9071d222de61 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:08.426351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-75430ae5-e032-47db-83bf-9071d222de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:08.452626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:08.453291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:08.453569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:08.453837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] PATH_INFO: `/v3/users/f35b4170e651422b8460b59cf1a8d0e6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:08.458734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35b4170e651422b8460b59cf1a8d0e6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:08.466459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:08.631877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35b4170e651422b8460b59cf1a8d0e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.664705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2489/4952] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:08.671546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35b4170e651422b8460b59cf1a8d0e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.672108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:08.673341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35b4170e651422b8460b59cf1a8d0e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.674333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:08.674619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35b4170e651422b8460b59cf1a8d0e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.675378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:08.711167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8bd5b228-f58e-4003-a0d6-e2436d3023cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35b4170e651422b8460b59cf1a8d0e6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:08.756440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:08.758578 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2464/4953] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:07 2022] DELETE /identity/v3/users/f35b4170e651422b8460b59cf1a8d0e6 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:34:08.762843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:08.763133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:08.763401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:08.766275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:08.840135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:08.842067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:09.028407 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2465/4954] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:09.041250 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2490/4955] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:09.042055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:09.044567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:09.052552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:09.072664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312b2f0-2358-4b6a-8d82-7303db114fd1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:09.114481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:09.116516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:09.116887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:09.117349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:09.121062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:34:09.123521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:09.125790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:09.156457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:09.185555 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2491/4956] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:34:09.189890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:09.248492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50a9b3-3d2c-4905-82bf-68f970d28792 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:09.274772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:09.275449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:09.276294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:09.276608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:09.277260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:09.285300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb8a-8417-47df-88e5-8d19dc87f253 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:09.287920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:09.303921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:09.305184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:09.305708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:09.306172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:09.348095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:09.349834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:09.395636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2466/4957] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:09.447081 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2492/4958] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:34:09 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:09.447554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:09.461125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474b16-87f1-4f77-bc87-6f11ae067670 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:09.610982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:09.611824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:09.612140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:09.612465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:09.613061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:09.616267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:09.677935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2467/4959] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:34:09 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:09.679221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:09.696370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b3cf-5786-4a08-b4d8-09780bacbde0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:09.728900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:09.734807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:09.735103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:09.735386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:09.736071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:09.747875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:09.833282 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2493/4960] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:09.837180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:09.919330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023309-647b-49c8-a35a-e3cfff0ba2d4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:09.969488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986a00f-12f4-4e34-beb9-74906d7070a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:09.971102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a00f-12f4-4e34-beb9-74906d7070a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:09.982891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a00f-12f4-4e34-beb9-74906d7070a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:09.984729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a00f-12f4-4e34-beb9-74906d7070a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:09.988198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986a00f-12f4-4e34-beb9-74906d7070a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:10.009450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986a00f-12f4-4e34-beb9-74906d7070a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:10.074286 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2468/4961] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:10.076403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:10.082441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:10.097275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796a64-8739-4a69-89ff-389449ff4679 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:10.144307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbeea9-66aa-46f7-9e52-3ba27ff04be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:10.144307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbeea9-66aa-46f7-9e52-3ba27ff04be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:10.144307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbeea9-66aa-46f7-9e52-3ba27ff04be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:10.144307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbeea9-66aa-46f7-9e52-3ba27ff04be8 admin admin] PATH_INFO: `/v3/projects/de9e88cf2f8e4b35a0840db55aa03b9c/users/3cfc93c792364c83b783b398287521cd/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:10.238038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbeea9-66aa-46f7-9e52-3ba27ff04be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9e88cf2f8e4b35a0840db55aa03b9c, user_id=3cfc93c792364c83b783b398287521cd, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:10.281584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbeea9-66aa-46f7-9e52-3ba27ff04be8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:10.357082 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2494/4962] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:10 2022] PUT /identity/v3/projects/de9e88cf2f8e4b35a0840db55aa03b9c/users/3cfc93c792364c83b783b398287521cd/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:10.380584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:10.381162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:10.381671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:10.560617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] MFA Rules not processed for user `3cfc93c792364c83b783b398287521cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:10.563705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:10.858244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2469/4963] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:34:10.865476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:10.866249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:10.866249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:10.886121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:10.887743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:10.970492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] MFA Rules not processed for user `3cfc93c792364c83b783b398287521cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:10.972578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:11.005705 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2495/4964] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:11.018247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:11.020167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:11.035587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:11.136545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c121f7a-e2d4-422b-b944-529cc7ef8703 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:11.160176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:11.161301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:11.161991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:11.161991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] PATH_INFO: `/v3/projects/38f77eedee8b4a43b67a00d98e8d1e45` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:11.164145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f77eedee8b4a43b67a00d98e8d1e45)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:11.172011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:11.196523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0e418-138d-4c4d-aa33-f251953d8f26 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:11.220350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:11.223066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:11.224940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:11.232560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:11.269748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:11.273903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:11.315396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2496/4965] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:34:11.339361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f77eedee8b4a43b67a00d98e8d1e45', 'request_id': 'req-09213e72-c60d-4c2f-9770-1d970fb46246'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.351669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f77eedee8b4a43b67a00d98e8d1e45', 'request_id': 'req-09213e72-c60d-4c2f-9770-1d970fb46246'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.374839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f77eedee8b4a43b67a00d98e8d1e45', 'request_id': 'req-09213e72-c60d-4c2f-9770-1d970fb46246'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.415132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] The token cache is being invalidate because project 38f77eedee8b4a43b67a00d98e8d1e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:11.418245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.420483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.422876 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2470/4966] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:10 2022] DELETE /identity/v3/projects/38f77eedee8b4a43b67a00d98e8d1e45 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:34:11.426766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:11.445622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7619be-7423-4fac-ae08-a0b89d058a41 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:11.617834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:11.618530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:11.618812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:11.619085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] PATH_INFO: `/v3/users/e9f2078296724110b5ecbdcd95b1c0ce` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:11.628273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f2078296724110b5ecbdcd95b1c0ce)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:11.630391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:11.771751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f2078296724110b5ecbdcd95b1c0ce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.799789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:11.816188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f2078296724110b5ecbdcd95b1c0ce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.817592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f2078296724110b5ecbdcd95b1c0ce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.820842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f2078296724110b5ecbdcd95b1c0ce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.838124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35849000-2547-42f6-a0ef-55f1a8893fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f2078296724110b5ecbdcd95b1c0ce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:11.876413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2497/4967] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:11 2022] DELETE /identity/v3/users/e9f2078296724110b5ecbdcd95b1c0ce => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:12.625125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:12.627442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:12.680848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09213e72-c60d-4c2f-9770-1d970fb46246 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:12.886959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:12.887636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:12.887917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:12.888192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] PATH_INFO: `/v3/projects/b023b080fd4041199df69bd17c0569c4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:12.894783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b023b080fd4041199df69bd17c0569c4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:12.899461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:12.998176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b023b080fd4041199df69bd17c0569c4', 'request_id': 'req-51293fa7-422b-4360-903f-a03b9829c5d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:13.007075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b023b080fd4041199df69bd17c0569c4', 'request_id': 'req-51293fa7-422b-4360-903f-a03b9829c5d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:13.019072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b023b080fd4041199df69bd17c0569c4', 'request_id': 'req-51293fa7-422b-4360-903f-a03b9829c5d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:13.023238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:13.047566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] The token cache is being invalidate because project b023b080fd4041199df69bd17c0569c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:13.048141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:13.050345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-51293fa7-422b-4360-903f-a03b9829c5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:13.054695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2471/4968] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:12 2022] DELETE /identity/v3/projects/b023b080fd4041199df69bd17c0569c4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:13.060111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:13.060657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:13.061102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:13.085241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:13.103500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:13.276762 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2498/4969] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:13.284236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:13.284535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:13.284855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:13.351343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:13.353875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:13.381465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2472/4970] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:13.383523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:13.400007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7cfc-6129-4ce8-a395-2d45faf8ac18 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:13.420751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:13.421395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:13.426702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:13.427212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:13.428863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:34:13.430874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:13.438041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:13.490513 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2499/4971] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:34:13.492984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:13.561303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe089ae-3d78-46b2-b1d8-fe7f07660cd2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:13.587629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:13.588312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:13.588776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:13.589057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:13.589720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:13.591660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:13.711983 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2473/4972] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:34:13 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:13.719238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:13.732233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5edc2-19de-4834-9aff-645e459b93f3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:13.999661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:14.003966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:14.003966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:14.004494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:14.008062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:14.015169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:14.109580 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2500/4973] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:34:13 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:14.113701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:14.143678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14d08e-803e-4c86-81d8-cfd40db5aede admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:14.156772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:14.157756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:14.158397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:14.159020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:14.161250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:14.163618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:14.196860 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2474/4974] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:14.200372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:14.218701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bb56-5a38-465f-a0ec-de4a711893fe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:14.235052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d1af1-4c36-4f9d-b3a7-38da61e2b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:14.236022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d1af1-4c36-4f9d-b3a7-38da61e2b814 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:14.237675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d1af1-4c36-4f9d-b3a7-38da61e2b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:14.238302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d1af1-4c36-4f9d-b3a7-38da61e2b814 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:14.239202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d1af1-4c36-4f9d-b3a7-38da61e2b814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:14.245933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d1af1-4c36-4f9d-b3a7-38da61e2b814 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:14.281427 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2501/4975] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:14.284011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:14.301446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c144-432a-495b-a2b4-5df72760018c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:14.332461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:14.336425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:14.339636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:14.340056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] PATH_INFO: `/v3/projects/2b7c6b30fcc34cd1b57e49c397129f8d/users/b865ed96073d4f3faba2f0632933a5f9/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:14.404134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7c6b30fcc34cd1b57e49c397129f8d, user_id=b865ed96073d4f3faba2f0632933a5f9, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:14.418767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:14.477154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2475/4976] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:14 2022] PUT /identity/v3/projects/2b7c6b30fcc34cd1b57e49c397129f8d/users/b865ed96073d4f3faba2f0632933a5f9/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:14.482920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099f76c-b7a8-4ec7-90a2-61e2339bec99 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:14.483542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099f76c-b7a8-4ec7-90a2-61e2339bec99 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:14.483936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099f76c-b7a8-4ec7-90a2-61e2339bec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:14.542767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4099f76c-b7a8-4ec7-90a2-61e2339bec99 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:14.549081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4099f76c-b7a8-4ec7-90a2-61e2339bec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:14.732701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:14.800815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2502/4977] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:14.809670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:14.813111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:14.971323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819adb25-0b2a-4c9d-8b7b-7d118fb5d0a5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:14.981195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:14.984360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:14.984826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:14.985258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:15.015848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:15.020250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:15.056277 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2476/4978] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:17.395467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:17.396051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:17.396595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:17.459630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] MFA Rules not processed for user `b865ed96073d4f3faba2f0632933a5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:17.469995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:17.628060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2503/4979] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:17.629137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:17.643179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41429a53-d8d7-4059-b5db-8dd203e8108a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:17.659331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:17.662963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:17.662963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:17.662963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:17.663793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:17.669093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:17.731856 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2477/4980] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:17.737729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:17.750361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600c04-5381-42c7-bb74-8af1e6c1d7a7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:17.844037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:17.844859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:17.845254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:17.845645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:17.846441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:17.851138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:17.891437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:17.905606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f029-326e-40e8-b220-d3390f5ece66 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:17.905964 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2504/4981] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:34:17 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:17.920696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:17.920696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:17.920696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:17.920696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:17.921463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:17.924909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:17.954020 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2478/4982] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:17.958337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:17.988953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158fb85-b999-447a-aa81-f40a9347e3ca admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:18.011868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:18.013012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:18.013519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:18.022979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] PATH_INFO: `/v3/projects/27f3e1a520d14bdca5d2ba5f273eded0/users/5b908eba332247b0acde61030f0f391d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:18.076171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f3e1a520d14bdca5d2ba5f273eded0, user_id=5b908eba332247b0acde61030f0f391d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:18.086450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:18.135686 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2505/4983] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:17 2022] PUT /identity/v3/projects/27f3e1a520d14bdca5d2ba5f273eded0/users/5b908eba332247b0acde61030f0f391d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:18.145763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:18.172072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d06e9-661a-4be5-9322-af5da19487c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:18.365306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d83e9-1f5f-4fad-b4be-559584de0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:18.365954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d83e9-1f5f-4fad-b4be-559584de0010 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:18.366279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d83e9-1f5f-4fad-b4be-559584de0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:18.366566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d83e9-1f5f-4fad-b4be-559584de0010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:18.367214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d83e9-1f5f-4fad-b4be-559584de0010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:18.374488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d83e9-1f5f-4fad-b4be-559584de0010 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:18.384930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:18.405072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2479/4984] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:18.409461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:18.425808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efaab0-bd9b-4e19-a370-1a0b35a33b51 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:18.449481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d19a5-f256-4925-b644-bc2f09448efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:18.450819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d19a5-f256-4925-b644-bc2f09448efc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:18.451423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d19a5-f256-4925-b644-bc2f09448efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:18.451856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d19a5-f256-4925-b644-bc2f09448efc admin admin] PATH_INFO: `/v3/projects/27f3e1a520d14bdca5d2ba5f273eded0/users/5b908eba332247b0acde61030f0f391d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:18.454016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d19a5-f256-4925-b644-bc2f09448efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f3e1a520d14bdca5d2ba5f273eded0, user_id=5b908eba332247b0acde61030f0f391d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:18.458021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d19a5-f256-4925-b644-bc2f09448efc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:18.495098 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2506/4985] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:18 2022] PUT /identity/v3/projects/27f3e1a520d14bdca5d2ba5f273eded0/users/5b908eba332247b0acde61030f0f391d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:20.916292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:20.917991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:20.918542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:21.025507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] MFA Rules not processed for user `5b908eba332247b0acde61030f0f391d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:21.027823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:21.368675 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2480/4986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:21.381951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:21.387599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:21.387599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:21.446002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] MFA Rules not processed for user `b865ed96073d4f3faba2f0632933a5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:21.447297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:21.497352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:21.623806 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2507/4987] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:22.080280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:22.081976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:22.403453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccfac0-0e9d-4e68-8a9f-dd6b4cdb3eb7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:22.419973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72079a4-e470-4fcc-8bd6-cf229c7323c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:22.421803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72079a4-e470-4fcc-8bd6-cf229c7323c0 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:22.423306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72079a4-e470-4fcc-8bd6-cf229c7323c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:22.423855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72079a4-e470-4fcc-8bd6-cf229c7323c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:22.445195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72079a4-e470-4fcc-8bd6-cf229c7323c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:22.448375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72079a4-e470-4fcc-8bd6-cf229c7323c0 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:22.475016 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2481/4988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:23.552464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:23.697947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d7d40-5b38-4185-a351-c32e857b5f17 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:23.718489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:23.719631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:23.719631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:23.720194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:23.730750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:23.798060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:23.802649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:23.865974 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2508/4989] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:24.588303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed12b-b739-4ae7-9e2c-6f416434489b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:24.588954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed12b-b739-4ae7-9e2c-6f416434489b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:24.588954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed12b-b739-4ae7-9e2c-6f416434489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:24.678564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1a6ed12b-b739-4ae7-9e2c-6f416434489b None None] MFA Rules not processed for user `3cfc93c792364c83b783b398287521cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:24.679823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1a6ed12b-b739-4ae7-9e2c-6f416434489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:24.935944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2482/4990] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:26.318920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:26.321884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:26.498911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41460ba6-f900-421c-8db9-d41817e712b9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:26.514849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:26.515756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:26.516998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:26.517449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] PATH_INFO: `/v3/users/b7ccaa94c0bd4f308ffda2a5cfa679f0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:26.518834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ccaa94c0bd4f308ffda2a5cfa679f0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:26.520986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:26.649779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ccaa94c0bd4f308ffda2a5cfa679f0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:26.690750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ccaa94c0bd4f308ffda2a5cfa679f0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:26.691751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ccaa94c0bd4f308ffda2a5cfa679f0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:26.692549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ccaa94c0bd4f308ffda2a5cfa679f0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:26.709934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ccaa94c0bd4f308ffda2a5cfa679f0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:26.714118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:26.743719 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2509/4991] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:26 2022] DELETE /identity/v3/users/b7ccaa94c0bd4f308ffda2a5cfa679f0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:34:26.748845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:26.749806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:26.750351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:26.781288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:26.783613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:26.800575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:26.900133 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2483/4992] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:34:26.910977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:26.912857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:27.037901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34addf3f-f06f-4d78-8fa8-554785cec7d0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:27.049531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:27.050199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:27.050488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:27.050765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:27.077739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:27.079312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:27.102517 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2510/4993] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:28.489301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:28.490966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:28.513566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac1dd-d179-471a-acdf-93077f472be3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:28.538165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:28.538855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:28.539143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:28.539424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] PATH_INFO: `/v3/projects/5b5edf8c75f848d09ab2d3724c4f26b3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:28.542845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5edf8c75f848d09ab2d3724c4f26b3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:28.544853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:28.641058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5edf8c75f848d09ab2d3724c4f26b3', 'request_id': 'req-db3ca2d0-e96d-4c51-afac-d567a26163f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.664606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5edf8c75f848d09ab2d3724c4f26b3', 'request_id': 'req-db3ca2d0-e96d-4c51-afac-d567a26163f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.678504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5edf8c75f848d09ab2d3724c4f26b3', 'request_id': 'req-db3ca2d0-e96d-4c51-afac-d567a26163f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.701858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] The token cache is being invalidate because project 5b5edf8c75f848d09ab2d3724c4f26b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:28.702590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.705719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.708456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2484/4994] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:28 2022] DELETE /identity/v3/projects/5b5edf8c75f848d09ab2d3724c4f26b3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:28.714193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:28.727898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da513b33-9739-4b2d-89c0-d710777872ca service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:28.847200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:28.847872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:28.848157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:28.848502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] PATH_INFO: `/v3/users/d4274d6c1a4f40208a867f356395be78` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:28.852056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4274d6c1a4f40208a867f356395be78)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:28.859192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:28.960797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4274d6c1a4f40208a867f356395be78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.982368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4274d6c1a4f40208a867f356395be78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.983139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4274d6c1a4f40208a867f356395be78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.983808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4274d6c1a4f40208a867f356395be78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:28.997657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4274d6c1a4f40208a867f356395be78'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:29.038094 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2511/4995] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:28 2022] DELETE /identity/v3/users/d4274d6c1a4f40208a867f356395be78 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:29.915725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:29.917857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:29.944696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca2d0-e96d-4c51-afac-d567a26163f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:30.093717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:30.094707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:30.095185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:30.095669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] PATH_INFO: `/v3/projects/3303f5ae541141fe8188ce65b2840f3d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:30.097485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3303f5ae541141fe8188ce65b2840f3d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:30.099661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:30.186631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:30.203949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3303f5ae541141fe8188ce65b2840f3d', 'request_id': 'req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.212783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3303f5ae541141fe8188ce65b2840f3d', 'request_id': 'req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.232378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3303f5ae541141fe8188ce65b2840f3d', 'request_id': 'req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.248342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] The token cache is being invalidate because project 3303f5ae541141fe8188ce65b2840f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:30.248979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.249753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.251672 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2485/4996] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:29 2022] DELETE /identity/v3/projects/3303f5ae541141fe8188ce65b2840f3d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:30.255604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:30.257060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:30.271787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4137b0-d066-4f41-8516-40e92528670c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:30.288146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:30.373157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:30.375022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:30.375729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:30.376844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] PATH_INFO: `/v3/users/fae66b69381948a5b23b530a00d1599d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:30.378312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae66b69381948a5b23b530a00d1599d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:30.380560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:30.551290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae66b69381948a5b23b530a00d1599d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.602627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae66b69381948a5b23b530a00d1599d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.604034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae66b69381948a5b23b530a00d1599d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.604880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae66b69381948a5b23b530a00d1599d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.613978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae66b69381948a5b23b530a00d1599d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:30.638509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2512/4997] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:30 2022] DELETE /identity/v3/users/fae66b69381948a5b23b530a00d1599d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:34:30.939305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:30.941243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:31.001051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:31.002238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:31.082716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339ff6-5f13-4207-bc10-7fb70a6ba7f8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:31.096793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:31.097604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:31.097896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:31.098208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:31.099991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11107ac2-1d2a-4e03-8033-1ed0bc899866 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:31.101661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:31.107107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:31.107985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:31.108385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:31.114649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:31.128676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:31.129801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:31.130343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440b2e-a451-429b-a617-851f6e159866 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:31.133757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:31.157340 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2513/4998] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:31.173966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2486/4999] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:31.292922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:31.295808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:31.372508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:31.504750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75de1b3-91c4-4f4c-94cf-339246d350e9 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:31.522436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:31.523104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:31.523386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:31.523658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] PATH_INFO: `/v3/projects/b9f861e4a364472c9ba92d801f0d870c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:31.529009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f861e4a364472c9ba92d801f0d870c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:31.535346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:31.692107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f861e4a364472c9ba92d801f0d870c', 'request_id': 'req-16ee5c9b-f006-469d-90a5-a0423b3392fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:31.705227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f861e4a364472c9ba92d801f0d870c', 'request_id': 'req-16ee5c9b-f006-469d-90a5-a0423b3392fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:31.714896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f861e4a364472c9ba92d801f0d870c', 'request_id': 'req-16ee5c9b-f006-469d-90a5-a0423b3392fd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:31.752576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] The token cache is being invalidate because project b9f861e4a364472c9ba92d801f0d870c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:31.752921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:31.754620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16ee5c9b-f006-469d-90a5-a0423b3392fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:31.769707 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2514/5000] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:31 2022] DELETE /identity/v3/projects/b9f861e4a364472c9ba92d801f0d870c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:31.771726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:31.771982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:31.772267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:31.815661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:31.816972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:31.943175 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2487/5001] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:31.952498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:31.953258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:31.953730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.002785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:32.005561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:32.016458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2515/5002] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:32.020855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.042749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4d451-fb97-4005-8980-0f6da804c888 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.061843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.062524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.062803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.065550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.070779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:34:32.071594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.075524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.120887 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2488/5003] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:34:32.120987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.131449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e43a3b-228b-4398-a8c1-675a8906c095 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.137101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.137726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.138192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.138477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.139122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.141046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.181553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2516/5004] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:34:32 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:32.185975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.206865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f851b-c920-4069-abf5-cfcda3bd4b53 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.268375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:32.308366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.309281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.309716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.310140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.311001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.313381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.365856 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2489/5005] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:34:32 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:32.370956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.385310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48120fc1-783e-4307-84ad-dd2d914138fb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.393291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.393986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.394506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.396134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.397289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.399735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.420046 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2517/5006] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:32.420814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.441380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d94e29-3a16-4eed-b996-954d8b6fe501 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.448105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8b66-a137-457d-b364-eec9014d08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.448962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8b66-a137-457d-b364-eec9014d08f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.449301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8b66-a137-457d-b364-eec9014d08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.449569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8b66-a137-457d-b364-eec9014d08f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.450343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c8b66-a137-457d-b364-eec9014d08f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.452081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c8b66-a137-457d-b364-eec9014d08f2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.483817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2490/5007] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:32.488729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.509600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74e61-4a6f-4bfd-930c-ac2dd4da06f0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.524302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.526983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.529058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.534635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] PATH_INFO: `/v3/projects/03795a954fb2485ead31ca60cf4d5afd/users/c23f31668bce435f87b8ec48da3b5f75/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.568660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03795a954fb2485ead31ca60cf4d5afd, user_id=c23f31668bce435f87b8ec48da3b5f75, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.576113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.608119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2518/5008] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:32 2022] PUT /identity/v3/projects/03795a954fb2485ead31ca60cf4d5afd/users/c23f31668bce435f87b8ec48da3b5f75/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:32.608885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.609261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.609581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.657868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] MFA Rules not processed for user `c23f31668bce435f87b8ec48da3b5f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:32.659377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:32.808648 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2491/5009] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:32.831805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:32.834911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:32.919310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:32.923936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6d4d2-6623-4363-8f89-dfd152db6ebd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:32.928741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:32.929741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:32.930382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:32.931000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:32.943717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:32.946125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:32.972799 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2519/5010] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:33.365429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:33.369293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:33.533160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f8877-68b6-4ec3-9555-1766bfc2f16d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:33.542554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:33.545190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:33.545836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:33.546137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:33.552618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:33.655912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:33.657617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:33.731129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:33.775041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:33.779729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:33.838635 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2492/5011] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:33.843072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea281d56-3f57-41e0-937a-5f9b3b8e3dd2 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:33.858475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:33.859141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:33.859424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:33.859862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] PATH_INFO: `/v3/users/750a6e11223943ac967b4a77893ff882` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:33.862838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] RBAC: Authorizing `identity:delete_user(user_id=750a6e11223943ac967b4a77893ff882)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:33.864954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:33.993758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:33.996241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:34.004429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750a6e11223943ac967b4a77893ff882'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:34.037811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750a6e11223943ac967b4a77893ff882'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:34.038592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750a6e11223943ac967b4a77893ff882'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:34.039334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750a6e11223943ac967b4a77893ff882'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:34.055800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7057082-9b63-4efe-8d70-c4037db0780a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750a6e11223943ac967b4a77893ff882'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:34.086085 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2520/5012] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:33 2022] DELETE /identity/v3/users/750a6e11223943ac967b4a77893ff882 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:34.088002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b6787-2211-4c29-9642-42abae631434 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:34.088289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b6787-2211-4c29-9642-42abae631434 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:34.088562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b6787-2211-4c29-9642-42abae631434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:34.128365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a421c-2e41-471c-9a0e-8e766475c9b5 service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:34.133371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-db4b6787-2211-4c29-9642-42abae631434 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:34.134603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db4b6787-2211-4c29-9642-42abae631434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:34.205049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:34.206376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:34.206895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:34.207581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:34.209874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:34.225783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:34.230213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:34.244645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2493/5013] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:34:34.266680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2521/5014] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:34:34.281545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:34.283378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:34.318941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bedcc-dd73-4790-90d9-311e96825e62 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:34.325720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:34.326746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:34.327247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:34.327736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:34.364716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:34.368449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:34.387210 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2494/5015] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:34.398844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b6787-2211-4c29-9642-42abae631434 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:34.400439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db4b6787-2211-4c29-9642-42abae631434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:34.422482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b6787-2211-4c29-9642-42abae631434 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:34.433579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:34.434343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:34.434522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:34.434796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:34.443599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:34.462025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:34.587085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:34.590407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff3e7-8a7b-4239-b812-5471e9a7de0a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:34.611348 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2522/5016] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:35.227776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:35.229475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:35.253624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52395-166c-4712-b3af-0d9fc0851845 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:35.273475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:35.274600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:35.277773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:35.278345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] PATH_INFO: `/v3/projects/918038b1d01846faa081a3326118fbf1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:35.283785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=918038b1d01846faa081a3326118fbf1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:35.289410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:35.434945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918038b1d01846faa081a3326118fbf1', 'request_id': 'req-aa38d409-5736-401f-a68a-fca3037aa03f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:35.448311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918038b1d01846faa081a3326118fbf1', 'request_id': 'req-aa38d409-5736-401f-a68a-fca3037aa03f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:35.464071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918038b1d01846faa081a3326118fbf1', 'request_id': 'req-aa38d409-5736-401f-a68a-fca3037aa03f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:35.489046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] The token cache is being invalidate because project 918038b1d01846faa081a3326118fbf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:35.489425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:35.490345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa38d409-5736-401f-a68a-fca3037aa03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:35.492523 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2495/5017] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:35 2022] DELETE /identity/v3/projects/918038b1d01846faa081a3326118fbf1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:35.499009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:35.499508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:35.499594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:35.548592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:35.552457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:35.664424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2523/5018] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:35.760134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f8ed-37f2-4018-acb1-bb038e4658b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:35.760770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f8ed-37f2-4018-acb1-bb038e4658b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:35.761213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f8ed-37f2-4018-acb1-bb038e4658b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:35.809668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0a19f8ed-37f2-4018-acb1-bb038e4658b0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:35.811099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0a19f8ed-37f2-4018-acb1-bb038e4658b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:35.821429 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2496/5019] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:35.825374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:35.844392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8869223-fd76-4370-af81-46d011523bc0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:35.853002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:35.853290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:35.854327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:35.860090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:35.860808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:35.861165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:35.870917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:35.876825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:34:35.878693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:35.881328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:35.892774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] MFA Rules not processed for user `c23f31668bce435f87b8ec48da3b5f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:35.893993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:35.910326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2524/5020] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:34:35.911487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:35.920962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:35.925791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51c752-257c-4395-98ce-2ec4278db30d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:35.934370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:35.936684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:35.937208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:35.937703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:35.938736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:35.941616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:35.994727 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2525/5021] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:34:35 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:35.996548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:36.048630 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2497/5022] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:36.153268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2375b-e5f7-4cde-8f29-2f8be02b5ee4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:36.170979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:36.170979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:36.170979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:36.170979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:36.171378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:36.171378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:36.179583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:36.215240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:36.216709 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2526/5023] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:34:35 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:36.251816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c928180-f5d5-4e5d-9a0e-e905f5fdfe3c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:36.269736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:36.270685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:36.272932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:36.273288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:36.274492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:36.282026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:36.308145 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2498/5024] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:34:36.309741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:36.323882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8314f-1e66-4c26-ac25-17dd3ffaa873 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:36.329517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720bcf-5f95-4ee2-80ab-f9d0a4bf21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:36.330141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720bcf-5f95-4ee2-80ab-f9d0a4bf21eb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:36.330446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720bcf-5f95-4ee2-80ab-f9d0a4bf21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:36.330717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720bcf-5f95-4ee2-80ab-f9d0a4bf21eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:36.331410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720bcf-5f95-4ee2-80ab-f9d0a4bf21eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:36.334452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720bcf-5f95-4ee2-80ab-f9d0a4bf21eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:36.347692 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2527/5025] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:36.351121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:36.371013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7630f-38bf-49da-ab08-5be86aca3847 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:36.382684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:36.383375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:36.383869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:36.384626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] PATH_INFO: `/v3/projects/fd7198ee06d8409b90126efac7dbf237/users/c4036603c3524efabf88f3a7bccc2674/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:36.418964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7198ee06d8409b90126efac7dbf237, user_id=c4036603c3524efabf88f3a7bccc2674, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:36.430664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:36.460579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2499/5026] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:36 2022] PUT /identity/v3/projects/fd7198ee06d8409b90126efac7dbf237/users/c4036603c3524efabf88f3a7bccc2674/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:36.471573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:36.471573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:36.471952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:36.552110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] MFA Rules not processed for user `c4036603c3524efabf88f3a7bccc2674`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:36.558901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:36.725905 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2528/5027] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:36.737132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:36.739146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:36.839765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff95457-3312-45a6-a99a-d06b4824c761 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:36.843619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c5e3-e4a8-4406-a3ca-a3c26605dfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:36.844260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c5e3-e4a8-4406-a3ca-a3c26605dfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:36.844551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c5e3-e4a8-4406-a3ca-a3c26605dfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:36.844945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c5e3-e4a8-4406-a3ca-a3c26605dfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:36.855641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c5e3-e4a8-4406-a3ca-a3c26605dfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:36.857660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c5e3-e4a8-4406-a3ca-a3c26605dfd9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:36.898821 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2500/5028] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:38.308611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:38.412996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5acb5a-4bad-4065-a02a-4da2004ab241 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:38.419105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:38.419838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:38.420170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:38.420512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] PATH_INFO: `/v3/users/c4036603c3524efabf88f3a7bccc2674` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:38.421888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4036603c3524efabf88f3a7bccc2674)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:38.424956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:38.490953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4036603c3524efabf88f3a7bccc2674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:38.508277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4036603c3524efabf88f3a7bccc2674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:38.509344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4036603c3524efabf88f3a7bccc2674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:38.510309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4036603c3524efabf88f3a7bccc2674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:38.520151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:38.524843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4036603c3524efabf88f3a7bccc2674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:38.564972 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2529/5029] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:38 2022] DELETE /identity/v3/users/c4036603c3524efabf88f3a7bccc2674 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:38.569727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555e7ff-7b1c-4f76-81bb-0275d613e789 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:38.570215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555e7ff-7b1c-4f76-81bb-0275d613e789 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:38.570306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555e7ff-7b1c-4f76-81bb-0275d613e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:38.595061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6555e7ff-7b1c-4f76-81bb-0275d613e789 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:38.596677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6555e7ff-7b1c-4f76-81bb-0275d613e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:38.671375 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2501/5030] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:38.695192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:38.697593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:38.800874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4689308-966d-4e7e-ac1e-48ff0f0cfd9f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:38.806216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:38.807297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:38.807789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:38.808704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:38.824658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:38.827516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:38.846059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2530/5031] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:39.092250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:39.092737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:39.093206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:39.144114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:39.146896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:39.187547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:39.266229 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2502/5032] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:34:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:34:39.282398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:39.284094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:39.448978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ff589-0cd1-41fd-bb7a-d598cd24b88b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:39.456033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0060b-d098-4578-94dd-2dd588f6645a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:39.456800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0060b-d098-4578-94dd-2dd588f6645a service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:39.457206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0060b-d098-4578-94dd-2dd588f6645a service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:39.459286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0060b-d098-4578-94dd-2dd588f6645a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:39.480783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0060b-d098-4578-94dd-2dd588f6645a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:39.482742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0060b-d098-4578-94dd-2dd588f6645a service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:39.502958 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2531/5033] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:34:39.903094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:39.906474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:39.941497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47752269-2cd8-49af-b3c5-ae229119e65b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:39.958969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:39.959703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:39.959988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:39.960267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] PATH_INFO: `/v3/projects/fd7198ee06d8409b90126efac7dbf237` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:39.966370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7198ee06d8409b90126efac7dbf237)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:39.973131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:40.185661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7198ee06d8409b90126efac7dbf237', 'request_id': 'req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:40.204926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7198ee06d8409b90126efac7dbf237', 'request_id': 'req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:40.222379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7198ee06d8409b90126efac7dbf237', 'request_id': 'req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:40.259429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] The token cache is being invalidate because project fd7198ee06d8409b90126efac7dbf237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:34:40.263124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:40.264858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8e6ff076-6aa2-4452-b31d-f5fd12c6d382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:40.277027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2503/5034] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:34:39 2022] DELETE /identity/v3/projects/fd7198ee06d8409b90126efac7dbf237 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:40.282512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:40.283250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:40.283771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:40.335217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:40.336565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:40.532511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2532/5035] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:40.535292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:40.535689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:40.536205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:40.626712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:40.632705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:40.689597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2504/5036] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:40.693603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:40.711509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45a5a-c443-4e31-8598-4f199dbc8c02 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:40.733676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:40.737212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:40.739578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:40.739990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:40.742783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:34:40.745691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:40.773239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:40.807791 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2533/5037] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:34:40.813262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:40.825272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62edc6-a795-4e84-ae4f-eadd819def8b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:40.860930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:40.861506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:40.861789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:40.862068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:40.862753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:40.875002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:41.004477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2505/5038] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:34:40 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:41.008808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:41.026730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200198c3-b8fd-427d-8f27-f325ec06994f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:41.041329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:41.165470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:41.167337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:41.167734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:41.168610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:41.168882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:41.172504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:41.222526 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2534/5039] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:34:41 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:34:41.224495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:41.240890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956de14-cb68-4bbc-a7d7-59817ee1a9ea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:41.277247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:41.293437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:41.301042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:41.301649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:41.314567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:41.331302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:41.391610 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2506/5040] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:41.392985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:41.414254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00e6ca-b859-4281-bb2e-6764f93bef99 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:41.443505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bac06-5b77-447e-a9fa-9564588a60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:41.446806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bac06-5b77-447e-a9fa-9564588a60d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:41.448348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bac06-5b77-447e-a9fa-9564588a60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:41.448886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bac06-5b77-447e-a9fa-9564588a60d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:41.454457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bac06-5b77-447e-a9fa-9564588a60d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:41.456557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bac06-5b77-447e-a9fa-9564588a60d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:41.497312 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2535/5041] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:34:41.503609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:41.527101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d0fd-b227-4103-bc35-9b8f623550ee admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:41.544619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:41.545326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:41.545650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:41.545959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] PATH_INFO: `/v3/projects/a9cbabf60e9a4e7cbd2f4e5ae71ad6b3/users/9d6fb5c3b9b049c7b0b91265b0c5a342/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:41.596808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cbabf60e9a4e7cbd2f4e5ae71ad6b3, user_id=9d6fb5c3b9b049c7b0b91265b0c5a342, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:41.606476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:41.685046 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2507/5042] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:34:41 2022] PUT /identity/v3/projects/a9cbabf60e9a4e7cbd2f4e5ae71ad6b3/users/9d6fb5c3b9b049c7b0b91265b0c5a342/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:41.688660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:41.689165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:41.689483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:41.774233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] MFA Rules not processed for user `9d6fb5c3b9b049c7b0b91265b0c5a342`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:41.796713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:42.044948 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2536/5043] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:42.057966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:42.060363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:42.237610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120664-af33-4051-a538-15cbdd50b179 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:42.245166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:42.246190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:42.246672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:42.247145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:42.253344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:42.269763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:42.271342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:42.307130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2508/5044] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:52.008129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:52.011442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:52.282629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:52.304005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171e9c-74b5-45ab-b8fb-e3e7f79a73fb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:52.324331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:52.328237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:52.330078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:52.330633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:52.339289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:52.465843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:34:52.553951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:52.558194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:52.583702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2537/5045] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:59.273652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:59.276257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:59.459899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a55b2-7928-48c7-b132-5e27b4a47bd1 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:59.471513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:59.472238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:59.473329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:59.473614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:59.476285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:59.514893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:59.536377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:59.543752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69ff43-7388-45b5-8592-8a5d0b954ca4 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:59.574668 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2509/5046] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:34:59.659293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2798-df0f-438f-a8f2-48948ae58564 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:34:59.666038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:34:59.667701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:59.667992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:59.668268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] PATH_INFO: `/v3/users/9d6fb5c3b9b049c7b0b91265b0c5a342` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:59.670114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6fb5c3b9b049c7b0b91265b0c5a342)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:34:59.672404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:34:59.747063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6fb5c3b9b049c7b0b91265b0c5a342'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:59.766122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6fb5c3b9b049c7b0b91265b0c5a342'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:59.767693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6fb5c3b9b049c7b0b91265b0c5a342'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:59.768577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6fb5c3b9b049c7b0b91265b0c5a342'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:59.780611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6fb5c3b9b049c7b0b91265b0c5a342'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:34:59.798758 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2538/5047] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:34:59 2022] DELETE /identity/v3/users/9d6fb5c3b9b049c7b0b91265b0c5a342 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:34:59.803337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:34:59.803629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:34:59.803910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:34:59.825481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:34:59.826662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:59.910409 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2510/5048] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:34:59.921904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:34:59.926958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:34:59.999314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:00.006859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035ad6-799d-4318-8b90-873c50483577 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:00.012411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a794-0a9a-4ae0-8e19-4de51fc35ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:00.013373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a794-0a9a-4ae0-8e19-4de51fc35ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.014103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a794-0a9a-4ae0-8e19-4de51fc35ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.014570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a794-0a9a-4ae0-8e19-4de51fc35ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.027033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6a794-0a9a-4ae0-8e19-4de51fc35ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:00.028896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6a794-0a9a-4ae0-8e19-4de51fc35ee5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:00.039083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2539/5049] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:00.278880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:00.280077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:00.297871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e9a0-8e1b-405d-83d0-7afe0534a598 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:00.304404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:00.305434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.305713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.306628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] PATH_INFO: `/v3/projects/a9cbabf60e9a4e7cbd2f4e5ae71ad6b3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.308348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cbabf60e9a4e7cbd2f4e5ae71ad6b3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:00.310717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:00.379273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cbabf60e9a4e7cbd2f4e5ae71ad6b3', 'request_id': 'req-0d166593-4aea-4d41-a47a-0405b20a6f13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:00.387608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cbabf60e9a4e7cbd2f4e5ae71ad6b3', 'request_id': 'req-0d166593-4aea-4d41-a47a-0405b20a6f13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:00.400152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cbabf60e9a4e7cbd2f4e5ae71ad6b3', 'request_id': 'req-0d166593-4aea-4d41-a47a-0405b20a6f13'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:00.421258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] The token cache is being invalidate because project a9cbabf60e9a4e7cbd2f4e5ae71ad6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:00.421683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:00.429305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0d166593-4aea-4d41-a47a-0405b20a6f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:00.429305 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2511/5050] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:00 2022] DELETE /identity/v3/projects/a9cbabf60e9a4e7cbd2f4e5ae71ad6b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:00.431868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76113702-1caa-4fa8-9321-b3be389ca7be None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.432336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76113702-1caa-4fa8-9321-b3be389ca7be None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.433082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76113702-1caa-4fa8-9321-b3be389ca7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.458835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-76113702-1caa-4fa8-9321-b3be389ca7be None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:00.460498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-76113702-1caa-4fa8-9321-b3be389ca7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:00.548241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2540/5051] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:00.550842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e639c-e3ae-4343-bc8f-2bb9f3925ceb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.551413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e639c-e3ae-4343-bc8f-2bb9f3925ceb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.552108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e639c-e3ae-4343-bc8f-2bb9f3925ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.566512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.566716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.567743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.591854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-829e639c-e3ae-4343-bc8f-2bb9f3925ceb None None] MFA Rules not processed for user `d21096fd76b44434bb2bb0633fc0376c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:00.595445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-829e639c-e3ae-4343-bc8f-2bb9f3925ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:00.616233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:00.617712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:00.624949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:00.632876 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2541/5052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:00.639075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:00.667248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e439e-b64e-444a-ab2f-1485d201be1d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:00.684799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:00.685884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.685884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.686645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.687311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:35:00.688285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:00.690109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:00.716284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2542/5053] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:35:00.721094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:00.756853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb0f1-63af-4d31-ab02-fc98c9775c8b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:00.764529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:00.765161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.765531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.765741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.766421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:00.768418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:00.773271 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2512/5054] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:00.790979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:00.791621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:00.791621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:00.815007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] MFA Rules not processed for user `d21096fd76b44434bb2bb0633fc0376c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:00.816409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:00.831321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2513/5055] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:00.834367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2543/5056] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:35:00.836118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:00.867522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbb70-e243-4648-803b-37edd398cd7e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:01.018189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:01.019090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:01.019241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:01.021444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:01.022263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:01.027751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:01.078442 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2514/5057] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:00 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:01.081979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:01.100203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6781-5001-4a03-9284-b144e6a05ea3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:01.113428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:01.114081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:01.114673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:01.114953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:01.115613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:01.120683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:01.144485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2544/5058] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:35:01.148635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:01.162308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d44d-5439-4d4e-aadb-fdc9596f1bfb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:01.190874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9051b-4add-457e-ab68-1be419ffe0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:01.191527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9051b-4add-457e-ab68-1be419ffe0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:01.191796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9051b-4add-457e-ab68-1be419ffe0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:01.192077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9051b-4add-457e-ab68-1be419ffe0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:01.206742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9051b-4add-457e-ab68-1be419ffe0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:01.208402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9051b-4add-457e-ab68-1be419ffe0b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:01.225178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2515/5059] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:01.228291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:01.241147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbc052-419b-4bf4-af07-50d35ed7198d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:01.246934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:01.247835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:01.248442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:01.248833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] PATH_INFO: `/v3/projects/1ca51196b203424f9a27072bdd85132c/users/0a0321e73d8f4175be60ded9ff022a4e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:01.267264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca51196b203424f9a27072bdd85132c, user_id=0a0321e73d8f4175be60ded9ff022a4e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:01.270296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:01.289529 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2545/5060] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:01 2022] PUT /identity/v3/projects/1ca51196b203424f9a27072bdd85132c/users/0a0321e73d8f4175be60ded9ff022a4e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:01.301793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819da03-c03a-40cb-8781-ee26b3a07211 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:01.303043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819da03-c03a-40cb-8781-ee26b3a07211 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:01.303581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819da03-c03a-40cb-8781-ee26b3a07211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:01.357162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9819da03-c03a-40cb-8781-ee26b3a07211 None None] MFA Rules not processed for user `0a0321e73d8f4175be60ded9ff022a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:01.358861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9819da03-c03a-40cb-8781-ee26b3a07211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:01.472789 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2516/5061] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:01.484414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:01.486438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:01.577266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc232d-d2e2-4579-8e37-afa3662b19f4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:01.582457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:01.583280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:01.583870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:01.584364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:01.594876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:01.596585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:01.607870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2546/5062] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:06.137018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:06.138103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:06.138588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:06.208454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:06.209697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:06.226511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:06.319974 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2517/5063] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:06.347774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:06.350007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:06.443383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:06.733136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b96307-db6b-4895-a370-ad6d89c6b9f8 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:06.747301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:06.747468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:06.747701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:06.747980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:06.786212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:06.788282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:06.873211 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2547/5064] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:35:07.547347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:07.559341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b70a9-8bab-471d-876a-52c6c810f2f3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:07.581260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:07.581950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:07.582891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:07.583193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:07.599162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:07.834364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:07.835959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35eeeb-77e0-45e6-af90-d80840e6f575 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:07.883493 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2518/5065] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:16.861844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=25 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:17.872418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=46 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:18.571325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:18.591287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aac623-eff1-462d-a128-9ffedbb380c9 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:18.600851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:18.601693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:18.602131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:18.603098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] PATH_INFO: `/v3/users/0a0321e73d8f4175be60ded9ff022a4e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:18.605051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0321e73d8f4175be60ded9ff022a4e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:18.607173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:18.728963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0321e73d8f4175be60ded9ff022a4e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:18.764089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0321e73d8f4175be60ded9ff022a4e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:18.764849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0321e73d8f4175be60ded9ff022a4e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:18.765469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0321e73d8f4175be60ded9ff022a4e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:18.778940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0321e73d8f4175be60ded9ff022a4e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:18.806318 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2548/5066] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:18 2022] DELETE /identity/v3/users/0a0321e73d8f4175be60ded9ff022a4e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:18.810988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:18.811276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:18.811553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:18.858958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:18.860191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:18.983971 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2519/5067] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:19.014573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:19.016037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:19.131378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:19.132811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:19.152285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e062-5bcf-45a7-b47f-371e32d65043 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:19.155812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ab13-0d1a-470c-bc0e-867bad29d1e1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:19.159788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c167e9b-00dc-4038-8af7-0833c5ce650a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:19.160596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167e9b-00dc-4038-8af7-0833c5ce650a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:19.160992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167e9b-00dc-4038-8af7-0833c5ce650a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:19.161363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167e9b-00dc-4038-8af7-0833c5ce650a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:19.166973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:19.168210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:19.169022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:19.169479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] PATH_INFO: `/v3/users/3cfc93c792364c83b783b398287521cd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:19.172064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfc93c792364c83b783b398287521cd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:19.173616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c167e9b-00dc-4038-8af7-0833c5ce650a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:19.175528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c167e9b-00dc-4038-8af7-0833c5ce650a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:19.180284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:19.194499 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2549/5068] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:19.317621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfc93c792364c83b783b398287521cd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:19.334608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfc93c792364c83b783b398287521cd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:19.335654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfc93c792364c83b783b398287521cd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:19.338115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfc93c792364c83b783b398287521cd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:19.363285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfc93c792364c83b783b398287521cd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:19.439713 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2520/5069] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:19 2022] DELETE /identity/v3/users/3cfc93c792364c83b783b398287521cd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:19.444860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:19.445864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:19.446458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:19.484116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:19.485658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:19.707486 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2550/5070] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:19.732842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:19.734352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:19.865144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6350a-6e9b-4ca6-9532-77839a13d0f2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:19.877579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26605-6a09-4dac-a5f2-a9ca17d6630c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:19.878828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26605-6a09-4dac-a5f2-a9ca17d6630c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:19.880590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26605-6a09-4dac-a5f2-a9ca17d6630c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:19.881554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26605-6a09-4dac-a5f2-a9ca17d6630c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:19.907756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26605-6a09-4dac-a5f2-a9ca17d6630c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:19.913075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26605-6a09-4dac-a5f2-a9ca17d6630c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:19.930361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:19.932424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:19.965680 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2521/5071] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:19.970866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6a6b-54a5-4536-979c-c34fa0f55c0e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:19.990491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:19.991787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:19.992229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:19.992646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] PATH_INFO: `/v3/projects/1ca51196b203424f9a27072bdd85132c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:19.994752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca51196b203424f9a27072bdd85132c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:19.997360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:20.052379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:20.150694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca51196b203424f9a27072bdd85132c', 'request_id': 'req-8957c242-11e5-498b-9c18-bca45f7c429f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:20.175106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca51196b203424f9a27072bdd85132c', 'request_id': 'req-8957c242-11e5-498b-9c18-bca45f7c429f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:20.193768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca51196b203424f9a27072bdd85132c', 'request_id': 'req-8957c242-11e5-498b-9c18-bca45f7c429f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:20.219830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] The token cache is being invalidate because project 1ca51196b203424f9a27072bdd85132c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:20.220535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:20.221197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8957c242-11e5-498b-9c18-bca45f7c429f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:20.224250 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2551/5072] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:19 2022] DELETE /identity/v3/projects/1ca51196b203424f9a27072bdd85132c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:20.229687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:20.230251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:20.230543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:20.256447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:20.257957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:20.298082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:20.415223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2522/5073] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:20.422634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:20.423176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:20.423668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:20.477554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:20.499854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:20.553779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:20.562629 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2552/5074] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:20.574070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08c61-fc20-4947-b882-662d9acd129d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:20.596305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:20.597617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:20.598401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:20.598941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:20.600097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:35:20.600931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:20.604046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:20.648282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2523/5075] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:35:20.653577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:20.678420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9f62-f16f-47b0-9afd-950bc653da4e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:20.694097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:20.697984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:20.698540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:20.699225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:20.700269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:20.703960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:20.762131 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2553/5076] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:20 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:20.766265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:20.792507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ca47-63cf-4399-80bf-9ec0e31c136a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:20.926014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:20.926907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:20.927308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:20.927684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:20.928425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:20.930530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:20.980957 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2524/5077] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:20 2022] POST /identity/v3/users => generated 303 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:20.982279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:20.999845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf89420-0b29-4eb1-8a23-2b32d80ad702 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:21.018415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:21.019212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:21.019503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:21.019784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:21.020453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:21.022584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:21.050919 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2554/5078] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:21.054928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:21.072258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8185798-f731-4054-a63f-05103eb88eb6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:21.085536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a2ea2-f457-4730-bf7c-b28276148a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:21.087051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a2ea2-f457-4730-bf7c-b28276148a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:21.087445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a2ea2-f457-4730-bf7c-b28276148a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:21.088105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a2ea2-f457-4730-bf7c-b28276148a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:21.089005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a2ea2-f457-4730-bf7c-b28276148a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:21.091998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a2ea2-f457-4730-bf7c-b28276148a17 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:21.123834 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2525/5079] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:21.125519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:21.145001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0145dc-8be1-409a-9c62-dc87832b53f8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:21.161326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:21.163216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:21.164329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:21.165679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] PATH_INFO: `/v3/projects/bba09ecd14c44877acae4d4ba927f11b/users/e8e9285b4a4448ecadf6b82cb1c66a32/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:21.221605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba09ecd14c44877acae4d4ba927f11b, user_id=e8e9285b4a4448ecadf6b82cb1c66a32, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:21.232060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:21.278945 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2555/5080] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:21 2022] PUT /identity/v3/projects/bba09ecd14c44877acae4d4ba927f11b/users/e8e9285b4a4448ecadf6b82cb1c66a32/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:21.296085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:21.296085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:21.296675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:21.355592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:21.356999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:21.552154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2526/5081] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:21.566007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:21.569957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:21.716863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb00d-cb92-4ea5-8159-7185e6890f92 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:21.726780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546f61-b9a5-40b1-96bb-25a17909dd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:21.729112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546f61-b9a5-40b1-96bb-25a17909dd10 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:21.729890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546f61-b9a5-40b1-96bb-25a17909dd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:21.730410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546f61-b9a5-40b1-96bb-25a17909dd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:21.760343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53546f61-b9a5-40b1-96bb-25a17909dd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:21.762246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53546f61-b9a5-40b1-96bb-25a17909dd10 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:21.782264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2556/5082] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:22.507981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:22.509752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:22.539886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ed1b-0ef0-40d3-9da4-2e1572539f86 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:22.552743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:22.555034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:22.556638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:22.557396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] PATH_INFO: `/v3/projects/de9e88cf2f8e4b35a0840db55aa03b9c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:22.561434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9e88cf2f8e4b35a0840db55aa03b9c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:22.567960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:22.617767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:22.695691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9e88cf2f8e4b35a0840db55aa03b9c', 'request_id': 'req-c26c9ddf-df6f-492d-a660-ac35303d49c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:22.707471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9e88cf2f8e4b35a0840db55aa03b9c', 'request_id': 'req-c26c9ddf-df6f-492d-a660-ac35303d49c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:22.737757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9e88cf2f8e4b35a0840db55aa03b9c', 'request_id': 'req-c26c9ddf-df6f-492d-a660-ac35303d49c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:22.778730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] The token cache is being invalidate because project de9e88cf2f8e4b35a0840db55aa03b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:22.779056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:22.780361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c26c9ddf-df6f-492d-a660-ac35303d49c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:22.786813 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2527/5083] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:22 2022] DELETE /identity/v3/projects/de9e88cf2f8e4b35a0840db55aa03b9c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:22.788641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:22.788641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:22.789205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:22.813359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:22.814940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:22.854684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:22.895783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2557/5084] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:22.904415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:22.904707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:22.904995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:22.952520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:22.953965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:22.968628 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2528/5085] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:22.973634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:22.989817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369539-cca8-43e3-94aa-7713fc72a9fa None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:23.010929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:23.012714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.013006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.014679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.016983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:35:23.017312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:23.035727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:23.073007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2558/5086] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:35:23.074761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:23.086049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b78f6-2952-4251-a6cd-0e6d286bd50e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:23.092487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:23.093119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.093409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.093686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.095376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:23.097469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:23.148945 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2529/5087] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:23 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:23.153765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:23.170345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11032c-970b-4f84-8409-4f129b65aea6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:23.369838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:23.370512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.370796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.371075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.371725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:23.378032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:23.429619 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2559/5088] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:23 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:23.429837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:23.458629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405366a-3895-4c99-b911-d155278f7663 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:23.475008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:23.475941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.475941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.476247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.477344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:23.479175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:23.528331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2530/5089] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:23.532630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:23.545001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863222f-c43b-4d32-abe9-8a056c8f057e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:23.558530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccb33-a545-4991-9575-34a504c33b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:23.559187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccb33-a545-4991-9575-34a504c33b76 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.559494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccb33-a545-4991-9575-34a504c33b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.559772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccb33-a545-4991-9575-34a504c33b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.560448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccb33-a545-4991-9575-34a504c33b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:23.562076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccb33-a545-4991-9575-34a504c33b76 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:23.598721 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2560/5090] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:23.600376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:23.614962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f0196-d701-4237-ba8d-3baae05c73e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:23.629056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:23.630298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.630883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.631172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] PATH_INFO: `/v3/projects/60ac370b81fd4fc09d2700123ab85d48/users/3556d4ac9f1e4f6393e9f7fe6a16ec5a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.663633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ac370b81fd4fc09d2700123ab85d48, user_id=3556d4ac9f1e4f6393e9f7fe6a16ec5a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:23.667100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:23.699906 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2531/5091] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:23 2022] PUT /identity/v3/projects/60ac370b81fd4fc09d2700123ab85d48/users/3556d4ac9f1e4f6393e9f7fe6a16ec5a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:23.705380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257facb9-a876-4d6a-8a78-67d80c613235 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.705670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257facb9-a876-4d6a-8a78-67d80c613235 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.705946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257facb9-a876-4d6a-8a78-67d80c613235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:23.738591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-257facb9-a876-4d6a-8a78-67d80c613235 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:23.739827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-257facb9-a876-4d6a-8a78-67d80c613235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:23.888867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2561/5092] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:23.925556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:23.927187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:23.944793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:23.945090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:23.945373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:24.018357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] MFA Rules not processed for user `e8e9285b4a4448ecadf6b82cb1c66a32`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:24.019637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:24.092023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3536bf-5c6a-445b-b275-db73caea7243 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:24.111598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:24.112698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:24.115196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:24.115678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:24.128832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:24.144941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:24.152078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:24.186092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2532/5093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:24.202729 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2562/5094] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:24.207105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:24.208884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:24.224014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9303-fb63-4bbc-86e3-237293959f17 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:24.230317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:24.231378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:24.231899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:24.232427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:24.233391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:24.236500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:24.307932 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2533/5095] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:24 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:24.312034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:24.329494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508606d5-7de8-4801-aced-97327d38ed9d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:24.503622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:24.504357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:24.504845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:24.505244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:24.506346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:24.510805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:24.564064 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2563/5096] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:24 2022] POST /identity/v3/users => generated 309 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:24.567855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:24.604031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67426-8b51-4518-a031-3f2caaf171dc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:24.646884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:24.647882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:24.651378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:24.651680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:24.654220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:24.661758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:24.731154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2534/5097] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:24.731910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:24.752897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b9901-8808-49e6-9df7-0b49255c45d4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:24.770259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:24.770963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:24.773636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:24.773636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] PATH_INFO: `/v3/projects/134657053916487abeb953e883f43e3c/users/bf0a53d9d9c04ccabb142b5abe808952/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:24.847864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134657053916487abeb953e883f43e3c, user_id=bf0a53d9d9c04ccabb142b5abe808952, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:24.851193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:24.936087 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2564/5098] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:24 2022] PUT /identity/v3/projects/134657053916487abeb953e883f43e3c/users/bf0a53d9d9c04ccabb142b5abe808952/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:35:24.936697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:24.948147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae8965-f5fb-45ae-8a51-78c0b2e053a4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:24.986651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:25.093771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75763b99-c508-40ba-8478-5e3cd5fe82f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:25.094768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763b99-c508-40ba-8478-5e3cd5fe82f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:25.095214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763b99-c508-40ba-8478-5e3cd5fe82f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:25.095842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763b99-c508-40ba-8478-5e3cd5fe82f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:25.096676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75763b99-c508-40ba-8478-5e3cd5fe82f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:25.098530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75763b99-c508-40ba-8478-5e3cd5fe82f3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:25.123951 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2535/5099] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:25.128332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:25.142085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca102f-bd2c-42a9-ba60-787bdd506424 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:25.148522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:25.149994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:25.150546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:25.150999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] PATH_INFO: `/v3/projects/134657053916487abeb953e883f43e3c/users/bf0a53d9d9c04ccabb142b5abe808952/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:25.153293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134657053916487abeb953e883f43e3c, user_id=bf0a53d9d9c04ccabb142b5abe808952, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:25.156409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:25.171262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2565/5100] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:25 2022] PUT /identity/v3/projects/134657053916487abeb953e883f43e3c/users/bf0a53d9d9c04ccabb142b5abe808952/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:31.245650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3afa0-341b-496f-a1ba-3012d61bf374 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:31.246123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3afa0-341b-496f-a1ba-3012d61bf374 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:31.250935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3afa0-341b-496f-a1ba-3012d61bf374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:31.374573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-94e3afa0-341b-496f-a1ba-3012d61bf374 None None] MFA Rules not processed for user `bf0a53d9d9c04ccabb142b5abe808952`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:31.375839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94e3afa0-341b-496f-a1ba-3012d61bf374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:31.624197 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2536/5101] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:35.166178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:40.715712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:40.965312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:40.966460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:40.966906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:40.997480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f9b-bcd8-414f-ac8a-e958814f15d3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:41.027828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:41.028512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:41.028795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:41.029073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] PATH_INFO: `/v3/users/e8e9285b4a4448ecadf6b82cb1c66a32` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:41.046521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e9285b4a4448ecadf6b82cb1c66a32)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:41.061450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] MFA Rules not processed for user `3556d4ac9f1e4f6393e9f7fe6a16ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:41.061670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:41.063403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:41.229843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e9285b4a4448ecadf6b82cb1c66a32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:41.259815 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2537/5102] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:41.273256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:41.275068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e9285b4a4448ecadf6b82cb1c66a32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:41.277015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:41.282169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e9285b4a4448ecadf6b82cb1c66a32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:41.282885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e9285b4a4448ecadf6b82cb1c66a32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:41.311836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e9285b4a4448ecadf6b82cb1c66a32'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:41.360302 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2566/5103] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:40 2022] DELETE /identity/v3/users/e8e9285b4a4448ecadf6b82cb1c66a32 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:41.394461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:41.532630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7904ae-2fa5-4ff0-a4e8-1d98158f79ef None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:41.662804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:41.663802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:41.664318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:41.664861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:41.669826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:41.829636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:41.832010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:41.855855 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2538/5104] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:42.497120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:42.501052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:42.800906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9883-d08a-4d42-a6a2-864d713e0862 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:42.820178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:42.821068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:42.821394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:42.821676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] PATH_INFO: `/v3/projects/bba09ecd14c44877acae4d4ba927f11b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:42.823048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba09ecd14c44877acae4d4ba927f11b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:42.825041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:42.889364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:42.986284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba09ecd14c44877acae4d4ba927f11b', 'request_id': 'req-72c63fc3-dd60-4ac0-a0ad-05bca701912d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.038829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba09ecd14c44877acae4d4ba927f11b', 'request_id': 'req-72c63fc3-dd60-4ac0-a0ad-05bca701912d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.056596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba09ecd14c44877acae4d4ba927f11b', 'request_id': 'req-72c63fc3-dd60-4ac0-a0ad-05bca701912d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.085349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] The token cache is being invalidate because project bba09ecd14c44877acae4d4ba927f11b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:43.085865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.087556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.094986 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2567/5105] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:42 2022] DELETE /identity/v3/projects/bba09ecd14c44877acae4d4ba927f11b => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:43.099846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:43.127939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3ead-1d2a-47f5-a33d-8f88232eb44b service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:43.240227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:43.243964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:43.366665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:43.403387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:43.406803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:43.407183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:43.407468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] PATH_INFO: `/v3/users/bf0a53d9d9c04ccabb142b5abe808952` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:43.410286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0a53d9d9c04ccabb142b5abe808952)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:43.414522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:43.521955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c63fc3-dd60-4ac0-a0ad-05bca701912d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:43.544570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:43.547025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:43.547321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:43.549041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] PATH_INFO: `/v3/users/4eff9d64a7c84373ace007cd34d1809c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:43.553516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eff9d64a7c84373ace007cd34d1809c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:43.562621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:43.576395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0a53d9d9c04ccabb142b5abe808952'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.600070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0a53d9d9c04ccabb142b5abe808952'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.602818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0a53d9d9c04ccabb142b5abe808952'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.603634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0a53d9d9c04ccabb142b5abe808952'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.638620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0a53d9d9c04ccabb142b5abe808952'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.703589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eff9d64a7c84373ace007cd34d1809c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.726248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eff9d64a7c84373ace007cd34d1809c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.729309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eff9d64a7c84373ace007cd34d1809c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.730243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eff9d64a7c84373ace007cd34d1809c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.738511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2539/5106] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:43 2022] DELETE /identity/v3/users/bf0a53d9d9c04ccabb142b5abe808952 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:43.746657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eff9d64a7c84373ace007cd34d1809c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:43.820602 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2568/5107] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:43 2022] DELETE /identity/v3/users/4eff9d64a7c84373ace007cd34d1809c => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:44.500442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:44.503434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:44.734908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68399b00-dc50-4df2-b4c2-4cc4adbab234 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:44.849273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:44.849273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:44.849273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:44.849273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] PATH_INFO: `/v3/projects/df9b8fc02e4046a488bfb1b222b4b989` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:44.849614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9b8fc02e4046a488bfb1b222b4b989)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:44.851716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:44.918401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:44.919974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:44.935759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:44.961238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3873ade-0b00-46f3-935d-adc2f19ab96b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:45.002461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9b8fc02e4046a488bfb1b222b4b989', 'request_id': 'req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.031403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9b8fc02e4046a488bfb1b222b4b989', 'request_id': 'req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.096965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:45.104224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9b8fc02e4046a488bfb1b222b4b989', 'request_id': 'req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.161180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] The token cache is being invalidate because project df9b8fc02e4046a488bfb1b222b4b989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:45.162470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.166744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.171569 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2540/5108] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:44 2022] DELETE /identity/v3/projects/df9b8fc02e4046a488bfb1b222b4b989 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:45.175832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:45.182906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:45.274277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:45.282570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:45.283023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:45.290511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] PATH_INFO: `/v3/projects/134657053916487abeb953e883f43e3c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:45.290511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=134657053916487abeb953e883f43e3c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:45.291410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:45.484632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134657053916487abeb953e883f43e3c', 'request_id': 'req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.497039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f1ee-f47f-48ec-9ec0-bbed1c4e1fb2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:45.500889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134657053916487abeb953e883f43e3c', 'request_id': 'req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.519237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134657053916487abeb953e883f43e3c', 'request_id': 'req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.550506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] The token cache is being invalidate because project 134657053916487abeb953e883f43e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:45.553043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.553821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d7357d58-b42c-41f7-9ab7-663c1bcbc75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.557679 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2569/5109] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:44 2022] DELETE /identity/v3/projects/134657053916487abeb953e883f43e3c => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:35:45.563222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0215-bea2-48f1-b1bb-17c5a2ff9b75 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:45.563516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0215-bea2-48f1-b1bb-17c5a2ff9b75 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:45.563799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0215-bea2-48f1-b1bb-17c5a2ff9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:45.621101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-029d0215-bea2-48f1-b1bb-17c5a2ff9b75 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:45.624843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-029d0215-bea2-48f1-b1bb-17c5a2ff9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:45.714322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:45.715125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:45.715346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:45.715852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] PATH_INFO: `/v3/users/75eb8fa3a81749259cf07cb2bfeba79b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:45.718465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75eb8fa3a81749259cf07cb2bfeba79b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:45.720618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:45.856112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75eb8fa3a81749259cf07cb2bfeba79b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.877061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2570/5110] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:45.882946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75eb8fa3a81749259cf07cb2bfeba79b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.883873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:45.884223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:45.884363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75eb8fa3a81749259cf07cb2bfeba79b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.884483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:45.885188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75eb8fa3a81749259cf07cb2bfeba79b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.903810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75eb8fa3a81749259cf07cb2bfeba79b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:45.905302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:45.961238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:45.962498 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2541/5111] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:45 2022] DELETE /identity/v3/users/75eb8fa3a81749259cf07cb2bfeba79b => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:35:45.963498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:46.145846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:46.185607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2571/5112] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:46.187049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:46.204899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe4c86-3388-4ee9-bc92-bcb78c558b67 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:46.226941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:46.228506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.229052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.229559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.230500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:35:46.236782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:46.243756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:46.303198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2542/5113] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:35:46.307988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:46.324091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e43d66-32c2-409c-809f-cf2fab9126d4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:46.339881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:46.341805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.342195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.342498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.346550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:46.350904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:46.361282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:46.363300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:46.386517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ea3b-33c0-416e-984f-4b5520c5711a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:46.409758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:46.410597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.410956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.411306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] PATH_INFO: `/v3/projects/870e87005c33480e91ac51a105beb30b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.416017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=870e87005c33480e91ac51a105beb30b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:46.420741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:46.432225 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2572/5114] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:46 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:46.436619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:46.578729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870e87005c33480e91ac51a105beb30b', 'request_id': 'req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:46.595474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870e87005c33480e91ac51a105beb30b', 'request_id': 'req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:46.616048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870e87005c33480e91ac51a105beb30b', 'request_id': 'req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:46.650304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845b8f5-75f8-405e-b4f3-599e8b1b179d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:46.658670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] The token cache is being invalidate because project 870e87005c33480e91ac51a105beb30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:35:46.659205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:46.660134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b31b334f-fa2f-47c0-a63b-a1ff4f395f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:46.662499 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2543/5115] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:35:46 2022] DELETE /identity/v3/projects/870e87005c33480e91ac51a105beb30b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:46.667312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3abc-fb6b-4aad-98d8-e23f9e2d0232 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.667836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3abc-fb6b-4aad-98d8-e23f9e2d0232 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.668281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3abc-fb6b-4aad-98d8-e23f9e2d0232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.708489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-428b3abc-fb6b-4aad-98d8-e23f9e2d0232 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:46.714520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-428b3abc-fb6b-4aad-98d8-e23f9e2d0232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:46.795587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:46.796385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.796674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.796952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.799067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:46.803514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:46.864174 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2544/5116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:46.871727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.872310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.872823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.877791 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2573/5117] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:46 2022] POST /identity/v3/users => generated 290 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:46.881517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:46.886764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:46.920227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:46.921804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:46.930166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30354a-0fa1-48d9-8d85-b0fca93a0f58 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:46.941780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2545/5118] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:46.945843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:46.952249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:46.953174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.953461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.956667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.958527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:46.966271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:46.968418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c3ea-98ea-4957-8d51-6d591697bb88 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:46.986185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:46.987163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:46.987646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:46.988122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:46.989025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:35:46.989534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:46.991802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.005565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2574/5119] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:47.009817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.022883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2546/5120] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:35:47.024567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.043677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991616fc-87ea-4791-8158-a9e2cf973e7a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.048858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c473747-9dc7-49ab-8835-32a1237b0164 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.062708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.063353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.063638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.063919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.064479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.065373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.065927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.066447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.067528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.070240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.072080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.083452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.139395 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2575/5121] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:47.140788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.171527 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2547/5122] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:47 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:47.173992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.185726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7f29-892a-4aca-9a17-d0eee1e7380c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.213787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:47.379490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:47.404380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14febded-f43e-4b57-ba16-0d88f58afb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.405575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14febded-f43e-4b57-ba16-0d88f58afb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.406295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14febded-f43e-4b57-ba16-0d88f58afb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.407551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14febded-f43e-4b57-ba16-0d88f58afb48 admin admin] PATH_INFO: `/v3/projects/53a2f09fb99a4fb1a671013cae2341af/users/f1187449b23a430aa9e83d0b170be6c5/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.411030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b2f3-1c8b-4ac2-8296-886a9898c5c4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.426612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.427411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.427798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.428282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.429045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.432020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.443145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14febded-f43e-4b57-ba16-0d88f58afb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a2f09fb99a4fb1a671013cae2341af, user_id=f1187449b23a430aa9e83d0b170be6c5, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.447494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14febded-f43e-4b57-ba16-0d88f58afb48 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.481174 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2548/5123] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:47 2022] POST /identity/v3/users => generated 290 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:47.482185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.520230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2576/5124] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:47 2022] PUT /identity/v3/projects/53a2f09fb99a4fb1a671013cae2341af/users/f1187449b23a430aa9e83d0b170be6c5/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:47.525385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dd84f-747c-4578-991c-8b1836e1b16f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.530485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.530776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.531054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.612523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] MFA Rules not processed for user `f1187449b23a430aa9e83d0b170be6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:47.615947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:47.690671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.691325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.691975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.692922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.693950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.698859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.726499 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2549/5125] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:47.729388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.761433 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2577/5126] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:47.765195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.773859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ccc83-8eb1-4b53-a764-020248401f46 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.795858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb653-618c-47e7-8308-be1cb515e93c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.801903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.808662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.808959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.809101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.809718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.810139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.810440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.811040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.811226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.814738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.816616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.823169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.855218 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2550/5127] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:47.859407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.881004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50aae4-6f16-4367-af31-51ed48379c5d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:47.889665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2578/5128] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:35:47 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:47.890920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:47.898035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414cfca-ddb6-4dc4-8df3-3d1ae803d064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:47.900460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414cfca-ddb6-4dc4-8df3-3d1ae803d064 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.900768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414cfca-ddb6-4dc4-8df3-3d1ae803d064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.901032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414cfca-ddb6-4dc4-8df3-3d1ae803d064 admin admin] PATH_INFO: `/v3/projects/4edce059d68a4d3fb2d5806a2ef55502/users/a794107ab8db4cdf9f3d15220e1f5982/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:47.942676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414cfca-ddb6-4dc4-8df3-3d1ae803d064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edce059d68a4d3fb2d5806a2ef55502, user_id=a794107ab8db4cdf9f3d15220e1f5982, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:47.945616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414cfca-ddb6-4dc4-8df3-3d1ae803d064 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:47.971770 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2551/5129] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:47 2022] PUT /identity/v3/projects/4edce059d68a4d3fb2d5806a2ef55502/users/a794107ab8db4cdf9f3d15220e1f5982/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:35:47.982675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c110b0-6bcf-43de-aa43-a45f5def3b80 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:47.982960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c110b0-6bcf-43de-aa43-a45f5def3b80 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:47.983234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c110b0-6bcf-43de-aa43-a45f5def3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.055158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599fbe-c7ac-4545-8254-b49fed2dd19e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:48.058366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-00c110b0-6bcf-43de-aa43-a45f5def3b80 None None] MFA Rules not processed for user `a794107ab8db4cdf9f3d15220e1f5982`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:48.061957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-00c110b0-6bcf-43de-aa43-a45f5def3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:48.210265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:48.213777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:48.237157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:48.237878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.238189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.240452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.244756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:48.249066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:48.273502 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2552/5130] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:48.284161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.284520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.284725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.327503 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2579/5131] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:35:47 2022] POST /identity/v3/users => generated 296 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:35:48.331048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:48.346186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] MFA Rules not processed for user `a794107ab8db4cdf9f3d15220e1f5982`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:48.349730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:48.355694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef02cf6-f2cf-4db3-bd36-b764cca4fcb9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:48.370106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:48.370774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.371056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.371334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.371992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:48.376073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:48.385606 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2553/5132] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:48.388134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:48.394794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:48.413793 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2580/5133] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:35:48.417435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:48.438412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba0f13-caa0-40e4-b950-81c6e78802ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:48.454593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:48.455580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.455867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.456153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] PATH_INFO: `/v3/projects/dc03f8bcd4ee4952951466132bb7519c/users/e132983f1e444bbdbf41f743de4c0e60/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.488362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc03f8bcd4ee4952951466132bb7519c, user_id=e132983f1e444bbdbf41f743de4c0e60, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:48.492432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:48.557030 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2581/5134] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:48 2022] PUT /identity/v3/projects/dc03f8bcd4ee4952951466132bb7519c/users/e132983f1e444bbdbf41f743de4c0e60/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:48.558059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:48.625877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10ed10-2d45-495c-999d-81bf270885e1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:48.752061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d03e8-29b3-489b-b34a-ed62ffc1df99 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:48.767100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:48.770691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.771694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.774677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.779242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:48.780932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:48.813442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:48.814838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.815347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.815842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.835718 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2582/5135] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:35:48.839516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:48.872191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efacedb-03ed-4f85-b3d7-a55eb3dee57e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:48.881414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89c6f0-bce5-453d-8070-1b1960afb35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:48.882106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c6f0-bce5-453d-8070-1b1960afb35d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.882419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c6f0-bce5-453d-8070-1b1960afb35d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.882698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c6f0-bce5-453d-8070-1b1960afb35d admin admin] PATH_INFO: `/v3/projects/dc03f8bcd4ee4952951466132bb7519c/users/e132983f1e444bbdbf41f743de4c0e60/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:48.889774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89c6f0-bce5-453d-8070-1b1960afb35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc03f8bcd4ee4952951466132bb7519c, user_id=e132983f1e444bbdbf41f743de4c0e60, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:48.892581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89c6f0-bce5-453d-8070-1b1960afb35d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:48.928295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2583/5136] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:35:48 2022] PUT /identity/v3/projects/dc03f8bcd4ee4952951466132bb7519c/users/e132983f1e444bbdbf41f743de4c0e60/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:35:48.943035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:48.943324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:48.943599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:49.010962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:49.012973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:49.049251 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2554/5137] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:49.064323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] MFA Rules not processed for user `e132983f1e444bbdbf41f743de4c0e60`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:49.072949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:49.383824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2584/5138] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:35:49.445454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:49.447704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:49.499254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:49.652035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea553-17d8-4edc-a84e-7bdb2d9f4578 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:49.837542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2709d-3703-4f5e-af9d-8ac5d9f77d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:49.838243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2709d-3703-4f5e-af9d-8ac5d9f77d3d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:49.838581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2709d-3703-4f5e-af9d-8ac5d9f77d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:49.839334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2709d-3703-4f5e-af9d-8ac5d9f77d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:49.869699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2709d-3703-4f5e-af9d-8ac5d9f77d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:49.871231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2709d-3703-4f5e-af9d-8ac5d9f77d3d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:49.935602 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2555/5139] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:50.302436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:50.304573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:50.323535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996863a-3ccb-4c2e-8063-c9f1bcc27864 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:50.328652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:50.330627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:50.331554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:50.332289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:50.348944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:35:50.408208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:50.408853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:50.409329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:50.458689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] MFA Rules not processed for user `3556d4ac9f1e4f6393e9f7fe6a16ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:35:50.467972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:50.476022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:50.481827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:50.528088 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2585/5140] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:35:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:35:50.654243 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2556/5141] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:35:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:35:59.434256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:35:59.437590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:35:59.634347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c021ec-4795-422c-81e2-0736bb51434f service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:35:59.653426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:35:59.654158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:35:59.656238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:35:59.657854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] PATH_INFO: `/v3/users/b865ed96073d4f3faba2f0632933a5f9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:35:59.660473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b865ed96073d4f3faba2f0632933a5f9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:35:59.671258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:35:59.759398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b865ed96073d4f3faba2f0632933a5f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:59.796876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b865ed96073d4f3faba2f0632933a5f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:59.797822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b865ed96073d4f3faba2f0632933a5f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:59.798671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b865ed96073d4f3faba2f0632933a5f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:59.817544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b865ed96073d4f3faba2f0632933a5f9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:35:59.859586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2586/5142] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:35:59 2022] DELETE /identity/v3/users/b865ed96073d4f3faba2f0632933a5f9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:00.585778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=63 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:00.712011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:00.732092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcd240-d085-4cbd-aed1-e53a5369889b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:00.841616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:00.842566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:00.843021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:00.844491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] PATH_INFO: `/v3/projects/2b7c6b30fcc34cd1b57e49c397129f8d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:00.846734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7c6b30fcc34cd1b57e49c397129f8d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:00.848873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:00.917339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:00.919074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:00.952087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7c6b30fcc34cd1b57e49c397129f8d', 'request_id': 'req-9a670452-fc62-44ed-8eff-d57e7145282b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:00.952235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dbe73-72f9-4883-bf21-e781d8ce5672 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:00.954628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7c6b30fcc34cd1b57e49c397129f8d', 'request_id': 'req-9a670452-fc62-44ed-8eff-d57e7145282b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:00.968008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7c6b30fcc34cd1b57e49c397129f8d', 'request_id': 'req-9a670452-fc62-44ed-8eff-d57e7145282b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.019547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] The token cache is being invalidate because project 2b7c6b30fcc34cd1b57e49c397129f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:01.019856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.025237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.033490 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2557/5143] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:00 2022] DELETE /identity/v3/projects/2b7c6b30fcc34cd1b57e49c397129f8d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:01.037942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:01.040862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:01.082799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:01.154381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:01.155044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:01.155328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:01.156103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] PATH_INFO: `/v3/users/a794107ab8db4cdf9f3d15220e1f5982` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:01.161271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a794107ab8db4cdf9f3d15220e1f5982)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:01.175361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:01.233895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a670452-fc62-44ed-8eff-d57e7145282b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:01.245058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:01.251413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:01.251614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:01.254633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] PATH_INFO: `/v3/users/5b908eba332247b0acde61030f0f391d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:01.256849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b908eba332247b0acde61030f0f391d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:01.270122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:01.319727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a794107ab8db4cdf9f3d15220e1f5982'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.353011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a794107ab8db4cdf9f3d15220e1f5982'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.354204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a794107ab8db4cdf9f3d15220e1f5982'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.358605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a794107ab8db4cdf9f3d15220e1f5982'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.364030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:01.376193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a21bb06-2264-4d12-b1b4-ece9aba27773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a794107ab8db4cdf9f3d15220e1f5982'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.384753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b908eba332247b0acde61030f0f391d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.396920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b908eba332247b0acde61030f0f391d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.397710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b908eba332247b0acde61030f0f391d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.399030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b908eba332247b0acde61030f0f391d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.406087 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2587/5144] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:00 2022] DELETE /identity/v3/users/a794107ab8db4cdf9f3d15220e1f5982 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:01.407906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:01.408196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:01.408477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:01.409632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b908eba332247b0acde61030f0f391d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:01.435858 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2558/5145] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:01 2022] DELETE /identity/v3/users/5b908eba332247b0acde61030f0f391d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:01.487443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:01.489673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:01.581630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:01.583460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:01.607896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2588/5146] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:01.620144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:01.624395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:01.722529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276095-2a00-4ccf-96c7-86e5dcba3736 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:01.735888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:01.737182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:01.737637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:01.738683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:01.744473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:01.750934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006ce8b-6be6-42fc-9748-d723f54a8407 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:01.762606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:01.764002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:01.764002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:01.764002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:01.772873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:01.779934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:01.782945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:01.810584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2589/5147] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:01.862870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:01.864525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:01.875970 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2559/5148] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:36:02.355972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:02.368979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:02.407729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da6cbb-e456-4632-8c2e-894d022634f2 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:02.420504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:02.421169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:02.421453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:02.421730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] PATH_INFO: `/v3/projects/4edce059d68a4d3fb2d5806a2ef55502` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:02.424096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edce059d68a4d3fb2d5806a2ef55502)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:02.426317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:02.501402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edce059d68a4d3fb2d5806a2ef55502', 'request_id': 'req-c5c266bf-0e45-431a-b7c4-97c479b1bbab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:02.512534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edce059d68a4d3fb2d5806a2ef55502', 'request_id': 'req-c5c266bf-0e45-431a-b7c4-97c479b1bbab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:02.517392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:02.525713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edce059d68a4d3fb2d5806a2ef55502', 'request_id': 'req-c5c266bf-0e45-431a-b7c4-97c479b1bbab'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:02.526745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:02.544503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] The token cache is being invalidate because project 4edce059d68a4d3fb2d5806a2ef55502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:02.544842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:02.549870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5c266bf-0e45-431a-b7c4-97c479b1bbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:02.552501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2590/5149] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:02 2022] DELETE /identity/v3/projects/4edce059d68a4d3fb2d5806a2ef55502 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:02.566666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776f8dc-9800-46e6-b950-0edcd794e8b2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:02.566996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776f8dc-9800-46e6-b950-0edcd794e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:02.567277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776f8dc-9800-46e6-b950-0edcd794e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:02.588882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a2082-63f8-4cc2-8e35-8d18afc3822c service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:02.643728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5776f8dc-9800-46e6-b950-0edcd794e8b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:02.654534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5776f8dc-9800-46e6-b950-0edcd794e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:02.747699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:02.809892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:02.816526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:02.827544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:02.827544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] PATH_INFO: `/v3/projects/27f3e1a520d14bdca5d2ba5f273eded0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:02.827544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f3e1a520d14bdca5d2ba5f273eded0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:02.839768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:02.950515 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2591/5150] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:02.953357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:02.953753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:02.955847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.016328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f3e1a520d14bdca5d2ba5f273eded0', 'request_id': 'req-46e09f57-f78f-470c-8c67-a402a2dc589d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:03.017637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:03.021243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:03.037985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f3e1a520d14bdca5d2ba5f273eded0', 'request_id': 'req-46e09f57-f78f-470c-8c67-a402a2dc589d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:03.062283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f3e1a520d14bdca5d2ba5f273eded0', 'request_id': 'req-46e09f57-f78f-470c-8c67-a402a2dc589d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:03.085685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] The token cache is being invalidate because project 27f3e1a520d14bdca5d2ba5f273eded0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:03.087264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:03.088465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46e09f57-f78f-470c-8c67-a402a2dc589d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:03.092672 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2560/5151] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:02 2022] DELETE /identity/v3/projects/27f3e1a520d14bdca5d2ba5f273eded0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:03.098880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988fe35-c45b-4be6-a968-f91b19cf7ae2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.099363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988fe35-c45b-4be6-a968-f91b19cf7ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.099799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988fe35-c45b-4be6-a968-f91b19cf7ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.146366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1988fe35-c45b-4be6-a968-f91b19cf7ae2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:03.151406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1988fe35-c45b-4be6-a968-f91b19cf7ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:03.235247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2592/5152] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:03.262322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.286183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e419-5f19-44be-8ac1-88018512d520 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.300756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.302579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.302876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.304411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.308210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:03.309328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.316647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.342036 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2593/5153] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:03.349655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.365221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:03.387796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2561/5154] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:03.391334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716783bd-0489-426f-958f-e93c08368a2b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.391633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716783bd-0489-426f-958f-e93c08368a2b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.392524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a24c08-5c14-4137-8e3e-681cbef6a6e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.393402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716783bd-0489-426f-958f-e93c08368a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.411242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.411877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.412157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.412433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.413083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.420747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.462468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-716783bd-0489-426f-958f-e93c08368a2b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:03.466505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-716783bd-0489-426f-958f-e93c08368a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:03.486869 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2562/5155] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:03.490447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716783bd-0489-426f-958f-e93c08368a2b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.499841 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2594/5156] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:03.504753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.514541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716783bd-0489-426f-958f-e93c08368a2b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.610489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f804e7-b4ac-4680-9894-eb4747daf300 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.623686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.624594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.624880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.625161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.625822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.627913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.661735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.662871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.664007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.664007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.665179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:03.666060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.670736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.676958 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2595/5157] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:36:03.682403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.695340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f5319-824f-461f-a450-92dffc770928 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.702185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.704058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.706218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.706605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.707287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.707982 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2563/5158] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:03.713308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.714850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.733441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36db2-fe2c-4f68-a08d-bc25407ca353 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.740150 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2596/5159] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:03.741233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.753838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.755284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e6a6-67ac-4917-a420-35310964df15 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.755446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.755446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.755822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.757006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.761041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.761230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.761344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.761344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.761547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.762166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.764169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.778117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:03.779641 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2597/5160] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:03.785211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.799233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e5c4-a5d1-4591-8e7b-432190721492 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:03.806994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c15789-bb70-47bc-a9e4-12052e733c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:03.807696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15789-bb70-47bc-a9e4-12052e733c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.807983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15789-bb70-47bc-a9e4-12052e733c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.808258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15789-bb70-47bc-a9e4-12052e733c4d admin admin] PATH_INFO: `/v3/projects/8610c4dbb172466c824ff9bedb03f0bd/users/344df8bcd7754daaae0f592034e6877a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.827024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c15789-bb70-47bc-a9e4-12052e733c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610c4dbb172466c824ff9bedb03f0bd, user_id=344df8bcd7754daaae0f592034e6877a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:03.829858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c15789-bb70-47bc-a9e4-12052e733c4d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:03.856961 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2598/5161] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:03 2022] PUT /identity/v3/projects/8610c4dbb172466c824ff9bedb03f0bd/users/344df8bcd7754daaae0f592034e6877a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:03.861193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2564/5162] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:03.865088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:03.865340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:03.865652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:03.865944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:03.967590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:03.968842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:04.090411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d12b8-e4ba-4e4b-8a20-79c5946df4b8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:04.119152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:04.120158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:04.120658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:04.121901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:04.124219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:04.130296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:04.156005 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2599/5163] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:04.167874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:04.169624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:04.225165 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2565/5164] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:03 2022] POST /identity/v3/users => generated 288 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:04.230103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:04.256125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdddec-3496-42dd-99fb-8c9849ec33a6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:04.260867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:04.293270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:04.297975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:04.299902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:04.301639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:04.303987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:04.307822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:04.338316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2566/5165] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:04.342525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:04.359448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849097bc-2bac-4bab-8052-1934c0760248 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:04.362072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92afd96-70c6-44ee-a21e-f595d68d967e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:04.371170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:04.371852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:04.372101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:04.372381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:04.378822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd95a-1b0a-4855-88cd-2df72e278408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:04.379566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd95a-1b0a-4855-88cd-2df72e278408 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:04.379929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd95a-1b0a-4855-88cd-2df72e278408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:04.380283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd95a-1b0a-4855-88cd-2df72e278408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:04.381012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cd95a-1b0a-4855-88cd-2df72e278408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:04.382728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cd95a-1b0a-4855-88cd-2df72e278408 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:04.396667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:04.398189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:04.420215 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2600/5166] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:04.421192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2567/5167] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:04.425551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:04.443368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6d8ed-c5cb-4eb1-a09f-77f5cb980af4 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:04.458005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:04.462616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:04.463170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:04.463967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] PATH_INFO: `/v3/projects/ce4eb7ca7be945c689ec8c1c296b07aa/users/1f859daf0fd14cf49672cce0a3e4958e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:04.500822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4eb7ca7be945c689ec8c1c296b07aa, user_id=1f859daf0fd14cf49672cce0a3e4958e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:04.507109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:04.536593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2601/5168] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:04 2022] PUT /identity/v3/projects/ce4eb7ca7be945c689ec8c1c296b07aa/users/1f859daf0fd14cf49672cce0a3e4958e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:36:04.551468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:04.551766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:04.552049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:04.638998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] MFA Rules not processed for user `1f859daf0fd14cf49672cce0a3e4958e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:04.640283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:04.882261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2568/5169] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:04.902572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:04.904464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:05.105541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e23d5-8cd0-4caa-82ae-d9325714da5c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:05.126611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bbfcb-e4fc-456d-bf9a-fc395b0796bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:05.127413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbfcb-e4fc-456d-bf9a-fc395b0796bb service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:05.127800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbfcb-e4fc-456d-bf9a-fc395b0796bb service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:05.128161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bbfcb-e4fc-456d-bf9a-fc395b0796bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:05.154411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbfcb-e4fc-456d-bf9a-fc395b0796bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:05.159011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bbfcb-e4fc-456d-bf9a-fc395b0796bb service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:05.208971 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2602/5170] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:07.883035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:07.886014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:08.129273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:08.189518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a977-fb8f-48d4-81c1-a442bcb4f65d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:08.203831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:08.205140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:08.205593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:08.206039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] PATH_INFO: `/v3/users/f1187449b23a430aa9e83d0b170be6c5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:08.209429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1187449b23a430aa9e83d0b170be6c5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:08.213412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:08.345429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1187449b23a430aa9e83d0b170be6c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:08.359987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1187449b23a430aa9e83d0b170be6c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:08.360643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1187449b23a430aa9e83d0b170be6c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:08.361279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1187449b23a430aa9e83d0b170be6c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:08.375093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1187449b23a430aa9e83d0b170be6c5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:08.419498 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2569/5171] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:07 2022] DELETE /identity/v3/users/f1187449b23a430aa9e83d0b170be6c5 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:08.427174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:08.427666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:08.427762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:08.493629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:08.494868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:08.641763 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2603/5172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:08.669815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:08.670046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:08.799968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcb40a-c75d-4fb3-9138-fe0bd7ed5ed6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:08.813147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:08.813956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:08.817211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:08.817695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:08.841065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:08.842894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:08.865846 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2570/5173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:09.008683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:09.010581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:09.166421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:09.210693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8172e9-4632-42fe-8bc1-f681d8c38365 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:09.221272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:09.222085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:09.222736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:09.224143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:09.230957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:09.262498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:09.264573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:09.328180 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2604/5174] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:09.382751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:09.384638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:09.405860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dbd8-ea68-4b38-943e-54506536dd6c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:09.423961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:09.424639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:09.424928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:09.425211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] PATH_INFO: `/v3/users/e43d96b4e15e444da73b993abe43a1d8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:09.429416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43d96b4e15e444da73b993abe43a1d8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:09.432986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:09.500960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:09.503482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:09.538472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92445971-b67e-4006-8719-04af3e5172ee service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:09.546764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:09.547422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:09.547712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:09.547992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] PATH_INFO: `/v3/projects/53a2f09fb99a4fb1a671013cae2341af` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:09.549152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a2f09fb99a4fb1a671013cae2341af)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:09.551971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:09.642801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a2f09fb99a4fb1a671013cae2341af', 'request_id': 'req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.658569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a2f09fb99a4fb1a671013cae2341af', 'request_id': 'req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.713754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43d96b4e15e444da73b993abe43a1d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.714383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a2f09fb99a4fb1a671013cae2341af', 'request_id': 'req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.735990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43d96b4e15e444da73b993abe43a1d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.736682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43d96b4e15e444da73b993abe43a1d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.737368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43d96b4e15e444da73b993abe43a1d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.751900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43d96b4e15e444da73b993abe43a1d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.752940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] The token cache is being invalidate because project 53a2f09fb99a4fb1a671013cae2341af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:09.753239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.753898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:09.754036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:09.756083 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2605/5175] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:09 2022] DELETE /identity/v3/projects/53a2f09fb99a4fb1a671013cae2341af => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:09.761271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:09.765728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:09.819331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2571/5176] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:09 2022] DELETE /identity/v3/users/e43d96b4e15e444da73b993abe43a1d8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:09.940209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be7cc-bd2c-45f0-a73f-ecf88e6cc393 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:10.072022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:10.072687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:10.072974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:10.073426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] PATH_INFO: `/v3/users/e132983f1e444bbdbf41f743de4c0e60` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:10.074521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e132983f1e444bbdbf41f743de4c0e60)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:10.076996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:10.088820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:10.175831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:10.177717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:10.199433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cfee5-d514-48b2-b0ae-92ae20edcaf4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:10.210506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:10.211295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:10.211582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:10.211867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] PATH_INFO: `/v3/projects/e4f08b6c32e6462a8a4e75d9152ea49a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:10.213970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f08b6c32e6462a8a4e75d9152ea49a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:10.216321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:10.228020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e132983f1e444bbdbf41f743de4c0e60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.252259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e132983f1e444bbdbf41f743de4c0e60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.253616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e132983f1e444bbdbf41f743de4c0e60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.260117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e132983f1e444bbdbf41f743de4c0e60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.271320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-de1b50b6-d118-4161-b057-79e6282dbdae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e132983f1e444bbdbf41f743de4c0e60'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.299368 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2606/5177] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:09 2022] DELETE /identity/v3/users/e132983f1e444bbdbf41f743de4c0e60 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:36:10.336015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f08b6c32e6462a8a4e75d9152ea49a', 'request_id': 'req-08435ce2-ab5b-4b03-b80a-c5bd149287f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.349678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f08b6c32e6462a8a4e75d9152ea49a', 'request_id': 'req-08435ce2-ab5b-4b03-b80a-c5bd149287f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.369558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f08b6c32e6462a8a4e75d9152ea49a', 'request_id': 'req-08435ce2-ab5b-4b03-b80a-c5bd149287f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.390541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] The token cache is being invalidate because project e4f08b6c32e6462a8a4e75d9152ea49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:10.391858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.393135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-08435ce2-ab5b-4b03-b80a-c5bd149287f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:10.395397 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2572/5178] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:10 2022] DELETE /identity/v3/projects/e4f08b6c32e6462a8a4e75d9152ea49a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:36:10.402443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:10.402914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:10.403089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:10.451030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:10.452321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:10.606698 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2607/5179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:10.615985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:10.616408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:10.616802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:10.655005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:10.657219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:10.692572 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2573/5180] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:10.698118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:10.738511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c44c4-4a93-413f-9fe3-821ff4c9b85f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:10.755100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:10.760487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:10.761088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:10.762788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:10.765429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:10.767363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:10.770626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:10.824210 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2608/5181] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:10.826896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:10.837454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c222e-e314-40da-a044-5ebca2e8beea None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:10.854686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:10.856364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:10.856824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:10.857109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:10.857778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:10.859919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:10.945029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2574/5182] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:10 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:10.946822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:10.966786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:10.966955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91878fe6-a97b-4e13-9915-67816e4ae828 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:10.968990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:11.114818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2ac02-900b-42b7-8106-3239c85b13d0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:11.121378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:11.122204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.122627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.122991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] PATH_INFO: `/v3/projects/dc03f8bcd4ee4952951466132bb7519c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.124580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc03f8bcd4ee4952951466132bb7519c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:11.126648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:11.131975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:11.134703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.135147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.136482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.138673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:11.143230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:11.187693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:11.208861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc03f8bcd4ee4952951466132bb7519c', 'request_id': 'req-bc3e658a-1193-4d62-a426-0bc92666585b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:11.229914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc03f8bcd4ee4952951466132bb7519c', 'request_id': 'req-bc3e658a-1193-4d62-a426-0bc92666585b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:11.248187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2609/5183] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:10 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:11.253682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:11.270254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc03f8bcd4ee4952951466132bb7519c', 'request_id': 'req-bc3e658a-1193-4d62-a426-0bc92666585b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:11.303515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:11.316387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] The token cache is being invalidate because project dc03f8bcd4ee4952951466132bb7519c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:11.316778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:11.318045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81e03-f520-4614-be78-bd08e633eb08 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:11.318809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc3e658a-1193-4d62-a426-0bc92666585b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:11.328850 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2575/5184] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:10 2022] DELETE /identity/v3/projects/dc03f8bcd4ee4952951466132bb7519c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:11.334410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac305530-6f88-4682-8b62-98a8ac79761b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.335428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac305530-6f88-4682-8b62-98a8ac79761b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.338298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac305530-6f88-4682-8b62-98a8ac79761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.388358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ac305530-6f88-4682-8b62-98a8ac79761b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:11.389963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac305530-6f88-4682-8b62-98a8ac79761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:11.470927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:11.471586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.471870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.472149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.472869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:11.474536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:11.499512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2610/5185] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:11.504872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:11.511518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:11.538759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499607d-506b-4e9a-b8bc-288885bfdcae admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:11.547824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:11.549295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.550276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.550747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.551578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:11.553646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:11.580154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2576/5186] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:11.588734 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2611/5187] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:11.593477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.593766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.594040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.601075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:11.624407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2319-4119-43b4-b31b-27a72234e219 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:11.627682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:11.629295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:11.638235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ccc31-3f64-4a03-a2c9-7884dca35a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:11.640965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccc31-3f64-4a03-a2c9-7884dca35a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.642407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccc31-3f64-4a03-a2c9-7884dca35a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.642882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccc31-3f64-4a03-a2c9-7884dca35a24 admin admin] PATH_INFO: `/v3/projects/e29c7efb986e4d2daa801a6553cfa8ec/users/a2150305f8e240ce86b8008d84da243d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.644526 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2577/5188] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:11.645930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:11.676367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec617-d1dc-4eb6-92bc-7d260daa15bb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:11.678061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ccc31-3f64-4a03-a2c9-7884dca35a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29c7efb986e4d2daa801a6553cfa8ec, user_id=a2150305f8e240ce86b8008d84da243d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:11.682375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ccc31-3f64-4a03-a2c9-7884dca35a24 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:11.689994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:11.711927 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2612/5189] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:11 2022] PUT /identity/v3/projects/e29c7efb986e4d2daa801a6553cfa8ec/users/a2150305f8e240ce86b8008d84da243d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:11.712375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.712763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.715058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.716007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:11.716626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:11.718469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:11.723520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:11.723935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:11.724519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:11.761350 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2578/5190] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:11.764296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:11.774425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:11.776630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:11.786391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1be4e-7b4e-45a1-8895-4deb03f3ca67 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:12.030293 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2613/5191] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:12.032503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:12.033162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.033492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.033784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.034493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:12.036498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:12.084914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:12.086860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:12.147183 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2579/5192] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:11 2022] POST /identity/v3/projects => generated 369 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:12.149747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:12.226545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:12.239417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a81b4-0b5f-44d5-aa92-83950674b204 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:12.286241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:12.318220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf65fe-974c-46a0-9397-b4c1e03bcf10 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:12.345399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:12.346650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.349370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.349919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.353492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:12.356954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:12.392730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:12.393461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.393838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.397082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.402681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2580/5193] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:12 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:12.403997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:12.419074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69adec-310e-494c-a674-8dd0198c5b9a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:12.420795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:12.424947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:12.427145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:12.428010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.429286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.430527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.431402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:12.433996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:12.449248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2614/5194] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:12.466197 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2581/5195] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:12.468807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:12.489236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccc34-9bd6-4748-b52e-204891c37426 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:12.500161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241df48c-0318-4111-8ea2-14e393924ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:12.501108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241df48c-0318-4111-8ea2-14e393924ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.501546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241df48c-0318-4111-8ea2-14e393924ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.501829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241df48c-0318-4111-8ea2-14e393924ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.502974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241df48c-0318-4111-8ea2-14e393924ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:12.507081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241df48c-0318-4111-8ea2-14e393924ef6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:12.536623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2615/5196] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:12.541447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:12.551758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f46ef5-b200-4193-909b-db326f61eade admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:12.557216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:12.557813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.558098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.558631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] PATH_INFO: `/v3/projects/24846da589944c229f61627c51d05ac6/users/aac63bdf76184eb1a5441100668d0e32/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.579540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24846da589944c229f61627c51d05ac6, user_id=aac63bdf76184eb1a5441100668d0e32, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:12.582304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:12.621599 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2582/5197] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:12 2022] PUT /identity/v3/projects/24846da589944c229f61627c51d05ac6/users/aac63bdf76184eb1a5441100668d0e32/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:12.633914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:12.635170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:12.635733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:12.698433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] MFA Rules not processed for user `aac63bdf76184eb1a5441100668d0e32`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:12.701284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:12.895516 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2616/5198] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:12.900707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:13.156738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603aaf8-4238-4431-b6b3-33288138dcd6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:13.170452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:13.171133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:13.171410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:13.171691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:13.172351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:13.174318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:13.269101 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2583/5199] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:12 2022] POST /identity/v3/projects => generated 369 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:13.273629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:13.309899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc3e68-15f8-46a1-8db6-af34724f4ee9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:13.484992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:13.488858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:13.491351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:13.491755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:13.493920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:13.498992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:13.603898 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2617/5200] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:13 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:13.607222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:13.628059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74cd4-bf31-471e-8a40-0534ee9b610a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:13.640914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:13.642312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:13.643339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:13.644896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:13.646684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:13.655380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:13.682918 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2584/5201] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:36:13.687112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:13.707934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53705a7-5e8b-4348-8ecf-70c118207394 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:13.728981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:13.730037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:13.730521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:13.731180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] PATH_INFO: `/v3/projects/440fa056d9d14eedade49f4e91239eef/users/5d3ec974a2dc4ae9aed2bb77a2596c42/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:13.772637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440fa056d9d14eedade49f4e91239eef, user_id=5d3ec974a2dc4ae9aed2bb77a2596c42, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:13.776290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:13.809545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2618/5202] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:13 2022] PUT /identity/v3/projects/440fa056d9d14eedade49f4e91239eef/users/5d3ec974a2dc4ae9aed2bb77a2596c42/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:13.814274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:13.832600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b4ea-0d89-45c5-b578-7522c449901e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:13.964054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:13.984171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fa1c0-cc02-45fe-84dd-bb1b427ebe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:13.985585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa1c0-cc02-45fe-84dd-bb1b427ebe55 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:13.985915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa1c0-cc02-45fe-84dd-bb1b427ebe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:13.986220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa1c0-cc02-45fe-84dd-bb1b427ebe55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:13.986900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fa1c0-cc02-45fe-84dd-bb1b427ebe55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:13.988789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fa1c0-cc02-45fe-84dd-bb1b427ebe55 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:14.011486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2585/5203] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:14.011971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:14.037110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdb3b-5d86-47cb-b5a5-d5e19576fe46 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:14.058744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:14.059760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:14.060216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:14.060675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] PATH_INFO: `/v3/projects/440fa056d9d14eedade49f4e91239eef/users/5d3ec974a2dc4ae9aed2bb77a2596c42/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:14.065548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440fa056d9d14eedade49f4e91239eef, user_id=5d3ec974a2dc4ae9aed2bb77a2596c42, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:14.077385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:14.084155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:14.108929 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2619/5204] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:14 2022] PUT /identity/v3/projects/440fa056d9d14eedade49f4e91239eef/users/5d3ec974a2dc4ae9aed2bb77a2596c42/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:36:14.119532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:14.119818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:14.120095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:14.212977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] MFA Rules not processed for user `5d3ec974a2dc4ae9aed2bb77a2596c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:14.214245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:14.444310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:14.445122 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2586/5205] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:14.451079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:14.613228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393961-7377-4fb8-b47d-4feac37851c3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:14.620224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:14.621404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:14.621874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:14.622841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:14.647172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:14.649048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:14.673050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2620/5206] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:18.220548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:18.390620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:18.392150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c0b4b-b4f3-4a1f-9297-cb8d90bf91ab None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:18.403999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6202-5dfb-4f29-875b-8b06bd6b7d67 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:18.413878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:18.415370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:18.415804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:18.416055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] PATH_INFO: `/v3/users/aac63bdf76184eb1a5441100668d0e32` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:18.416873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:18.417754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:18.418499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:18.418999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:18.419558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac63bdf76184eb1a5441100668d0e32)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:18.424414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:18.427335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:18.582574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:18.584743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdb7a5-ad77-4add-badd-d1645c81cfa8 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:18.607706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac63bdf76184eb1a5441100668d0e32'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:18.623162 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2621/5207] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:18.650103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac63bdf76184eb1a5441100668d0e32'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:18.650958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac63bdf76184eb1a5441100668d0e32'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:18.652696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac63bdf76184eb1a5441100668d0e32'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:18.677566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac63bdf76184eb1a5441100668d0e32'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:18.716525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:18.735477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2587/5208] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:18 2022] DELETE /identity/v3/users/aac63bdf76184eb1a5441100668d0e32 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:18.737856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb362d43-f6ec-4390-b4ad-d3122c7f1b10 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:18.738421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb362d43-f6ec-4390-b4ad-d3122c7f1b10 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:18.738873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb362d43-f6ec-4390-b4ad-d3122c7f1b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:18.838882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fb362d43-f6ec-4390-b4ad-d3122c7f1b10 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:18.849258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fb362d43-f6ec-4390-b4ad-d3122c7f1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:19.131369 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2622/5209] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:19.173273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:19.176936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:19.410435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c55012-7c54-4e1e-b788-08750425e0e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:19.451545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:19.452204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:19.452485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:19.452760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:19.499729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:19.503194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:19.545215 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2588/5210] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:20.077816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:20.078913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:20.079441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:20.150959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] MFA Rules not processed for user `344df8bcd7754daaae0f592034e6877a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:20.152372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:20.283842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:20.363221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2623/5211] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:20.375472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:20.377677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:20.575499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af55fb6-a614-4416-9b9e-1ed37df1cd20 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:20.582314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:20.583279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:20.583848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:20.584628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:20.607158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:20.609103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:20.638001 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2589/5212] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:21.817196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:21.818977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:21.851264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5e03f-af5c-449f-80d0-30a1db6cf2f4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:21.865657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:21.866362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:21.866644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:21.866919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] PATH_INFO: `/v3/projects/24846da589944c229f61627c51d05ac6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:21.868856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=24846da589944c229f61627c51d05ac6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:21.875528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:21.996630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24846da589944c229f61627c51d05ac6', 'request_id': 'req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.015991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24846da589944c229f61627c51d05ac6', 'request_id': 'req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.030099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24846da589944c229f61627c51d05ac6', 'request_id': 'req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.060580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] The token cache is being invalidate because project 24846da589944c229f61627c51d05ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:22.060885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.062613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.071104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2624/5213] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:21 2022] DELETE /identity/v3/projects/24846da589944c229f61627c51d05ac6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:22.071532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:22.089354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa732939-3e67-4c63-8a5e-0ae6781bcaeb service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:22.255416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:22.259204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:22.262717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:22.263163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] PATH_INFO: `/v3/users/5d3ec974a2dc4ae9aed2bb77a2596c42` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:22.266677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3ec974a2dc4ae9aed2bb77a2596c42)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:22.286753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:22.414916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:22.460129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3ec974a2dc4ae9aed2bb77a2596c42'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.483917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3ec974a2dc4ae9aed2bb77a2596c42'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.484943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3ec974a2dc4ae9aed2bb77a2596c42'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.485932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3ec974a2dc4ae9aed2bb77a2596c42'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.511207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3ec974a2dc4ae9aed2bb77a2596c42'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:22.568144 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2590/5214] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:22 2022] DELETE /identity/v3/users/5d3ec974a2dc4ae9aed2bb77a2596c42 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:23.174071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:23.175573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:23.364450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27f5d-ad8b-465d-821c-86f2d0ba1eee admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:23.559561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:23.560426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:23.561044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:23.561331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:23.564736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:23.637846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:23.846998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:23.848537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:23.889512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2625/5215] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:23.951984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:23.954278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:24.009718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50c670-52ad-4bf0-84ad-dcff43d73d17 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:24.024605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:24.025847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:24.030496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:24.031437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:24.038035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:24.079155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:24.085104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee4456-06b9-4329-ac2f-c0f4faa5867e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:24.131341 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2591/5216] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:24.578492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:24.580081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:24.832099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0897-c8dd-4d19-9ff9-320ff367c1f5 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:24.856017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:24.856880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:24.857267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:24.861520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] PATH_INFO: `/v3/projects/440fa056d9d14eedade49f4e91239eef` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:24.864982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=440fa056d9d14eedade49f4e91239eef)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:24.873803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:25.013229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440fa056d9d14eedade49f4e91239eef', 'request_id': 'req-f7b77275-7c95-4971-a857-5b2ebe631c4a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:25.024694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440fa056d9d14eedade49f4e91239eef', 'request_id': 'req-f7b77275-7c95-4971-a857-5b2ebe631c4a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:25.045880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440fa056d9d14eedade49f4e91239eef', 'request_id': 'req-f7b77275-7c95-4971-a857-5b2ebe631c4a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:25.071830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] The token cache is being invalidate because project 440fa056d9d14eedade49f4e91239eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:25.072266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:25.073065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7b77275-7c95-4971-a857-5b2ebe631c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:25.075771 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2626/5217] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:24 2022] DELETE /identity/v3/projects/440fa056d9d14eedade49f4e91239eef => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:25.082108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:25.082705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:25.082705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:25.163522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:25.174029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:25.466954 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2592/5218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:25.475210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:25.475652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:25.476071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:25.529292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:25.535849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:25.577982 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2627/5219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:25.579441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:25.594952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fd511-cf9c-4766-9b33-0dfac4694f3e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:25.612930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:25.614499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:25.615670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:25.616480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:25.622617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:25.623035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:25.628875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:25.677780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2593/5220] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:25.680819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:25.695696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af4d5-c465-42b2-9c6c-99a75d39be74 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:25.709562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:25.711371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:25.712452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:25.713512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:25.715374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:25.718960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:25.794225 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2628/5221] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:25 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:36:25.798437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:25.816643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd951d-d196-40ce-b81c-0e1d4b4b7985 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:25.952721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:25.953643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:25.954189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:25.954712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:25.955959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:25.958517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:26.014063 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2594/5222] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:25 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:26.018803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:26.043371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6aec8-c4d1-4976-acfd-ebba36edd1dc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:26.065385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:26.071961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:26.074534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:26.075022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:26.076190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:26.080839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:26.090055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:26.143869 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2629/5223] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:26.145617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:26.162779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2bec6-3277-4786-88d1-b8ab2c273e6b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:26.189504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3737d-ccdf-4681-88ca-eb5dd486aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:26.190632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3737d-ccdf-4681-88ca-eb5dd486aa87 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:26.191123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3737d-ccdf-4681-88ca-eb5dd486aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:26.194595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3737d-ccdf-4681-88ca-eb5dd486aa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:26.196774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3737d-ccdf-4681-88ca-eb5dd486aa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:26.198579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3737d-ccdf-4681-88ca-eb5dd486aa87 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:26.218691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:26.257087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:26.259922 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2595/5224] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:26.293229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6251cf8-70d3-4f96-b44e-6555b4d520d1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:26.318008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:26.323046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:26.324520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:26.349795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] PATH_INFO: `/v3/projects/81bf8408fa6a4f3d9231f94435b4c953/users/fd9819c8279e4ca3a175e6bdaba42ae3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:26.381379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf8408fa6a4f3d9231f94435b4c953, user_id=fd9819c8279e4ca3a175e6bdaba42ae3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:26.384695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:26.425062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2630/5225] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:26 2022] PUT /identity/v3/projects/81bf8408fa6a4f3d9231f94435b4c953/users/fd9819c8279e4ca3a175e6bdaba42ae3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:26.427069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:26.427432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:26.427708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:26.510305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] MFA Rules not processed for user `fd9819c8279e4ca3a175e6bdaba42ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:26.511565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:26.704168 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2596/5226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:26.712155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:26.867584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b8724-c377-46e2-b44e-c1d240ca3f0e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:26.880678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ed75e-aecf-4513-93f4-be0aa88aedc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:26.881642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed75e-aecf-4513-93f4-be0aa88aedc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:26.882192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed75e-aecf-4513-93f4-be0aa88aedc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:26.883370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ed75e-aecf-4513-93f4-be0aa88aedc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:26.884351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ed75e-aecf-4513-93f4-be0aa88aedc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:26.897469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ed75e-aecf-4513-93f4-be0aa88aedc2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:26.980035 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2631/5227] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:26 2022] POST /identity/v3/projects => generated 377 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:26.981807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:27.004736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7eade-6e7c-49bd-b286-88807c05b5eb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:27.126990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:27.126990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:27.127288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:27.199521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] MFA Rules not processed for user `a2150305f8e240ce86b8008d84da243d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:27.200787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:27.269328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:27.270780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:27.271315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:27.271934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:27.273190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:27.276250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:27.404378 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2597/5228] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:26 2022] POST /identity/v3/users => generated 295 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:36:27.414523 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2632/5229] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:27.424307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:27.431039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:27.432474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:27.441269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa3f0-0bf5-4fe3-aff8-2b1a0b361a85 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:27.457949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:27.459568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:27.460051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:27.460497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:27.461382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:27.465243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:27.502839 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2598/5230] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:27.507333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:27.530441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25796055-ddd4-466d-8b21-643a2c7f1c7f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:27.566924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:27.568197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:27.568495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:27.568774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] PATH_INFO: `/v3/projects/48dd2bd191d045e7a9de947ce0eaa636/users/1788c52beadd43c7bbb7faa52468e2a8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:27.617960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dd2bd191d045e7a9de947ce0eaa636, user_id=1788c52beadd43c7bbb7faa52468e2a8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:27.620929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:27.642824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:27.650621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2599/5231] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:27 2022] PUT /identity/v3/projects/48dd2bd191d045e7a9de947ce0eaa636/users/1788c52beadd43c7bbb7faa52468e2a8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:27.653680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:27.758496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cdc27-2d21-4ed1-982c-a1758f75cd45 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:27.836689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:27.908448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2ee0-a408-495f-8d57-eeca4cf17621 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:27.941782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:27.942613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:27.942892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:27.943165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:27.943850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:27.945709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:27.989937 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2600/5232] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:27.990611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:28.011960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:28.012748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:28.012867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:28.013131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:28.018392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51f7d-621a-4d5f-b60b-57589fd50b77 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:28.041417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990df58-7656-442d-bfa7-bfe076f56d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:28.043227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990df58-7656-442d-bfa7-bfe076f56d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:28.044118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990df58-7656-442d-bfa7-bfe076f56d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:28.045104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990df58-7656-442d-bfa7-bfe076f56d52 admin admin] PATH_INFO: `/v3/projects/48dd2bd191d045e7a9de947ce0eaa636/users/1788c52beadd43c7bbb7faa52468e2a8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:28.051644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990df58-7656-442d-bfa7-bfe076f56d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dd2bd191d045e7a9de947ce0eaa636, user_id=1788c52beadd43c7bbb7faa52468e2a8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:28.062414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990df58-7656-442d-bfa7-bfe076f56d52 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:28.093754 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2601/5233] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:27 2022] PUT /identity/v3/projects/48dd2bd191d045e7a9de947ce0eaa636/users/1788c52beadd43c7bbb7faa52468e2a8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:28.095473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c720-5804-45e7-9e4a-6e6b4f94bbfc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:28.096586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c720-5804-45e7-9e4a-6e6b4f94bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:28.097663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c720-5804-45e7-9e4a-6e6b4f94bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:28.194209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6bd5c720-5804-45e7-9e4a-6e6b4f94bbfc None None] MFA Rules not processed for user `1788c52beadd43c7bbb7faa52468e2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:28.195996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6bd5c720-5804-45e7-9e4a-6e6b4f94bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:28.197911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:28.199831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:28.229582 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2633/5234] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:28.411514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2602/5235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:28.425644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:28.427501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:28.618938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813847-0eee-47ef-b615-8d10bc2fc70f service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:28.777916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:28.807079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:28.807547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:28.808044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:28.808500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:28.984224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:28.985713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:29.018089 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2634/5236] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:34.628594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:34.629607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:34.630135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:34.655692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] MFA Rules not processed for user `a2150305f8e240ce86b8008d84da243d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:34.664300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:34.873927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2603/5237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:36.211462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:36.214234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:36.343529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f57f9e-07c2-4026-be9e-45a6b3ce31f5 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:36.348242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:36.348912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:36.349199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:36.349480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] PATH_INFO: `/v3/users/344df8bcd7754daaae0f592034e6877a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:36.350688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344df8bcd7754daaae0f592034e6877a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:36.353836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:36.469282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344df8bcd7754daaae0f592034e6877a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:36.496425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344df8bcd7754daaae0f592034e6877a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:36.497328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344df8bcd7754daaae0f592034e6877a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:36.498019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344df8bcd7754daaae0f592034e6877a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:36.511599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a59feb37-a9d5-4773-bd23-53eef17f8299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344df8bcd7754daaae0f592034e6877a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:36.533367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2635/5238] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:36 2022] DELETE /identity/v3/users/344df8bcd7754daaae0f592034e6877a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:37.417638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:37.447566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf5002-9ba6-452b-8ff2-ce2e23bf0f6a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:37.618808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:37.632258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:37.634556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:37.635049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:37.638545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] PATH_INFO: `/v3/projects/8610c4dbb172466c824ff9bedb03f0bd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:37.640169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8610c4dbb172466c824ff9bedb03f0bd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:37.644168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:37.789457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8610c4dbb172466c824ff9bedb03f0bd', 'request_id': 'req-df74179a-3fd3-4b18-a4ea-d9361df5537f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:37.806048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8610c4dbb172466c824ff9bedb03f0bd', 'request_id': 'req-df74179a-3fd3-4b18-a4ea-d9361df5537f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:37.822806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8610c4dbb172466c824ff9bedb03f0bd', 'request_id': 'req-df74179a-3fd3-4b18-a4ea-d9361df5537f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:37.842976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] The token cache is being invalidate because project 8610c4dbb172466c824ff9bedb03f0bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:37.843286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:37.846180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:37.849877 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2604/5239] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:37 2022] DELETE /identity/v3/projects/8610c4dbb172466c824ff9bedb03f0bd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:37.855554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9269-c4b7-4691-9995-da88a8e34d0b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:37.856778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9269-c4b7-4691-9995-da88a8e34d0b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:37.857259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9269-c4b7-4691-9995-da88a8e34d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:37.914859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9dba9269-c4b7-4691-9995-da88a8e34d0b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:37.922230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9dba9269-c4b7-4691-9995-da88a8e34d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:37.952502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:37.963034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:37.964634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:38.218372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2636/5240] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:38.219899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.220194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.220511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.239190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74179a-3fd3-4b18-a4ea-d9361df5537f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.253148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.253829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.254158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.254556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.268563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:38.289544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:38.291979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:38.327695 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2637/5241] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:38.340146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:38.371389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70bb7e-7b8c-4e5e-af99-a4401cf47cb1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.387702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.388340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.388624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.388897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.389554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:38.389859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.391799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:38.447541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2638/5242] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:38.450104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:38.484900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed3f8b-2f83-4371-9ae9-c65360227c4c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.501769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.505560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:38.506498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.507522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.508248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.508778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.514137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.516720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:38.540978 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2605/5243] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:38.600588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2639/5244] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:38 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:38.606873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:38.625643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ebf32-42e3-4faa-baec-292f92d5f86f service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.717411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:38.754440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.755677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.756145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.756599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.758496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.761631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:38.803372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:38.806406 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2606/5245] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:38 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:38.817208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a3dd-b22d-44a5-8bd4-a9015aac7c27 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.823572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.824645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.825319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.825942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.826871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.829351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:38.841283 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2640/5246] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:36:38.846085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:38.870822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54321bf-e093-4b28-b855-3d58fe885813 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.886277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65622b8d-45d8-4056-97d4-7c660cee89eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.886919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65622b8d-45d8-4056-97d4-7c660cee89eb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.887213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65622b8d-45d8-4056-97d4-7c660cee89eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.887488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65622b8d-45d8-4056-97d4-7c660cee89eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.888148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65622b8d-45d8-4056-97d4-7c660cee89eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.889764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65622b8d-45d8-4056-97d4-7c660cee89eb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:38.916468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:38.932832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd957c6-0fb2-447d-b84c-ee4d81d0bdcf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:38.933709 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2607/5247] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:38.945485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:38.946376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:38.946665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:38.946949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] PATH_INFO: `/v3/projects/ff0b51dbdf5c46d29c9e2ce1f09553cb/users/918429a321f84ab8b7746cb9d4f0ab7b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:38.986913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0b51dbdf5c46d29c9e2ce1f09553cb, user_id=918429a321f84ab8b7746cb9d4f0ab7b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:38.990875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:39.026307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e2d6-dc6d-491f-b024-2876c7a531ad None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:39.026632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e2d6-dc6d-491f-b024-2876c7a531ad None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:39.026921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e2d6-dc6d-491f-b024-2876c7a531ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:39.030421 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2641/5248] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:38 2022] PUT /identity/v3/projects/ff0b51dbdf5c46d29c9e2ce1f09553cb/users/918429a321f84ab8b7746cb9d4f0ab7b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:39.066746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-74c6e2d6-dc6d-491f-b024-2876c7a531ad None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:39.068543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74c6e2d6-dc6d-491f-b024-2876c7a531ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:39.324140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2608/5249] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:39.398338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:39.401459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:39.558992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cd5c3-d8b5-4eda-94d5-657d9477e86b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:39.565821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:39.578547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:39.578870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:39.579161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:39.615993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:39.619154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:39.647748 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2642/5250] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:40.339936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a05d-ed77-437a-82ab-891792053e43 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:40.340606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a05d-ed77-437a-82ab-891792053e43 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:40.340606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a05d-ed77-437a-82ab-891792053e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:40.391099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-adc8a05d-ed77-437a-82ab-891792053e43 None None] MFA Rules not processed for user `0b80262470174f089095460a99b91563`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:40.392343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-adc8a05d-ed77-437a-82ab-891792053e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:40.569290 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2609/5251] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:49.628522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:50.541625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:50.543609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:50.552504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:50.609153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886868e-e5a9-416b-867b-1680b7bdeb88 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:50.638222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:50.648554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:50.663156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:50.665916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] PATH_INFO: `/v3/users/1f859daf0fd14cf49672cce0a3e4958e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:50.680010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f859daf0fd14cf49672cce0a3e4958e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:50.697488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:50.899324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f859daf0fd14cf49672cce0a3e4958e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:50.963573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f859daf0fd14cf49672cce0a3e4958e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:50.967042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f859daf0fd14cf49672cce0a3e4958e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:50.970093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f859daf0fd14cf49672cce0a3e4958e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:51.025968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f859daf0fd14cf49672cce0a3e4958e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:51.067383 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2643/5252] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:50 2022] DELETE /identity/v3/users/1f859daf0fd14cf49672cce0a3e4958e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:51.072516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:51.073214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:51.074102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:51.113604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:51.118703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:51.505363 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2610/5253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:51.589511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:51.593692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:51.841792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107327c-fab3-416c-8d99-3f65c7169b11 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:51.870944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:51.871562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:51.871849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:51.872127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:51.903290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:51.904887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:51.936216 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2644/5254] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:53.769451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:53.771912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:53.844720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805ef0a-ce42-4bdb-acfc-33da6e91686c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:53.867760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:53.868407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:53.868693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:53.868971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:53.872049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:53.905601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:53.907159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e356e-a859-4a23-a7aa-e7733062a206 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:53.928492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2611/5255] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:54.312091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:54.313823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:54.339622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d42bb-1724-44b9-a794-a8d06d24be71 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:54.345991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:54.347752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:54.348254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:54.348732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] PATH_INFO: `/v3/projects/ce4eb7ca7be945c689ec8c1c296b07aa` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:54.350333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4eb7ca7be945c689ec8c1c296b07aa)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:54.354578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:54.433256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4eb7ca7be945c689ec8c1c296b07aa', 'request_id': 'req-2b520a6e-174b-480c-ad99-150177402960'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:54.444327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4eb7ca7be945c689ec8c1c296b07aa', 'request_id': 'req-2b520a6e-174b-480c-ad99-150177402960'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:54.495191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4eb7ca7be945c689ec8c1c296b07aa', 'request_id': 'req-2b520a6e-174b-480c-ad99-150177402960'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:54.516333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:54.528769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] The token cache is being invalidate because project ce4eb7ca7be945c689ec8c1c296b07aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:54.529602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:54.532021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2b520a6e-174b-480c-ad99-150177402960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:54.535326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2645/5256] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:54 2022] DELETE /identity/v3/projects/ce4eb7ca7be945c689ec8c1c296b07aa => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:54.540386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:54.540893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:54.541531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:54.586805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:54.589582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:54.768892 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2612/5257] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:54.779426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:54.780424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:54.780709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:54.836528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:54.838255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:54.861375 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2646/5258] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:54.865696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:54.885228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76d640-ff2f-4637-96be-dec8818315f1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:54.896532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:54.897181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:54.897471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:54.897755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:54.898977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:54.899284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:54.901030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:54.917372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2613/5259] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:54.921508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:54.937720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9edec2-29f5-4848-b287-cd40735a0200 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:54.965372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:54.966407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:54.967734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:54.968030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:54.969027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:54.971262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:55.038049 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2647/5260] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:54 2022] POST /identity/v3/projects => generated 359 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:55.046745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:55.059103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd708-a62e-4590-9661-3a38364d2bb4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:55.150259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:55.151312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.151763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.152224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:55.153654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:55.155852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:55.199352 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2614/5261] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:55 2022] POST /identity/v3/users => generated 280 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:55.203082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:55.223744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dbf6e-71da-4597-ae16-9d8486accce1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:55.242030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:55.242880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.243169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.243453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:55.244115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:55.245741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:55.298106 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2648/5262] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:55.319423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:55.328703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:55.338340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e79d7f-e8ab-461b-b9c2-bceee6a8d057 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:55.344348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1f74f-9ac7-44ca-8398-2b86fe3d04fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:55.360472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f74f-9ac7-44ca-8398-2b86fe3d04fa admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.360873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f74f-9ac7-44ca-8398-2b86fe3d04fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.361473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f74f-9ac7-44ca-8398-2b86fe3d04fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:55.364283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f74f-9ac7-44ca-8398-2b86fe3d04fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:55.370731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f74f-9ac7-44ca-8398-2b86fe3d04fa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:55.396733 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2615/5263] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:55.400657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:55.435081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04ac6-22b2-4a8d-aa58-dd8d855d4500 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:55.444396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:55.454559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.456928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.459094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] PATH_INFO: `/v3/projects/a0393c3f4d604d328ee1e0dd37af004c/users/753737356990483380abfb80109f8277/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:55.505161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0393c3f4d604d328ee1e0dd37af004c, user_id=753737356990483380abfb80109f8277, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:55.513321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:55.568828 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2649/5264] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:55 2022] PUT /identity/v3/projects/a0393c3f4d604d328ee1e0dd37af004c/users/753737356990483380abfb80109f8277/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:55.569763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183970-9239-4183-b6ee-26576e7ef9ce None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.570666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183970-9239-4183-b6ee-26576e7ef9ce None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.571139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183970-9239-4183-b6ee-26576e7ef9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:55.614612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-56183970-9239-4183-b6ee-26576e7ef9ce None None] MFA Rules not processed for user `753737356990483380abfb80109f8277`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:55.615961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-56183970-9239-4183-b6ee-26576e7ef9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:55.709073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2616/5265] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:55.750316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:55.753361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:55.894454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1417-c318-4f42-82a4-232069199c60 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:55.912063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:55.912720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.913095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.915203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:55.945800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:55.953475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:55.996242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c915-0bf3-4ebf-96c4-1278ad0d665f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:55.996691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c915-0bf3-4ebf-96c4-1278ad0d665f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:55.996893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c915-0bf3-4ebf-96c4-1278ad0d665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:56.013179 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2650/5266] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:36:56.039620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:56.073198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8bc9c915-0bf3-4ebf-96c4-1278ad0d665f None None] MFA Rules not processed for user `918429a321f84ab8b7746cb9d4f0ab7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:56.087571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8bc9c915-0bf3-4ebf-96c4-1278ad0d665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:56.308929 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2617/5267] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:36:56.321223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd3ea-2dda-4021-a879-9e55daffb138 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:56.327608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:56.333891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:56.333891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:56.338824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:56.339904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:56.340286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:56.340668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] PATH_INFO: `/v3/users/753737356990483380abfb80109f8277` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:56.345612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] RBAC: Authorizing `identity:delete_user(user_id=753737356990483380abfb80109f8277)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:56.347591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:56.402180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] MFA Rules not processed for user `918429a321f84ab8b7746cb9d4f0ab7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:56.407965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:56.435749 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2618/5268] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:56.446518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:56.448648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:56.449154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:56.478970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753737356990483380abfb80109f8277'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:56.512285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753737356990483380abfb80109f8277'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:56.518431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753737356990483380abfb80109f8277'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:56.524229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753737356990483380abfb80109f8277'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:56.541563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-baac73dc-4566-49a5-93fb-43e8113002db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753737356990483380abfb80109f8277'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:56.572796 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2651/5269] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:36:56 2022] DELETE /identity/v3/users/753737356990483380abfb80109f8277 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:56.577450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:56.578021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:56.578574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:56.658124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:56.667597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:56.740286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:56.756422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e54f84-814a-4a47-ba23-4d999b9a2d0d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:56.861441 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2652/5270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:56.871618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:56.873418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:56.908678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:56.909316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:56.909597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:56.909883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:56.915212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:56.966978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991f25-7da3-4ee4-8c8a-3e6de6041606 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:56.987926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:56.988903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:56.989381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:56.989829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:57.017746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:57.020102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:57.041254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2653/5271] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:57.094939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:57.096714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7f204-1941-4ef3-868d-882f7a17eb58 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:57.121068 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2619/5272] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:58.033362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:58.035765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:58.073979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa402e3-140f-416c-8f89-8225b472e645 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:58.092269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:58.093205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:58.093487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:58.099061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] PATH_INFO: `/v3/projects/a0393c3f4d604d328ee1e0dd37af004c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:58.105311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0393c3f4d604d328ee1e0dd37af004c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:58.112677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:58.290460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0393c3f4d604d328ee1e0dd37af004c', 'request_id': 'req-bbcfa3d4-d1cd-4c53-b376-654d91db906c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:58.308457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0393c3f4d604d328ee1e0dd37af004c', 'request_id': 'req-bbcfa3d4-d1cd-4c53-b376-654d91db906c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:58.310129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:58.324196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0393c3f4d604d328ee1e0dd37af004c', 'request_id': 'req-bbcfa3d4-d1cd-4c53-b376-654d91db906c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:58.353296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] The token cache is being invalidate because project a0393c3f4d604d328ee1e0dd37af004c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:36:58.353752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:58.356785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bbcfa3d4-d1cd-4c53-b376-654d91db906c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:36:58.362774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2654/5273] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:36:58 2022] DELETE /identity/v3/projects/a0393c3f4d604d328ee1e0dd37af004c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:58.369866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:58.370493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:58.370892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:58.422128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:58.423452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:58.593591 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2620/5274] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:58.599943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:58.600260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:58.600541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:58.690747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:58.692095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:58.736328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2655/5275] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:58.737652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:58.754629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9ada-f28c-45c2-9b66-0826072396f1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:58.764252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:58.764945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:58.765227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:58.765504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:58.771168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:36:58.771597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:58.776180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:58.833008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:58.833321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2621/5276] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:36:58.845058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411307-2b5b-465c-b198-16ab6ffb8de2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:58.867353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:58.867817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:58.868159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:58.868369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:58.869026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:58.871255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:58.908390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:58.910655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:58.962322 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2656/5277] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:58 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:36:58.969607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:58.994984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:36:59.119391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b376-4c64-4efc-9975-25dfd0c4a7d7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:59.179147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338642f-8013-4807-92c8-b1fcdd7b3a54 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:59.195456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:59.196384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.196766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.197311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.198240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:59.213152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:59.255019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:59.264685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.264977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.265264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.272348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:59.283957 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2657/5278] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:36:58 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:36:59.287268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:59.306948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:59.308467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:59.313915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbf32-2da9-416d-817f-38350949c5ed admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:59.325934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:59.327159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.329095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.329811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.331664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:59.337128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:59.339748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2622/5279] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:36:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:36:59.354030 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2658/5280] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:36:59.357875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:59.370328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0c50-5e46-4b12-b792-713956036f9b service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:59.376922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e002a2-a152-4cfd-bd4b-e1e9ffafb6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:59.378316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e002a2-a152-4cfd-bd4b-e1e9ffafb6af admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.378802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e002a2-a152-4cfd-bd4b-e1e9ffafb6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.379260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e002a2-a152-4cfd-bd4b-e1e9ffafb6af admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.380164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e002a2-a152-4cfd-bd4b-e1e9ffafb6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:59.388346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e002a2-a152-4cfd-bd4b-e1e9ffafb6af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:59.417649 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2623/5281] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:36:59.418850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:59.432507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd12e1-d750-42e5-99cc-f271edc05699 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:59.449512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:59.450668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.451267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.451728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] PATH_INFO: `/v3/projects/e03570812e184a94b901666b3771848d/users/2b5ba1b6b5bf4efe831f10bb2b8a707a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.485901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03570812e184a94b901666b3771848d, user_id=2b5ba1b6b5bf4efe831f10bb2b8a707a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:59.489915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:59.519369 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2659/5282] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:36:59 2022] PUT /identity/v3/projects/e03570812e184a94b901666b3771848d/users/2b5ba1b6b5bf4efe831f10bb2b8a707a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:36:59.523589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46157794-635f-4641-832d-359c7d0fd309 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.524010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46157794-635f-4641-832d-359c7d0fd309 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.524396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46157794-635f-4641-832d-359c7d0fd309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.579470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-46157794-635f-4641-832d-359c7d0fd309 None None] MFA Rules not processed for user `2b5ba1b6b5bf4efe831f10bb2b8a707a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:36:59.581675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46157794-635f-4641-832d-359c7d0fd309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:36:59.794340 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2624/5283] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:36:59.797570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:36:59.894821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ae3ce-96c6-4ea4-b916-44d7a3c30f6c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:36:59.905778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:36:59.906562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:36:59.906853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:36:59.907136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:36:59.907801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:36:59.909838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:36:59.927557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:00.020259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46157794-635f-4641-832d-359c7d0fd309 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:00.041300 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2660/5284] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:36:59 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:00.046746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46157794-635f-4641-832d-359c7d0fd309 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:00.198550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:00.248753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:00.250575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:00.251329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:00.252192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:00.253018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:00.265051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:00.329679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2625/5285] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:00 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:00.332189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:00.353119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82f45-f50e-4966-918d-9c4403952fa1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:00.370696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:00.373358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:00.373652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:00.373978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:00.377024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:00.387579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:00.418810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:00.420656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2661/5286] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:00.445607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae0019-acaa-4873-8f07-9a99d15d88fe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:00.473731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55a3ed-15c6-4d3a-80f3-49a8435ac6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:00.474446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a3ed-15c6-4d3a-80f3-49a8435ac6ff admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:00.474732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a3ed-15c6-4d3a-80f3-49a8435ac6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:00.475017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a3ed-15c6-4d3a-80f3-49a8435ac6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:00.475687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55a3ed-15c6-4d3a-80f3-49a8435ac6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:00.481336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55a3ed-15c6-4d3a-80f3-49a8435ac6ff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:00.506310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2626/5287] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:00.510946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:00.532098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd9b4-2d2f-4636-b30a-021cb0ff0f6e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:00.547767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:00.548474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:00.548758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:00.549036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] PATH_INFO: `/v3/projects/5766ce3054c34696a65e062411acc297/users/3b67421591ae4f0dbb447078710954a6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:00.593727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5766ce3054c34696a65e062411acc297, user_id=3b67421591ae4f0dbb447078710954a6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:00.596473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:00.650602 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2662/5288] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:00 2022] PUT /identity/v3/projects/5766ce3054c34696a65e062411acc297/users/3b67421591ae4f0dbb447078710954a6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:00.814404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:00.815075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:00.815515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:00.865730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] MFA Rules not processed for user `3b67421591ae4f0dbb447078710954a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:00.869217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:01.035728 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2627/5289] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:01.040530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:01.174379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42fe9a-7072-4af1-807a-d25a07531e59 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:01.197808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:01.198877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:01.199396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:01.200436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:01.201018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:01.207835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:01.313390 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2663/5290] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:01 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:01.321510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:01.417801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039556cd-c8d0-46be-a6ae-d629e00c188c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:01.665797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:01.669798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:01.670095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:01.670411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:01.673193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:01.677088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:01.761605 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2628/5291] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:01 2022] POST /identity/v3/users => generated 295 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:01.766010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:01.796713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c764-87f3-4539-b41e-1fda2e0d9c35 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:01.815520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:01.816886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:01.816886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:01.816886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:01.818386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:01.822605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:01.845418 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2664/5292] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:01.850354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:01.869639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a0f20-7d5b-4ea6-abc2-e60964a7661f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:01.884714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:01.887779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:01.888102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:01.896288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] PATH_INFO: `/v3/projects/d5d1aa27bd9546f1a011e110bf5e4ad2/users/6b2c29dd2e994790aed2233162a06ffe/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:01.950387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1aa27bd9546f1a011e110bf5e4ad2, user_id=6b2c29dd2e994790aed2233162a06ffe, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:01.969710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:01.999547 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2629/5293] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:01 2022] PUT /identity/v3/projects/d5d1aa27bd9546f1a011e110bf5e4ad2/users/6b2c29dd2e994790aed2233162a06ffe/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:02.005756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:02.026951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55237b-a28d-413c-a9d9-f150946b098d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:02.171848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad487-4c0b-428e-9f8c-946a1dd13306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:02.172937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad487-4c0b-428e-9f8c-946a1dd13306 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:02.173629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad487-4c0b-428e-9f8c-946a1dd13306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:02.174117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad487-4c0b-428e-9f8c-946a1dd13306 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:02.175014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad487-4c0b-428e-9f8c-946a1dd13306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:02.177049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad487-4c0b-428e-9f8c-946a1dd13306 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:02.197195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:02.205955 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2665/5294] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:02.209654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a4f7-c7d5-4ec2-8644-3fb73e2b23a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:02.232787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:02.233817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:02.234109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:02.234445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] PATH_INFO: `/v3/projects/d5d1aa27bd9546f1a011e110bf5e4ad2/users/6b2c29dd2e994790aed2233162a06ffe/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:02.236965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1aa27bd9546f1a011e110bf5e4ad2, user_id=6b2c29dd2e994790aed2233162a06ffe, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:02.239732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:02.258752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:02.268477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2630/5295] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:02 2022] PUT /identity/v3/projects/d5d1aa27bd9546f1a011e110bf5e4ad2/users/6b2c29dd2e994790aed2233162a06ffe/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:02.279673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:02.280062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:02.280396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:02.321247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] MFA Rules not processed for user `6b2c29dd2e994790aed2233162a06ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:02.322612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:02.344294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:02.409806 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2666/5296] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:02.419378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:02.421641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:02.490627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d561b7f-e5db-4ee3-bdbe-ac5be19681a9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:02.495799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:02.497042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:02.497335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:02.497614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:02.563685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:02.565125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:02.577086 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2631/5297] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:05.700386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:05.731010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03400-bacd-4643-862b-d31623cf318a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:05.745022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:05.746718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:05.747243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:05.747922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:05.865490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:05.868226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:05.879253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2667/5298] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:06.832532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:06.843111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd69bd-1837-44e7-aa9c-be29c696bb10 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:06.846916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:06.848237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:06.848973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:06.849260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:06.869471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:06.872073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:06.886695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2632/5299] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:12.776652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:12.778877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:12.993167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599adc-bc30-429d-9823-e77c415b0baa service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:13.015671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:13.018604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:13.019856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:13.020321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:13.026214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:13.056896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:13.058804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066feead-585b-4ed4-953f-a643eef4cd7b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:13.075214 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2668/5300] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:16.880266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=54 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:17.030572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:17.144256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dbe42-285f-4ff6-9bc0-8be72bdfd95d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:17.144730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dbe42-285f-4ff6-9bc0-8be72bdfd95d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:17.145026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dbe42-285f-4ff6-9bc0-8be72bdfd95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:17.179686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-410dbe42-285f-4ff6-9bc0-8be72bdfd95d None None] MFA Rules not processed for user `3556d4ac9f1e4f6393e9f7fe6a16ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:17.183478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-410dbe42-285f-4ff6-9bc0-8be72bdfd95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:17.192904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380529f0-fadb-4ed5-878f-cc541fc5e7f5 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:17.201521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:17.202552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:17.203041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:17.203677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] PATH_INFO: `/v3/users/2b5ba1b6b5bf4efe831f10bb2b8a707a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:17.205220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5ba1b6b5bf4efe831f10bb2b8a707a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:17.209338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:17.279415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:17.307337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5ba1b6b5bf4efe831f10bb2b8a707a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:17.316393 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2669/5301] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:17.324822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5ba1b6b5bf4efe831f10bb2b8a707a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:17.325760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5ba1b6b5bf4efe831f10bb2b8a707a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:17.326577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5ba1b6b5bf4efe831f10bb2b8a707a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:17.347013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5ba1b6b5bf4efe831f10bb2b8a707a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:17.384079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2633/5302] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:17 2022] DELETE /identity/v3/users/2b5ba1b6b5bf4efe831f10bb2b8a707a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:17.385768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:17.386068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:17.386419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:17.460670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:17.462807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:17.726867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2670/5303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:17.737642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:17.739947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:17.911679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940aaa1-1d78-438b-bd40-7c28f7cdf2bd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:17.924861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:17.925596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:17.926180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:17.926535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:17.950452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:17.956256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:17.997080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2634/5304] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:18.457501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:18.459011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:18.482788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f103-cd7a-4a9f-b2a3-44df6a1d77a0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:18.495844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:18.496722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:18.497131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:18.497516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:18.500209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:18.514303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:18.516615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:18.543437 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2671/5305] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:18.748402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:18.750636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:18.767989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4f12-919b-458e-9d2f-2f67e7cb057e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:18.773300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:18.774605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:18.775066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:18.775533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] PATH_INFO: `/v3/projects/e03570812e184a94b901666b3771848d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:18.777141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03570812e184a94b901666b3771848d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:18.779478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:18.813630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:18.916304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03570812e184a94b901666b3771848d', 'request_id': 'req-1c690c55-16a5-41cf-a647-db82b0a7a353'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:18.935827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03570812e184a94b901666b3771848d', 'request_id': 'req-1c690c55-16a5-41cf-a647-db82b0a7a353'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:18.946622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03570812e184a94b901666b3771848d', 'request_id': 'req-1c690c55-16a5-41cf-a647-db82b0a7a353'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:18.963944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] The token cache is being invalidate because project e03570812e184a94b901666b3771848d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:18.965313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:18.967404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:18.970034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2635/5306] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:18 2022] DELETE /identity/v3/projects/e03570812e184a94b901666b3771848d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:18.973669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:18.988939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b95f-813f-49ee-9c51-fe98f199d875 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:19.120685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:19.121643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:19.122099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:19.122622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] PATH_INFO: `/v3/users/3b67421591ae4f0dbb447078710954a6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:19.128338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b67421591ae4f0dbb447078710954a6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:19.131083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:19.203173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b67421591ae4f0dbb447078710954a6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.224371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b67421591ae4f0dbb447078710954a6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.226015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b67421591ae4f0dbb447078710954a6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.227072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b67421591ae4f0dbb447078710954a6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.245030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:19.250845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b67421591ae4f0dbb447078710954a6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.316464 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2672/5307] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:18 2022] DELETE /identity/v3/users/3b67421591ae4f0dbb447078710954a6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:19.749047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:19.751357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:19.779109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c690c55-16a5-41cf-a647-db82b0a7a353 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:19.897155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:19.898198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:19.898525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:19.898870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] PATH_INFO: `/v3/projects/5766ce3054c34696a65e062411acc297` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:19.900120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5766ce3054c34696a65e062411acc297)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:19.902204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:19.973416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5766ce3054c34696a65e062411acc297', 'request_id': 'req-29f58fa7-a718-451e-a51c-85291509e185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.982539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5766ce3054c34696a65e062411acc297', 'request_id': 'req-29f58fa7-a718-451e-a51c-85291509e185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:19.997328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5766ce3054c34696a65e062411acc297', 'request_id': 'req-29f58fa7-a718-451e-a51c-85291509e185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.012554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] The token cache is being invalidate because project 5766ce3054c34696a65e062411acc297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:20.012904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.013838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.019007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2636/5308] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:19 2022] DELETE /identity/v3/projects/5766ce3054c34696a65e062411acc297 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:20.019683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:20.021946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:20.045901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202ac8c-6469-437d-a604-4dd23b28d778 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:20.149017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:20.150371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:20.152574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:20.153311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] PATH_INFO: `/v3/users/6b2c29dd2e994790aed2233162a06ffe` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:20.154763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2c29dd2e994790aed2233162a06ffe)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:20.156981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:20.227459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2c29dd2e994790aed2233162a06ffe'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.244564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2c29dd2e994790aed2233162a06ffe'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.245315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2c29dd2e994790aed2233162a06ffe'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.246096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2c29dd2e994790aed2233162a06ffe'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.257697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebbc93bc-82f1-4a18-bdf4-d581cb567d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2c29dd2e994790aed2233162a06ffe'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.283757 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2673/5309] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:20 2022] DELETE /identity/v3/users/6b2c29dd2e994790aed2233162a06ffe => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:20.341848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:20.343357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:20.364071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58fa7-a718-451e-a51c-85291509e185 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:20.492105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:20.558877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:20.559651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:20.560005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:20.560355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] PATH_INFO: `/v3/users/fd9819c8279e4ca3a175e6bdaba42ae3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:20.562959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9819c8279e4ca3a175e6bdaba42ae3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:20.564996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:20.669318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9819c8279e4ca3a175e6bdaba42ae3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.689420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9819c8279e4ca3a175e6bdaba42ae3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.690845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9819c8279e4ca3a175e6bdaba42ae3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.691636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9819c8279e4ca3a175e6bdaba42ae3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.722685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9819c8279e4ca3a175e6bdaba42ae3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:20.788707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:20.789240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:20.789815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:20.798002 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2637/5310] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:20 2022] DELETE /identity/v3/users/fd9819c8279e4ca3a175e6bdaba42ae3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:20.834340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:20.836405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:20.854740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:20.859614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:21.128081 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2674/5311] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:21.130744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416498e-60ab-4448-92e2-412fc9e9b7df admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.136839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.137496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.137785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.138261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] PATH_INFO: `/v3/projects/d5d1aa27bd9546f1a011e110bf5e4ad2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.139426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d1aa27bd9546f1a011e110bf5e4ad2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.141340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.147597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.149155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:21.166414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:21.247327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d1aa27bd9546f1a011e110bf5e4ad2', 'request_id': 'req-4b3b63fb-5bb7-477e-96df-967133a61b1a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:21.256352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d1aa27bd9546f1a011e110bf5e4ad2', 'request_id': 'req-4b3b63fb-5bb7-477e-96df-967133a61b1a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:21.259120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:21.276915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274059b7-a54e-4b72-8b53-eb0c83aa95e7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.291672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d1aa27bd9546f1a011e110bf5e4ad2', 'request_id': 'req-4b3b63fb-5bb7-477e-96df-967133a61b1a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:21.318340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] The token cache is being invalidate because project d5d1aa27bd9546f1a011e110bf5e4ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:21.318638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:21.319851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b3b63fb-5bb7-477e-96df-967133a61b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:21.324156 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2638/5312] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:20 2022] DELETE /identity/v3/projects/d5d1aa27bd9546f1a011e110bf5e4ad2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:21.329258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e3ec-8ff1-4f28-bca5-3d0ce821a71a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.329687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e3ec-8ff1-4f28-bca5-3d0ce821a71a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.330367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23e3ec-8ff1-4f28-bca5-3d0ce821a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.377409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ea23e3ec-8ff1-4f28-bca5-3d0ce821a71a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:21.378663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ea23e3ec-8ff1-4f28-bca5-3d0ce821a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:21.387911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.388557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.388839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.389119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.396190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:21.486052 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2639/5313] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:21.492183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.492480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.492748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.530313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.530626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:21.531783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:21.542360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.546102 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2640/5314] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:21.546663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.557295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b12ed-0b82-4836-983e-ae7ed612fea4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.562555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.563185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.563468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.563746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.564409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:21.564715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.566361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.572998 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2675/5315] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:37:21.581392 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2641/5316] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:21.587217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.600077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10fa4e-d639-46bf-bc12-d38f53362774 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.608010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.608656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.609053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.609449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.609984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.612759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.665604 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2676/5317] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:21 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:21.666921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.679590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07412e-fec1-459d-b28d-6e4bf196ce3a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.784830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.786736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.787260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.788972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.790430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.793514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.831266 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2642/5318] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:21 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:21.835752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.849090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6425975-fe21-4709-9558-a30d9a4402ef admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.854963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.855624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.855913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.856194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.858159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.859852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.877696 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2677/5319] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:37:21.878873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.894444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36a222-4784-414b-995f-42dfeef70881 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.908632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eaaa9-3972-4ada-a19a-cffce889c02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.909335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eaaa9-3972-4ada-a19a-cffce889c02a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.909752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eaaa9-3972-4ada-a19a-cffce889c02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.910762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eaaa9-3972-4ada-a19a-cffce889c02a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:21.911561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eaaa9-3972-4ada-a19a-cffce889c02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:21.914054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eaaa9-3972-4ada-a19a-cffce889c02a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:21.935474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2643/5320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:21.939421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:21.961177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083cac2-370f-48d6-926e-944e469b567b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:21.994006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:21.996633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:21.999010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:21.999421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] PATH_INFO: `/v3/projects/4bb3a0bc528249608c0e46ad7f74400e/users/acbeaca3712e45049837e4e21538f9a8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:22.034232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb3a0bc528249608c0e46ad7f74400e, user_id=acbeaca3712e45049837e4e21538f9a8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:22.039883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:22.073528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2678/5321] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:21 2022] PUT /identity/v3/projects/4bb3a0bc528249608c0e46ad7f74400e/users/acbeaca3712e45049837e4e21538f9a8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:22.086895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:22.087550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:22.088092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:22.221991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] MFA Rules not processed for user `acbeaca3712e45049837e4e21538f9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:22.234953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:22.308218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:22.338126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:22.340676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:22.415072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2644/5322] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:22.423570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:22.424428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:22.427763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:22.549127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2bcd3-04e7-465c-84c1-94a6127d619a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:22.563241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:22.564300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:22.564559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84a0c-ce88-49c8-bbe1-d2651f0a5a40 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:22.565907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:22.566639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:22.574885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:22.576068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:22.576068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:22.576331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] PATH_INFO: `/v3/projects/81bf8408fa6a4f3d9231f94435b4c953` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:22.578803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bf8408fa6a4f3d9231f94435b4c953)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:22.580806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:22.592541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:22.593998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:22.615769 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2645/5323] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:37:22.680974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:22.694003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567de68-bd5d-418d-a480-603e228fafa5 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:22.700998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bf8408fa6a4f3d9231f94435b4c953', 'request_id': 'req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.714166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bf8408fa6a4f3d9231f94435b4c953', 'request_id': 'req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.738908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bf8408fa6a4f3d9231f94435b4c953', 'request_id': 'req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.767427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] The token cache is being invalidate because project 81bf8408fa6a4f3d9231f94435b4c953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:22.767875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.769439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.773105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2679/5324] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:22 2022] DELETE /identity/v3/projects/81bf8408fa6a4f3d9231f94435b4c953 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:22.780219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:22.782259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:22.855773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:22.856340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:22.858857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:22.859259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] PATH_INFO: `/v3/users/acbeaca3712e45049837e4e21538f9a8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:22.862023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbeaca3712e45049837e4e21538f9a8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:22.864094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:22.969832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e1460-dcf2-4a12-b4e4-9c5268c3a93a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:22.976223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbeaca3712e45049837e4e21538f9a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.987072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:22.987960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:22.988243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:22.988616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] PATH_INFO: `/v3/users/1788c52beadd43c7bbb7faa52468e2a8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:22.990276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1788c52beadd43c7bbb7faa52468e2a8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:22.994050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbeaca3712e45049837e4e21538f9a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.995001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbeaca3712e45049837e4e21538f9a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:22.996440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbeaca3712e45049837e4e21538f9a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.000925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:23.022686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5d7b8b6-4df0-47b6-ae03-6909cad2c078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbeaca3712e45049837e4e21538f9a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.052030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:23.070538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2646/5325] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:22 2022] DELETE /identity/v3/users/acbeaca3712e45049837e4e21538f9a8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:23.075694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:23.076076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:23.076362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:23.138537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:23.140958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:23.143724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1788c52beadd43c7bbb7faa52468e2a8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.147266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:23.173302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1788c52beadd43c7bbb7faa52468e2a8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.174383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1788c52beadd43c7bbb7faa52468e2a8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.176318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1788c52beadd43c7bbb7faa52468e2a8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.187002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1788c52beadd43c7bbb7faa52468e2a8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:23.208226 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2680/5326] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:22 2022] DELETE /identity/v3/users/1788c52beadd43c7bbb7faa52468e2a8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:23.365241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2647/5327] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:23.439108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:23.442832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:23.607451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9d59-5b0c-4e9a-9548-07c6cdfceb15 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:23.618865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0f14-06d2-4c08-bc56-694b1797438d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:23.619548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0f14-06d2-4c08-bc56-694b1797438d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:23.619862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0f14-06d2-4c08-bc56-694b1797438d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:23.620151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0f14-06d2-4c08-bc56-694b1797438d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:23.781103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0f14-06d2-4c08-bc56-694b1797438d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:23.784239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0f14-06d2-4c08-bc56-694b1797438d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:23.813013 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2681/5328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:24.616102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:24.618867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:24.633678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07cac-ba20-4797-843a-893533df1eaa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:24.650406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:24.651593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:24.652144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:24.652627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] PATH_INFO: `/v3/projects/48dd2bd191d045e7a9de947ce0eaa636` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:24.654655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dd2bd191d045e7a9de947ce0eaa636)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:24.659411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:24.741806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dd2bd191d045e7a9de947ce0eaa636', 'request_id': 'req-595c30b9-70f4-48d0-b415-55b4d12dbd9d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:24.759434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dd2bd191d045e7a9de947ce0eaa636', 'request_id': 'req-595c30b9-70f4-48d0-b415-55b4d12dbd9d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:24.791721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dd2bd191d045e7a9de947ce0eaa636', 'request_id': 'req-595c30b9-70f4-48d0-b415-55b4d12dbd9d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:24.815580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] The token cache is being invalidate because project 48dd2bd191d045e7a9de947ce0eaa636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:24.815873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:24.818200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:24.822589 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2648/5329] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:24 2022] DELETE /identity/v3/projects/48dd2bd191d045e7a9de947ce0eaa636 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:24.827698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41b10-06a7-4d3d-b156-6fc8715f5148 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:24.829026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41b10-06a7-4d3d-b156-6fc8715f5148 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:24.829447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41b10-06a7-4d3d-b156-6fc8715f5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:24.856214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:24.859742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:24.886946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c4d41b10-06a7-4d3d-b156-6fc8715f5148 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:24.889465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c4d41b10-06a7-4d3d-b156-6fc8715f5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.008281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2682/5330] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:25.015986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.016274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.016620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.033399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c30b9-70f4-48d0-b415-55b4d12dbd9d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.041859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.042802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.043221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.043986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.048817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.058826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:25.060646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.072153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.076573 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2683/5331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:25.076704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.078433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.092982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea57f3-69d5-480f-903b-e9d06187092b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.093840 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2649/5332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:25.099856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.102434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.103496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.104032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.105308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:25.105945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.108852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.122089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:25.134417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.142695 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2684/5333] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:25.143541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:25.152076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13b3f4-81f5-4dff-8229-da4627310d8c service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.175321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.179683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.184854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.186311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.188610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.192989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.233412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.235378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.284378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac992c-ea13-4b93-b77a-62ba47a99023 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.290734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2650/5334] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:25.291915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.414606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.415259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.415539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.415811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] PATH_INFO: `/v3/projects/4bb3a0bc528249608c0e46ad7f74400e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.417076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb3a0bc528249608c0e46ad7f74400e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.419000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.423684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78128066-c5e4-4e75-a784-34e399846959 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.431413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.432369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.433046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.433791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.435273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.437998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.489627 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2651/5335] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:25.492783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.502270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb3a0bc528249608c0e46ad7f74400e', 'request_id': 'req-d0fd747a-834f-4079-8b51-068970aea5be'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:25.511703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb3a0bc528249608c0e46ad7f74400e', 'request_id': 'req-d0fd747a-834f-4079-8b51-068970aea5be'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:25.519397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb3a0bc528249608c0e46ad7f74400e', 'request_id': 'req-d0fd747a-834f-4079-8b51-068970aea5be'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:25.522725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0ba0-a80b-414e-a417-ee2dc41a334e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.540099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] The token cache is being invalidate because project 4bb3a0bc528249608c0e46ad7f74400e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:25.540407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:25.541071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0fd747a-834f-4079-8b51-068970aea5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:25.543231 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2685/5336] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:25 2022] DELETE /identity/v3/projects/4bb3a0bc528249608c0e46ad7f74400e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:37:25.547995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f435-9089-4dd8-9e55-e9aa51ea285b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.548338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f435-9089-4dd8-9e55-e9aa51ea285b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.549680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f435-9089-4dd8-9e55-e9aa51ea285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.580944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1121f435-9089-4dd8-9e55-e9aa51ea285b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:25.582223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1121f435-9089-4dd8-9e55-e9aa51ea285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.682018 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2686/5337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:25.688582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.688877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.689630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.693152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.693636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.693636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.693827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.696186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.698728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.744914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:25.748813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.759851 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2687/5338] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:25.764488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.787987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d96442-adf9-45c4-b457-e9648506ce47 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.789165 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2652/5339] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:25.792752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.796424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:25.801740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.803218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.804398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.807373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.809298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:25.814508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.818736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.835845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8ee0b-75c8-4ca8-b704-abe76686e826 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.849630 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2688/5340] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:37:25.854298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.856513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.857376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.857904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.858310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.859046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.861141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.885477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817c86-1ece-467e-a9b2-c7031897a4c4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.895075 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2653/5341] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:25.900613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.904558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.905310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.905695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.906099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.906869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.909292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:25.921119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:25.928245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b566-6af5-41f3-b40a-65d62be09cb3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:25.941879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1bd8e-3f52-42f8-8ecc-6af933d05bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:25.942599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1bd8e-3f52-42f8-8ecc-6af933d05bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:25.942967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1bd8e-3f52-42f8-8ecc-6af933d05bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:25.943305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1bd8e-3f52-42f8-8ecc-6af933d05bd7 admin admin] PATH_INFO: `/v3/projects/55146b6c8d46435b89a5eb7ab6135c05/users/a771da017a2a4c75824da938dcde00ea/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:25.971010 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2689/5342] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:25.973699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:25.984343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1bd8e-3f52-42f8-8ecc-6af933d05bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55146b6c8d46435b89a5eb7ab6135c05, user_id=a771da017a2a4c75824da938dcde00ea, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:25.990415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1bd8e-3f52-42f8-8ecc-6af933d05bd7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.022597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2654/5343] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:25 2022] PUT /identity/v3/projects/55146b6c8d46435b89a5eb7ab6135c05/users/a771da017a2a4c75824da938dcde00ea/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:26.030442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.030859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.031625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.095187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] MFA Rules not processed for user `a771da017a2a4c75824da938dcde00ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:26.096583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:26.097701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4628c-1e8b-4e89-b343-5c2001490a05 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.154973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:26.173285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.173846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.174135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.174488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.175328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.178075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.226928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2690/5344] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:25 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:26.233686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2655/5345] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:26.234889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.235069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.252128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3665d-e6fa-445e-bc76-5cae2b53ec10 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.254805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc5507-0246-41a4-89f9-0b565a2ac2bb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.263065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.263777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.264179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.264602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.265582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.266378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.267724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.268590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.269099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.269973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.272139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.273134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.289108 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2691/5346] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:26.292905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.308720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd5e72-16ec-420d-8702-b54942523c7a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.316148 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2656/5347] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:26 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:26.322509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.323413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.323413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.323574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.324172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.324278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.325920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.342875 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2692/5348] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:37:26.347328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.361694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0f19a-6e9e-447d-92e2-1946d59904b0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.439069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa8e2-6819-4744-94a7-b4ee43d0ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.440082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa8e2-6819-4744-94a7-b4ee43d0ef7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.440366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa8e2-6819-4744-94a7-b4ee43d0ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.440748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa8e2-6819-4744-94a7-b4ee43d0ef7a admin admin] PATH_INFO: `/v3/projects/07bedfaaf2ad4e63b277c6ad874c6b5e/users/c9d5ec5af50a4be78cfd007565c7165d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.445247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:26.464086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa8e2-6819-4744-94a7-b4ee43d0ef7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bedfaaf2ad4e63b277c6ad874c6b5e, user_id=c9d5ec5af50a4be78cfd007565c7165d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.467196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa8e2-6819-4744-94a7-b4ee43d0ef7a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.476154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b217-5b63-43c0-8824-67226adbf930 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.483227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.483932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.484223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.484506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.485163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.487459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.502223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2693/5349] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:26 2022] PUT /identity/v3/projects/07bedfaaf2ad4e63b277c6ad874c6b5e/users/c9d5ec5af50a4be78cfd007565c7165d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:37:26.509460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.509753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.510314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.517534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2657/5350] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:26 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:26.528769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.553132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] MFA Rules not processed for user `c9d5ec5af50a4be78cfd007565c7165d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:26.555369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:26.565388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6aba-2d35-4038-b733-2b712cfaa78f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.648461 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2694/5351] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:26.653221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.676647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.677042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.677453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.677905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.679996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.681586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.697220 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2658/5352] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:26.702403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.715123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0e897-9950-4523-a7f3-e31347a3468d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.721362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.722462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.722856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.723276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] PATH_INFO: `/v3/projects/5de710c7e5214638acd4a8bf5d6d6a59/users/fed083090b544f7098ed79488b4746a9/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.758328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de710c7e5214638acd4a8bf5d6d6a59, user_id=fed083090b544f7098ed79488b4746a9, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.767238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.783975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235bfd8-ea69-47ba-916b-a6d0a0f8e651 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.791167 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2659/5353] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:26 2022] PUT /identity/v3/projects/5de710c7e5214638acd4a8bf5d6d6a59/users/fed083090b544f7098ed79488b4746a9/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:26.792432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.795358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:26.805856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:26.917853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d3eef-60b5-4a27-8af7-651687dec4cc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.925529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.926710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.927646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.927646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.930472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:26.941188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.942761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.945528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.945911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.946814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.947755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.949406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.951994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:26.963544 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2660/5354] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:26.964728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:26.978936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6644-4b37-457c-879e-1a45123f8732 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:26.985465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:26.986454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:26.986815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:26.987262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:26.988922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:26.990915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.008807 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2661/5355] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:27.008807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.008807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.024125 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2695/5356] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:26 2022] POST /identity/v3/projects => generated 389 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:27.025395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.033841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012ff4-a022-4814-ab6c-17926b1d3a6a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.048776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:27.120518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.121279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.121640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.121994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] PATH_INFO: `/v3/users/918429a321f84ab8b7746cb9d4f0ab7b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.123460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918429a321f84ab8b7746cb9d4f0ab7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.126377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.133832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffe8a1-d949-4e67-9a64-001581887f48 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.141220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.142007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.142353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.142707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] PATH_INFO: `/v3/projects/5de710c7e5214638acd4a8bf5d6d6a59/users/fed083090b544f7098ed79488b4746a9/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.146833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de710c7e5214638acd4a8bf5d6d6a59, user_id=fed083090b544f7098ed79488b4746a9, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.150534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.164916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2696/5357] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:27 2022] PUT /identity/v3/projects/5de710c7e5214638acd4a8bf5d6d6a59/users/fed083090b544f7098ed79488b4746a9/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:27.165814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.198837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918429a321f84ab8b7746cb9d4f0ab7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.210886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918429a321f84ab8b7746cb9d4f0ab7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.211753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918429a321f84ab8b7746cb9d4f0ab7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.212548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918429a321f84ab8b7746cb9d4f0ab7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.221699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38bdfa5e-5697-4800-855e-4c0dc70283f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918429a321f84ab8b7746cb9d4f0ab7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.244018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:27.250686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2662/5358] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:27 2022] DELETE /identity/v3/users/918429a321f84ab8b7746cb9d4f0ab7b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:27.255430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.256098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.257826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.276056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9aec8-6822-4156-9219-0d0d2850a847 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.312357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] MFA Rules not processed for user `fed083090b544f7098ed79488b4746a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:27.313713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.399104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.399982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.400962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.401350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.402098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.402471 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2663/5359] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:27.404676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.414925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.416460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.455124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2697/5360] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:27 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:27.456443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.460606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.483192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9191aa-1296-4c45-b8f4-da69fe2e2979 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.488651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.489327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.489849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.490352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.491844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.493900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.509760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533a2fc-00a6-46e4-8d1f-d6ddc34889cf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.511937 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2698/5361] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:27.513232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.517255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.527701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.528823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.529247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.529672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.533206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a600e-677a-4068-b901-36a390397814 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.540507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.541477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.541912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.542347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] PATH_INFO: `/v3/projects/ff0b51dbdf5c46d29c9e2ce1f09553cb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.544141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0b51dbdf5c46d29c9e2ce1f09553cb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.546644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.548096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.550919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.565669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2664/5362] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:27.578012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:27.584867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.622759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b154d0d-8529-41c5-9345-40ce626fca55 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.667542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0b51dbdf5c46d29c9e2ce1f09553cb', 'request_id': 'req-a25f4805-9e51-4450-9305-0a65b3ee9839'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.688973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0b51dbdf5c46d29c9e2ce1f09553cb', 'request_id': 'req-a25f4805-9e51-4450-9305-0a65b3ee9839'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.704749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0b51dbdf5c46d29c9e2ce1f09553cb', 'request_id': 'req-a25f4805-9e51-4450-9305-0a65b3ee9839'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.725277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] The token cache is being invalidate because project ff0b51dbdf5c46d29c9e2ce1f09553cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:27.726643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.727688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a25f4805-9e51-4450-9305-0a65b3ee9839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:27.730038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2699/5363] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:27 2022] DELETE /identity/v3/projects/ff0b51dbdf5c46d29c9e2ce1f09553cb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:27.737258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d789f2b-31ea-43ce-bccb-530e2f2fdc2a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.737475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d789f2b-31ea-43ce-bccb-530e2f2fdc2a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.737751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d789f2b-31ea-43ce-bccb-530e2f2fdc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.744316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.745155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.745481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.745709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.746428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.748175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.765363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5d789f2b-31ea-43ce-bccb-530e2f2fdc2a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:27.766644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d789f2b-31ea-43ce-bccb-530e2f2fdc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.766948 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2665/5364] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:27.772983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.775563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.786202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2700/5365] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:27.794576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.795042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.795492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.815816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162995ec-b8ed-4fe5-add5-2a40943f2cd5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.823826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.824291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:27.824732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.825015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.825381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] PATH_INFO: `/v3/projects/15e9867f1ac94862ad31c266716fc5a5/users/8138a18b044f4ee4a3c3215873546505/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.826771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.839408 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2701/5366] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:27.845350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.857666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46781f-8d50-4753-a530-b0bf6e064c7b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.864351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.865054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.865563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.866608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e9867f1ac94862ad31c266716fc5a5, user_id=8138a18b044f4ee4a3c3215873546505, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.866721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.867563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:27.867993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.869810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.870900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.883729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:27.892523 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2666/5367] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:27 2022] PUT /identity/v3/projects/15e9867f1ac94862ad31c266716fc5a5/users/8138a18b044f4ee4a3c3215873546505/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:37:27.892699 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2702/5368] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:27.892815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.894430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:27.894600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:27.909289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb577-ea96-405a-b968-d9a79b5fd427 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.977816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c6e9-f79b-4f27-bb67-4d3680c030f6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:27.983035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.983869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.984190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.984640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] PATH_INFO: `/v3/users/a771da017a2a4c75824da938dcde00ea` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.985915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a771da017a2a4c75824da938dcde00ea)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.988177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:27.993129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09922c5c-1bb9-48e9-a056-935abf37ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:27.993129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09922c5c-1bb9-48e9-a056-935abf37ce81 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:27.994335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09922c5c-1bb9-48e9-a056-935abf37ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:27.994477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09922c5c-1bb9-48e9-a056-935abf37ce81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:27.995361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09922c5c-1bb9-48e9-a056-935abf37ce81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:27.997873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09922c5c-1bb9-48e9-a056-935abf37ce81 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.033991 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2703/5369] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:27 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:28.035514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d6710-bfb5-4f99-be13-33ee31446074 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.035899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d6710-bfb5-4f99-be13-33ee31446074 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.036247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d6710-bfb5-4f99-be13-33ee31446074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.052526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a771da017a2a4c75824da938dcde00ea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.063351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a771da017a2a4c75824da938dcde00ea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.063971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a771da017a2a4c75824da938dcde00ea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.064577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a771da017a2a4c75824da938dcde00ea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.073376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e35d6710-bfb5-4f99-be13-33ee31446074 None None] MFA Rules not processed for user `8138a18b044f4ee4a3c3215873546505`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:28.074760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e35d6710-bfb5-4f99-be13-33ee31446074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.076025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a771da017a2a4c75824da938dcde00ea'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.096268 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2667/5370] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:27 2022] DELETE /identity/v3/users/a771da017a2a4c75824da938dcde00ea => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:28.097641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.099242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.154858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:28.160112 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2704/5371] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:28.161341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.161611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.161885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.196112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f15f38-14af-41f1-b6a0-d2642d92989c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.200596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:28.201355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.202236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.202981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.203361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.203767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.204472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.206529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.209598 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2705/5372] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:28.210513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.211818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.226614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8585f-d9c5-4863-a404-f2f2ce0104ec None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.232990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.233662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.233924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.234234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.234459 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2668/5373] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:28 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:28.234920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.235411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.236846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.238580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.250860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:28.267235 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2706/5374] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:28 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:28.268045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.306018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01ce5-fb6c-4947-a96b-d32d692aa914 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.342672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84174d-0afa-48f2-8bd9-8724d5c99b05 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.347392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.348004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.348284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.348558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.349205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.351364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.361660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2707/5375] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:28.362438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.366556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.368549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.369970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.370377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.373009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f8da-5665-46fa-9207-566c6a3a8bde admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.378130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.378773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.379053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.379329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.379958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.381378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.382466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.383497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.396590 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2669/5376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:28.399548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.407311 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2708/5377] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:28 2022] POST /identity/v3/users => generated 301 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:28.412423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.416243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0955d-a156-45d5-b8de-7c2243f47614 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.423030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.424277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.424797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.425485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.426421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.429829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c0f66-4803-4073-ba06-762a798bfe41 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.430590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.440711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.441685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.442015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.442439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.444755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.450268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.459380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2670/5378] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:28.463882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.474203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2709/5379] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:28.477576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.487656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf889853-8ed0-4783-8664-6c11c7ac879d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.499482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7cab3-c7ef-4ad6-bf2d-761b04ab084d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.504536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bae1-4cd2-492b-a0a0-da4edea3adac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.505233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bae1-4cd2-492b-a0a0-da4edea3adac admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.505721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bae1-4cd2-492b-a0a0-da4edea3adac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.506018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bae1-4cd2-492b-a0a0-da4edea3adac admin admin] PATH_INFO: `/v3/projects/31e3f6c9a8cc4f8e88fcaa62f9744188/users/40d24a7cd0894955a68c1603287cebfa/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.508245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.509769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.510688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.510688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] PATH_INFO: `/v3/projects/6b7fbdfad88b4fcda36e0650e942a4dc/users/8fe3ce0a6a724f3289f56ce49f808a8e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.536068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7fbdfad88b4fcda36e0650e942a4dc, user_id=8fe3ce0a6a724f3289f56ce49f808a8e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.541351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.542137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891bae1-4cd2-492b-a0a0-da4edea3adac admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e3f6c9a8cc4f8e88fcaa62f9744188, user_id=40d24a7cd0894955a68c1603287cebfa, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.548540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891bae1-4cd2-492b-a0a0-da4edea3adac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.576805 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2710/5380] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:28 2022] PUT /identity/v3/projects/6b7fbdfad88b4fcda36e0650e942a4dc/users/8fe3ce0a6a724f3289f56ce49f808a8e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:37:28.580040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2671/5381] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:28 2022] PUT /identity/v3/projects/31e3f6c9a8cc4f8e88fcaa62f9744188/users/40d24a7cd0894955a68c1603287cebfa/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:28.586088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.591828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.592335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.593358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.635261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] MFA Rules not processed for user `40d24a7cd0894955a68c1603287cebfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:28.636914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.730617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8040f-d57c-4d75-a24e-6f51822a4076 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.764663 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2672/5382] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:28.765220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:28.783401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.832684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:28.838680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.839791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.840084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.840424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.841175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.843208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.857767 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2711/5383] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:28.859160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.861441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.877337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a70c8-1914-47cc-9c3a-bb9b4df6b545 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.886199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.886199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.886199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.886199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] PATH_INFO: `/v3/projects/55146b6c8d46435b89a5eb7ab6135c05` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.886572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55146b6c8d46435b89a5eb7ab6135c05)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.888098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.906472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646aae4-6fd3-4ff9-a681-53d5f7a01293 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:28.911235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:28.911863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:28.912145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:28.912416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] PATH_INFO: `/v3/users/40d24a7cd0894955a68c1603287cebfa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:28.914103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d24a7cd0894955a68c1603287cebfa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:28.916056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:28.937983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55146b6c8d46435b89a5eb7ab6135c05', 'request_id': 'req-2c3fef90-d7d6-44bd-b201-049223a56cdf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.945968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55146b6c8d46435b89a5eb7ab6135c05', 'request_id': 'req-2c3fef90-d7d6-44bd-b201-049223a56cdf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.953151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55146b6c8d46435b89a5eb7ab6135c05', 'request_id': 'req-2c3fef90-d7d6-44bd-b201-049223a56cdf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.969717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d24a7cd0894955a68c1603287cebfa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.971376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] The token cache is being invalidate because project 55146b6c8d46435b89a5eb7ab6135c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:28.971667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.972362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.977909 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2712/5384] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:28 2022] DELETE /identity/v3/projects/55146b6c8d46435b89a5eb7ab6135c05 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:28.978857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:28.980335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:28.981787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d24a7cd0894955a68c1603287cebfa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.982646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d24a7cd0894955a68c1603287cebfa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.983462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d24a7cd0894955a68c1603287cebfa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:28.992360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d24a7cd0894955a68c1603287cebfa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.015524 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2673/5385] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:28 2022] DELETE /identity/v3/users/40d24a7cd0894955a68c1603287cebfa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:29.015524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:29.015524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.062165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fef90-d7d6-44bd-b201-049223a56cdf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:29.088805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bf534-e2e3-40b1-9fae-3c95e5238f4d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:29.094548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:29.095220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.095501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.095776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] PATH_INFO: `/v3/users/fed083090b544f7098ed79488b4746a9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.096949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed083090b544f7098ed79488b4746a9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:29.098870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:29.113351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:29.133676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d98e2-2bf1-4a8d-ab85-53400e0d857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:29.134580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d98e2-2bf1-4a8d-ab85-53400e0d857d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.134867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d98e2-2bf1-4a8d-ab85-53400e0d857d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.135151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d98e2-2bf1-4a8d-ab85-53400e0d857d admin admin] PATH_INFO: `/v3/projects/6b7fbdfad88b4fcda36e0650e942a4dc/users/8fe3ce0a6a724f3289f56ce49f808a8e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.137520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d98e2-2bf1-4a8d-ab85-53400e0d857d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7fbdfad88b4fcda36e0650e942a4dc, user_id=8fe3ce0a6a724f3289f56ce49f808a8e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:29.140549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d98e2-2bf1-4a8d-ab85-53400e0d857d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:29.150115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:29.153239 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2713/5386] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:28 2022] PUT /identity/v3/projects/6b7fbdfad88b4fcda36e0650e942a4dc/users/8fe3ce0a6a724f3289f56ce49f808a8e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:29.163653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.163653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.163653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.164001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed083090b544f7098ed79488b4746a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.167990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed083090b544f7098ed79488b4746a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.168642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed083090b544f7098ed79488b4746a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.169583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed083090b544f7098ed79488b4746a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.178168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c27fcf9a-1901-4c88-a868-95c32db15597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed083090b544f7098ed79488b4746a9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.182584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:29.183826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.214324 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2674/5387] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:29 2022] DELETE /identity/v3/users/fed083090b544f7098ed79488b4746a9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:29.216002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.216362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.216670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.253978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] MFA Rules not processed for user `8fe3ce0a6a724f3289f56ce49f808a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:29.255453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2714/5388] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:29.263851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.277239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:29.279325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.365681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185968-66a5-40aa-a140-9bfed27c5bfa None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:29.372301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2675/5389] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:29.392197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:29.393905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.436071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:29.436841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.437267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.437641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.535445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:29.548041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aed8a8-34e0-456f-b04d-ce50e5a2e188 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:29.558303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:29.559241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.559478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:29.559815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.560850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.561586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:29.563061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.576947 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2715/5390] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:29.578067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:29.580104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.608243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89954cc8-8a1b-41e7-ae6c-e5863f3fd654 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:29.622974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:29.623861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.626113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:29.626682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.626974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.630997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.653420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:29.655191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:29.655746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:29.660368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43f366-9a1f-4e94-9b0c-afc9c915eed6 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:29.674658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2676/5391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:29.680498 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2716/5392] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:29.687666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:29.689506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:29.713388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13ee4-6c18-43b1-b7b6-d34197729e35 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:29.719851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:29.720628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.720911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.721187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] PATH_INFO: `/v3/projects/5de710c7e5214638acd4a8bf5d6d6a59` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.722604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de710c7e5214638acd4a8bf5d6d6a59)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:29.724793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:29.828951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de710c7e5214638acd4a8bf5d6d6a59', 'request_id': 'req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.865771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de710c7e5214638acd4a8bf5d6d6a59', 'request_id': 'req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.878954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de710c7e5214638acd4a8bf5d6d6a59', 'request_id': 'req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.898375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] The token cache is being invalidate because project 5de710c7e5214638acd4a8bf5d6d6a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:29.898935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.900100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef9a6ec7-3a4f-4ce1-9179-b14f39ef36d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:29.903216 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2677/5393] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:29 2022] DELETE /identity/v3/projects/5de710c7e5214638acd4a8bf5d6d6a59 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:29.908055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:29.908354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:29.908678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:29.972512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:29.973757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.130819 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2717/5394] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:30.139573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.139573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.139863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.168580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.171794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.198036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:30.202139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.212387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823d365-e72b-4c2d-9a1b-40852fdf581c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.230720 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2678/5395] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:30.233016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.233812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.236952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.237414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.239216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] PATH_INFO: `/v3/projects/31e3f6c9a8cc4f8e88fcaa62f9744188` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.243410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e3f6c9a8cc4f8e88fcaa62f9744188)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.248447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.278028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecc7ae-53ec-41e8-acca-1e021358fbd7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.290602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.292298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.292417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.294342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.295037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:30.295355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.297406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.337828 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2679/5396] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:30.343226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.368270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dab45d-9535-40f8-a1ae-decaecbf5862 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.396513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e3f6c9a8cc4f8e88fcaa62f9744188', 'request_id': 'req-15bc7c86-ea46-4902-a511-5c65b016d137'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:30.406092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e3f6c9a8cc4f8e88fcaa62f9744188', 'request_id': 'req-15bc7c86-ea46-4902-a511-5c65b016d137'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:30.412548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e3f6c9a8cc4f8e88fcaa62f9744188', 'request_id': 'req-15bc7c86-ea46-4902-a511-5c65b016d137'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:30.431070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] The token cache is being invalidate because project 31e3f6c9a8cc4f8e88fcaa62f9744188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:30.431358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:30.432036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15bc7c86-ea46-4902-a511-5c65b016d137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:30.433646 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2718/5397] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:30 2022] DELETE /identity/v3/projects/31e3f6c9a8cc4f8e88fcaa62f9744188 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:30.439507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.439793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.440706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.462388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61a7fd-4e69-43e6-923d-d87ba22c5a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.462692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61a7fd-4e69-43e6-923d-d87ba22c5a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.463019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61a7fd-4e69-43e6-923d-d87ba22c5a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.463318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61a7fd-4e69-43e6-923d-d87ba22c5a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.464800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61a7fd-4e69-43e6-923d-d87ba22c5a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.467251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61a7fd-4e69-43e6-923d-d87ba22c5a13 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.485855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:30.487252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.508056 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2680/5399] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:30.508285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2719/5399] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:30.509938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.510343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.510536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.518118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.521310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.541737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:30.544530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.556337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1450-a1c1-4874-b9f2-ba20bea38f42 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.585774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:30.616753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:30.631163 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2681/5400] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:30.632769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.633826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.634518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.635154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.635432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.636097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.638114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.645150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23863-1415-4738-868b-3d51ecfd1cd0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.651196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.652130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.652627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.652928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.653702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:30.654074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.655820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.663652 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2720/5401] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:30.669316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2682/5402] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:30.670573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.673561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.682776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a52f1-c0c3-48b3-8bf3-9da92abd1249 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.686285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ee9fc-9481-44e4-aa09-b0df41ef84c7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.688990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.689729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.690014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.690327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.690981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.691131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.691754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.692090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.692373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.692609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.693042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.695773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.704529 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2721/5403] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:30.708779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.722841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286129-240d-40ee-86b2-c49ae3b70290 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.729971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.730654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.731536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.731536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.732056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.733722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.735148 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2683/5404] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:30.739010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.748270 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2722/5405] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:37:30.752904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.765415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700805b-1e52-4810-954b-1eb4bc0ba377 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.813343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123490-a198-494d-ac3a-16fe02c1b2cb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.819500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.820094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.820368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.820650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.821306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.823276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.829277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789213d-a22b-4569-a5ae-12dc4322d94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.830016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789213d-a22b-4569-a5ae-12dc4322d94b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.830393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789213d-a22b-4569-a5ae-12dc4322d94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.830761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789213d-a22b-4569-a5ae-12dc4322d94b admin admin] PATH_INFO: `/v3/projects/cef67f4c76b14552a375175a33a8f1fd/users/8663013055124f049b86ef7d800ccb0e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.847348 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2684/5406] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:30.848738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789213d-a22b-4569-a5ae-12dc4322d94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef67f4c76b14552a375175a33a8f1fd, user_id=8663013055124f049b86ef7d800ccb0e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.851616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.852008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789213d-a22b-4569-a5ae-12dc4322d94b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.862256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3747b4-a052-425f-a09e-93499ebcf724 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.868827 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2723/5407] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:30 2022] PUT /identity/v3/projects/cef67f4c76b14552a375175a33a8f1fd/users/8663013055124f049b86ef7d800ccb0e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:30.879704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.879996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.880278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.913975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] MFA Rules not processed for user `8663013055124f049b86ef7d800ccb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:30.915607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:30.926721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.927348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.927627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.927900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.929220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.930804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.944010 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2685/5408] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:37:30.945195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.955882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0a2e1-2830-4382-a616-12968699b354 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.961970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:30.962730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:30.963109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:30.963573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:30.964264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:30.965988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:30.978829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2686/5409] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:30.982559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:30.995761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5609-9b02-49f4-b430-44adf949d487 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:30.997763 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2724/5410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:31.002356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.005704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e937e-5ce1-4be0-8e68-6fdbb2023a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.006865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e937e-5ce1-4be0-8e68-6fdbb2023a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.006982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e937e-5ce1-4be0-8e68-6fdbb2023a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.007227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e937e-5ce1-4be0-8e68-6fdbb2023a43 admin admin] PATH_INFO: `/v3/projects/012382ce78b04df7ba4784b183f7f78a/users/3d70ff7b82f447eeaec8197547dd69e8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.019039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:31.020031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973d3c3-a0ca-49da-947b-7e9d02b838fe None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.027775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.031998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.031998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.031998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.031998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.034301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.035978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e937e-5ce1-4be0-8e68-6fdbb2023a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012382ce78b04df7ba4784b183f7f78a, user_id=3d70ff7b82f447eeaec8197547dd69e8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.039180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e937e-5ce1-4be0-8e68-6fdbb2023a43 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.060064 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2687/5411] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:30 2022] PUT /identity/v3/projects/012382ce78b04df7ba4784b183f7f78a/users/3d70ff7b82f447eeaec8197547dd69e8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:31.071161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.071378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.071658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.091221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2725/5412] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:31 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:31.095011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.108851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:31.114323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] MFA Rules not processed for user `3d70ff7b82f447eeaec8197547dd69e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:31.117568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:31.182644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e2b7-dd39-4fe6-98ed-460ea4522320 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.189574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.190776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.191256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.192025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.192914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.195833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.226874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2726/5413] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:31 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:37:31.231408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.243403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2262589-b71e-4a45-8265-ead44f068d2d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.249461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.250501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.250785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.251063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.251740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.253510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.254739 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2688/5414] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:31.267163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.269356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:31.276995 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2727/5415] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:31.280848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.300274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838779-e62a-4d3c-80d5-2da18dbd22a4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.308591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.319754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.320263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.320729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] PATH_INFO: `/v3/projects/d284ceacc8414f018facb99af104b2b6/users/6fb3b31a6f9d42fe8084cea34066157d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.346893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284ceacc8414f018facb99af104b2b6, user_id=6fb3b31a6f9d42fe8084cea34066157d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.352732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.379387 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2728/5416] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:31 2022] PUT /identity/v3/projects/d284ceacc8414f018facb99af104b2b6/users/6fb3b31a6f9d42fe8084cea34066157d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:31.380635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.397307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00106f62-b0d4-47e1-ada6-32003300d18f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.485051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28933c4d-751b-4894-90f4-83ef06983a73 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.487250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.488445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.488922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.489757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.490174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.491081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.491408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.491690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.492578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.494392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.511903 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2729/5417] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:31.515332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.532016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e9be-f79d-407b-84a8-48812d1797a0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.538755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975e33-d238-47c1-bc7d-eeacf05171f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.539742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975e33-d238-47c1-bc7d-eeacf05171f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.540227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975e33-d238-47c1-bc7d-eeacf05171f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.540480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975e33-d238-47c1-bc7d-eeacf05171f8 admin admin] PATH_INFO: `/v3/projects/d284ceacc8414f018facb99af104b2b6/users/6fb3b31a6f9d42fe8084cea34066157d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.542615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975e33-d238-47c1-bc7d-eeacf05171f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284ceacc8414f018facb99af104b2b6, user_id=6fb3b31a6f9d42fe8084cea34066157d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.546096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25975e33-d238-47c1-bc7d-eeacf05171f8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.566197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2730/5418] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:31 2022] PUT /identity/v3/projects/d284ceacc8414f018facb99af104b2b6/users/6fb3b31a6f9d42fe8084cea34066157d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:37:31.571412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.571810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.572978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.575139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:31.592024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.593512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.604714 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2689/5419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:31.618316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] MFA Rules not processed for user `6fb3b31a6f9d42fe8084cea34066157d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:31.620009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:31.667272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:31.751818 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2731/5420] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:31.767609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:31.769276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:31.796732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4658b6-3022-4de4-bd3a-98aadf1f707e service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:31.916107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:31.917501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:31.917997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:31.918447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:31.935113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:31.936674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:31.951818 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2690/5421] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:32.111070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:32.131119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed1cb-67e0-4bb0-bca7-1b8d9d6e5981 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:32.145584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:32.146323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:32.146612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:32.146889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:32.232861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:32.234889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:32.245842 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2732/5422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:32.570039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:32.571647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:32.724048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a968e9-503b-4904-8647-972618f0c1c6 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:32.733888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:32.734771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:32.735233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:32.736297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:32.747680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:32.842731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:32.844750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15216f0d-8795-496d-a12d-e3152fcf2734 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:32.859331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2691/5423] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:36.978134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:36.979860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:37.005417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c52f5-f55d-4f4f-a09f-574de1265984 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:37.020016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:37.020745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:37.028129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:37.028393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:37.046945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:37.073507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:37.083023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32bb05-cde4-4062-8021-1d9aad45f41e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:37.118556 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2733/5424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:39.544951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fbcd-6e39-4cdb-9b21-e11daa9fa222 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:39.545984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fbcd-6e39-4cdb-9b21-e11daa9fa222 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:39.546517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fbcd-6e39-4cdb-9b21-e11daa9fa222 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:39.548647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2692/5425] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 05:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 05:37:39.558107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:39.559297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:39.560032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:39.599327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:39.599327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:39.619941 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2734/5426] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:37:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:39.769476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fbcd-6e39-4cdb-9b21-e11daa9fa222 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:39.795862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fbcd-6e39-4cdb-9b21-e11daa9fa222 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:39.811886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf72f6-610f-4dde-a306-15bc89241b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:39.812897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf72f6-610f-4dde-a306-15bc89241b97 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:39.814664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf72f6-610f-4dde-a306-15bc89241b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:39.815092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf72f6-610f-4dde-a306-15bc89241b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:39.847423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf72f6-610f-4dde-a306-15bc89241b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:39.848887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf72f6-610f-4dde-a306-15bc89241b97 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:39.874738 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2693/5427] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:41.202961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:41.394177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff63123-3e51-4487-bbca-2182662b1391 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:41.405333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:41.406286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:41.406966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:41.407416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] PATH_INFO: `/v3/users/8663013055124f049b86ef7d800ccb0e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:41.413346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8663013055124f049b86ef7d800ccb0e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:41.415672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:41.526340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8663013055124f049b86ef7d800ccb0e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:41.538335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:41.562699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8663013055124f049b86ef7d800ccb0e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:41.566130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8663013055124f049b86ef7d800ccb0e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:41.567086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8663013055124f049b86ef7d800ccb0e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:41.589589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8663013055124f049b86ef7d800ccb0e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:41.613254 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2735/5428] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:41 2022] DELETE /identity/v3/users/8663013055124f049b86ef7d800ccb0e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:41.620202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda155-d454-4649-9571-23b04522b415 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:41.620668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda155-d454-4649-9571-23b04522b415 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:41.620777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda155-d454-4649-9571-23b04522b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:41.663381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8bdda155-d454-4649-9571-23b04522b415 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:41.668309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8bdda155-d454-4649-9571-23b04522b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:41.729814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:41.843216 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2694/5429] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:41.886232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:41.888028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:42.081247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09686e7-89d6-49f3-b465-7c6c8b32f72f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:42.096615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:42.097272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:42.097556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:42.097834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:42.126712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:42.134788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:42.167312 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2736/5430] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:42.810234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda155-d454-4649-9571-23b04522b415 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:42.811777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8bdda155-d454-4649-9571-23b04522b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:42.831491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda155-d454-4649-9571-23b04522b415 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:42.848519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:42.848519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:42.848519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:42.848519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] PATH_INFO: `/v3/projects/cef67f4c76b14552a375175a33a8f1fd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:42.849119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef67f4c76b14552a375175a33a8f1fd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:42.859883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:42.995599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef67f4c76b14552a375175a33a8f1fd', 'request_id': 'req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.029752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef67f4c76b14552a375175a33a8f1fd', 'request_id': 'req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.051959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef67f4c76b14552a375175a33a8f1fd', 'request_id': 'req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.077233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] The token cache is being invalidate because project cef67f4c76b14552a375175a33a8f1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:43.077537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.079946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.082787 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2695/5431] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:42 2022] DELETE /identity/v3/projects/cef67f4c76b14552a375175a33a8f1fd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:43.086998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:43.106270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1653-062d-4c9b-85ad-d619d799259a service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:43.241995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:43.242694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:43.242973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:43.243234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] PATH_INFO: `/v3/users/6fb3b31a6f9d42fe8084cea34066157d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:43.246818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb3b31a6f9d42fe8084cea34066157d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:43.267961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:43.388576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb3b31a6f9d42fe8084cea34066157d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.445929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb3b31a6f9d42fe8084cea34066157d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.452093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb3b31a6f9d42fe8084cea34066157d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.453213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb3b31a6f9d42fe8084cea34066157d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.481719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5ffbf67-7408-4018-a6b3-583cee0d4b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb3b31a6f9d42fe8084cea34066157d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:43.497658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:43.514730 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2737/5432] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:43 2022] DELETE /identity/v3/users/6fb3b31a6f9d42fe8084cea34066157d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:44.437521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:44.441901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:44.486951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2053d-a2cc-4c1a-8276-f8867e51b9ee admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:44.676505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:44.677567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:44.681862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:44.682210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] PATH_INFO: `/v3/projects/d284ceacc8414f018facb99af104b2b6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:44.685731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d284ceacc8414f018facb99af104b2b6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:44.688137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:44.821899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd284ceacc8414f018facb99af104b2b6', 'request_id': 'req-ddb631a9-7598-485c-b44d-ff11a425c93c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:44.826387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:44.848007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd284ceacc8414f018facb99af104b2b6', 'request_id': 'req-ddb631a9-7598-485c-b44d-ff11a425c93c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:44.852099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ba2f6-c40c-48d9-8a68-2dcc50055819 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:44.852579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ba2f6-c40c-48d9-8a68-2dcc50055819 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:44.853542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ba2f6-c40c-48d9-8a68-2dcc50055819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:44.871867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd284ceacc8414f018facb99af104b2b6', 'request_id': 'req-ddb631a9-7598-485c-b44d-ff11a425c93c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:44.909674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-749ba2f6-c40c-48d9-8a68-2dcc50055819 None None] MFA Rules not processed for user `c9d5ec5af50a4be78cfd007565c7165d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:44.911184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] The token cache is being invalidate because project d284ceacc8414f018facb99af104b2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:44.911554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:44.912252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ddb631a9-7598-485c-b44d-ff11a425c93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:44.913321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-749ba2f6-c40c-48d9-8a68-2dcc50055819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:44.919572 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2696/5433] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:44 2022] DELETE /identity/v3/projects/d284ceacc8414f018facb99af104b2b6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:44.925552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:44.927411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:44.927715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.004027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:45.014655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:45.083408 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2738/5434] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:45.220816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2697/5435] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:45.222603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.222897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.223176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.269368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:45.270667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:45.291582 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2739/5436] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:37:45.295996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:45.311856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8860-edcf-46cf-b976-4f6343d8fc20 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:45.325005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:45.325668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.325959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.326265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.326942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:45.327253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:45.341889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:45.380817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2698/5437] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:45.387433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:45.400733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811566-e730-4dde-8ac2-30c93f40f14f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:45.414417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:45.418466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.418850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.419604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.420523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:45.422592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:45.467209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:45.468437 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2740/5438] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:45 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:45.487977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af136e3f-57cf-4b36-94be-2596d27c7798 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:45.758446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:45.759091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.759374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.759914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.760687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:45.762722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:45.807711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:45.815707 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2699/5439] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:45 2022] POST /identity/v3/users => generated 291 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:45.821229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce3f1-62e0-464c-aa53-5b9adb220e6c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:45.841051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:45.841713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.841996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.842292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.842952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:45.848242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:45.879454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:45.894732 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2741/5440] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:37:45.896189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e02a89-7b65-4fd2-9d84-0aa2827c151c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:45.909462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5ae2-0d08-415a-bbb6-32c97d1e09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:45.910374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5ae2-0d08-415a-bbb6-32c97d1e09ae admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.910706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5ae2-0d08-415a-bbb6-32c97d1e09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.910981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5ae2-0d08-415a-bbb6-32c97d1e09ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:45.911639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5ae2-0d08-415a-bbb6-32c97d1e09ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:45.913595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5ae2-0d08-415a-bbb6-32c97d1e09ae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:45.935710 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2700/5441] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:37:45.940779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:45.955496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7029aa9-0ecd-4031-ba86-d3de70f98a9c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:45.973641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:45.975589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:45.975942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:45.976226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] PATH_INFO: `/v3/projects/afa3ffed09f641d19d6bdf41a18e3390/users/2ca9764211034ce293f11f39be6e4dc2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:46.019355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa3ffed09f641d19d6bdf41a18e3390, user_id=2ca9764211034ce293f11f39be6e4dc2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:46.025138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:46.071410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:46.071609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:46.071983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:46.082121 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2742/5442] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:45 2022] PUT /identity/v3/projects/afa3ffed09f641d19d6bdf41a18e3390/users/2ca9764211034ce293f11f39be6e4dc2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:46.145649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] MFA Rules not processed for user `2ca9764211034ce293f11f39be6e4dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:46.149029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:46.239579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:46.341662 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2701/5443] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:46.344945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:46.574957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30d81-ecc1-486a-b05a-adc32421b882 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:46.589492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:46.591081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:46.591380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:46.591659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:46.592439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:46.595325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:46.642049 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2743/5444] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:46 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:46.646060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:46.662911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bf1fa-334d-43af-a21d-593a1e8e28d9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:46.847495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:46.848605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:46.848987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:46.849365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:46.850930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:46.853926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:46.905931 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2702/5445] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:46 2022] POST /identity/v3/users => generated 298 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:46.907504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:46.926856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2ff54-5207-4785-8cf1-1bfd0dcfbbb5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:46.939423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:46.941289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:46.941788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:46.945551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:46.946615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:46.950446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:46.973053 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2744/5446] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:46.978424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:47.011523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac44101-5ca6-4b27-aa2f-f6815888838e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:47.016696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:47.017933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:47.018396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:47.018686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] PATH_INFO: `/v3/projects/485e655ad3424d1b842b2e5a8f2b674d/users/9ad23b6462bf4383b3550cc8f51eb590/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:47.040265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485e655ad3424d1b842b2e5a8f2b674d, user_id=9ad23b6462bf4383b3550cc8f51eb590, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:47.043348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:47.077777 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2703/5447] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:46 2022] PUT /identity/v3/projects/485e655ad3424d1b842b2e5a8f2b674d/users/9ad23b6462bf4383b3550cc8f51eb590/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:47.078907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:47.093300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde67d9-bf47-4c8f-89f3-75d2731bc79b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:47.097147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:47.238286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8555-2bef-4dae-8078-0be7265e8ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:47.239630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8555-2bef-4dae-8078-0be7265e8ddb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:47.240109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8555-2bef-4dae-8078-0be7265e8ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:47.240384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8555-2bef-4dae-8078-0be7265e8ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:47.242664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b8555-2bef-4dae-8078-0be7265e8ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:47.244733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b8555-2bef-4dae-8078-0be7265e8ddb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:47.259408 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2745/5448] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:47.263448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:47.277577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd845a38-cf53-4bcb-969c-144bef6cfc13 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:47.285329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:47.286635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:47.287066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:47.287709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] PATH_INFO: `/v3/projects/485e655ad3424d1b842b2e5a8f2b674d/users/9ad23b6462bf4383b3550cc8f51eb590/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:47.290946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485e655ad3424d1b842b2e5a8f2b674d, user_id=9ad23b6462bf4383b3550cc8f51eb590, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:47.294482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:47.330593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2704/5449] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:47 2022] PUT /identity/v3/projects/485e655ad3424d1b842b2e5a8f2b674d/users/9ad23b6462bf4383b3550cc8f51eb590/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:47.333067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:47.333422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:47.333766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:47.411660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] MFA Rules not processed for user `9ad23b6462bf4383b3550cc8f51eb590`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:47.413449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:47.616528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2746/5450] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:47.639645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:47.641704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:47.823082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2319a1-835a-4dc5-845e-d6934741ddc9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:47.836091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed096679-1304-4c31-b018-481d2349b96d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:47.837644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed096679-1304-4c31-b018-481d2349b96d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:47.837944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed096679-1304-4c31-b018-481d2349b96d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:47.838397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed096679-1304-4c31-b018-481d2349b96d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:47.980632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:48.043321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed096679-1304-4c31-b018-481d2349b96d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:48.045533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed096679-1304-4c31-b018-481d2349b96d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:48.099379 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2705/5451] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:57.292030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:57.295014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:57.489123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb109ee-44ee-466b-a6c9-68177a8dc910 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:57.512085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:57.512903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:57.513200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:57.513482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] PATH_INFO: `/v3/users/3d70ff7b82f447eeaec8197547dd69e8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:57.514945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d70ff7b82f447eeaec8197547dd69e8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:57.517458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:57.572642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:57.639229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d70ff7b82f447eeaec8197547dd69e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:57.671549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d70ff7b82f447eeaec8197547dd69e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:57.673519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d70ff7b82f447eeaec8197547dd69e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:57.675202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d70ff7b82f447eeaec8197547dd69e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:57.695592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d70ff7b82f447eeaec8197547dd69e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:57.733163 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2747/5452] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:37:57 2022] DELETE /identity/v3/users/3d70ff7b82f447eeaec8197547dd69e8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:57.735241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c2f5-9f6b-4437-bc11-0267c7151e0f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:57.735697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c2f5-9f6b-4437-bc11-0267c7151e0f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:57.735792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c2f5-9f6b-4437-bc11-0267c7151e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:57.775930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-30a2c2f5-9f6b-4437-bc11-0267c7151e0f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:57.777183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-30a2c2f5-9f6b-4437-bc11-0267c7151e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:57.927744 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2706/5453] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:57.938242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:57.939869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:58.039227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc06e28-8c39-4d66-b66f-b804c3fa2ef7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:58.046495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:58.048473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:58.049107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:58.049559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:58.090385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:58.092788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:58.123630 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2748/5454] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:37:58.171398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:58.172162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:58.172595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:58.197585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:58.199944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:58.302776 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2707/5455] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:58.393941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:58.395950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:58.536664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233082-222e-4663-9be2-56717eb6c50e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:58.574600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064023a-1c16-45c3-b1f7-3ac9b06584ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:58.575304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064023a-1c16-45c3-b1f7-3ac9b06584ee service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:58.575590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064023a-1c16-45c3-b1f7-3ac9b06584ee service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:58.575868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064023a-1c16-45c3-b1f7-3ac9b06584ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:58.590521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064023a-1c16-45c3-b1f7-3ac9b06584ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:58.592174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064023a-1c16-45c3-b1f7-3ac9b06584ee service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:58.610201 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2749/5456] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:37:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:37:58.856676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:58.858949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:58.887053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c56f17-5095-4136-96d4-35f9570ab387 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:58.910424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:58.911111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:58.911397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:58.911678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] PATH_INFO: `/v3/projects/012382ce78b04df7ba4784b183f7f78a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:58.913412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012382ce78b04df7ba4784b183f7f78a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:58.915881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:59.029254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012382ce78b04df7ba4784b183f7f78a', 'request_id': 'req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:59.056395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012382ce78b04df7ba4784b183f7f78a', 'request_id': 'req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:59.071136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012382ce78b04df7ba4784b183f7f78a', 'request_id': 'req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:59.093262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] The token cache is being invalidate because project 012382ce78b04df7ba4784b183f7f78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:37:59.093615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:59.094906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3953fc83-5c99-4a70-a7c0-cc9e691b35f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:37:59.098654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2708/5457] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:37:58 2022] DELETE /identity/v3/projects/012382ce78b04df7ba4784b183f7f78a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:37:59.104564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.104860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.105139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.150242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:59.152249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:59.222952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:59.300052 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2750/5458] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:59.309754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.310044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.310496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.358163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:37:59.359798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:37:59.374922 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2709/5459] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:37:59.375875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:59.388873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7062f87-4e52-40fc-8305-7c29ab10ab0d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:59.400783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:59.402536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.403542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.404432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.406366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:37:59.407228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:59.409390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:59.438453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2751/5460] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:37:59.440034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:59.449173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:37:59.456998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6325ac-a373-4431-935c-d4040582a02f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:59.466339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:59.488827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.489440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.491278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.492570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:59.494890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:59.543684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:59.549854 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2710/5461] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:37:59 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:59.567232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbba77-5dc5-464d-b163-54414c91e3ec admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:59.722368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:59.723403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.724059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.724900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.730050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:59.732295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:59.772298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:59.773133 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2752/5462] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:37:59 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:37:59.786540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58446e-9b70-48b5-ab74-703615772758 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:59.792979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:59.793860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.794417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.794881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.795889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:59.797865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:59.822263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:59.834081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205252c-7484-4a3b-a662-6b50fe3cd772 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:59.834951 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2711/5463] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:59.847633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23af103-eaac-474d-8b43-823cf62f359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:59.848578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af103-eaac-474d-8b43-823cf62f359f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.849063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af103-eaac-474d-8b43-823cf62f359f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.849734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23af103-eaac-474d-8b43-823cf62f359f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.851129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af103-eaac-474d-8b43-823cf62f359f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:59.857311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23af103-eaac-474d-8b43-823cf62f359f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:37:59.891433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:37:59.892662 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2753/5464] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:37:59.905713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48949-c6b2-4fc8-9605-b12dcf89715a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:37:59.923772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:37:59.930228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:37:59.930695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:37:59.931080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] PATH_INFO: `/v3/projects/9067995b883b468db201a0bb190696e5/users/bec0422edabb49538c36d3750ad6ff09/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:37:59.970124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9067995b883b468db201a0bb190696e5, user_id=bec0422edabb49538c36d3750ad6ff09, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:37:59.972037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:00.010586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2712/5465] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:37:59 2022] PUT /identity/v3/projects/9067995b883b468db201a0bb190696e5/users/bec0422edabb49538c36d3750ad6ff09/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:00.015534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:00.016412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:00.016802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:00.094219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] MFA Rules not processed for user `bec0422edabb49538c36d3750ad6ff09`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:00.106919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:00.272535 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2754/5466] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:00.278804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:00.439961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856729b-6ee2-4fd5-aafa-80ef4647c001 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:00.452974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:00.453676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:00.453922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:00.454231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:00.454889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:00.456932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:00.544303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2713/5467] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:00 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:00.552912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:00.579206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aeeac-6f9a-4ad4-ae8d-fd6e44df5694 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:00.696490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:00.776083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:00.776758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:00.777041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:00.777316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:00.782554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:00.784769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:00.852161 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2755/5468] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:00 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:00.853534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:00.868334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d067d9e-0158-4f52-8b02-5fed5021050b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:00.876167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:00.879365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:00.879681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:00.879969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:00.880658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:00.882379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:00.905026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2714/5469] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:00.909265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:00.939856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53bfba-89aa-4167-ad2e-7e538dbd05ad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:00.949863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:00.950631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:00.950925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:00.951208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] PATH_INFO: `/v3/projects/18252a4e80ca47fa815940ddffd32750/users/b6f3268f16bb4b8dad997612c27b0f7b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:00.977400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18252a4e80ca47fa815940ddffd32750, user_id=b6f3268f16bb4b8dad997612c27b0f7b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:00.985222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:01.030755 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2756/5470] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:00 2022] PUT /identity/v3/projects/18252a4e80ca47fa815940ddffd32750/users/b6f3268f16bb4b8dad997612c27b0f7b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:01.033743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:01.061910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422688-21c1-4c53-9bee-fbcf25a530d8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:01.215636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b3bb0-a280-4f65-9910-03552b57349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:01.216285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b3bb0-a280-4f65-9910-03552b57349b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:01.216575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b3bb0-a280-4f65-9910-03552b57349b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:01.216855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b3bb0-a280-4f65-9910-03552b57349b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:01.217513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b3bb0-a280-4f65-9910-03552b57349b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:01.219163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b3bb0-a280-4f65-9910-03552b57349b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:01.237569 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2715/5471] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:01.244600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:01.266932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393aaf1-1441-4ba3-b9df-ec641f5e9113 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:01.281608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:01.281608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:01.281608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:01.281608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] PATH_INFO: `/v3/projects/18252a4e80ca47fa815940ddffd32750/users/b6f3268f16bb4b8dad997612c27b0f7b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:01.302633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] RBAC: Authorizing `identity:create_grant(project_id=18252a4e80ca47fa815940ddffd32750, user_id=b6f3268f16bb4b8dad997612c27b0f7b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:01.305597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:01.339324 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2757/5472] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:01 2022] PUT /identity/v3/projects/18252a4e80ca47fa815940ddffd32750/users/b6f3268f16bb4b8dad997612c27b0f7b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:01.341958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:01.342310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:01.342895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:01.402396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] MFA Rules not processed for user `b6f3268f16bb4b8dad997612c27b0f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:01.403733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:01.419863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:01.574740 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2716/5473] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:01.579161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:01.593806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb12feb-84cc-4b00-9ed6-13cc644bfcde admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:01.602888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:01.603238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:01.603512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:01.604381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:01.604876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:01.607045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:01.671261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2758/5474] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:01 2022] POST /identity/v3/projects => generated 351 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:01.676460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:01.692203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffefd8-3bc7-418f-9faf-c27306ec954b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:01.822966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:01.823909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:01.828959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:01.829503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:01.830460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:01.832547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:01.911218 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2717/5475] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:38:01 2022] POST /identity/v3/projects => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:01.917221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:01.938920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc685e-f77f-4770-99fd-99c092b03d44 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.106493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.107412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.107902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.108410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/users/bec0422edabb49538c36d3750ad6ff09` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.109856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:get_user(user_id=bec0422edabb49538c36d3750ad6ff09)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.117212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.119545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2759/5476] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:38:01 2022] GET /identity/v3/users/bec0422edabb49538c36d3750ad6ff09 => generated 287 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:02.124520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.151985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a5653-9788-46ad-9949-11b5e80c7e16 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.180558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.182139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.182139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.182411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.183120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.185039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.278134 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2718/5477] 10.222.0.23 () {60 vars in 1162 bytes} [Mon Oct 31 05:38:02 2022] POST /identity/v3/credentials => generated 429 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:02.282037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.298618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ce168-a9e0-4e83-8fb1-b4b104255a87 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.312374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.313344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.313711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.314059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials/7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.318339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.323987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.333341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.335451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.367528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2760/5478] 10.222.0.23 () {60 vars in 1358 bytes} [Mon Oct 31 05:38:02 2022] PATCH /identity/v3/credentials/7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761 => generated 436 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:02.371348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.391579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc457ca-17f4-423e-9bac-a3faa9aa3d93 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.403963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.404987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.405425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.405867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials/7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.409199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.415383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.418301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2719/5479] 10.222.0.23 () {58 vars in 1335 bytes} [Mon Oct 31 05:38:02 2022] GET /identity/v3/credentials/7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761 => generated 436 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:02.422917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.455252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6973-4f51-49bb-91a3-72536053a407 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.472090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.479604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.480344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.482838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials/7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.488424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.491442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.535297 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2761/5480] 10.222.0.23 () {58 vars in 1338 bytes} [Mon Oct 31 05:38:02 2022] DELETE /identity/v3/credentials/7d249a44652609ce7e1c40061c4314f86c6516e9e126716046d700972c4cf761 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:02.540822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.557241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da3359-b0ce-4b35-ae0d-7cf5ce856c7f tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.569432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.570321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.570760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.571192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.572119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.574037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.600288 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2720/5481] 10.222.0.23 () {60 vars in 1162 bytes} [Mon Oct 31 05:38:02 2022] POST /identity/v3/credentials => generated 429 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:02.604204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.616796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf071d-303f-4aed-bb68-902e729f7e94 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.636870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.637789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.639997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.640942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.641792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.647250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.689248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2762/5482] 10.222.0.23 () {60 vars in 1162 bytes} [Mon Oct 31 05:38:02 2022] POST /identity/v3/credentials => generated 431 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:02.693256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.708625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edaf91-f8e1-4967-bc73-86996fb6ed3d tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.723582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.724851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.725953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.726415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.727190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.736073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.753383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.755898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.774511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.778500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.787921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.788684 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2721/5483] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Oct 31 05:38:02 2022] GET /identity/v3/credentials => generated 945 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:02.800612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c84d47-8429-40a3-b16e-4d5e4966960a tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.834304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.835533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.836164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.836884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials/5861f7eced99a7892b90de9aad3e71ba00af893831ee4d317eca84237bf8531a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.842291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5861f7eced99a7892b90de9aad3e71ba00af893831ee4d317eca84237bf8531a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.844451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.868937 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2763/5484] 10.222.0.23 () {58 vars in 1338 bytes} [Mon Oct 31 05:38:02 2022] DELETE /identity/v3/credentials/5861f7eced99a7892b90de9aad3e71ba00af893831ee4d317eca84237bf8531a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:02.873027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:02.886502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0640f-1b08-46a9-8016-4295208ce1c9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:02.892321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:02.904840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:02.905171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:02.905458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/credentials/d6831a880b4057b05809fdc7f0c83c248dd628530832fe2ce5c2d3c869ff2ff5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:02.909463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=d6831a880b4057b05809fdc7f0c83c248dd628530832fe2ce5c2d3c869ff2ff5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:02.912198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:02.994014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2722/5485] 10.222.0.23 () {58 vars in 1338 bytes} [Mon Oct 31 05:38:02 2022] DELETE /identity/v3/credentials/d6831a880b4057b05809fdc7f0c83c248dd628530832fe2ce5c2d3c869ff2ff5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:02.994906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:03.033512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a0b9-8598-49b9-b47b-28776689a3b9 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:03.053246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:03.054611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:03.068477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:03.068844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/projects/9009bdbd644c478eabee26b5944515bb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:03.072594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9009bdbd644c478eabee26b5944515bb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:03.079277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:03.105942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:03.198109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9009bdbd644c478eabee26b5944515bb', 'request_id': 'req-eeec2bf5-6555-4ed9-9576-ea2114f81553'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.230383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9009bdbd644c478eabee26b5944515bb', 'request_id': 'req-eeec2bf5-6555-4ed9-9576-ea2114f81553'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.245112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9009bdbd644c478eabee26b5944515bb', 'request_id': 'req-eeec2bf5-6555-4ed9-9576-ea2114f81553'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.325816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] The token cache is being invalidate because project 9009bdbd644c478eabee26b5944515bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:03.325816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.325816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.327342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:03.328258 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2764/5486] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:02 2022] DELETE /identity/v3/projects/9009bdbd644c478eabee26b5944515bb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:03.329427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:03.361735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e7910-3e9d-49d7-8850-e06e7baae79c tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:03.437573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:03.439921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:03.521164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:03.595868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f3268f16bb4b8dad997612c27b0f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18252a4e80ca47fa815940ddffd32750', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:03.598111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:03.598654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:03.599647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] PATH_INFO: `/v3/projects/6d7e9e7fdfb5401dbf292d2fb9b474ac` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:03.602283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d7e9e7fdfb5401dbf292d2fb9b474ac)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:03.608920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:03.629974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec2bf5-6555-4ed9-9576-ea2114f81553 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:03.637564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:03.638593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:03.639056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:03.639508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:03.641760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:03.697330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7e9e7fdfb5401dbf292d2fb9b474ac', 'request_id': 'req-ada36760-c2e4-4838-9306-152d8ce327e8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.713215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7e9e7fdfb5401dbf292d2fb9b474ac', 'request_id': 'req-ada36760-c2e4-4838-9306-152d8ce327e8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.730938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7e9e7fdfb5401dbf292d2fb9b474ac', 'request_id': 'req-ada36760-c2e4-4838-9306-152d8ce327e8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.747308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] The token cache is being invalidate because project 6d7e9e7fdfb5401dbf292d2fb9b474ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:03.748000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.748871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:03.750918 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2723/5487] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:03 2022] DELETE /identity/v3/projects/6d7e9e7fdfb5401dbf292d2fb9b474ac => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:03.754736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:03.758633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:03.813482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:03.819499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92824c5d-53cb-43cb-b232-9c882c70516b service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:03.840683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2765/5488] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:38:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:38:03.953738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada36760-c2e4-4838-9306-152d8ce327e8 tempest-CredentialsTestJSON-777570449 tempest-CredentialsTestJSON-777570449-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:03.953738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:03.953738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:03.955632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:03.955632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] PATH_INFO: `/v3/users/bec0422edabb49538c36d3750ad6ff09` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:03.955632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec0422edabb49538c36d3750ad6ff09)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:03.955632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:04.088182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec0422edabb49538c36d3750ad6ff09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:04.128499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec0422edabb49538c36d3750ad6ff09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:04.134362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec0422edabb49538c36d3750ad6ff09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:04.143375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec0422edabb49538c36d3750ad6ff09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:04.180811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec0422edabb49538c36d3750ad6ff09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:04.185634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:04.245141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2724/5489] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:03 2022] DELETE /identity/v3/users/bec0422edabb49538c36d3750ad6ff09 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:04.249506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:04.249817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:04.250097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:04.313011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:04.314293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:04.453489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:04.514787 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2766/5490] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:04.524062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:04.525874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:04.679331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4d4e-5d31-44a6-b90c-353218bb6ac7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:04.683684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:04.684332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:04.684614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:04.684893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:04.709237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:04.711542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:04.753457 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2725/5491] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:38:05.921487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:05.923645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:05.948541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92233-c88e-4b70-a003-39fd75e0e3f1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:05.970907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:05.975914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:05.976358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:05.976661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] PATH_INFO: `/v3/projects/9067995b883b468db201a0bb190696e5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:05.984856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9067995b883b468db201a0bb190696e5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:05.987892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:06.175034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9067995b883b468db201a0bb190696e5', 'request_id': 'req-8fa94635-253f-47d2-bc81-53b3902f11c6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.200032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9067995b883b468db201a0bb190696e5', 'request_id': 'req-8fa94635-253f-47d2-bc81-53b3902f11c6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.217182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9067995b883b468db201a0bb190696e5', 'request_id': 'req-8fa94635-253f-47d2-bc81-53b3902f11c6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.245998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] The token cache is being invalidate because project 9067995b883b468db201a0bb190696e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:06.246398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.247630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.249532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2767/5492] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:05 2022] DELETE /identity/v3/projects/9067995b883b468db201a0bb190696e5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:06.253537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:06.270238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c33510-7c68-415e-8917-ebef870d8e43 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:06.477212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:06.477881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:06.478179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:06.478469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] PATH_INFO: `/v3/users/b6f3268f16bb4b8dad997612c27b0f7b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:06.480673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3268f16bb4b8dad997612c27b0f7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:06.489969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:06.658789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3268f16bb4b8dad997612c27b0f7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.680082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3268f16bb4b8dad997612c27b0f7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.680796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3268f16bb4b8dad997612c27b0f7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.681458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3268f16bb4b8dad997612c27b0f7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.692602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75b8fa00-ae82-49fd-8588-b43803083bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3268f16bb4b8dad997612c27b0f7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:06.737753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2726/5493] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:06 2022] DELETE /identity/v3/users/b6f3268f16bb4b8dad997612c27b0f7b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:07.937915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:07.940278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:08.013568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa94635-253f-47d2-bc81-53b3902f11c6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:08.143210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:08.143948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:08.144110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:08.145000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] PATH_INFO: `/v3/projects/18252a4e80ca47fa815940ddffd32750` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:08.148950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18252a4e80ca47fa815940ddffd32750)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:08.149838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:08.307701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18252a4e80ca47fa815940ddffd32750', 'request_id': 'req-55953a45-772c-40b3-883f-5f716869de36'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:08.319757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18252a4e80ca47fa815940ddffd32750', 'request_id': 'req-55953a45-772c-40b3-883f-5f716869de36'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:08.337175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18252a4e80ca47fa815940ddffd32750', 'request_id': 'req-55953a45-772c-40b3-883f-5f716869de36'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:08.340057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:08.374978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] The token cache is being invalidate because project 18252a4e80ca47fa815940ddffd32750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:08.375862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:08.378201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-55953a45-772c-40b3-883f-5f716869de36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:08.383634 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2768/5494] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:07 2022] DELETE /identity/v3/projects/18252a4e80ca47fa815940ddffd32750 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:08.388989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:08.389678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:08.389678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:08.401717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:08.437138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:08.438477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:08.599520 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2727/5495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:08.706051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:08.706413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:08.706648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:08.777031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:08.778555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:08.804059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2769/5496] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:08.808215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:08.831062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09979429-5847-4301-a31b-e872d21a5bf1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:08.857271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:08.862592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:08.863091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:08.867989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:08.869433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:08.869433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:08.879219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:08.937974 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2728/5497] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:08.939062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:08.963049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d8e2c-3775-4084-aa40-cd05a2f1a125 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:08.974382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:08.975133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:08.975430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:08.975836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:08.976509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:08.978610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:09.071278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:09.088167 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2770/5498] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:08 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:09.089928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee446e3-d64e-4285-98fd-bace8de13722 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:09.402252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:09.403504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:09.404382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:09.404654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:09.405310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:09.407309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:09.481630 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2729/5499] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:09 2022] POST /identity/v3/users => generated 284 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:09.483325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:09.501457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab331d28-3183-405a-a2e6-efa3e1cf3871 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:09.554617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:09.555260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:09.555545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:09.558320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:09.559021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:09.560709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:09.588637 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2771/5500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:09.590856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:09.608325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71efc7a-9828-4b98-8913-2f38f2119052 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:09.624342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5ab0-5f31-46e6-ae30-cf82a9edf4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:09.624986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5ab0-5f31-46e6-ae30-cf82a9edf4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:09.625257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5ab0-5f31-46e6-ae30-cf82a9edf4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:09.625788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5ab0-5f31-46e6-ae30-cf82a9edf4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:09.632169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a5ab0-5f31-46e6-ae30-cf82a9edf4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:09.633834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a5ab0-5f31-46e6-ae30-cf82a9edf4f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:09.664561 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2730/5501] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:09.667026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:09.680876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418108-4787-45f3-befe-ac3e879ef26e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:09.699579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:09.700455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:09.700748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:09.708208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] PATH_INFO: `/v3/projects/0369dccf4ea74b32a88991b3165111ff/users/feda09d0b71c4372bf0e88c498642f9f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:09.775886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0369dccf4ea74b32a88991b3165111ff, user_id=feda09d0b71c4372bf0e88c498642f9f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:09.785135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:09.848947 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2772/5502] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:09 2022] PUT /identity/v3/projects/0369dccf4ea74b32a88991b3165111ff/users/feda09d0b71c4372bf0e88c498642f9f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:09.859284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:09.859578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:09.859856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:09.961641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] MFA Rules not processed for user `feda09d0b71c4372bf0e88c498642f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:09.965601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:10.224055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:10.248426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:10.251941 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2731/5503] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:10.586058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dafa7-0fb5-4c75-9122-721a5e6cbcad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:10.602476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:10.603129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:10.603413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:10.603692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:10.604346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:10.620031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:10.740651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2773/5504] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:10 2022] POST /identity/v3/projects => generated 367 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:10.749545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:10.790411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0046e5-599e-4c1f-81e5-ac01839f8e7d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:11.003845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:11.004536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.004653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.004961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.009326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:11.013495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:11.070592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:11.070761 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2732/5505] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:10 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:11.087238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582a4ad-0dbc-4e07-93cd-7c92ebc4864f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:11.105054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:11.108292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.108578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.108856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.109536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:11.111190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:11.186680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2774/5506] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:11.200391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:11.217628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c056-418e-451b-840e-0fe7b55d5790 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:11.230214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:11.231733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.232712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.232954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] PATH_INFO: `/v3/projects/afdfaa69ef5649ffa8fc000ae5fb8d81/users/e3f874cffffc4ef196661903e41500ef/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.270088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdfaa69ef5649ffa8fc000ae5fb8d81, user_id=e3f874cffffc4ef196661903e41500ef, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:11.276979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:11.307100 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2733/5507] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:11 2022] PUT /identity/v3/projects/afdfaa69ef5649ffa8fc000ae5fb8d81/users/e3f874cffffc4ef196661903e41500ef/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:11.311171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:11.325026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9c8c-7ece-4651-833e-ee9ceaa1db1b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:11.448033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791962d6-0164-4d1a-962c-41516333a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:11.449637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791962d6-0164-4d1a-962c-41516333a516 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.450285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791962d6-0164-4d1a-962c-41516333a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.450783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791962d6-0164-4d1a-962c-41516333a516 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.467102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791962d6-0164-4d1a-962c-41516333a516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:11.479840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791962d6-0164-4d1a-962c-41516333a516 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:11.485185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:11.506404 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2775/5508] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:38:11.508737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:11.522918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f29fd-a424-4a0f-b6da-526748c487b4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:11.529604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:11.531185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.533603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.533998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] PATH_INFO: `/v3/projects/afdfaa69ef5649ffa8fc000ae5fb8d81/users/e3f874cffffc4ef196661903e41500ef/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.551612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdfaa69ef5649ffa8fc000ae5fb8d81, user_id=e3f874cffffc4ef196661903e41500ef, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:11.551612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:11.576600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2734/5509] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:11 2022] PUT /identity/v3/projects/afdfaa69ef5649ffa8fc000ae5fb8d81/users/e3f874cffffc4ef196661903e41500ef/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:11.579045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.579344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.579621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.630767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] MFA Rules not processed for user `e3f874cffffc4ef196661903e41500ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:11.642675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:11.808702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2776/5510] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:11.812959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:11.830965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a2442-64e3-4bea-a333-12381fd6db94 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:11.842870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:11.843869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:11.844510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:11.844989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:11.845877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:11.849306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:11.924021 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2735/5511] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:38:11 2022] POST /identity/v3/domains => generated 276 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:11.927459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:11.946552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a152-01fe-4f09-8a94-9c3c2f51d4fe None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.158921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.159567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.159859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.160140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.160803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.166755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.314970 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2777/5512] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:11 2022] POST /identity/v3/users => generated 346 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:12.317183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.334908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b88c75-3f9c-4f0a-83e3-898b6aeb315d tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.350346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.350981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.351328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.351670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.352576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.354466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.410921 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2736/5513] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:12 2022] POST /identity/v3/users => generated 323 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:12.413807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.429598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73b2a-ad0b-45d5-ab58-4805fe0861b3 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.440722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.441381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.441885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.442339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users/57dd8f46e47547f7b6712dce48a15fcd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.477451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:get_user(user_id=57dd8f46e47547f7b6712dce48a15fcd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.480042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.482055 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2778/5514] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:38:12 2022] GET /identity/v3/users/57dd8f46e47547f7b6712dce48a15fcd => generated 346 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:38:12.487577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.510617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f242bf-fd2f-42f3-92c4-dcd3aed67a17 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.518830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.519822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.520259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.520688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.521603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Adding query filter params (domain_id=5b56abfd4183466e919763370e0c07ac) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:12.522079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.523504 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:12.523504 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:38:12.523504 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:38:12.525084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.560766 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2737/5515] 10.222.0.23 () {58 vars in 1207 bytes} [Mon Oct 31 05:38:12 2022] GET /identity/v3/users?domain_id=5b56abfd4183466e919763370e0c07ac => generated 483 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:12.565749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.585206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ba0f-729d-4afa-98e2-60bc5f069d55 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.590766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.591591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.592057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.592485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.593307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.596266 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:12.596266 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:38:12.596266 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:38:12.597779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.721763 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2779/5516] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:12 2022] GET /identity/v3/users => generated 9458 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:12.728602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.744793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf364f-87c7-4087-b52b-d82b94c2314a tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.758868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.759687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.760127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.760547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.761411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Adding query filter params (name=tempest-test_user-55076794) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:12.761854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.763905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.815581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.822339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2738/5517] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 31 05:38:12 2022] GET /identity/v3/users?name=tempest-test_user-55076794 => generated 472 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:12.827767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa050c-7237-4668-baaa-b20c068817dc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.837365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.838295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.838831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.839327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:12.840273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:12.840780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:12.843199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:12.885687 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2780/5518] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 31 05:38:12 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:38:12.886364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:12.942814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b905f1-9346-4c10-ba97-cc91e1dc914e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:12.967792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:12.968531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:12.968850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:12.969160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users/5fec6e1d7332436f8ccc5c25752887b2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:13.008548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5fec6e1d7332436f8ccc5c25752887b2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:13.010740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:13.120101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:INSERT=9,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:13.129983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fec6e1d7332436f8ccc5c25752887b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.149812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fec6e1d7332436f8ccc5c25752887b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.150124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fec6e1d7332436f8ccc5c25752887b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.150885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fec6e1d7332436f8ccc5c25752887b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.164823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fec6e1d7332436f8ccc5c25752887b2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.201391 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2739/5519] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:12 2022] DELETE /identity/v3/users/5fec6e1d7332436f8ccc5c25752887b2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:13.207219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:13.209951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:13.245550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dea1d-29ab-4dff-8970-f3af63987054 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:13.338970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:13.491550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:13.492228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:13.492512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:13.492788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/users/57dd8f46e47547f7b6712dce48a15fcd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:13.511521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:delete_user(user_id=57dd8f46e47547f7b6712dce48a15fcd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:13.514281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:13.702277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57dd8f46e47547f7b6712dce48a15fcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.743553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57dd8f46e47547f7b6712dce48a15fcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.748014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57dd8f46e47547f7b6712dce48a15fcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.749743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57dd8f46e47547f7b6712dce48a15fcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.784652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57dd8f46e47547f7b6712dce48a15fcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:13.826924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:13.827477 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2781/5520] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:13 2022] DELETE /identity/v3/users/57dd8f46e47547f7b6712dce48a15fcd => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:13.841292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328d05-d684-420f-9013-caa712dc50fc tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:13.994567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:13.995243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:13.995533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:13.995816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/domains/5b56abfd4183466e919763370e0c07ac` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:14.002020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5b56abfd4183466e919763370e0c07ac)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:14.004812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:14.050816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5b56abfd4183466e919763370e0c07ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.052338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5b56abfd4183466e919763370e0c07ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.109034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5b56abfd4183466e919763370e0c07ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.115878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5b56abfd4183466e919763370e0c07ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.116958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2740/5521] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:38:13 2022] PATCH /identity/v3/domains/5b56abfd4183466e919763370e0c07ac => generated 277 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:38:14.122008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:14.124147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:14.154382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91de4-81ab-4641-b73e-46ab7071d8e8 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:14.277323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3f874cffffc4ef196661903e41500ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:14.277990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:14.278320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:14.278598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] PATH_INFO: `/v3/domains/5b56abfd4183466e919763370e0c07ac` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:14.306324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5b56abfd4183466e919763370e0c07ac)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:14.308165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:14.399012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5b56abfd4183466e919763370e0c07ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.403351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5b56abfd4183466e919763370e0c07ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.446865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:14.538259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b56abfd4183466e919763370e0c07ac', 'request_id': 'req-bf55159f-9423-4587-8529-98744a8e033e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.551861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b56abfd4183466e919763370e0c07ac', 'request_id': 'req-bf55159f-9423-4587-8529-98744a8e033e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.571695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b56abfd4183466e919763370e0c07ac', 'request_id': 'req-bf55159f-9423-4587-8529-98744a8e033e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.603795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] The token cache is being invalidate because project 5b56abfd4183466e919763370e0c07ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:14.604370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.605651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.618825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5b56abfd4183466e919763370e0c07ac', 'request_id': 'req-bf55159f-9423-4587-8529-98744a8e033e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.623231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5b56abfd4183466e919763370e0c07ac', 'request_id': 'req-bf55159f-9423-4587-8529-98744a8e033e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.624206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf55159f-9423-4587-8529-98744a8e033e tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5b56abfd4183466e919763370e0c07ac', 'request_id': 'req-bf55159f-9423-4587-8529-98744a8e033e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:14.633391 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2782/5522] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:38:14 2022] DELETE /identity/v3/domains/5b56abfd4183466e919763370e0c07ac => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:14.643678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:14.647833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:14.774606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd528e-42f0-4908-86b2-f4fb16b78f35 tempest-UsersV3TestJSON-1291179051 tempest-UsersV3TestJSON-1291179051-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:14.815031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:14.886272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:14.886912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:14.887206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:14.887479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] PATH_INFO: `/v3/users/feda09d0b71c4372bf0e88c498642f9f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:14.891808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feda09d0b71c4372bf0e88c498642f9f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:14.894983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:15.065553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feda09d0b71c4372bf0e88c498642f9f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:15.081679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feda09d0b71c4372bf0e88c498642f9f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:15.081679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feda09d0b71c4372bf0e88c498642f9f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:15.082557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feda09d0b71c4372bf0e88c498642f9f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:15.106490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feda09d0b71c4372bf0e88c498642f9f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:15.150195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2741/5523] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:14 2022] DELETE /identity/v3/users/feda09d0b71c4372bf0e88c498642f9f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:15.153277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:15.153571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:15.153846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:15.204379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:15.205639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:15.409956 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2783/5524] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:15.421502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:15.425478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:15.532857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d304d-5b21-4434-b887-1a827eec3f79 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:15.536582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:15.537880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:15.538318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:15.538596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:15.552300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:15.553863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:15.565730 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2742/5525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:38:16.133947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:16.135571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:16.173514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49ae20-6809-42a1-b457-b19e3b5b03b8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:16.216783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:16.217605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:16.217894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:16.218273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] PATH_INFO: `/v3/projects/0369dccf4ea74b32a88991b3165111ff` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:16.220994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0369dccf4ea74b32a88991b3165111ff)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:16.228803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:16.389935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0369dccf4ea74b32a88991b3165111ff', 'request_id': 'req-a82428a2-d24f-41f5-936b-bf4a9f97e93c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.403499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0369dccf4ea74b32a88991b3165111ff', 'request_id': 'req-a82428a2-d24f-41f5-936b-bf4a9f97e93c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.419141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0369dccf4ea74b32a88991b3165111ff', 'request_id': 'req-a82428a2-d24f-41f5-936b-bf4a9f97e93c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.440972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] The token cache is being invalidate because project 0369dccf4ea74b32a88991b3165111ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:16.441573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.442486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.447902 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2784/5526] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:16 2022] DELETE /identity/v3/projects/0369dccf4ea74b32a88991b3165111ff => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:16.451857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:16.476811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe567-280c-4e29-acf8-1198460158f6 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:16.604143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:16.623580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:16.626091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:16.629444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:16.629896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] PATH_INFO: `/v3/users/e3f874cffffc4ef196661903e41500ef` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:16.631916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f874cffffc4ef196661903e41500ef)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:16.637970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:16.737405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f874cffffc4ef196661903e41500ef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.761909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f874cffffc4ef196661903e41500ef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.762711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f874cffffc4ef196661903e41500ef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.764104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f874cffffc4ef196661903e41500ef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.783421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e2727033-5171-4b24-a76b-71dd1bd093b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f874cffffc4ef196661903e41500ef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:16.826272 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2743/5527] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:16 2022] DELETE /identity/v3/users/e3f874cffffc4ef196661903e41500ef => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:17.534647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:17.536120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:17.576918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82428a2-d24f-41f5-936b-bf4a9f97e93c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:17.590108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:17.738239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:17.739188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:17.739621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:17.740042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] PATH_INFO: `/v3/projects/afdfaa69ef5649ffa8fc000ae5fb8d81` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:17.742051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdfaa69ef5649ffa8fc000ae5fb8d81)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:17.744187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:17.857232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'request_id': 'req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:17.874860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'request_id': 'req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:17.885512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdfaa69ef5649ffa8fc000ae5fb8d81', 'request_id': 'req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:17.906662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] The token cache is being invalidate because project afdfaa69ef5649ffa8fc000ae5fb8d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:17.907789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:17.910521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eeb585b0-070d-4828-a7b4-cce59fa8a5e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:17.913060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2785/5528] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:17 2022] DELETE /identity/v3/projects/afdfaa69ef5649ffa8fc000ae5fb8d81 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:17.918421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:17.918901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:17.918991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:17.973252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:17.980174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:18.145419 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2744/5529] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:18.154682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.155176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.155624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.203994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:18.205666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:18.251590 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2786/5530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:18.253916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:18.268916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c06b5-123f-466d-b82c-c6b054ab5ac3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:18.291144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:18.291729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.297240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.297628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.301023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:18.301366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:18.345628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:18.374754 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2745/5531] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:18.375944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:18.388175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0090565-91ac-43c3-96d0-d2c38fc594f6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:18.403586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:18.404666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.404666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.404835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.405413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:18.407475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:18.466660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2787/5532] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:18.467758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:18.488281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea63e-3678-4449-b93c-a597cca10cf9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:18.630943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:18.642098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:18.644228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.645305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.645753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.646661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:18.649474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:18.697394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:18.698077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2746/5533] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:18 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:18.724533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7b5e7-214f-46b0-82bd-659ebf9d35a5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:18.733223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:18.734256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.734804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.736080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.738679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:18.741515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:18.758757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:18.769720 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2788/5534] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:18.778670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd65d1-1344-40c1-8776-6fbe37954255 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:18.786450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d411c6-9fee-4550-b32a-1e15c25d2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:18.787928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d411c6-9fee-4550-b32a-1e15c25d2f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.789728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d411c6-9fee-4550-b32a-1e15c25d2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.790423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d411c6-9fee-4550-b32a-1e15c25d2f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.791438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d411c6-9fee-4550-b32a-1e15c25d2f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:18.793371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d411c6-9fee-4550-b32a-1e15c25d2f37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:18.822031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2747/5535] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:38:18.824642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:18.871002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba64ea-ac39-4785-8ec6-828d7b8a4c7f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:18.886831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:18.888736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.889226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.889732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] PATH_INFO: `/v3/projects/c3001d86bb5343909954f38bf2ba20f8/users/314ed9d80ca84a11abce621ee6c685b6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.913943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3001d86bb5343909954f38bf2ba20f8, user_id=314ed9d80ca84a11abce621ee6c685b6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:18.918908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:18.946453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2789/5536] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:18 2022] PUT /identity/v3/projects/c3001d86bb5343909954f38bf2ba20f8/users/314ed9d80ca84a11abce621ee6c685b6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:18.957858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:18.958391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:18.958466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:18.998912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] MFA Rules not processed for user `314ed9d80ca84a11abce621ee6c685b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:19.001117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:19.135499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:19.140154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2748/5537] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:19.178901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:19.226706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ab307-2c6b-4fd4-9fb1-cb7cdae30564 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:19.232887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:19.233661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.234200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.234581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.235319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:19.237328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:19.282948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:19.285183 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2790/5538] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:19 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:19.309962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee615ec-5f8a-4a18-b89a-a92758562839 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:19.479067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:19.479716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.480002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.480281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.480944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:19.482887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:19.533336 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2749/5539] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:19 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:19.538201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:19.561098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ad6f-e043-490e-b32a-9c900f1f6cbc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:19.581833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:19.591472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.591869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.592157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.592855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:19.594566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:19.621550 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2791/5540] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:19.623578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:19.642033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccc1b-724b-4d15-a9aa-7dc32a8a9e81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:19.648025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:19.648715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.648998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.649277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] PATH_INFO: `/v3/projects/4eef18053d724d698e4da722bbe53a75/users/cc6e896c3f934bba9311461ed2760057/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.670246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eef18053d724d698e4da722bbe53a75, user_id=cc6e896c3f934bba9311461ed2760057, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:19.670246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:19.690104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2750/5541] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:19 2022] PUT /identity/v3/projects/4eef18053d724d698e4da722bbe53a75/users/cc6e896c3f934bba9311461ed2760057/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:19.694072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:19.717513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d7d0c-0bc7-48f4-941c-7452fe286329 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:19.800685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65b90-47f8-46a1-8fc3-68433fd8738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:19.801617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65b90-47f8-46a1-8fc3-68433fd8738f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.802198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65b90-47f8-46a1-8fc3-68433fd8738f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.803612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65b90-47f8-46a1-8fc3-68433fd8738f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.804663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b65b90-47f8-46a1-8fc3-68433fd8738f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:19.806777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b65b90-47f8-46a1-8fc3-68433fd8738f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:19.820871 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2792/5542] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:19.824523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:19.844267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb246392-68c0-4ea7-9f71-e1fec913b4f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:19.854495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:19.855324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.856123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.856511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] PATH_INFO: `/v3/projects/4eef18053d724d698e4da722bbe53a75/users/cc6e896c3f934bba9311461ed2760057/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.858790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eef18053d724d698e4da722bbe53a75, user_id=cc6e896c3f934bba9311461ed2760057, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:19.861909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:19.893593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2751/5543] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:19 2022] PUT /identity/v3/projects/4eef18053d724d698e4da722bbe53a75/users/cc6e896c3f934bba9311461ed2760057/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:19.899934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:19.900232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:19.900509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:19.937338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] MFA Rules not processed for user `cc6e896c3f934bba9311461ed2760057`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:19.939119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:20.123547 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2793/5544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:20.124706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.139623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c0f8-29a5-4ee9-baa4-f413de1bad8f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.172740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.173875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.174560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.175177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.176509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.181079 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:20.181079 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:38:20.181079 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:38:20.184186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.244778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.246041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2752/5545] 10.222.0.23 () {60 vars in 1185 bytes} [Mon Oct 31 05:38:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:20.263466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a6ed9-8721-4238-8599-fd82b1bd655b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.269980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.270792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.271071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.271373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4dece04fe64f49ad9eb2b9561a403102` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.273073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4dece04fe64f49ad9eb2b9561a403102)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.274085 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:20.274085 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:38:20.274085 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:38:20.275023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.295541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2794/5546] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:38:20 2022] GET /identity/v3/OS-OAUTH1/consumers/4dece04fe64f49ad9eb2b9561a403102 => generated 221 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:38:20.300274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.307174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:20.312857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585120e-fe65-4d7d-a166-87a9120a880d tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.320546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.321882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.322345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.322879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4dece04fe64f49ad9eb2b9561a403102` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.324309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4dece04fe64f49ad9eb2b9561a403102)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.325484 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:20.325484 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:38:20.325484 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:38:20.326711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.327155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invalidating token cache because consumer 4dece04fe64f49ad9eb2b9561a403102 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:20.327494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.328192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.355967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4dece04fe64f49ad9eb2b9561a403102', 'request_id': 'req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.376693 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2753/5547] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:38:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4dece04fe64f49ad9eb2b9561a403102 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:20.382197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.384071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:20.414378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d99869-23ff-456f-a4f0-69092876b021 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.422524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.423153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.423437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.423716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.424378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.425385 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:20.425385 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:38:20.425385 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:38:20.426307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.463141 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2795/5548] 10.222.0.23 () {60 vars in 1185 bytes} [Mon Oct 31 05:38:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:20.467252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.486021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf268c-ccdc-4043-9083-1a9f6d92d0eb tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.492305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.492957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.493245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.493520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.494114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=54242012a7604a9083fcbfd6d082c53e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.495139 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:20.495139 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:38:20.495139 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:38:20.501660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.517415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.518364 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2754/5549] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:38:20 2022] GET /identity/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e => generated 220 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:20.538190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb2bce-00dd-46ed-9b12-420966606aa5 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.544731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.545615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.546050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.546516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.547263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=54242012a7604a9083fcbfd6d082c53e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.548435 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:20.548435 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:38:20.548435 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:38:20.549629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.550047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invalidating token cache because consumer 54242012a7604a9083fcbfd6d082c53e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:20.550508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.551330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.555187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:20.580460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '54242012a7604a9083fcbfd6d082c53e', 'request_id': 'req-8b0661b7-5840-4a37-a8c3-735ecec960da'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.623016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2796/5550] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:38:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:20.634907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.641040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:20.657124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c84b11-4a63-48c5-897e-bc4933b3cffa tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.667005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.667711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.668129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.668129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.668869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=54242012a7604a9083fcbfd6d082c53e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.670371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 31 05:38:20.696392 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 31 05:38:20.697434 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:38:20.702688 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2755/5551] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:38:20 2022] GET /identity/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e => generated 74 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:38:20.703532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.727130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0661b7-5840-4a37-a8c3-735ecec960da tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.779713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.780535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.780939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.781317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.782010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=54242012a7604a9083fcbfd6d082c53e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.783919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.784292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invalidating token cache because consumer 54242012a7604a9083fcbfd6d082c53e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:20.784800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.785619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 31 05:38:20.857255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 31 05:38:20.858506 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:38:20.866697 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2797/5552] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:38:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/54242012a7604a9083fcbfd6d082c53e => generated 74 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:38:20.867986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.870651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:20.899031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def086f-7fb0-4a27-8f5b-593f679ea7ce tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.913808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.914560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.914842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.915111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.915766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.917560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:20.945314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2756/5553] 10.222.0.23 () {60 vars in 1185 bytes} [Mon Oct 31 05:38:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:20.949602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:20.965648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a7a8-e9e9-43a4-a312-90855d4ca656 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:20.974139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:20.977717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:20.978016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:20.978363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:20.979044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:20.980891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.005709 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2798/5554] 10.222.0.23 () {60 vars in 1185 bytes} [Mon Oct 31 05:38:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:21.009903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.023311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4cd3-4e5c-4555-8a4e-78a941f488bc tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.040481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.041136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.041420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.041695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.050076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.051209 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:21.051209 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:38:21.051209 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:38:21.052124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.059090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2757/5555] 10.222.0.23 () {58 vars in 1164 bytes} [Mon Oct 31 05:38:21 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:21.063070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.079464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520007ab-9227-4f6e-aad2-89b310201874 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.086132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.086866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.087153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.087481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c2133e32dda644dfad494331675a0334` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.088018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c2133e32dda644dfad494331675a0334)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.089949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.090769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invalidating token cache because consumer c2133e32dda644dfad494331675a0334 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:21.091070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.091839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.119345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c2133e32dda644dfad494331675a0334', 'request_id': 'req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.145372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2799/5556] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:38:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c2133e32dda644dfad494331675a0334 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:21.150504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.152320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:21.177324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60c0b3-5e13-42b6-bc6a-c02b865d5ca7 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.193586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.197652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.197945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.198248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f2fe8b93499647518c6d9ea352ac5d75` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.198867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f2fe8b93499647518c6d9ea352ac5d75)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.200961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.201239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invalidating token cache because consumer f2fe8b93499647518c6d9ea352ac5d75 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:21.201526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.202306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.228236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f2fe8b93499647518c6d9ea352ac5d75', 'request_id': 'req-57eaaa14-a288-41da-bfc7-7d21a0b448ef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.254434 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2758/5557] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:38:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f2fe8b93499647518c6d9ea352ac5d75 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:21.255908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.281889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3651-9b5b-4fda-ab58-76a4d34f137c tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.290539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.291166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.291555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.291843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.292772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.294999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.323602 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2800/5558] 10.222.0.23 () {60 vars in 1185 bytes} [Mon Oct 31 05:38:21 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:21.327543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.329919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:21.399425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaaa14-a288-41da-bfc7-7d21a0b448ef tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.406495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.407341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.407804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.408094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e2cb0291b1284f448d07e62e383fe748` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.408794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=e2cb0291b1284f448d07e62e383fe748)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.409921 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:38:21.409921 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:38:21.409921 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:38:21.410978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.435010 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2759/5559] 10.222.0.23 () {60 vars in 1285 bytes} [Mon Oct 31 05:38:21 2022] PATCH /identity/v3/OS-OAUTH1/consumers/e2cb0291b1284f448d07e62e383fe748 => generated 221 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:21.439391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.464814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681980-7b2e-4cee-aaee-5952c05d20c1 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.478525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.479443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.479952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.480427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e2cb0291b1284f448d07e62e383fe748` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.481251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e2cb0291b1284f448d07e62e383fe748)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.484673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.494200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2801/5560] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:38:21 2022] GET /identity/v3/OS-OAUTH1/consumers/e2cb0291b1284f448d07e62e383fe748 => generated 221 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:21.539112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.566891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5d29e-3a7b-46b0-89d3-3ffbe0cb0334 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.573913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6e896c3f934bba9311461ed2760057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eef18053d724d698e4da722bbe53a75', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.574798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.575244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.575685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e2cb0291b1284f448d07e62e383fe748` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.576442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e2cb0291b1284f448d07e62e383fe748)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.578328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.578752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invalidating token cache because consumer e2cb0291b1284f448d07e62e383fe748 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:21.579193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.580352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.668837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1b39197-1347-4bf3-b07e-c50bd2bca08e tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e2cb0291b1284f448d07e62e383fe748', 'request_id': 'req-a1b39197-1347-4bf3-b07e-c50bd2bca08e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.693086 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2760/5561] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 31 05:38:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e2cb0291b1284f448d07e62e383fe748 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:21.694993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:21.697112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:21.777907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ac2ed-dea4-447e-b31e-88f188a572a8 tempest-OAUTHConsumersV3Test-1117097027 tempest-OAUTHConsumersV3Test-1117097027-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:21.786296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:21.787129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.787666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.787994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] PATH_INFO: `/v3/users/314ed9d80ca84a11abce621ee6c685b6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.789945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314ed9d80ca84a11abce621ee6c685b6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:21.792601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:21.879782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314ed9d80ca84a11abce621ee6c685b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.908802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314ed9d80ca84a11abce621ee6c685b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.909879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314ed9d80ca84a11abce621ee6c685b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.910541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314ed9d80ca84a11abce621ee6c685b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.913667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:21.919881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314ed9d80ca84a11abce621ee6c685b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:21.954498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:21.954814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:21.955099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:21.958140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2802/5562] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:21 2022] DELETE /identity/v3/users/314ed9d80ca84a11abce621ee6c685b6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:21.993708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:21.995205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:22.127643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2761/5563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:22.138614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:22.140095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:22.278932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e9fed-187d-4e87-8db4-f47ff639f517 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:22.291016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:22.291738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:22.292208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:22.292686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:22.313711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:22.319475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:22.372445 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2803/5564] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:38:22.903701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:22.905162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:22.986848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ae2f9-dde8-45e9-87ee-5d81c1fc11bb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:23.001251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:23.001925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:23.002232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:23.002511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] PATH_INFO: `/v3/projects/c3001d86bb5343909954f38bf2ba20f8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:23.003743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3001d86bb5343909954f38bf2ba20f8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:23.006189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:23.067686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:23.127304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3001d86bb5343909954f38bf2ba20f8', 'request_id': 'req-840adef4-1bcd-48af-aed2-46fe4fee6363'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.135200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3001d86bb5343909954f38bf2ba20f8', 'request_id': 'req-840adef4-1bcd-48af-aed2-46fe4fee6363'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.147910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3001d86bb5343909954f38bf2ba20f8', 'request_id': 'req-840adef4-1bcd-48af-aed2-46fe4fee6363'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.181057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] The token cache is being invalidate because project c3001d86bb5343909954f38bf2ba20f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:23.181605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.182346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.183958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2762/5565] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:22 2022] DELETE /identity/v3/projects/c3001d86bb5343909954f38bf2ba20f8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:23.189444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:23.202480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe4dd3-0af4-45e9-b505-132a6ce7ddda service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:23.280309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:23.281295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:23.281637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:23.282209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] PATH_INFO: `/v3/users/cc6e896c3f934bba9311461ed2760057` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:23.283393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6e896c3f934bba9311461ed2760057)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:23.287171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:23.361887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6e896c3f934bba9311461ed2760057'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.385818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6e896c3f934bba9311461ed2760057'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.387098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6e896c3f934bba9311461ed2760057'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.388039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6e896c3f934bba9311461ed2760057'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.400093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c10278c7-f1a4-4403-a364-251e3b26b13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6e896c3f934bba9311461ed2760057'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:23.416833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:23.429302 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2804/5566] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:23 2022] DELETE /identity/v3/users/cc6e896c3f934bba9311461ed2760057 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:24.044668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.048140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:24.086763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840adef4-1bcd-48af-aed2-46fe4fee6363 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.152676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.153775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.154207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.154588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] PATH_INFO: `/v3/projects/4eef18053d724d698e4da722bbe53a75` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.155829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eef18053d724d698e4da722bbe53a75)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.157837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.215950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eef18053d724d698e4da722bbe53a75', 'request_id': 'req-01ebbf21-093f-4c5e-896f-228859770153'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:24.222121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eef18053d724d698e4da722bbe53a75', 'request_id': 'req-01ebbf21-093f-4c5e-896f-228859770153'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:24.232347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eef18053d724d698e4da722bbe53a75', 'request_id': 'req-01ebbf21-093f-4c5e-896f-228859770153'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:24.273906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] The token cache is being invalidate because project 4eef18053d724d698e4da722bbe53a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:24.274485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:24.279126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01ebbf21-093f-4c5e-896f-228859770153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:24.280906 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2763/5567] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:24 2022] DELETE /identity/v3/projects/4eef18053d724d698e4da722bbe53a75 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:24.290390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.290390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.290390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.324074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:24.326067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:24.414433 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2805/5568] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:38:24.417590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.417883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.418181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.440702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:24.443839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:24.455704 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2764/5569] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:24.459886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.479581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8720a-bc85-4f0a-ab0c-271e0df1aba5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.485182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.485935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.486447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.486832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.487781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:24.488189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.490278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.508828 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2806/5570] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:24.509526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.519986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34443db1-d29d-4a51-b572-4eaea180611e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.526241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.527153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.527714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.528135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.529097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.533161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.592301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2765/5571] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:24 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:24.596140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.610317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2dd788-40fb-4581-a911-3fe9a113e0b5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.691461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.692186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.692570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.692943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.694499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.697368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.735356 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2807/5572] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:24 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:24.737543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.769592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a7e6-ff91-4aa0-8f15-72b22ae140f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.775721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.776508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.776871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.777210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.777893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.779878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.781757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:24.801282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2766/5573] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:24.802243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.813931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc9d7-97cc-417d-aa06-91799e5a4342 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.819884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8ca7-6914-44e8-9b3e-2639c2e0bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.820695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8ca7-6914-44e8-9b3e-2639c2e0bccc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.820965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8ca7-6914-44e8-9b3e-2639c2e0bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.821244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8ca7-6914-44e8-9b3e-2639c2e0bccc admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.821897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b8ca7-6914-44e8-9b3e-2639c2e0bccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.823600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b8ca7-6914-44e8-9b3e-2639c2e0bccc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.837861 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2808/5574] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:24.841990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:24.857302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecaff4-1915-40ff-a9fd-86cc8b1e20b9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:24.871792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:24.872692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.873117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.873410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] PATH_INFO: `/v3/projects/c306f04a280f423abb8f3a46c6b9c884/users/d90e077d6f034980a988f5b08035a19c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.895714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c306f04a280f423abb8f3a46c6b9c884, user_id=d90e077d6f034980a988f5b08035a19c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:24.898437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:24.914787 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2767/5575] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:24 2022] PUT /identity/v3/projects/c306f04a280f423abb8f3a46c6b9c884/users/d90e077d6f034980a988f5b08035a19c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:24.925057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:24.925502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:24.925883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:24.965628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] MFA Rules not processed for user `d90e077d6f034980a988f5b08035a19c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:24.966925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:25.058285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:25.075442 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2809/5576] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:38:25.076421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.167194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf78aff-e578-43c7-9305-bf47f264af32 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.172750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.173523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.174085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.174290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.175084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.178398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.210430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2768/5577] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:25.214687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.226234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d553c2-816d-4eb2-87a0-42544fb172ca None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.305369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.306267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.306631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.307009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.308030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.310114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.337812 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2810/5578] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:25 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:25.338625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.351441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192033-7940-4ae0-8350-e58e42fae6bc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.356104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.356729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.357008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.357288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.357934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.359735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.375368 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2769/5579] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:38:25.379363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.393905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3461f-e6b1-4597-af1f-73520c776ec5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.399283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.399951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.400250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.400632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] PATH_INFO: `/v3/projects/d406219471134951b92b914f41b57fbf/users/8c83605f35d84dbfb950309d1e2bc301/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.419057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d406219471134951b92b914f41b57fbf, user_id=8c83605f35d84dbfb950309d1e2bc301, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.421759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.447751 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2811/5580] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:25 2022] PUT /identity/v3/projects/d406219471134951b92b914f41b57fbf/users/8c83605f35d84dbfb950309d1e2bc301/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:25.451533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.462484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ce91-2c97-4053-85b7-a22a30571725 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.528135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4227947-7fb6-4c1e-b501-ac24f5fb5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.528838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4227947-7fb6-4c1e-b501-ac24f5fb5f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.529191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4227947-7fb6-4c1e-b501-ac24f5fb5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.529670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4227947-7fb6-4c1e-b501-ac24f5fb5f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.530529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4227947-7fb6-4c1e-b501-ac24f5fb5f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.532323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4227947-7fb6-4c1e-b501-ac24f5fb5f62 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.547297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2770/5581] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:25.547993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.559784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdaea2-681b-49bc-b1b2-2cc780e09a82 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.564450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.565226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.565505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.565774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] PATH_INFO: `/v3/projects/d406219471134951b92b914f41b57fbf/users/8c83605f35d84dbfb950309d1e2bc301/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.567716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d406219471134951b92b914f41b57fbf, user_id=8c83605f35d84dbfb950309d1e2bc301, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.571529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.582903 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2812/5582] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:25 2022] PUT /identity/v3/projects/d406219471134951b92b914f41b57fbf/users/8c83605f35d84dbfb950309d1e2bc301/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:25.595022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.595643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.595931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.631321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] MFA Rules not processed for user `8c83605f35d84dbfb950309d1e2bc301`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:25.632565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:25.665309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:25.720156 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2771/5583] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:25.726011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.738667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13ba9-5f38-4d40-9467-377c5ce4f3d2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.744088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c83605f35d84dbfb950309d1e2bc301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd406219471134951b92b914f41b57fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.744725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.745010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.745313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.745953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.747865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:25.806240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2813/5584] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:25 2022] POST /identity/v3/projects => generated 358 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:25.810621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:25.873294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a161-b93d-468b-9680-cfe0231887fd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:25.941798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90e077d6f034980a988f5b08035a19c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c306f04a280f423abb8f3a46c6b9c884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:25.942538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:25.942854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:25.943659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] PATH_INFO: `/v3/projects/ab631ee7a08e40e2938981e303d522bf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:25.944843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] RBAC: Authorizing `identity:delete_project(project_id=ab631ee7a08e40e2938981e303d522bf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 31 05:38:25.967067 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 31 05:38:25.968142 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:38:25.968669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2772/5585] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:25 2022] DELETE /identity/v3/projects/ab631ee7a08e40e2938981e303d522bf => generated 136 bytes in 158 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:38:25.972843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:26.054061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a25a4-0913-41cf-8d95-7e102070986f tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:26.059670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c83605f35d84dbfb950309d1e2bc301', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd406219471134951b92b914f41b57fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:26.060326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:26.060631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:26.060940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] PATH_INFO: `/v3/projects/ab631ee7a08e40e2938981e303d522bf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:26.062284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab631ee7a08e40e2938981e303d522bf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:26.064522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:26.109151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:26.131858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab631ee7a08e40e2938981e303d522bf', 'request_id': 'req-b2e61933-2b6b-40f1-8126-55200b8745d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.139606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab631ee7a08e40e2938981e303d522bf', 'request_id': 'req-b2e61933-2b6b-40f1-8126-55200b8745d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.149189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab631ee7a08e40e2938981e303d522bf', 'request_id': 'req-b2e61933-2b6b-40f1-8126-55200b8745d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.166172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] The token cache is being invalidate because project ab631ee7a08e40e2938981e303d522bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:26.166702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.167831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b2e61933-2b6b-40f1-8126-55200b8745d8 tempest-ProjectsNegativeTestJSON-239926226 tempest-ProjectsNegativeTestJSON-239926226-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.174505 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2814/5586] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:25 2022] DELETE /identity/v3/projects/ab631ee7a08e40e2938981e303d522bf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:26.175075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:26.177110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:26.329435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f01c-9948-4440-9b1c-95483d6fb699 tempest-ProjectsNegativeTestJSON-327214355 tempest-ProjectsNegativeTestJSON-327214355-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:26.390523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:26.449742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:26.450623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:26.451113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:26.451400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] PATH_INFO: `/v3/users/d90e077d6f034980a988f5b08035a19c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:26.452683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90e077d6f034980a988f5b08035a19c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:26.457301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:26.526067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90e077d6f034980a988f5b08035a19c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.534786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90e077d6f034980a988f5b08035a19c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.535804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90e077d6f034980a988f5b08035a19c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.538691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90e077d6f034980a988f5b08035a19c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.549094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90e077d6f034980a988f5b08035a19c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:26.574247 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2773/5587] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:26 2022] DELETE /identity/v3/users/d90e077d6f034980a988f5b08035a19c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:26.576864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:26.577919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:26.578613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:26.603631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:26.605390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:26.687307 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2815/5588] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:26.698197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:26.699663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:26.792195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41459d-fc9a-40d4-8e51-48f7a48ec1cc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:26.796172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:26.797003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:26.797298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:26.797581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:26.808051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:26.809511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:26.820529 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2774/5589] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:38:27.227942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:27.229601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:27.244931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdb674-1203-4f6b-b61c-bd1b73d095f7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:27.250426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:27.251534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:27.254504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:27.254812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] PATH_INFO: `/v3/projects/c306f04a280f423abb8f3a46c6b9c884` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:27.256262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c306f04a280f423abb8f3a46c6b9c884)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:27.262382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:27.342354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c306f04a280f423abb8f3a46c6b9c884', 'request_id': 'req-65095c3c-bf8a-4b3f-86fc-0f3445c71566'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.352107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c306f04a280f423abb8f3a46c6b9c884', 'request_id': 'req-65095c3c-bf8a-4b3f-86fc-0f3445c71566'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.359738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c306f04a280f423abb8f3a46c6b9c884', 'request_id': 'req-65095c3c-bf8a-4b3f-86fc-0f3445c71566'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.404444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] The token cache is being invalidate because project c306f04a280f423abb8f3a46c6b9c884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:27.405063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.409734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.416018 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2816/5590] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:27 2022] DELETE /identity/v3/projects/c306f04a280f423abb8f3a46c6b9c884 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:27.417334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:27.437019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572c05-f53d-4b77-8a70-4421a628745c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:27.529016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:27.550130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:27.551120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:27.551822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:27.552100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] PATH_INFO: `/v3/users/8c83605f35d84dbfb950309d1e2bc301` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:27.553361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c83605f35d84dbfb950309d1e2bc301)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:27.559508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:27.628513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c83605f35d84dbfb950309d1e2bc301'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.639441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c83605f35d84dbfb950309d1e2bc301'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.642021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c83605f35d84dbfb950309d1e2bc301'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.642879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c83605f35d84dbfb950309d1e2bc301'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.660132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19170387-0049-4e6d-9309-91f2307f52e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c83605f35d84dbfb950309d1e2bc301'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:27.687322 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2775/5591] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:27 2022] DELETE /identity/v3/users/8c83605f35d84dbfb950309d1e2bc301 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:28.072487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:28.075058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:28.123437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095c3c-bf8a-4b3f-86fc-0f3445c71566 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:28.214188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:28.249596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:28.250641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.251184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.251465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] PATH_INFO: `/v3/projects/d406219471134951b92b914f41b57fbf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.253769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d406219471134951b92b914f41b57fbf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:28.256937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:28.352539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd406219471134951b92b914f41b57fbf', 'request_id': 'req-b898cdd7-9975-4fa1-be1f-20e15457cd23'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:28.360937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd406219471134951b92b914f41b57fbf', 'request_id': 'req-b898cdd7-9975-4fa1-be1f-20e15457cd23'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:28.381553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd406219471134951b92b914f41b57fbf', 'request_id': 'req-b898cdd7-9975-4fa1-be1f-20e15457cd23'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:28.408049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] The token cache is being invalidate because project d406219471134951b92b914f41b57fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:28.408590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:28.413943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b898cdd7-9975-4fa1-be1f-20e15457cd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:28.417703 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2817/5592] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:28 2022] DELETE /identity/v3/projects/d406219471134951b92b914f41b57fbf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:28.425644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.426571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.427069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.456514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:28.458015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:28.546490 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2776/5593] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:28.547861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.548156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.548437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.581229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:28.582919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:28.590536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:28.596164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:28.612263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2818/5594] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:38:28.621002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:28.635119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb230b1e-ec3c-45d7-a4b2-4f1c2b82032c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:28.650227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:28.650458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.650741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.651020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.651685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:28.651982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:28.653615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:28.675506 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2819/5595] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:28.678445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e15e4-e6c8-410e-b024-55afe9ae6668 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:28.680119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:28.682982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:28.683621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.683900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.684175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.686033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:28.696156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5f21d-1644-4b94-97cf-07d8215e537b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:28.704592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:28.705509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.705978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.706457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.708116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:28.710652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:28.713352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:28.790434 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2820/5596] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:28 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:28.792038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:28.803294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:28.804725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:28.852170 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2777/5597] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:38:28.926517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8bb26-b1a5-472d-9fb6-c34d13535071 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:28.938816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:28.939628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:28.940048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:28.940429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:28.941187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:28.947384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:28.949262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:28.950482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:29.002889 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2821/5598] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:28 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:29.007300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.028340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d64bf-72a2-48a8-854e-8cebe6305397 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.043341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.043981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.044264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.044545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.045216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.054776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.060201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5741d1-8448-406a-9a75-f291565ccf4c service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.081374 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2822/5599] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:29.096913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.123032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:29.134293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97f41-a42c-4ff8-85ed-b56635d64bd3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.166915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.169276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.169629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.170014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.171006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.172966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.200261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.200261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.200261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.200261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.202747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:29.213561 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2823/5600] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:29.218126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.234218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b9725-6d51-48b9-a408-9b7e31f937d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.262587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.262587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.262587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.262587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] PATH_INFO: `/v3/projects/4522bd17e96641acbca79d8677c0224e/users/efa10598356f4ee9bd5a23bfc0ee502d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.270403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.272079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c45787-2842-4082-92fd-9940fb6f984b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.297118 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2778/5601] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:38:29.298944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4522bd17e96641acbca79d8677c0224e, user_id=efa10598356f4ee9bd5a23bfc0ee502d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.320716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.349528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2824/5602] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:29 2022] PUT /identity/v3/projects/4522bd17e96641acbca79d8677c0224e/users/efa10598356f4ee9bd5a23bfc0ee502d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:29.365751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.365963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.366273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.405359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] MFA Rules not processed for user `efa10598356f4ee9bd5a23bfc0ee502d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:29.406794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:29.516554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:29.546834 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2779/5603] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:29.552010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.567483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138d921-fac3-43b3-b32b-e53a74236167 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.590854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.591530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.591812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.592085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.592724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.594242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.650295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2825/5604] 10.222.0.23 () {60 vars in 1299 bytes} [Mon Oct 31 05:38:29 2022] POST /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2 => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:29.657203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.696875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf052808-fc0f-44e1-b830-7da52d040b06 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.713167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.713878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.714196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.714489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/93ac1d88a5eb4863a823ca5b604dfee2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.717028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d, credential_id=93ac1d88a5eb4863a823ca5b604dfee2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.723140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.762310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2780/5605] 10.222.0.23 () {58 vars in 1380 bytes} [Mon Oct 31 05:38:29 2022] DELETE /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/93ac1d88a5eb4863a823ca5b604dfee2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:29.767096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.781510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2d04-185c-4683-947d-b470baa22177 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.793012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.793721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.794009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.794314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.794964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.796468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.836825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2826/5606] 10.222.0.23 () {60 vars in 1299 bytes} [Mon Oct 31 05:38:29 2022] POST /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2 => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:29.841282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.866412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22b229-6abc-49ef-a237-442e49cb1463 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.874422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.875298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.877247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.877600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/7b42f54b227e43a1b8b66b9d3ea2e259` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.883355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d, credential_id=7b42f54b227e43a1b8b66b9d3ea2e259)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:29.884990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:29.920577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2781/5607] 10.222.0.23 () {58 vars in 1380 bytes} [Mon Oct 31 05:38:29 2022] DELETE /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/7b42f54b227e43a1b8b66b9d3ea2e259 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:29.925084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:29.938852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4765-ac3c-47eb-ae02-894cdae69495 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:29.951103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:29.951819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:29.952119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:29.952329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/7b42f54b227e43a1b8b66b9d3ea2e259` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Could not find credential: 78f5971dceec450eec543b35b085d5b12857cc42f5c13d83792bde9e88cb0c45.: keystone.exception.CredentialNotFound: Could not find credential: 78f5971dceec450eec543b35b085d5b12857cc42f5c13d83792bde9e88cb0c45. Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 31 05:38:29.985022 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:38:29.985870 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 78f5971dceec450eec543b35b085d5b12857cc42f5c13d83792bde9e88cb0c45. Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:38:29.986832 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2827/5608] 10.222.0.23 () {58 vars in 1377 bytes} [Mon Oct 31 05:38:29 2022] GET /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/7b42f54b227e43a1b8b66b9d3ea2e259 => generated 148 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:38:29.993840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.022477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fa49-ac60-4b3b-a1c2-9271bd9380a3 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.038123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.038945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.039323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.039699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.040479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.042458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.094135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2782/5609] 10.222.0.23 () {60 vars in 1299 bytes} [Mon Oct 31 05:38:29 2022] POST /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2 => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:30.097421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.113566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0307ca-afcf-4192-bb0c-ac03c42ec088 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.129224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.131448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.131925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.132373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.133202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.134911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.173405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2828/5610] 10.222.0.23 () {60 vars in 1299 bytes} [Mon Oct 31 05:38:30 2022] POST /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2 => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:38:30.178209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.189915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd889d-e48f-4b19-bb3c-0df9c0f7f2b5 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.198745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.199406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.199801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.200035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.200779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.210529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.249077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2783/5611] 10.222.0.23 () {58 vars in 1278 bytes} [Mon Oct 31 05:38:30 2022] GET /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2 => generated 865 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:30.253990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.266959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6382-b751-4ac4-aaff-032eb5159953 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.284871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.285694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.286198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.286642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/0438f40a70bf4eff930576d166e9eff9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.293752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d, credential_id=0438f40a70bf4eff930576d166e9eff9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.295683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.362177 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2829/5612] 10.222.0.23 () {58 vars in 1380 bytes} [Mon Oct 31 05:38:30 2022] DELETE /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/0438f40a70bf4eff930576d166e9eff9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:30.363583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.379506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00d1e-a1fa-4dc9-8bde-f9144372315b tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.394668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.397320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.399861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.400294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/19c98220314a426ea97e1a5d4642207f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.405361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d, credential_id=19c98220314a426ea97e1a5d4642207f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.408714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.456871 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2784/5613] 10.222.0.23 () {58 vars in 1380 bytes} [Mon Oct 31 05:38:30 2022] DELETE /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/19c98220314a426ea97e1a5d4642207f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:30.461945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.475691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d668ce5-bfa7-4d5e-b3ec-b8aa190c6113 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.491525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.492299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.492764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.493208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.494279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.497713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.541268 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2830/5614] 10.222.0.23 () {60 vars in 1299 bytes} [Mon Oct 31 05:38:30 2022] POST /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2 => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:30.543107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.560039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da896f9-c9c8-425a-838d-794d753e97ee tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.576260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.577110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.577849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.578340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/d795c4463e8e47669642c2e24c11763e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.581066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d, credential_id=d795c4463e8e47669642c2e24c11763e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.582966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.589041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2785/5615] 10.222.0.23 () {58 vars in 1377 bytes} [Mon Oct 31 05:38:30 2022] GET /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/d795c4463e8e47669642c2e24c11763e => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:38:30.593305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.605545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7dc87-a885-4b17-b270-ed3947f493f7 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.615683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807d2b8-2535-44d8-9a84-7f212fec7cf6 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efa10598356f4ee9bd5a23bfc0ee502d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4522bd17e96641acbca79d8677c0224e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.617102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807d2b8-2535-44d8-9a84-7f212fec7cf6 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.617600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807d2b8-2535-44d8-9a84-7f212fec7cf6 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.618082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807d2b8-2535-44d8-9a84-7f212fec7cf6 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/d795c4463e8e47669642c2e24c11763e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.620791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807d2b8-2535-44d8-9a84-7f212fec7cf6 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=efa10598356f4ee9bd5a23bfc0ee502d, credential_id=d795c4463e8e47669642c2e24c11763e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.622572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807d2b8-2535-44d8-9a84-7f212fec7cf6 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.659085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:30.659251 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2831/5616] 10.222.0.23 () {58 vars in 1380 bytes} [Mon Oct 31 05:38:30 2022] DELETE /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d/credentials/OS-EC2/d795c4463e8e47669642c2e24c11763e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:30.805620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b6131-786d-4a7d-b693-aa41ed03d842 tempest-EC2CredentialsTest-75849351 tempest-EC2CredentialsTest-75849351-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:30.811825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:30.812489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:30.812774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:30.813056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] PATH_INFO: `/v3/users/efa10598356f4ee9bd5a23bfc0ee502d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:30.815045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa10598356f4ee9bd5a23bfc0ee502d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:30.817708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:30.908399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa10598356f4ee9bd5a23bfc0ee502d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:30.927313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa10598356f4ee9bd5a23bfc0ee502d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:30.928666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa10598356f4ee9bd5a23bfc0ee502d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:30.929348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa10598356f4ee9bd5a23bfc0ee502d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:30.941749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa10598356f4ee9bd5a23bfc0ee502d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:30.973988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:30.994557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2786/5617] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:30 2022] DELETE /identity/v3/users/efa10598356f4ee9bd5a23bfc0ee502d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:31.000333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:31.001282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:31.001563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:31.040567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:31.043531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:31.165779 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2832/5618] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:31.177062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:31.179295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:31.329698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d0e4f-fc53-4b33-8dab-4c23bcf7872c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:31.343671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6dfe0-2cb1-4abb-adb2-de93f0fbc2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:31.344330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6dfe0-2cb1-4abb-adb2-de93f0fbc2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:31.346118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6dfe0-2cb1-4abb-adb2-de93f0fbc2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:31.346118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6dfe0-2cb1-4abb-adb2-de93f0fbc2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:31.373701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6dfe0-2cb1-4abb-adb2-de93f0fbc2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:31.375207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6dfe0-2cb1-4abb-adb2-de93f0fbc2a3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:31.399339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2787/5619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:38:32.151665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:32.153163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:32.185200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d21a7-bb8f-4fdd-926a-123676be96f8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:32.197926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:32.198051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:32.199390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:32.200502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] PATH_INFO: `/v3/projects/4522bd17e96641acbca79d8677c0224e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:32.203062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4522bd17e96641acbca79d8677c0224e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:32.216993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:32.338676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:32.372533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4522bd17e96641acbca79d8677c0224e', 'request_id': 'req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:32.379599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4522bd17e96641acbca79d8677c0224e', 'request_id': 'req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:32.387288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4522bd17e96641acbca79d8677c0224e', 'request_id': 'req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:32.406673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] The token cache is being invalidate because project 4522bd17e96641acbca79d8677c0224e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:38:32.407270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:32.408035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9a14a1c9-b0f5-4848-82e6-cce45cb741c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:32.413983 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2833/5620] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:38:32 2022] DELETE /identity/v3/projects/4522bd17e96641acbca79d8677c0224e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:32.415742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:32.416699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:32.417605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:32.444054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:32.445399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:32.592012 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2788/5621] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:32.603767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:32.604148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:32.604502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:32.656408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:32.658323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:32.672589 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2834/5622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:32.673573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:32.689352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b88abf-7a3b-47a8-98a0-0f9a41f65143 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:32.745763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:32.746617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:32.747001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:32.747430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:32.748214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:38:32.752329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:32.752990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:32.782353 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2789/5623] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:38:32.786531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:32.799879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba792f-4e9c-4bc3-9b0b-07586eaa4c33 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:32.813012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:32.813721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:32.814005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:32.814480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:32.815271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:32.817512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:32.899804 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2835/5624] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:38:32 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:32.905349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:32.917191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60caeb-3caf-4201-8530-e018026e7600 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:33.056611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:33.057431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:33.057723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:33.058223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:33.058930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:33.061001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:33.123166 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2790/5625] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:38:32 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:38:33.124420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:33.152518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e62738-d304-4e4a-bb9f-4203e80c0d17 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:33.157960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:33.158704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:33.159065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:33.159414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:33.161160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:33.168330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:33.196672 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2836/5626] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:33.200666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:33.214632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69317a9-decf-438e-b90e-281f3b1e1eec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:33.232811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abd9e6-df28-4430-b0b3-0b8e6dfabb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:33.233456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abd9e6-df28-4430-b0b3-0b8e6dfabb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:33.233741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abd9e6-df28-4430-b0b3-0b8e6dfabb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:33.234016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abd9e6-df28-4430-b0b3-0b8e6dfabb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:33.234698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abd9e6-df28-4430-b0b3-0b8e6dfabb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:33.236456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abd9e6-df28-4430-b0b3-0b8e6dfabb4a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:33.258001 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2791/5627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:38:33.262116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:33.291160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eb8fa-1aa9-433d-9997-ade5f8522ae3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:33.308923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:33.310552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:33.312195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:33.312624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] PATH_INFO: `/v3/projects/5a32f16b2e2848c1a6a8bb3b15c9fd4e/users/601a4f1808e54074a3a3145cad9aa746/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:33.353572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a32f16b2e2848c1a6a8bb3b15c9fd4e, user_id=601a4f1808e54074a3a3145cad9aa746, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:33.358855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:33.384223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2837/5628] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:38:33 2022] PUT /identity/v3/projects/5a32f16b2e2848c1a6a8bb3b15c9fd4e/users/601a4f1808e54074a3a3145cad9aa746/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:33.394679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300166fa-e02d-4c46-baa3-4139e504419e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:33.394976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300166fa-e02d-4c46-baa3-4139e504419e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:33.395260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300166fa-e02d-4c46-baa3-4139e504419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:33.403346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:33.453934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-300166fa-e02d-4c46-baa3-4139e504419e None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:33.456947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-300166fa-e02d-4c46-baa3-4139e504419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:33.606283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2792/5629] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:33.607387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:33.621728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718fc9c-f6a4-44b1-a338-f7d982471a4e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:33.631668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f437ff-9d30-4eb3-a36f-9712fa74c6df tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:33.635630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f437ff-9d30-4eb3-a36f-9712fa74c6df tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:33.636218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f437ff-9d30-4eb3-a36f-9712fa74c6df tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:33.636651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f437ff-9d30-4eb3-a36f-9712fa74c6df tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:33.736457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-28f437ff-9d30-4eb3-a36f-9712fa74c6df tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:33.752819 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2838/5630] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:33 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:34.758566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:34.759011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:34.759336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:34.801185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:34.806006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:34.815511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2793/5631] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:34 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:34.817350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:34.817803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:34.817938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:34.863147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:34.864497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:34.885588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2839/5632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:34.886401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:34.901565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc0b3d-7a8f-4dc5-8182-527b9ce425d6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:34.908019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:34.908898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:34.909343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:34.909764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:35.017087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 05:38:35.018440 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:38:35.021665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2794/5633] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:34 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 188 bytes in 136 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 31 05:38:35.025549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:35.038357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1eac7-0ca6-44ec-aeb4-79e24e376297 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:35.067245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13f974-0ef5-4090-b985-8622b7fbe813 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:35.068764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13f974-0ef5-4090-b985-8622b7fbe813 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:35.069059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13f974-0ef5-4090-b985-8622b7fbe813 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:35.069332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13f974-0ef5-4090-b985-8622b7fbe813 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-ed13f974-0ef5-4090-b985-8622b7fbe813 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:35.177693 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 05:38:35.179121 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:38:35.182966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:35.186575 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2840/5634] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:35 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 188 bytes in 161 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:38:35.197378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344708d-7489-48de-8d0b-6f401dafb712 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:35.209854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c292-1c27-4400-a1a0-0453a29802a1 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:35.211141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c292-1c27-4400-a1a0-0453a29802a1 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:35.211598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c292-1c27-4400-a1a0-0453a29802a1 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:35.212082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c292-1c27-4400-a1a0-0453a29802a1 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:35.285860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c547c292-1c27-4400-a1a0-0453a29802a1 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:35.306485 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2795/5635] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:35 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:36.249957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f5711-a120-4cea-a59d-ba3da5d18729 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:36.251079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f5711-a120-4cea-a59d-ba3da5d18729 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:36.251508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f5711-a120-4cea-a59d-ba3da5d18729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:36.282624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7c4f5711-a120-4cea-a59d-ba3da5d18729 None None] MFA Rules not processed for user `3556d4ac9f1e4f6393e9f7fe6a16ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:36.283850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c4f5711-a120-4cea-a59d-ba3da5d18729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:36.311135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:36.312515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:36.313018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:36.350879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:36.351332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:36.357166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:36.363189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2841/5636] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:36.367549 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2796/5637] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:36.372033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251e8ad-2ec1-4ba9-95d9-6a26e60f275a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:36.372545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251e8ad-2ec1-4ba9-95d9-6a26e60f275a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:36.372872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251e8ad-2ec1-4ba9-95d9-6a26e60f275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:36.402217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e251e8ad-2ec1-4ba9-95d9-6a26e60f275a None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:36.403968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e251e8ad-2ec1-4ba9-95d9-6a26e60f275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:36.413144 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2842/5638] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:36.418184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:36.451994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1063-8b3f-46f7-8cab-8f7bf60cd7f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:36.457476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c41b2-0573-4271-8e2a-582aadd95482 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:36.458310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c41b2-0573-4271-8e2a-582aadd95482 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:36.458792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c41b2-0573-4271-8e2a-582aadd95482 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:36.460031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c41b2-0573-4271-8e2a-582aadd95482 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:36.555409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-453c41b2-0573-4271-8e2a-582aadd95482 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:36.581899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2797/5639] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:36 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:37.587572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:37.588050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:37.588140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:37.620700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:37.621982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:37.625564 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2843/5640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:37.630319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bbe00-cda1-44b0-b947-65a09c6364c6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:37.631055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bbe00-cda1-44b0-b947-65a09c6364c6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:37.631055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bbe00-cda1-44b0-b947-65a09c6364c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:37.661897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ca1bbe00-cda1-44b0-b947-65a09c6364c6 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:37.663508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ca1bbe00-cda1-44b0-b947-65a09c6364c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:37.674780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2798/5641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:37.679902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:37.691821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e280d7-6c5b-4f20-ab42-ebdc3701b2e9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:37.699384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f73ee-3681-4f18-b6b4-7c78311e4d85 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:37.700517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f73ee-3681-4f18-b6b4-7c78311e4d85 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:37.700892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f73ee-3681-4f18-b6b4-7c78311e4d85 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:37.701340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f73ee-3681-4f18-b6b4-7c78311e4d85 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:37.821592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-770f73ee-3681-4f18-b6b4-7c78311e4d85 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:37.836650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2844/5642] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:37 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:38:38.840966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:38.841478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:38.841478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:38.885807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:38.887056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:38.899978 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2799/5643] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:38 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:38.905016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8640045-f0df-40fd-b294-f2868e359f97 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:38.905487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8640045-f0df-40fd-b294-f2868e359f97 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:38.905594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8640045-f0df-40fd-b294-f2868e359f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:38.933592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e8640045-f0df-40fd-b294-f2868e359f97 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:38.935055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e8640045-f0df-40fd-b294-f2868e359f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:38.959104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2845/5644] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:38.963548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:38.978285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65618-e75c-4da5-9e88-03cc9f618029 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:39.000056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecef3a-38d6-4778-9e7a-0f3d8c3f602e tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:39.000741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecef3a-38d6-4778-9e7a-0f3d8c3f602e tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:39.001277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecef3a-38d6-4778-9e7a-0f3d8c3f602e tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:39.001551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecef3a-38d6-4778-9e7a-0f3d8c3f602e tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:39.072273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-95ecef3a-38d6-4778-9e7a-0f3d8c3f602e tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:39.078826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:39.090283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2800/5645] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:38 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:40.104519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debd1d-cdbe-4a4f-8165-ece5b1a50836 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:40.104961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debd1d-cdbe-4a4f-8165-ece5b1a50836 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:40.105037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debd1d-cdbe-4a4f-8165-ece5b1a50836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:40.187365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-85debd1d-cdbe-4a4f-8165-ece5b1a50836 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:40.194403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-85debd1d-cdbe-4a4f-8165-ece5b1a50836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:40.200379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2846/5646] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:41.207520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f469585-a162-42d1-8a71-d7bb4f44d675 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:41.209050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f469585-a162-42d1-8a71-d7bb4f44d675 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:41.210592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f469585-a162-42d1-8a71-d7bb4f44d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:41.260457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7f469585-a162-42d1-8a71-d7bb4f44d675 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:41.263673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7f469585-a162-42d1-8a71-d7bb4f44d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:41.282322 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2801/5647] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:41.288885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0144a9-a3cc-4710-be8c-a4ce69b1669a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:41.290596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0144a9-a3cc-4710-be8c-a4ce69b1669a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:41.291072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0144a9-a3cc-4710-be8c-a4ce69b1669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:41.325462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0b0144a9-a3cc-4710-be8c-a4ce69b1669a None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:41.329291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b0144a9-a3cc-4710-be8c-a4ce69b1669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:41.342256 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2847/5648] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:41 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:41.344022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1effa-dbf9-463f-a87a-c37082d11d8b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:41.344382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1effa-dbf9-463f-a87a-c37082d11d8b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:41.344803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1effa-dbf9-463f-a87a-c37082d11d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:41.696750 n-d-862355-5 devstack@keystone.service[81999]: WARNING keystone.server.flask.application [None req-49f1effa-dbf9-463f-a87a-c37082d11d8b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 05:38:41.699069 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2802/5649] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 356 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 05:38:41.704093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0480fc0-14de-41f8-91d8-05d2741ee3fe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:41.704481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0480fc0-14de-41f8-91d8-05d2741ee3fe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:41.704934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0480fc0-14de-41f8-91d8-05d2741ee3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:41.810910 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.server.flask.application [None req-b0480fc0-14de-41f8-91d8-05d2741ee3fe None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 05:38:41.815859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2848/5650] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 114 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 05:38:41.821381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:41.821671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:41.822081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:41.866918 n-d-862355-5 devstack@keystone.service[81999]: WARNING keystone.server.flask.application [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 05:38:41.871021 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2803/5651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 51 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 05:38:51.724004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b6b8-df86-4eb4-9438-87837b7ac89d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:51.725157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b6b8-df86-4eb4-9438-87837b7ac89d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:51.725157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b6b8-df86-4eb4-9438-87837b7ac89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:51.766444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-64f8b6b8-df86-4eb4-9438-87837b7ac89d None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:51.767782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-64f8b6b8-df86-4eb4-9438-87837b7ac89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:51.852747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=16,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:51.891168 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2849/5652] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:38:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:51.908692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:51.911970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:52.135545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01009a5-6f20-4721-8e16-1d4088c891d5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:52.154594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:52.155278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:52.155567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:52.155844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:52.180191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:52.184291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:52.246453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2804/5653] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:38:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:38:52.885423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190e77-a115-4d4f-956b-877c0be1b335 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:52.885914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190e77-a115-4d4f-956b-877c0be1b335 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:52.885991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190e77-a115-4d4f-956b-877c0be1b335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:53.010339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e6190e77-a115-4d4f-956b-877c0be1b335 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:53.012208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e6190e77-a115-4d4f-956b-877c0be1b335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:53.022974 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2850/5654] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:52 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:53.028990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:53.051734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c7c5c-01cd-4870-bd34-d506940ce836 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:53.065136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798bed1-5729-43ef-abb1-03efe6111ff0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:53.066299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798bed1-5729-43ef-abb1-03efe6111ff0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:53.066880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798bed1-5729-43ef-abb1-03efe6111ff0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:53.067387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798bed1-5729-43ef-abb1-03efe6111ff0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:53.179425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f798bed1-5729-43ef-abb1-03efe6111ff0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:53.213777 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2805/5655] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:53 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:54.219768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab4bd5-e2be-40fa-8d57-d3f56cf5fde0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:54.223640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab4bd5-e2be-40fa-8d57-d3f56cf5fde0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:54.224686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab4bd5-e2be-40fa-8d57-d3f56cf5fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:54.275027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-faab4bd5-e2be-40fa-8d57-d3f56cf5fde0 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:54.277468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-faab4bd5-e2be-40fa-8d57-d3f56cf5fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:54.297382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2851/5656] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:54.301907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274983d5-4c94-4299-ac77-620827dd659f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:54.302408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274983d5-4c94-4299-ac77-620827dd659f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:54.302734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274983d5-4c94-4299-ac77-620827dd659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-274983d5-4c94-4299-ac77-620827dd659f None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 31 05:38:54.365270 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:54.366384 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 31 05:38:54.367307 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:38:54.369759 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2806/5657] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:54 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:38:54.374201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857b82-d714-4580-b369-d1de39ff2e04 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:54.374561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857b82-d714-4580-b369-d1de39ff2e04 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:54.374863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857b82-d714-4580-b369-d1de39ff2e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:54.469297 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.server.flask.application [None req-3e857b82-d714-4580-b369-d1de39ff2e04 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 05:38:54.472835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2852/5658] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:54 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 99 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 05:38:54.478499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1145d0-9284-4ca0-ab0d-5e5163eaf778 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:54.479012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1145d0-9284-4ca0-ab0d-5e5163eaf778 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:54.479587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1145d0-9284-4ca0-ab0d-5e5163eaf778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:54.554448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9b1145d0-9284-4ca0-ab0d-5e5163eaf778 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:54.556529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9b1145d0-9284-4ca0-ab0d-5e5163eaf778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:54.571816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2807/5659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:38:54.575977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857b82-d714-4580-b369-d1de39ff2e04 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:54.593364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857b82-d714-4580-b369-d1de39ff2e04 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:54.599335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f916b-833d-4033-9292-5e8c5d677921 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:54.600958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f916b-833d-4033-9292-5e8c5d677921 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:54.601617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f916b-833d-4033-9292-5e8c5d677921 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:54.602134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f916b-833d-4033-9292-5e8c5d677921 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:54.709632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:UPDATE=5,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:54.722058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fe2f916b-833d-4033-9292-5e8c5d677921 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:54.750261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2853/5660] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:54 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:55.757143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:55.757700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:55.757830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:55.778647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:55.780101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:55.788286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a965d-6690-4a09-b4e9-27b2f42318b4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:55.789183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a965d-6690-4a09-b4e9-27b2f42318b4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:55.789614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a965d-6690-4a09-b4e9-27b2f42318b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:55.799443 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2808/5661] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:55 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:55.811927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-799a965d-6690-4a09-b4e9-27b2f42318b4 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:55.813423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-799a965d-6690-4a09-b4e9-27b2f42318b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:55.825410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:55.832602 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2854/5662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:55.837331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728283d-0333-4523-af20-f4f65cd4f5b4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:55.841664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26898ce7-8eb1-405f-a9f1-d5d78a15bde6 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:55.842568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898ce7-8eb1-405f-a9f1-d5d78a15bde6 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:55.842996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898ce7-8eb1-405f-a9f1-d5d78a15bde6 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:55.843557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898ce7-8eb1-405f-a9f1-d5d78a15bde6 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:55.970517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26898ce7-8eb1-405f-a9f1-d5d78a15bde6 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:55.997250 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2809/5663] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:55 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:57.001022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:57.001839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:57.001839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:57.049079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:57.050336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:57.063718 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2855/5664] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 05:38:57.068921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:57.069514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:57.069723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:57.116229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:57.117667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:57.142124 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2810/5665] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:57.147255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:57.169308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3dd9-c095-4ae8-99f5-c3caf229101e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:57.178970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177975e-4498-4e33-a997-2b3c4d3e80d0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601a4f1808e54074a3a3145cad9aa746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:57.179969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177975e-4498-4e33-a997-2b3c4d3e80d0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:57.180410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177975e-4498-4e33-a997-2b3c4d3e80d0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:57.180841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177975e-4498-4e33-a997-2b3c4d3e80d0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746/password` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:57.250830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e177975e-4498-4e33-a997-2b3c4d3e80d0 tempest-IdentityV3UsersTest-799446986 tempest-IdentityV3UsersTest-799446986-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:57.270243 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2856/5666] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:38:57 2022] POST /identity/v3/users/601a4f1808e54074a3a3145cad9aa746/password => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:57.890406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:57.892513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:57.963602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:38:58.008038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f962c-3fac-4c4e-9af5-e4878f8921f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:58.017669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:58.018342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:58.018626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:58.018905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:58.028179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:58.193247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:58.194753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a30ea-107a-43d7-96b6-9aded867c072 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:58.250646 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2811/5667] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:38:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:38:58.276479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:58.277706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:58.278175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:58.321910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:58.323205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:58.337468 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2857/5668] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:58 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:38:59.343849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785a47f-6ecb-4bc9-8c5e-68b147e9cabe None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:59.344377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785a47f-6ecb-4bc9-8c5e-68b147e9cabe None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:59.344664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785a47f-6ecb-4bc9-8c5e-68b147e9cabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:59.382331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8785a47f-6ecb-4bc9-8c5e-68b147e9cabe None None] MFA Rules not processed for user `601a4f1808e54074a3a3145cad9aa746`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:59.387915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8785a47f-6ecb-4bc9-8c5e-68b147e9cabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:38:59.411107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2812/5669] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:38:59.416428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:38:59.553850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc680340-1680-4ae6-ad70-9c878e2a1fe8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:38:59.570808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:38:59.571754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:59.572195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:59.572641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] PATH_INFO: `/v3/users/601a4f1808e54074a3a3145cad9aa746` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:59.573995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601a4f1808e54074a3a3145cad9aa746)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:38:59.576113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:38:59.694093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:59.744211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:59.745127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:59.745902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:59.777399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601a4f1808e54074a3a3145cad9aa746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:38:59.810761 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2858/5670] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:38:59 2022] DELETE /identity/v3/users/601a4f1808e54074a3a3145cad9aa746 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:38:59.815309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:38:59.815937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:38:59.823790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:38:59.859653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:38:59.863995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:00.019872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2813/5671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:00.035639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:00.035886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:00.085666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=13,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:00.162958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65610f1a-0d95-4af1-b1c4-fe7e3dfdd545 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:00.168346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dfd5c-8486-46bd-b5ee-2be35c75bd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:00.169319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dfd5c-8486-46bd-b5ee-2be35c75bd3e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:00.169720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dfd5c-8486-46bd-b5ee-2be35c75bd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:00.170461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dfd5c-8486-46bd-b5ee-2be35c75bd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:00.186124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dfd5c-8486-46bd-b5ee-2be35c75bd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:00.188670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dfd5c-8486-46bd-b5ee-2be35c75bd3e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:00.209566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2859/5672] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:39:00.781645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:00.783754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:00.815379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60254398-f579-4476-8d72-0dd1ee5aecfb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:00.829025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:00.829695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:00.829980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:00.830305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] PATH_INFO: `/v3/projects/5a32f16b2e2848c1a6a8bb3b15c9fd4e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:00.855719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a32f16b2e2848c1a6a8bb3b15c9fd4e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:00.858019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:00.978103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'request_id': 'req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:00.992861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'request_id': 'req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:01.012439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a32f16b2e2848c1a6a8bb3b15c9fd4e', 'request_id': 'req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:01.032100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] The token cache is being invalidate because project 5a32f16b2e2848c1a6a8bb3b15c9fd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:01.033885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:01.038078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-894d16e0-930e-4ac0-a5e2-6e8d90f3fb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:01.041742 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2814/5673] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:00 2022] DELETE /identity/v3/projects/5a32f16b2e2848c1a6a8bb3b15c9fd4e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:01.047531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.048451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.049011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.089824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:01.091525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:01.272189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.275567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.275981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.285432 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2860/5674] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:01.310814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:01.312261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:01.336477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:01.342782 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2815/5675] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:01.349968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eb5f6-6061-446c-b2db-a85403935791 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:01.361940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:01.363604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.364136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.365195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.366570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:01.368415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:01.373500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:01.404852 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2861/5676] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:39:01.406311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:01.421912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e973d1-3853-45dd-9cd9-27b3cfe5443e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:01.432325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:01.434248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.434661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.435612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.437387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:01.443953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:01.451878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:01.494638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2816/5677] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:01 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:01.495892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:01.520330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c1460-3bad-469f-8e1f-8c4ab00c12ee admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:01.619789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:01.621218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.621847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.622260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.623011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:01.625718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:01.665741 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2862/5678] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:01 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:01.681832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:01.700585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb0ca-9b72-4ce6-9d6f-dd36a85dec1b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:01.707569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:01.709268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.709930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.710523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.711380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:01.713588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:01.753541 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2817/5679] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:01.758297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:01.774892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b020c-ebde-4851-95da-e1b361f0968f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:01.781183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5238b-70d2-4437-8798-2698992b8417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:01.781864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5238b-70d2-4437-8798-2698992b8417 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.782666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5238b-70d2-4437-8798-2698992b8417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.783130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5238b-70d2-4437-8798-2698992b8417 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.784218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5238b-70d2-4437-8798-2698992b8417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:01.787131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5238b-70d2-4437-8798-2698992b8417 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:01.804990 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2863/5680] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:01.806252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:01.824025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1961-4d41-4aa3-b44c-94fa2c666d7b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:01.848280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:01.851606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.851946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.852283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] PATH_INFO: `/v3/projects/1ec9450558b34507b731ba5850286c10/users/d21060d162bc4682a268d18596477450/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:01.892599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec9450558b34507b731ba5850286c10, user_id=d21060d162bc4682a268d18596477450, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:01.897611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:01.942427 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2818/5681] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:01 2022] PUT /identity/v3/projects/1ec9450558b34507b731ba5850286c10/users/d21060d162bc4682a268d18596477450/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:01.949595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:01.949889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:01.950195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:02.068991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] MFA Rules not processed for user `d21060d162bc4682a268d18596477450`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:02.070404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:02.145005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:02.352060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2864/5682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:02.367304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:02.369110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:02.542409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e4845-1bc9-4168-a614-2776e2495ed5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:02.570703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224b93-91cc-4b55-9775-f51a9e421698 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:02.571706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224b93-91cc-4b55-9775-f51a9e421698 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:02.572149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224b93-91cc-4b55-9775-f51a9e421698 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:02.572592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224b93-91cc-4b55-9775-f51a9e421698 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:02.592125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224b93-91cc-4b55-9775-f51a9e421698 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:02.593923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224b93-91cc-4b55-9775-f51a9e421698 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:02.624743 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2819/5683] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:03.869147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:03.981923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb2ba-56d4-47ac-b78c-b74a70165e4a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:03.987255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:03.987910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:03.988192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:03.988469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] PATH_INFO: `/v3/users/d21060d162bc4682a268d18596477450` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:03.989646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21060d162bc4682a268d18596477450)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:03.992238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:04.053339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21060d162bc4682a268d18596477450'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.070464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21060d162bc4682a268d18596477450'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.071563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21060d162bc4682a268d18596477450'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.072528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21060d162bc4682a268d18596477450'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.081820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21060d162bc4682a268d18596477450'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.101534 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2865/5684] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:03 2022] DELETE /identity/v3/users/d21060d162bc4682a268d18596477450 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:04.105653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:04.106280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:04.106280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:04.131364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:04.133226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:04.213145 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2820/5685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:04.225168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:04.227079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:04.278826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:04.307332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2913f-75e4-4069-82b0-7937398e86f7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:04.311247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70db3-c6f6-4bb2-8efe-3576d695f1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:04.311874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70db3-c6f6-4bb2-8efe-3576d695f1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:04.312153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70db3-c6f6-4bb2-8efe-3576d695f1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:04.312428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70db3-c6f6-4bb2-8efe-3576d695f1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:04.323415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70db3-c6f6-4bb2-8efe-3576d695f1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:04.324859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70db3-c6f6-4bb2-8efe-3576d695f1a6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:04.340919 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2866/5686] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:04.718411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:04.719858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:04.742642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df696d80-5e66-4a05-b3b3-05bc45bf1b48 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:04.774672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:04.775520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:04.775762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:04.776091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] PATH_INFO: `/v3/projects/1ec9450558b34507b731ba5850286c10` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:04.777410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec9450558b34507b731ba5850286c10)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:04.780367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:04.836475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:04.847354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec9450558b34507b731ba5850286c10', 'request_id': 'req-f0140112-5760-47be-a648-f2f23d64528c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.855887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec9450558b34507b731ba5850286c10', 'request_id': 'req-f0140112-5760-47be-a648-f2f23d64528c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.867177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec9450558b34507b731ba5850286c10', 'request_id': 'req-f0140112-5760-47be-a648-f2f23d64528c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.883135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] The token cache is being invalidate because project 1ec9450558b34507b731ba5850286c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:04.883588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.884622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0140112-5760-47be-a648-f2f23d64528c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:04.887396 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2821/5687] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:04 2022] DELETE /identity/v3/projects/1ec9450558b34507b731ba5850286c10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:04.891770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:04.892235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:04.892329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:04.917261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:04.918464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:05.035866 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2867/5688] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:05.037817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.038335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.038689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.089353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:05.090654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:05.104942 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2822/5689] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:39:05.106776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.119104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3241-e92b-48fe-bdb8-938e534eb9b4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.125611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.126545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.126832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.127112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.127831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:05.128193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.129903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.150613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.159012 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2868/5690] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:39:05.164182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066673-1ea2-43dd-9023-71bac3026582 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.191114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.191751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.192028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.192298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.193590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.195538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.247289 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2823/5691] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:05 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:05.248304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.265159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b75e-f726-456a-8bd3-507d7183291b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.357160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.357928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.358365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.358649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.359386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.361618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.388575 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2869/5692] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:05 2022] POST /identity/v3/users => generated 281 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:05.392901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.405123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5641803-7305-4de6-980f-e3397901aa89 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.410067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.410826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.411293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.411688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.412877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.427807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.443829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2824/5693] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:05.444239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.455112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313a09-2d71-4289-81e9-5494dda98fa0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.461973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dda29-8b32-404d-bf2f-590abd4e2195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.462627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dda29-8b32-404d-bf2f-590abd4e2195 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.462914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dda29-8b32-404d-bf2f-590abd4e2195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.463193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dda29-8b32-404d-bf2f-590abd4e2195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.463850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dda29-8b32-404d-bf2f-590abd4e2195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.465465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dda29-8b32-404d-bf2f-590abd4e2195 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.481802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2870/5694] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:39:05.483222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.495591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b094f3-2c10-4045-89fb-acf6d32e4af0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.500964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.501893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.502406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.502838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] PATH_INFO: `/v3/projects/6ac70c0fb0c2456ebd939f4277c878b3/users/6995f73a6d7c45a6a38adcb366139119/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.520257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac70c0fb0c2456ebd939f4277c878b3, user_id=6995f73a6d7c45a6a38adcb366139119, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.524158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.552367 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2825/5695] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:05 2022] PUT /identity/v3/projects/6ac70c0fb0c2456ebd939f4277c878b3/users/6995f73a6d7c45a6a38adcb366139119/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:05.555008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406b3f-9f51-421b-b803-aaf095f71e3a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.555325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406b3f-9f51-421b-b803-aaf095f71e3a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.555884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406b3f-9f51-421b-b803-aaf095f71e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.638944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c7406b3f-9f51-421b-b803-aaf095f71e3a None None] MFA Rules not processed for user `6995f73a6d7c45a6a38adcb366139119`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:05.640429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7406b3f-9f51-421b-b803-aaf095f71e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:05.711267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:05.776724 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2871/5696] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:05.794710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:05.886951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacda06-a8d7-4937-ac0c-529309548393 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:05.892996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:05.894258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:05.894801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:05.895298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] PATH_INFO: `/v3/users/6995f73a6d7c45a6a38adcb366139119` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:05.897739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6995f73a6d7c45a6a38adcb366139119)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:05.900184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:05.964056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6995f73a6d7c45a6a38adcb366139119'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:05.974607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6995f73a6d7c45a6a38adcb366139119'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:05.975536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6995f73a6d7c45a6a38adcb366139119'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:05.976282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6995f73a6d7c45a6a38adcb366139119'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:05.986866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6995f73a6d7c45a6a38adcb366139119'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:05.989179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:06.011963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2826/5697] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:05 2022] DELETE /identity/v3/users/6995f73a6d7c45a6a38adcb366139119 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:06.017569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:06.018075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:06.018346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:06.042723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:06.044066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:06.119874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2872/5698] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:06.131953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:06.133884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:06.204992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bdc1-a4fe-4464-9fab-8f74186f48bb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:06.210417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a921e-255c-4ddb-8cf6-cf2097aa24ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:06.211356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a921e-255c-4ddb-8cf6-cf2097aa24ac service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:06.211855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a921e-255c-4ddb-8cf6-cf2097aa24ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:06.212869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a921e-255c-4ddb-8cf6-cf2097aa24ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:06.225640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a921e-255c-4ddb-8cf6-cf2097aa24ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:06.227535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a921e-255c-4ddb-8cf6-cf2097aa24ac service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:06.246244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2827/5699] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:06.692514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:06.695024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:06.711874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294ec3c-aad8-4716-91f8-d1253722dc18 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:06.720306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:06.721167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:06.721167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:06.721449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] PATH_INFO: `/v3/projects/6ac70c0fb0c2456ebd939f4277c878b3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:06.722914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac70c0fb0c2456ebd939f4277c878b3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:06.725532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:06.825611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac70c0fb0c2456ebd939f4277c878b3', 'request_id': 'req-48b9d53c-6a82-4216-bb57-66fed02f8a15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:06.834542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac70c0fb0c2456ebd939f4277c878b3', 'request_id': 'req-48b9d53c-6a82-4216-bb57-66fed02f8a15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:06.840905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac70c0fb0c2456ebd939f4277c878b3', 'request_id': 'req-48b9d53c-6a82-4216-bb57-66fed02f8a15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:06.865786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] The token cache is being invalidate because project 6ac70c0fb0c2456ebd939f4277c878b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:06.866089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:06.870596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-48b9d53c-6a82-4216-bb57-66fed02f8a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:06.873453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2873/5700] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:06 2022] DELETE /identity/v3/projects/6ac70c0fb0c2456ebd939f4277c878b3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:06.879286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:06.879670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:06.880152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:06.905253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:06.906619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:07.039341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.039861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.040082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.049056 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2828/5701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:07.082655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:07.084001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:07.095423 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2874/5702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:07.096654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.109254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d63e8-4b27-4983-8475-cbef6245f3d8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.115370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.116190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.116632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.117074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.117873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:07.118362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.121041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.136129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2829/5703] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:07.140489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.150825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e41b4-7afa-47b2-9df7-56b4470f90e8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.155684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.156302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.156584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.156859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.157497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.159519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.200481 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2875/5704] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:07 2022] POST /identity/v3/projects => generated 355 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:07.202049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.214095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c8135-66a6-4477-8616-8a6b83c06ec7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.315681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.316694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.316989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.317383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.318579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.320605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.352168 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2830/5705] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:07 2022] POST /identity/v3/users => generated 278 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:07.353355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.364972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da916-22f9-4109-a9e3-41f3e0d616c9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.370087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.370772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.371055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.371329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.371975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.373575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.392431 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2876/5706] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:39:07.396770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.403247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:07.411127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b269e3-8b65-412a-980c-f5ae621ea7f9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.419102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da01c-117c-43f7-b91d-37463d4d6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.420125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da01c-117c-43f7-b91d-37463d4d6ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.420787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da01c-117c-43f7-b91d-37463d4d6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.421218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da01c-117c-43f7-b91d-37463d4d6ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.422014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da01c-117c-43f7-b91d-37463d4d6ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.423931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da01c-117c-43f7-b91d-37463d4d6ba5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.437666 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2831/5707] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:39:07.441505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.451902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30db1e-c143-46b5-8698-3b45ea08a098 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.456892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.457557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.457838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.458681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] PATH_INFO: `/v3/projects/d371d64ae9ec40a38a74da1347fa3207/users/c6b693b6d7dd4e4aa402a9453e5dc942/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.481165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d371d64ae9ec40a38a74da1347fa3207, user_id=c6b693b6d7dd4e4aa402a9453e5dc942, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.483910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.486133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:07.507026 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2877/5708] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:07 2022] PUT /identity/v3/projects/d371d64ae9ec40a38a74da1347fa3207/users/c6b693b6d7dd4e4aa402a9453e5dc942/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:07.517190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.517487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.517770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.549211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] MFA Rules not processed for user `c6b693b6d7dd4e4aa402a9453e5dc942`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:07.550614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:07.634557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2832/5709] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:07.638266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.721063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b2182-1314-4cca-80e6-1a9f1ac99d20 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.726434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.727200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.727663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.727948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.728613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.731488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:07.781518 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2878/5710] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:07 2022] POST /identity/v3/projects => generated 357 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:07.782844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:07.799433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf095-eb52-45c5-ab42-1e2d8f4ffd7c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:07.924314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:07.925691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:07.941810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:07.941810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:07.941810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:07.944091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.028436 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2833/5711] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:07 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:08.032653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.045328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ee18-904c-476c-b15c-13b36c18d22c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.050605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.051213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.051622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.052435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.053218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.055706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.070624 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2879/5712] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:08.074017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.086985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474184f6-1f92-4df1-9a2c-ea56af5e5bb6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.092439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.093117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.093402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.093681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] PATH_INFO: `/v3/projects/55c4e73af5824b79842ad751a43085b0/users/bc214b467296441e95e9d1b4f91c8dba/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.112824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c4e73af5824b79842ad751a43085b0, user_id=bc214b467296441e95e9d1b4f91c8dba, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.116537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.142392 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2834/5713] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:08 2022] PUT /identity/v3/projects/55c4e73af5824b79842ad751a43085b0/users/bc214b467296441e95e9d1b4f91c8dba/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:08.147612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.158211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1249e9-4303-4253-9710-113e16affe3f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.219020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c261e-c1a5-4118-867c-32c97a539b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.219653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c261e-c1a5-4118-867c-32c97a539b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.220008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c261e-c1a5-4118-867c-32c97a539b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.220362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c261e-c1a5-4118-867c-32c97a539b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.221151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c261e-c1a5-4118-867c-32c97a539b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.222885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c261e-c1a5-4118-867c-32c97a539b06 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.237355 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2880/5714] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:08.238927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.251978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51e6bb-af73-42a7-911c-357a850cae3c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.258169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.258169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.258169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.258169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] PATH_INFO: `/v3/projects/55c4e73af5824b79842ad751a43085b0/users/bc214b467296441e95e9d1b4f91c8dba/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.265538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c4e73af5824b79842ad751a43085b0, user_id=bc214b467296441e95e9d1b4f91c8dba, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.268212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.281834 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2835/5715] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:08 2022] PUT /identity/v3/projects/55c4e73af5824b79842ad751a43085b0/users/bc214b467296441e95e9d1b4f91c8dba/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:08.293739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.294013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.294288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.340458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] MFA Rules not processed for user `bc214b467296441e95e9d1b4f91c8dba`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:08.341810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:08.398706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:08.420896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2881/5716] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:08.425935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.437918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b7be-a43b-48f1-ac70-98714775c356 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.443653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc214b467296441e95e9d1b4f91c8dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55c4e73af5824b79842ad751a43085b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.444367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.444751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.445129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.445878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:08.446338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.448046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.464678 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2836/5717] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:39:08.465909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.475579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b65d9-6592-41d8-a0dd-8a48b73801f1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.480574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc214b467296441e95e9d1b4f91c8dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55c4e73af5824b79842ad751a43085b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.481195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.481480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.481759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.482772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.484723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.518593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2882/5718] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:08 2022] POST /identity/v3/projects => generated 348 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:08.519999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.531134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e757e-f90c-4b7c-be61-6468a8f4ea3e tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.550134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:08.603882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc214b467296441e95e9d1b4f91c8dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55c4e73af5824b79842ad751a43085b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.604603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.604958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.605301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.606020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:08.606413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.608072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.625852 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2837/5719] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:08.633699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.635693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:08.715323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e43b-3b0b-4cd2-9d59-bbec76541550 tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.719695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.720544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.721003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.721773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.733042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.734771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:08.747031 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2883/5720] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:08.899717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:08.913660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9674-81dd-43bc-ada7-96a3a85bcc5f tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:08.937442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc214b467296441e95e9d1b4f91c8dba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55c4e73af5824b79842ad751a43085b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:08.938962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:08.939589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:08.940850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] PATH_INFO: `/v3/projects/e73a20e8c796499d9344678090e866fb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:08.944403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e73a20e8c796499d9344678090e866fb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:08.949316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:09.057781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73a20e8c796499d9344678090e866fb', 'request_id': 'req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.074574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73a20e8c796499d9344678090e866fb', 'request_id': 'req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.089620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73a20e8c796499d9344678090e866fb', 'request_id': 'req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.113895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] The token cache is being invalidate because project e73a20e8c796499d9344678090e866fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:09.115256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.116495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aa98239f-0efe-446b-be9a-6c7a5b3cbffa tempest-QuotasTest-1986788437 tempest-QuotasTest-1986788437-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.136164 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2838/5721] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:08 2022] DELETE /identity/v3/projects/e73a20e8c796499d9344678090e866fb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:09.310915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:09.420134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d988f3a-02d7-4cf6-99ce-215110378e62 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:09.485152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:09.485847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:09.486140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:09.486432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] PATH_INFO: `/v3/users/c6b693b6d7dd4e4aa402a9453e5dc942` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:09.487733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b693b6d7dd4e4aa402a9453e5dc942)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:09.490581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:09.492514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:09.548899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b693b6d7dd4e4aa402a9453e5dc942'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.562835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b693b6d7dd4e4aa402a9453e5dc942'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.563455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b693b6d7dd4e4aa402a9453e5dc942'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.564086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b693b6d7dd4e4aa402a9453e5dc942'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.573161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b693b6d7dd4e4aa402a9453e5dc942'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:09.590808 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2884/5722] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:09 2022] DELETE /identity/v3/users/c6b693b6d7dd4e4aa402a9453e5dc942 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:09.595064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:09.595910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:09.596359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:09.629056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:09.630811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:09.722029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2839/5723] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:09.731785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:09.733225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:09.820233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe371-5909-42c7-a710-993d314aa6ed admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:09.824090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:09.824715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:09.824997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:09.825271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:09.837046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:09.838798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:09.850957 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2885/5724] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:10.204816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:10.206320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:10.219671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a32124-022d-4d8e-8f65-3d093672a474 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:10.226226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:10.226881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:10.227162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:10.227435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] PATH_INFO: `/v3/projects/d371d64ae9ec40a38a74da1347fa3207` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:10.228572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d371d64ae9ec40a38a74da1347fa3207)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:10.230497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:10.253808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:10.326465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd371d64ae9ec40a38a74da1347fa3207', 'request_id': 'req-19eef46a-16ce-4db7-adb9-ccc95b9a2693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.334333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd371d64ae9ec40a38a74da1347fa3207', 'request_id': 'req-19eef46a-16ce-4db7-adb9-ccc95b9a2693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.351423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd371d64ae9ec40a38a74da1347fa3207', 'request_id': 'req-19eef46a-16ce-4db7-adb9-ccc95b9a2693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.374170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] The token cache is being invalidate because project d371d64ae9ec40a38a74da1347fa3207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:10.374516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.375320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.378396 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2840/5725] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:10 2022] DELETE /identity/v3/projects/d371d64ae9ec40a38a74da1347fa3207 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:10.383038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:10.406009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b84c74-7d59-42d7-a87a-7ea623047c10 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:10.491139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:10.492097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:10.492562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:10.493081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] PATH_INFO: `/v3/users/bc214b467296441e95e9d1b4f91c8dba` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:10.494485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc214b467296441e95e9d1b4f91c8dba)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:10.496735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:10.503768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:10.566139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc214b467296441e95e9d1b4f91c8dba'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.587791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc214b467296441e95e9d1b4f91c8dba'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.588630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc214b467296441e95e9d1b4f91c8dba'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.589304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc214b467296441e95e9d1b4f91c8dba'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.598604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ead58133-1a76-4beb-830a-f816ac0278e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc214b467296441e95e9d1b4f91c8dba'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:10.618896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2886/5726] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:10 2022] DELETE /identity/v3/users/bc214b467296441e95e9d1b4f91c8dba => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:11.037916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:11.039842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:11.067023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eef46a-16ce-4db7-adb9-ccc95b9a2693 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:11.218135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:11.219269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.219667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.220048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] PATH_INFO: `/v3/projects/55c4e73af5824b79842ad751a43085b0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.221529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c4e73af5824b79842ad751a43085b0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:11.224120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:11.342695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c4e73af5824b79842ad751a43085b0', 'request_id': 'req-ad42827c-5e96-43ce-9828-158aa7141a27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:11.352841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c4e73af5824b79842ad751a43085b0', 'request_id': 'req-ad42827c-5e96-43ce-9828-158aa7141a27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:11.363656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c4e73af5824b79842ad751a43085b0', 'request_id': 'req-ad42827c-5e96-43ce-9828-158aa7141a27'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:11.401630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] The token cache is being invalidate because project 55c4e73af5824b79842ad751a43085b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:11.401983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:11.402801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ad42827c-5e96-43ce-9828-158aa7141a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:11.404672 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2841/5727] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:11 2022] DELETE /identity/v3/projects/55c4e73af5824b79842ad751a43085b0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:11.411739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.412327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.414833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.490548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:11.492031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:11.601215 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2887/5728] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:11.610857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.610857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.610857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.635256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:11.636724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:11.655650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:11.671438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2842/5729] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:11.683900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3a1a-9619-4272-8b8d-0cbf33e4e0bf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:11.689468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:11.690252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.690639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.691687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.694012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:11.694474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:11.696248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:11.720089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:11.725716 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2888/5730] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:11.737014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c6870-139a-49f6-9d69-21e26f6dd5e9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:11.759692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:11.759692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.760183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.760579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.761430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:11.763975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:11.801080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2843/5731] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:11 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:11.803593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:11.819681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490edd13-be91-4304-b1af-2ea383c69c5b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:11.894049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:11.894720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.895061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.895346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.896663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:11.898887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:11.922472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2889/5732] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:11 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:11.926492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:11.938532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00071-544f-408e-a786-f040afccc27b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:11.944076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:11.944807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:11.945098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:11.945377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:11.946236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:11.947980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:11.949526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:11.962974 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2844/5733] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:11.965844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:11.977623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe905b-263a-4057-8026-837c07b1459d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:11.990932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:12.002953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6a287-8da4-49d7-9617-8e787f714819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.006332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6a287-8da4-49d7-9617-8e787f714819 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.006624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6a287-8da4-49d7-9617-8e787f714819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.006894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6a287-8da4-49d7-9617-8e787f714819 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.007686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6a287-8da4-49d7-9617-8e787f714819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.013983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6a287-8da4-49d7-9617-8e787f714819 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.026767 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2890/5734] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:12.030784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.043131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f45c3-b7c7-41a7-a556-be4ac9e3471a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.048184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.048926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.049286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.049638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] PATH_INFO: `/v3/projects/5d851f950fdc4324a22726b4d780d869/users/0b6073d8736743ee90379237d801c3dd/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.066393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d851f950fdc4324a22726b4d780d869, user_id=0b6073d8736743ee90379237d801c3dd, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.069824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.083254 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2845/5735] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:12 2022] PUT /identity/v3/projects/5d851f950fdc4324a22726b4d780d869/users/0b6073d8736743ee90379237d801c3dd/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:12.094745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.095038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.095320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.125913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] MFA Rules not processed for user `0b6073d8736743ee90379237d801c3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:12.127459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:12.205592 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2891/5736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:12.209975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.279934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbdb7c-3cfb-4d82-8258-12e32ed55d9e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.284787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.285421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.285702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.285978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.287261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.289176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.321984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2846/5737] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:12 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:12.326009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.338686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c874-757c-4dff-90a0-b0315e05ae0d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.413836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.416161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.417095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.417190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.418015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.420935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.466949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2892/5738] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:12 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:12.468225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.493313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b28a-1a06-4996-adae-a46cdd152645 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.509939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.510833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.511357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.511819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.513308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.515726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.527927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2847/5739] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:12.531821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.544045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be714-da30-4c1b-9b8d-a57bd4dfbf5c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.549103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.549986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.550457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.550880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] PATH_INFO: `/v3/projects/43bc05317f094edea727c86b08216354/users/5e9303803dee4929b23d3637f3b1c99c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.586597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bc05317f094edea727c86b08216354, user_id=5e9303803dee4929b23d3637f3b1c99c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.589701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.614970 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2893/5740] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:12 2022] PUT /identity/v3/projects/43bc05317f094edea727c86b08216354/users/5e9303803dee4929b23d3637f3b1c99c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:12.620538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.639165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd982596-fa23-41e3-99eb-1503fcf9489b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.651719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.654088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:12.728042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:12.738216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfa366-3798-4466-a917-9383bd060db0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.752310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.753224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.753637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.754225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.761106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:12.782785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.784763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.785347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.785807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.788488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.794517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.814312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.818216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ae9ca-1006-42f9-a933-afdedb6c7ac4 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.829140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2848/5741] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:12.831882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:12.851059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2894/5742] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:39:12.868703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcec208-03d3-4249-ae1f-f18cdf469d7e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:12.885480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:12.886190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.886477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.886754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] PATH_INFO: `/v3/projects/43bc05317f094edea727c86b08216354/users/5e9303803dee4929b23d3637f3b1c99c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.896900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bc05317f094edea727c86b08216354, user_id=5e9303803dee4929b23d3637f3b1c99c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:12.909188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:12.936849 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2849/5743] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:12 2022] PUT /identity/v3/projects/43bc05317f094edea727c86b08216354/users/5e9303803dee4929b23d3637f3b1c99c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:12.948452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe6d1-083e-4838-bfd3-082d62c40188 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:12.949049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe6d1-083e-4838-bfd3-082d62c40188 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:12.949510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe6d1-083e-4838-bfd3-082d62c40188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:12.989098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9fffe6d1-083e-4838-bfd3-082d62c40188 None None] MFA Rules not processed for user `5e9303803dee4929b23d3637f3b1c99c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:12.992164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9fffe6d1-083e-4838-bfd3-082d62c40188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:13.078069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2895/5744] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:39:13.085389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:13.087264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:13.156268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:13.193577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8d9be-d7ad-4b8a-9169-1fe1fc585990 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:13.197605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:13.199109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:13.199496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:13.199847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:13.211226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:13.213775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:13.226363 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2850/5745] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:15.367287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:15.368044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:15.368468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:15.416043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:15.417550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:15.494021 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2896/5746] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:15.520046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:15.521785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:15.689027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1f946-84da-4342-bc6d-a94f64dab0a1 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:15.703311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:15.704998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:15.705869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:15.706376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:15.742463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:15.745411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:15.803012 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2851/5747] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:39:20.695030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:20.696560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:20.876919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed3348-a857-4b29-b196-ae6d227bee70 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:20.888582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:20.892562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:20.893126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:20.893577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] PATH_INFO: `/v3/users/0b80262470174f089095460a99b91563` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:20.894984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b80262470174f089095460a99b91563)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:20.897201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:20.951712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:21.016744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b80262470174f089095460a99b91563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:21.043402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b80262470174f089095460a99b91563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:21.044181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b80262470174f089095460a99b91563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:21.044811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b80262470174f089095460a99b91563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:21.061284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8d93e76c-815c-410b-b5dd-04178c0764a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b80262470174f089095460a99b91563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:21.087812 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2897/5748] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:20 2022] DELETE /identity/v3/users/0b80262470174f089095460a99b91563 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:22.100667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:22.122651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986c90-ef0d-4f1e-b384-9dced57a5176 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:22.300569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:22.302893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:22.303379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:22.303791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] PATH_INFO: `/v3/projects/23cbfb7d36aa489e8ff4b80d6eca9af0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:22.306368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cbfb7d36aa489e8ff4b80d6eca9af0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:22.320433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:22.454229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cbfb7d36aa489e8ff4b80d6eca9af0', 'request_id': 'req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:22.487905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cbfb7d36aa489e8ff4b80d6eca9af0', 'request_id': 'req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:22.499515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:22.516052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cbfb7d36aa489e8ff4b80d6eca9af0', 'request_id': 'req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:22.534355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] The token cache is being invalidate because project 23cbfb7d36aa489e8ff4b80d6eca9af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:22.534725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:22.535689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8852e20d-2c8f-49c2-ab01-0be4a9c5e23d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:22.542039 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2852/5749] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:22 2022] DELETE /identity/v3/projects/23cbfb7d36aa489e8ff4b80d6eca9af0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:22.544110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:22.545140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:22.545772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:22.592286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:22.597925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:22.832347 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2898/5750] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:22.839998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:22.840322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:22.840698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:22.879318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:22.881126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:22.903986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:22.904835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2853/5751] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:22.916281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b6858-fa5a-444d-a8d0-ca197cac86f3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:22.945102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:22.945102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:22.945102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:22.945102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:22.945545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:22.952526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:22.954247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:23.013546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2899/5752] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:23.018933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:23.035345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64190bc-c866-498f-93cb-664090459ae2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:23.046881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:23.048161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:23.048590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:23.049002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:23.049887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:23.054356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:23.154687 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2854/5753] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:23 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:23.157937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:23.187929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c726be1-a3e8-44ca-b104-4e955df63fa4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:23.388794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:23.389707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:23.390113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:23.390611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:23.392052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:23.399497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:23.454422 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2900/5754] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:23 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:23.460287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:23.471621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c8bd-3cfd-4b8e-aafc-d86d20cafe23 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:23.477856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:23.478777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:23.479325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:23.479758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:23.480612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:23.482727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:23.496954 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2855/5755] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:23.500885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:23.518458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88d7b4-23b6-46c0-a326-41341d2d52cc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:23.530652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26564a6-ef74-4da4-9e4f-5737d70bcc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:23.532599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26564a6-ef74-4da4-9e4f-5737d70bcc46 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:23.534919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26564a6-ef74-4da4-9e4f-5737d70bcc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:23.535334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26564a6-ef74-4da4-9e4f-5737d70bcc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:23.536127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26564a6-ef74-4da4-9e4f-5737d70bcc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:23.540060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26564a6-ef74-4da4-9e4f-5737d70bcc46 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:23.570765 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2901/5756] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:23.574900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:23.593433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98581d-ca22-4fab-be53-b328ac56744e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:23.607303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:23.608285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:23.608704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:23.609108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] PATH_INFO: `/v3/projects/857312c351194591904618524d58eacd/users/4080f9509937443f9306a7db0c4e631c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:23.698899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=857312c351194591904618524d58eacd, user_id=4080f9509937443f9306a7db0c4e631c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:23.708102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:23.762956 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2856/5757] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:23 2022] PUT /identity/v3/projects/857312c351194591904618524d58eacd/users/4080f9509937443f9306a7db0c4e631c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:23.773462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:23.774040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:23.774782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:23.806213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:23.913750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] MFA Rules not processed for user `4080f9509937443f9306a7db0c4e631c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:23.915196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:24.107460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2902/5758] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:24.111970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:24.383672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa012e4-0fe1-4891-bc84-02c7cf02cbfa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:24.392405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:24.393778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:24.394305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:24.394835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:24.396535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:24.398774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:24.500108 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2857/5759] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:24 2022] POST /identity/v3/projects => generated 369 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:24.504281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:24.524389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f4a95-a02d-43ff-8cbe-116e3d0269cf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:24.688159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:24.688822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:24.689091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:24.689367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:24.690499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:24.692686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:24.782539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2903/5760] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:24 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:24.786302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:24.828523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:24.830372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:24.841295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c944e-cc56-4999-a294-f17e7fa5cc1b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:24.865297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:24.866762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:24.867268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:24.867778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:24.868831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:24.878884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:24.908169 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2858/5761] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:24.913509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:24.943132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866e29f-20f2-468d-ae80-e60d8336bebb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:24.951885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:24.953132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:24.953631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:24.954353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] PATH_INFO: `/v3/projects/7b98b087ccd7475fb4ff73aecba3a71c/users/84df99bea5c44376ba843b743e2acf30/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:24.979417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c997b-befe-408f-974f-2df6b2c4a9ae admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:24.990752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9303803dee4929b23d3637f3b1c99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43bc05317f094edea727c86b08216354', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:24.991376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:24.991668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:24.991944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:24.993622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:24.996190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:24.997851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:25.027187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2904/5762] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:39:25.036144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:25.072108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b98b087ccd7475fb4ff73aecba3a71c, user_id=84df99bea5c44376ba843b743e2acf30, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:25.073906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfb590-8349-441f-b0fa-6394488dc0d6 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:25.076550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:25.080286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9303803dee4929b23d3637f3b1c99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43bc05317f094edea727c86b08216354', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:25.081373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:25.081861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:25.082358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:25.083221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:25.085480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:25.106009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:25.110727 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2859/5763] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:24 2022] PUT /identity/v3/projects/7b98b087ccd7475fb4ff73aecba3a71c/users/84df99bea5c44376ba843b743e2acf30/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:25.112837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:25.137502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2905/5764] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:25 2022] POST /identity/v3/projects => generated 347 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:25.141552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:25.251322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:25.295379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a15588-2d46-4ec9-8b9e-ff4fbc26ee12 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:25.351722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159d16-1925-4159-b41b-551b10b7f868 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:25.384737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9303803dee4929b23d3637f3b1c99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43bc05317f094edea727c86b08216354', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:25.398008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:25.405539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:25.405539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:25.408290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:25.408290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:25.418477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:25.466511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2906/5765] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:25.496260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a423d-e016-4da0-ac56-43c1cf997fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:25.497566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a423d-e016-4da0-ac56-43c1cf997fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:25.498032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a423d-e016-4da0-ac56-43c1cf997fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:25.498632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a423d-e016-4da0-ac56-43c1cf997fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:25.499639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a423d-e016-4da0-ac56-43c1cf997fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:25.501894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a423d-e016-4da0-ac56-43c1cf997fb3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:25.536090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2860/5766] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:25.540329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:25.555530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a068a-0ca5-42e2-9911-1680d8c77b7a tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:25.568496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:25.569638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:25.571241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:25.571723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] PATH_INFO: `/v3/projects/7b98b087ccd7475fb4ff73aecba3a71c/users/84df99bea5c44376ba843b743e2acf30/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:25.575233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b98b087ccd7475fb4ff73aecba3a71c, user_id=84df99bea5c44376ba843b743e2acf30, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:25.579398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:25.596634 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2907/5767] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:25 2022] PUT /identity/v3/projects/7b98b087ccd7475fb4ff73aecba3a71c/users/84df99bea5c44376ba843b743e2acf30/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:25.609614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:25.611699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:25.612408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:25.700779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] MFA Rules not processed for user `84df99bea5c44376ba843b743e2acf30`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:25.702204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:25.969794 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2861/5768] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:25.970230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:25.995542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d0d8-6b72-4c02-86da-e3fe908f3aad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.020638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.021391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.021752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.022103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.023523 n-d-862355-5 devstack@keystone.service[82000]: WARNING oslo_log.versionutils [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.023693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.025085 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.025085 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:39:26.025085 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:26.038808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.113551 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2908/5769] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:39:25 2022] POST /identity/v3/policies => generated 229 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:26.118283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.147463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fce8-ff13-4a25-b6b9-34066f07d19d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.154019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.154717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.154999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.155276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies/6845c3d8ff8a4b94b153ba26c6218f84` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.156238 n-d-862355-5 devstack@keystone.service[81999]: WARNING oslo_log.versionutils [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.156802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=6845c3d8ff8a4b94b153ba26c6218f84)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.158716 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.158716 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:39:26.158716 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:39:26.160668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.206440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2862/5770] 10.222.0.23 () {60 vars in 1252 bytes} [Mon Oct 31 05:39:26 2022] PATCH /identity/v3/policies/6845c3d8ff8a4b94b153ba26c6218f84 => generated 236 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:26.211337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.229236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642fabf-d050-4a2f-b665-e9fbe883ccb3 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.241519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.242550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.244646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.245307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies/6845c3d8ff8a4b94b153ba26c6218f84` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.246401 n-d-862355-5 devstack@keystone.service[82000]: WARNING oslo_log.versionutils [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.247953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=6845c3d8ff8a4b94b153ba26c6218f84)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.252131 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.252131 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:39:26.252131 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:26.253409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.278501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2909/5771] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:39:26 2022] GET /identity/v3/policies/6845c3d8ff8a4b94b153ba26c6218f84 => generated 236 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:26.279837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.315852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d05cb-b455-47f1-9b1d-948231274d88 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.334934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.336023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.336322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.336649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies/6845c3d8ff8a4b94b153ba26c6218f84` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.337568 n-d-862355-5 devstack@keystone.service[81999]: WARNING oslo_log.versionutils [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.338172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6845c3d8ff8a4b94b153ba26c6218f84)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.342862 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.342862 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:39:26.342862 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:39:26.345839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.391512 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2863/5772] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:26 2022] DELETE /identity/v3/policies/6845c3d8ff8a4b94b153ba26c6218f84 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:26.393957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.420536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f535f9-f97e-4e2c-8c88-4866a6347064 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.429532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.430548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.431083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.431575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.433145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.435988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.484977 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2910/5773] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:39:26 2022] POST /identity/v3/policies => generated 228 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:26.490194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.510752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96ad7-a85e-4b95-82dc-b2bd4a11cf53 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.524063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.526386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.526668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.526941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.528238 n-d-862355-5 devstack@keystone.service[81999]: WARNING oslo_log.versionutils [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.528379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.532444 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.532444 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:39:26.532444 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:39:26.538316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.583324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.596083 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2864/5774] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:39:26 2022] POST /identity/v3/policies => generated 228 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:26.603666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe71a45-7eee-4b1a-ab66-e6da433059d7 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.623342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.632611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.633328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.633851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.633962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.638538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.640392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.706624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:26.710315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2911/5775] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:39:26 2022] POST /identity/v3/policies => generated 229 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:26.711607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.736951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad019-5d89-4753-b7da-e86c265abc2d tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.747288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.747941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.748226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.748501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.753110 n-d-862355-5 devstack@keystone.service[82000]: WARNING oslo_log.versionutils [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.755403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.759914 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.759914 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:39:26.759914 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:26.761182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.821910 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2912/5776] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:39:26 2022] GET /identity/v3/policies => generated 761 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:26.825741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.842215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5b5e-4c5c-41f4-a9b2-b4a6466673e9 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.847692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f9a-8982-485f-9ac4-72807f58c351 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.851585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.852173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.852463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.852738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies/70d39a223ba04c9f8d0726ee04fbaacd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.857072 n-d-862355-5 devstack@keystone.service[82000]: WARNING oslo_log.versionutils [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 05:39:26.858909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=70d39a223ba04c9f8d0726ee04fbaacd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.860606 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:26.860606 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:39:26.860606 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:26.861534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.878074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e9303803dee4929b23d3637f3b1c99c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43bc05317f094edea727c86b08216354', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.878776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.879068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.880050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] PATH_INFO: `/v3/projects/cac8c7e8a2214a24b4ce2ef2661b97a6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.883566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2913/5777] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:26 2022] DELETE /identity/v3/policies/70d39a223ba04c9f8d0726ee04fbaacd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:26.887498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cac8c7e8a2214a24b4ce2ef2661b97a6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.889379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.890670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.903496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cb21c-918c-48fc-b0b6-b17f12dd3e92 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.911845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.912721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.913181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.913606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies/6722e2e4830940dba822a7a9add9d884` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.915079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6722e2e4830940dba822a7a9add9d884)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.918431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:26.965354 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2914/5778] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:26 2022] DELETE /identity/v3/policies/6722e2e4830940dba822a7a9add9d884 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:26.972295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:26.986310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22376465-b20d-430e-a5e1-175de799fb28 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:26.995562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84df99bea5c44376ba843b743e2acf30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b98b087ccd7475fb4ff73aecba3a71c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:26.995562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:26.995562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:26.995857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] PATH_INFO: `/v3/policies/1383a94868f9452d8050bd7b315da053` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:26.996996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1383a94868f9452d8050bd7b315da053)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:26.999056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:27.054396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2915/5779] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:26 2022] DELETE /identity/v3/policies/1383a94868f9452d8050bd7b315da053 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:27.058195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac8c7e8a2214a24b4ce2ef2661b97a6', 'request_id': 'req-f597134a-b84c-4304-a1f0-36ce623cf523'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.063339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:27.093799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac8c7e8a2214a24b4ce2ef2661b97a6', 'request_id': 'req-f597134a-b84c-4304-a1f0-36ce623cf523'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.113477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac8c7e8a2214a24b4ce2ef2661b97a6', 'request_id': 'req-f597134a-b84c-4304-a1f0-36ce623cf523'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.152605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] The token cache is being invalidate because project cac8c7e8a2214a24b4ce2ef2661b97a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:27.153302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.154344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.162244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2865/5780] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:26 2022] DELETE /identity/v3/projects/cac8c7e8a2214a24b4ce2ef2661b97a6 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:27.163116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:27.175528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:27.187227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:27.341496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415404a2-b4c0-4285-990d-9e17fc5e1957 tempest-PoliciesTestJSON-1485389855 tempest-PoliciesTestJSON-1485389855-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:27.486806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597134a-b84c-4304-a1f0-36ce623cf523 tempest-RoutersAdminTest-1597918375 tempest-RoutersAdminTest-1597918375-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:27.502319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:27.503248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:27.503700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:27.504133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:27.509128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:27.532353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:27.532353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:27.532933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:27.533318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] PATH_INFO: `/v3/users/4080f9509937443f9306a7db0c4e631c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:27.538502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4080f9509937443f9306a7db0c4e631c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:27.539182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:27.638268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:27.639318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4080f9509937443f9306a7db0c4e631c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.643758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fc5b5-df41-4d9a-ba1e-423c76b942e3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:27.674349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4080f9509937443f9306a7db0c4e631c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.679883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4080f9509937443f9306a7db0c4e631c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.695241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2866/5781] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:27.695604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4080f9509937443f9306a7db0c4e631c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.712735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4080f9509937443f9306a7db0c4e631c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:27.744227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d48128-2d20-427b-bc51-0af04ea1d026 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:27.745207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d48128-2d20-427b-bc51-0af04ea1d026 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:27.745722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d48128-2d20-427b-bc51-0af04ea1d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:27.751308 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2916/5782] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:27 2022] DELETE /identity/v3/users/4080f9509937443f9306a7db0c4e631c => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:27.772738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:27.794431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-73d48128-2d20-427b-bc51-0af04ea1d026 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:27.798954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-73d48128-2d20-427b-bc51-0af04ea1d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:27.999193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2867/5783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:39:28.020842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:28.022609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:28.239463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b04bb-4b2d-4087-bda3-3e81aff7720b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:28.245331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:28.246412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:28.246793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:28.247257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:28.269997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:28.272055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:28.291583 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2917/5784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:28.313339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:28.313638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:28.313912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:28.376852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] MFA Rules not processed for user `c9d5ec5af50a4be78cfd007565c7165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:28.378329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:28.508579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2868/5785] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:29.186600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:29.187785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:29.206610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:29.213908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c16859-8376-4bbd-aadd-27790c261a21 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:29.229406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:29.230071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:29.230451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:29.230728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] PATH_INFO: `/v3/projects/857312c351194591904618524d58eacd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:29.231957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857312c351194591904618524d58eacd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:29.233885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:29.359937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857312c351194591904618524d58eacd', 'request_id': 'req-7ae72aee-3e99-40d8-969e-7e743e163f01'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.369537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857312c351194591904618524d58eacd', 'request_id': 'req-7ae72aee-3e99-40d8-969e-7e743e163f01'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.386945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857312c351194591904618524d58eacd', 'request_id': 'req-7ae72aee-3e99-40d8-969e-7e743e163f01'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.435153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] The token cache is being invalidate because project 857312c351194591904618524d58eacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:29.435153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.438359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.440072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2918/5786] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:29 2022] DELETE /identity/v3/projects/857312c351194591904618524d58eacd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:29.453247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:29.486108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5af803-fa85-4bb2-871b-4a084877059c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:29.621762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:29.622656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:29.623104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:29.623537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] PATH_INFO: `/v3/users/84df99bea5c44376ba843b743e2acf30` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:29.626417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84df99bea5c44376ba843b743e2acf30)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:29.629481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:29.725548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84df99bea5c44376ba843b743e2acf30'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.741125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84df99bea5c44376ba843b743e2acf30'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.741981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84df99bea5c44376ba843b743e2acf30'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.742848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84df99bea5c44376ba843b743e2acf30'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.744536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:29.760445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84df99bea5c44376ba843b743e2acf30'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:29.799423 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2869/5787] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:29 2022] DELETE /identity/v3/users/84df99bea5c44376ba843b743e2acf30 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:30.295083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:30.297874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:30.423489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:30.425333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:30.628472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae72aee-3e99-40d8-969e-7e743e163f01 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:30.747775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbc48b-e565-4ee4-b3a9-777872f3f3fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:30.758463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:30.759377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:30.761430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:30.762587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] PATH_INFO: `/v3/projects/7b98b087ccd7475fb4ff73aecba3a71c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:30.766400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b98b087ccd7475fb4ff73aecba3a71c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:30.787012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:30.851167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:30.852055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:30.852502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:30.852938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:30.855094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:30.875405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:30.878039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5eaac-9449-411b-8692-06a3ac35893f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:30.908747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2919/5788] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:30.971459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b98b087ccd7475fb4ff73aecba3a71c', 'request_id': 'req-9348766e-246a-4c98-a0db-2f5174477b9e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:30.995429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b98b087ccd7475fb4ff73aecba3a71c', 'request_id': 'req-9348766e-246a-4c98-a0db-2f5174477b9e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:31.009722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b98b087ccd7475fb4ff73aecba3a71c', 'request_id': 'req-9348766e-246a-4c98-a0db-2f5174477b9e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:31.049910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] The token cache is being invalidate because project 7b98b087ccd7475fb4ff73aecba3a71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:31.050627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:31.051725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9348766e-246a-4c98-a0db-2f5174477b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:31.058029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2870/5789] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:30 2022] DELETE /identity/v3/projects/7b98b087ccd7475fb4ff73aecba3a71c => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:31.063078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:31.063486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:31.063692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:31.132370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:31.137836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:31.313221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:31.360052 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2920/5790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:31.367859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:31.368700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:31.369425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:31.431343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:31.432931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:31.443142 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2871/5791] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:31.447150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:31.467667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea07b2c-bb60-4230-af02-c96a9df7e9f8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:31.481827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:31.482529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:31.482809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:31.483280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:31.484112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:31.488481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:31.490533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:31.534114 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2921/5792] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:31.539704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:31.588665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1a3f9-e61b-41b1-870a-a2a82efd52bf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:31.618879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:31.626419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:31.627195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:31.629128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:31.630169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:31.647950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:31.761246 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2872/5793] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:31 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:31.762759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:31.775791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac8a8-8d84-4cf9-8c93-dd30882c1c65 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:31.990408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:31.993371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:31.993371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:31.993371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.006556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:32.012867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:32.084781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2922/5794] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:31 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:32.088969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:32.100623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e05a1-6b17-4a6c-ba94-1a8e2b93610d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:32.105982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:32.106763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:32.107119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:32.107468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.108354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:32.110353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:32.138688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:32.146202 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2873/5795] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:32.151991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ff578-3ace-4b9c-8222-1e207a9097c0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:32.162866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c95114-5331-431c-aa64-198380113e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:32.163812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c95114-5331-431c-aa64-198380113e70 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:32.164373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c95114-5331-431c-aa64-198380113e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:32.164816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c95114-5331-431c-aa64-198380113e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.165665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c95114-5331-431c-aa64-198380113e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:32.167831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c95114-5331-431c-aa64-198380113e70 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:32.182379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2923/5796] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:39:32.186856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:32.200016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a7b7-a195-42df-88b0-b9722ebbe3cb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:32.205641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:32.216616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:32.217989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:32.218420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] PATH_INFO: `/v3/projects/05ad3cd6fc86432ab48e4a18afd59cca/users/92a7a1d6286848a48ce31f0a519529f2/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.243234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ad3cd6fc86432ab48e4a18afd59cca, user_id=92a7a1d6286848a48ce31f0a519529f2, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:32.247143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:32.270922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:32.283887 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2874/5797] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:32 2022] PUT /identity/v3/projects/05ad3cd6fc86432ab48e4a18afd59cca/users/92a7a1d6286848a48ce31f0a519529f2/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:32.295350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:32.295753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:32.296140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.358784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] MFA Rules not processed for user `92a7a1d6286848a48ce31f0a519529f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:32.360061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:32.524598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:32.530847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:32.549519 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2924/5798] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:32.554696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:32.689358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:32.732857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f7421-ac3a-4e17-9d18-e00aa8b387a9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:32.739536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a15047-c7db-4c75-9098-d2e5c0d407b8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:32.750932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:32.751833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:32.752123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:32.752405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.752849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:32.753959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:32.755050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:32.755573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:32.756434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:32.758369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:32.758896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:32.842088 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2925/5799] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:32 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:32.847649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:33.015437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5cca-ef3a-4d49-83c2-874df29c2be9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:33.021883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:33.023238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:33.023629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:33.024006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:33.024750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:33.026873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:33.053954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:33.060060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:33.062638 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2926/5800] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:32 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:33.066624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:33.080301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077634e-be5d-4db3-bbed-70a809cfff2f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:33.093842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:33.094663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:33.095169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:33.095548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:33.097268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:33.101371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:33.107189 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2875/5801] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:39:33.166058 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2927/5802] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:39:33.168479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:33.183181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e68ad-5a6a-43ad-a914-cd83357b273b service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:33.188427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:33.189176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:33.189559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:33.189907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] PATH_INFO: `/v3/projects/4d83a5c0e32949ce9fd46121d9ff4adf/users/8511777d1d5a4fa7a97fa31310d614a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:33.274778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d83a5c0e32949ce9fd46121d9ff4adf, user_id=8511777d1d5a4fa7a97fa31310d614a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:33.287762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:33.341906 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2876/5803] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:33 2022] PUT /identity/v3/projects/4d83a5c0e32949ce9fd46121d9ff4adf/users/8511777d1d5a4fa7a97fa31310d614a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:33.345627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:33.360752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687201-2823-48b3-b302-3ff83b66a50d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:33.557014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaf0ad-b0e8-498f-943c-5d0edf878b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:33.557709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf0ad-b0e8-498f-943c-5d0edf878b6b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:33.557997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf0ad-b0e8-498f-943c-5d0edf878b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:33.558297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf0ad-b0e8-498f-943c-5d0edf878b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:33.559047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaf0ad-b0e8-498f-943c-5d0edf878b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:33.560733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaf0ad-b0e8-498f-943c-5d0edf878b6b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:33.591495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2928/5804] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:33.595191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:33.622802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559d642-c608-49b8-a9c9-c143ebc24588 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:33.640781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:33.641290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:33.643073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:33.644297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] PATH_INFO: `/v3/projects/4d83a5c0e32949ce9fd46121d9ff4adf/users/8511777d1d5a4fa7a97fa31310d614a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:33.648997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d83a5c0e32949ce9fd46121d9ff4adf, user_id=8511777d1d5a4fa7a97fa31310d614a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:33.654814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:33.671221 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2877/5805] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:33 2022] PUT /identity/v3/projects/4d83a5c0e32949ce9fd46121d9ff4adf/users/8511777d1d5a4fa7a97fa31310d614a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:33.681648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:33.682044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:33.682453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:33.767361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] MFA Rules not processed for user `8511777d1d5a4fa7a97fa31310d614a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:33.768703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:33.856204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:33.963392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2929/5806] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:33.968383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:33.985758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b4eab-8bfd-4e60-b2e9-cf944a419422 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:34.000353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:34.000353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:34.000353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:34.000763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:34.002328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:34.007378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:34.067370 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2878/5807] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:33 2022] POST /identity/v3/projects => generated 359 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:34.071442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:34.086476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100076-1a74-406a-8f29-7939f63e22ff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:34.259050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:34.259753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:34.260038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:34.260312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-43830140` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:34.261943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=59db1c6b1bfc4345b01796048f89150d, value=tempest-tag-43830140)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:34.264176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:34.486818 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-43830140. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:39:34.486818 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:39:34.486818 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:34.508009 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2930/5808] 10.222.0.23 () {60 vars in 1327 bytes} [Mon Oct 31 05:39:34 2022] PUT /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-43830140 => generated 0 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 289 bytes (1 switches on core 0) Oct 31 05:39:34.508956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:34.523765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930990da-61f9-494b-b31c-9946c7900087 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:34.549820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:34.553817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:34.556117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:34.556487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-43830140` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:34.587573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=59db1c6b1bfc4345b01796048f89150d, value=tempest-tag-43830140)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:34.592055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:34.660488 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2879/5809] 10.222.0.23 () {58 vars in 1308 bytes} [Mon Oct 31 05:39:34 2022] GET /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-43830140 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:34.664630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:34.681861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7e429-8483-458e-9272-a6c879821c44 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:34.696099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:34.696787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:34.697076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:34.697359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:34.698772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=59db1c6b1bfc4345b01796048f89150d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:34.700839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:34.810460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2931/5810] 10.222.0.23 () {60 vars in 1265 bytes} [Mon Oct 31 05:39:34 2022] PUT /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags => generated 140 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:34.815842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:34.829861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3872f-e5c4-4265-b1eb-8e9066ddd9fe tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:34.847287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:34.848977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:34.849267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:34.849543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:34.883352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=59db1c6b1bfc4345b01796048f89150d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:34.885453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:34.915884 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2880/5811] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 31 05:39:34 2022] GET /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags => generated 140 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:34.919758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:34.934059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b56985-9fb4-425e-9cce-c6f78a49d15d tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:34.944875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:34.947446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:34.947906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:34.948339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-253427141` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:34.952883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=59db1c6b1bfc4345b01796048f89150d, value=tempest-tag-253427141)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:34.955765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:35.043048 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-253427141. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:39:35.043048 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:39:35.043048 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:35.047708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:35.056883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2932/5812] 10.222.0.23 () {58 vars in 1314 bytes} [Mon Oct 31 05:39:34 2022] DELETE /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-253427141 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:35.062010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:35.074884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117105-fcb8-4885-aee7-ac3c4553fc36 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:35.097456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:35.101255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:35.105851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:35.106251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-253427141` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:35.115775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:35.156330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=59db1c6b1bfc4345b01796048f89150d, value=tempest-tag-253427141)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:35.162520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Could not find project tag: tempest-tag-253427141.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-253427141. Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 31 05:39:35.199900 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 31 05:39:35.200910 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:39:35.200910 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:39:35.200910 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 31 05:39:35.200910 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 31 05:39:35.200910 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-253427141. Oct 31 05:39:35.200910 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:35.201295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2881/5813] 10.222.0.23 () {58 vars in 1311 bytes} [Mon Oct 31 05:39:35 2022] GET /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags/tempest-tag-253427141 => generated 106 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:39:35.205219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:35.219266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac68cd-4d9b-4588-837c-f46f120b13cf tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:35.226830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:35.227899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:35.228362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:35.228834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:35.230246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=59db1c6b1bfc4345b01796048f89150d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:35.234016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:35.345527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2933/5814] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:39:35 2022] DELETE /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:35.350251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:35.373062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a32d7a-9d86-4839-ab28-1b20100b488e tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:35.383724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:35.384731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:35.385238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:35.386226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:35.402188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=59db1c6b1bfc4345b01796048f89150d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:35.404603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:35.430773 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2882/5815] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 31 05:39:35 2022] GET /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d/tags => generated 66 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 05:39:35.435084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:35.449921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5fa7a-9bf4-4ce5-beed-7415bdea1a95 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:35.470363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8511777d1d5a4fa7a97fa31310d614a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d83a5c0e32949ce9fd46121d9ff4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:35.471145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:35.471431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:35.471838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] PATH_INFO: `/v3/projects/59db1c6b1bfc4345b01796048f89150d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:35.473130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59db1c6b1bfc4345b01796048f89150d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:35.476643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:35.561013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59db1c6b1bfc4345b01796048f89150d', 'request_id': 'req-e63938b3-85d3-4e0f-aab0-cdc164238721'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:35.572732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59db1c6b1bfc4345b01796048f89150d', 'request_id': 'req-e63938b3-85d3-4e0f-aab0-cdc164238721'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:35.584194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59db1c6b1bfc4345b01796048f89150d', 'request_id': 'req-e63938b3-85d3-4e0f-aab0-cdc164238721'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:35.619478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] The token cache is being invalidate because project 59db1c6b1bfc4345b01796048f89150d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:35.620265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:35.621165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e63938b3-85d3-4e0f-aab0-cdc164238721 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:35.623660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2934/5816] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:35 2022] DELETE /identity/v3/projects/59db1c6b1bfc4345b01796048f89150d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:35.628768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:35.632693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:35.781015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4910b-da27-4b80-ac2f-088c19149aa9 tempest-IdentityV3ProjectTagsTest-955602292 tempest-IdentityV3ProjectTagsTest-955602292-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:35.961952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:35.962826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:35.963795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:35.965524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] PATH_INFO: `/v3/users/92a7a1d6286848a48ce31f0a519529f2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:35.966989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a7a1d6286848a48ce31f0a519529f2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:35.969444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:36.078200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a7a1d6286848a48ce31f0a519529f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.089876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a7a1d6286848a48ce31f0a519529f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.091046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a7a1d6286848a48ce31f0a519529f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.091867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a7a1d6286848a48ce31f0a519529f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.102729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a7a1d6286848a48ce31f0a519529f2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.112680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:36.128987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2883/5817] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:35 2022] DELETE /identity/v3/users/92a7a1d6286848a48ce31f0a519529f2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:36.133450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:36.136796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:36.137259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:36.161681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:36.164330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:36.276145 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2935/5818] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:39:36.305245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:36.306894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:36.400341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a125a97-6fc8-47d6-abe6-81beffc68d64 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:36.404510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:36.405214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:36.405565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:36.405910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:36.417203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:36.419103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:36.444808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2884/5819] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:36.850349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:36.851832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:36.884214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17868-0056-4c7b-a2a4-5f1d77ecbdf0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:36.898001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:36.898697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:36.898978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:36.899252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] PATH_INFO: `/v3/projects/05ad3cd6fc86432ab48e4a18afd59cca` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:36.900536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ad3cd6fc86432ab48e4a18afd59cca)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:36.903394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:36.959087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:36.968087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ad3cd6fc86432ab48e4a18afd59cca', 'request_id': 'req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.977193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ad3cd6fc86432ab48e4a18afd59cca', 'request_id': 'req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:36.984493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ad3cd6fc86432ab48e4a18afd59cca', 'request_id': 'req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.002328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] The token cache is being invalidate because project 05ad3cd6fc86432ab48e4a18afd59cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:37.003043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.003925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.006771 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2936/5820] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:36 2022] DELETE /identity/v3/projects/05ad3cd6fc86432ab48e4a18afd59cca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:37.011354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:37.024527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc4f8e-704d-4d37-8026-61c4b18464da service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:37.110198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:37.111680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:37.112186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:37.112528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] PATH_INFO: `/v3/users/8511777d1d5a4fa7a97fa31310d614a3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:37.113908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8511777d1d5a4fa7a97fa31310d614a3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:37.116835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:37.175589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8511777d1d5a4fa7a97fa31310d614a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.187450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8511777d1d5a4fa7a97fa31310d614a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.188506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8511777d1d5a4fa7a97fa31310d614a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.189982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8511777d1d5a4fa7a97fa31310d614a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.202586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3f3090d-9635-4509-821e-18d39c6736aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8511777d1d5a4fa7a97fa31310d614a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:37.228156 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2885/5821] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:37 2022] DELETE /identity/v3/users/8511777d1d5a4fa7a97fa31310d614a3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:37.797618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:37.799656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:37.856147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88691e-7bbe-4023-ba9e-4cbb59fbde71 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:37.956898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:37.957606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:37.957944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:37.958425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] PATH_INFO: `/v3/projects/4d83a5c0e32949ce9fd46121d9ff4adf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:37.970731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d83a5c0e32949ce9fd46121d9ff4adf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:37.972918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.085736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d83a5c0e32949ce9fd46121d9ff4adf', 'request_id': 'req-42514bb4-7ccb-4717-b23a-f512dacc2332'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:38.099022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d83a5c0e32949ce9fd46121d9ff4adf', 'request_id': 'req-42514bb4-7ccb-4717-b23a-f512dacc2332'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:38.113868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d83a5c0e32949ce9fd46121d9ff4adf', 'request_id': 'req-42514bb4-7ccb-4717-b23a-f512dacc2332'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:38.134180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] The token cache is being invalidate because project 4d83a5c0e32949ce9fd46121d9ff4adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:38.134500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:38.135354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-42514bb4-7ccb-4717-b23a-f512dacc2332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:38.137456 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2937/5822] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:37 2022] DELETE /identity/v3/projects/4d83a5c0e32949ce9fd46121d9ff4adf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:38.142619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.144495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.144994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.205776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:38.212258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:38.239264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:38.361493 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2886/5823] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:38.369847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.370423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.370863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.398577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:38.402658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:38.418772 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2938/5824] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:38.423172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:38.439132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63748e3-024a-4f71-99f2-735feac9ddbf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:38.450591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:38.451169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.451560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.451715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.452388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:39:38.452693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:38.454319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.481556 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2887/5825] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:38.486065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:38.499337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15002b85-b8d6-4c54-a41d-8e5dd98c94e7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:38.505249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:38.506056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.507027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.507401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.508134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:38.510763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.556741 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2939/5826] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:38 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:38.560627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:38.574947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a772-2790-4bf5-b7f4-282eb1aaaac5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:38.672011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:38.673064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.673726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.674415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.675293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:38.678973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.765079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2888/5827] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:38 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:38.769415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:38.791573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469a97f-d534-409f-ba7c-dffb83766d5a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:38.825400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:38.826655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.827199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.828678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.829647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:38.834366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.848662 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2940/5828] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:38.851896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:38.867302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe094876-83c6-4459-be48-96a9288fae8d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:38.878079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47cb32-ab02-485a-8f04-8d2ea83d8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:38.878079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47cb32-ab02-485a-8f04-8d2ea83d8e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.878079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47cb32-ab02-485a-8f04-8d2ea83d8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.878079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47cb32-ab02-485a-8f04-8d2ea83d8e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.878557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47cb32-ab02-485a-8f04-8d2ea83d8e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:38.879389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47cb32-ab02-485a-8f04-8d2ea83d8e7a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.903591 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2889/5829] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:38.907897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:38.921792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd0c4-55c0-473d-a54e-cdeba3203210 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:38.927849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:38.928736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.929021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.929354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] PATH_INFO: `/v3/projects/03badf9b32074affb05448cbcfdf38c5/users/505ca7df93f34f8b84379f1aa51a8178/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:38.950472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03badf9b32074affb05448cbcfdf38c5, user_id=505ca7df93f34f8b84379f1aa51a8178, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:38.953539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:38.959931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:38.983747 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2941/5830] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:38 2022] PUT /identity/v3/projects/03badf9b32074affb05448cbcfdf38c5/users/505ca7df93f34f8b84379f1aa51a8178/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:38.995720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:38.996963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:38.997301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.066990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] MFA Rules not processed for user `505ca7df93f34f8b84379f1aa51a8178`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:39.068897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:39.158461 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2890/5831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:39.162617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:39.243592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6151-8180-4777-8cd7-f4e30044546f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:39.249002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:39.249819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.250293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.250716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.251500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:39.254111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:39.312129 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2942/5832] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:39 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:39.316450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:39.342293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad852a-aebd-484a-b452-70179cee6f36 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:39.347507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:39.439956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:39.440592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.440875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.441149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.441790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:39.444298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:39.491552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2891/5833] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:39 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:39.495596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:39.516971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d8b54-2db2-4268-90e0-8b22d96fe4a6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:39.522388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:39.523260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.523692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.524119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.524918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:39.526919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:39.543993 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2943/5834] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:39.548023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:39.559256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d798b-acb1-411f-8af6-16f0a3c3ea89 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:39.571723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:39.572623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.573077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.573520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] PATH_INFO: `/v3/projects/6d6bf663e66541a78651d57a7a991ae6/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.596308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6bf663e66541a78651d57a7a991ae6, user_id=70964db485d945cf8dde326cbbdec790, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:39.600590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:39.627268 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2892/5835] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:39 2022] PUT /identity/v3/projects/6d6bf663e66541a78651d57a7a991ae6/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:39.633644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:39.653652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a037c8-16c3-4d74-ac79-6c0356d2a8b4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:39.772622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfebda8-e468-4c2d-8ce4-5ab24993cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:39.773266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebda8-e468-4c2d-8ce4-5ab24993cffd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.773550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebda8-e468-4c2d-8ce4-5ab24993cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.774201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfebda8-e468-4c2d-8ce4-5ab24993cffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.774868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfebda8-e468-4c2d-8ce4-5ab24993cffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:39.776624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfebda8-e468-4c2d-8ce4-5ab24993cffd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:39.805115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:39.806232 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2944/5836] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:39.821158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653ef5-efbf-4bbe-94f1-49aabfbfee49 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:39.827623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:39.828638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.828928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.829204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] PATH_INFO: `/v3/projects/6d6bf663e66541a78651d57a7a991ae6/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.832457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6bf663e66541a78651d57a7a991ae6, user_id=70964db485d945cf8dde326cbbdec790, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:39.836682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:39.880175 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2893/5837] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:39 2022] PUT /identity/v3/projects/6d6bf663e66541a78651d57a7a991ae6/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:39.889612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:39.889910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:39.890217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:39.964404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] MFA Rules not processed for user `70964db485d945cf8dde326cbbdec790`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:39.965737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:40.062541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:40.092368 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2945/5838] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:40.096730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:40.195422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101a6b-0084-4e3e-b35e-5a8240de06af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:40.213726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:40.214492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.214778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.215130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.215911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:40.218664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:40.258959 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2894/5839] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:40 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:40.262791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:40.276770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d2258-081a-48dc-9937-86a57cc3989a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:40.402326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:40.403402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.404661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.405121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.406254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:40.408475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:40.448304 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2946/5840] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:40 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:40.452060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:40.476282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1989f-126b-4457-8094-6fdbffe9cd05 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:40.495222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:40.495874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.496159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.496439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.497176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:40.498961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:40.525076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2895/5841] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:40.528965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:40.540588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7091-f60f-4747-b927-60a17494721e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:40.546456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73774-ff23-41dd-81c3-67217f84b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:40.547493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73774-ff23-41dd-81c3-67217f84b5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.547787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73774-ff23-41dd-81c3-67217f84b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.548067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73774-ff23-41dd-81c3-67217f84b5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.548713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73774-ff23-41dd-81c3-67217f84b5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:40.550360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73774-ff23-41dd-81c3-67217f84b5f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:40.569396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:40.576677 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2947/5842] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:40.580342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba74f-4919-4765-b73a-fbcb0be971aa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:40.586896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:40.587584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.587869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.588286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] PATH_INFO: `/v3/projects/e4b3614fb4394015a90aac408631dfcd/users/18bbaba1384641d3a20c44aba5b89537/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.613483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b3614fb4394015a90aac408631dfcd, user_id=18bbaba1384641d3a20c44aba5b89537, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:40.617966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:40.654668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.655471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.655768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.659740 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2896/5843] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:40 2022] PUT /identity/v3/projects/e4b3614fb4394015a90aac408631dfcd/users/18bbaba1384641d3a20c44aba5b89537/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:40.693818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] MFA Rules not processed for user `18bbaba1384641d3a20c44aba5b89537`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:40.696730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:40.828969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:40.874994 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2948/5844] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:40.888951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:40.974479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39970-3672-4b2c-8b1f-c0ed7da433fc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:40.980202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:40.980928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:40.981287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:40.981640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:40.982663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:40.984986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.027899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2897/5845] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:39:40 2022] POST /identity/v3/domains => generated 276 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:41.032162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.088296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f634dc-5b33-4e54-956c-5553ab48c612 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.165467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.169031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:41.296186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.297104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.297574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.298304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.299879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.303493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.309907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:41.348724 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2949/5846] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:39:41 2022] POST /identity/v3/roles => generated 239 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:41.353613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.383626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3a3b-c2c5-400c-abb9-b5bacfd5cf0b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.385634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aee1d-f164-465d-a691-eb5d35acda19 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.394232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.397399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.397837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.398107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/41ae8296188b455ab2575ba2c9f1555c/users/18bbaba1384641d3a20c44aba5b89537/roles/b80ab32abea1446aa8b6d509356597f8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.399780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.400854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.401399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.401921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.407274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:41.431474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=41ae8296188b455ab2575ba2c9f1555c, user_id=18bbaba1384641d3a20c44aba5b89537, role_id=b80ab32abea1446aa8b6d509356597f8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.436293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.442034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.445149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.462642 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2950/5847] 10.222.0.23 () {60 vars in 1480 bytes} [Mon Oct 31 05:39:41 2022] PUT /identity/v3/domains/41ae8296188b455ab2575ba2c9f1555c/users/18bbaba1384641d3a20c44aba5b89537/roles/b80ab32abea1446aa8b6d509356597f8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:41.468108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.471337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2898/5848] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:39:41.581595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57621-efc0-4a53-9a90-852d6d72222c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.588541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.589693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.589986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.590818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.592425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.595004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.629324 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2951/5849] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:39:41 2022] POST /identity/v3/domains => generated 276 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:41.630073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.652265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598c49-174e-4740-8762-e0e896fc33f0 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.795977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.797022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.797603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.797973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.798797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.800108 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:41.800108 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:39:41.800108 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:39:41.801776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.838802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.849838 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2899/5850] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:39:41 2022] POST /identity/v3/roles => generated 239 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:41.854289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7133e10-bdab-4b27-a5d2-2632a4e25a34 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.861017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.861778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.862289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.862716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.863507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.867670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:41.920428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2952/5851] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:39:41 2022] POST /identity/v3/groups => generated 326 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:41.924817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:41.944726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933254f5-79ba-4418-bbd5-2739da220516 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:41.961326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:41.961326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:41.961614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:41.961900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups/df4a6455472f4daca48febc750290c10/users/18bbaba1384641d3a20c44aba5b89537` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:41.971304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:41.976819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=df4a6455472f4daca48febc750290c10, user_id=18bbaba1384641d3a20c44aba5b89537)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:41.978818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:42.041922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:42.054288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1507c-d03f-48de-80be-b6abaa67d914 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:42.054541 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2900/5852] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:39:41 2022] PUT /identity/v3/groups/df4a6455472f4daca48febc750290c10/users/18bbaba1384641d3a20c44aba5b89537 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:42.275466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:42.276163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:42.278481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:42.278773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/5fb5bb51e06f49c2a31b033d2913633c/groups/df4a6455472f4daca48febc750290c10/roles/3c7690bd3bbd481ead4862703a62cba4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:42.282752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5fb5bb51e06f49c2a31b033d2913633c, group_id=df4a6455472f4daca48febc750290c10, role_id=3c7690bd3bbd481ead4862703a62cba4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:42.289178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:42.371057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2953/5853] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:42 2022] PUT /identity/v3/domains/5fb5bb51e06f49c2a31b033d2913633c/groups/df4a6455472f4daca48febc750290c10/roles/3c7690bd3bbd481ead4862703a62cba4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:42.372597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:42.395705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312df76-ac0b-4e0e-bf42-1ee131d552b9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:42.556072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:42.556983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:42.557423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:42.557851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:42.558742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:42.560529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:42.605265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:42.607185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:42.621346 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2901/5854] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:39:42 2022] POST /identity/v3/domains => generated 275 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:42.623753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:42.718923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:42.833345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c57a3-5489-4be4-8f5e-034a3e8de43d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:42.867834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1a92-6fa1-4d66-b0f8-9dc1c0bb80e2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:42.880660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:42.881488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:42.881774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:42.882052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:42.882767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:42.884384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:42.929151 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2902/5855] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:39:42 2022] POST /identity/v3/roles => generated 239 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:42.930873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:42.952687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e992b-a076-4039-856f-f38589411903 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:42.969488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:42.971245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:42.971245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:42.971245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c/users/18bbaba1384641d3a20c44aba5b89537/roles/ad8fb7d4e75f4e77abd1b35b7453e00f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:43.042012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bfdb9298e9904cba8bc3f74642bd9e3c, user_id=18bbaba1384641d3a20c44aba5b89537, role_id=ad8fb7d4e75f4e77abd1b35b7453e00f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:43.060243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:43.070068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:43.070709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:43.071174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:43.071636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:43.079641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:43.098718 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2903/5856] 10.222.0.23 () {60 vars in 1480 bytes} [Mon Oct 31 05:39:42 2022] PUT /identity/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c/users/18bbaba1384641d3a20c44aba5b89537/roles/ad8fb7d4e75f4e77abd1b35b7453e00f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:43.102727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:43.239861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:43.279707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:43.288235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:43.288689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1511870-9b02-472e-9748-66a4cf260493 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:43.306001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:43.310311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:43.310685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:43.311270 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2954/5857] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:39:43.311415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:43.312849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:43.320170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:43.358283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2904/5858] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:39:43 2022] POST /identity/v3/domains => generated 276 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:43.358859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:43.376284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789255dc-85a6-43fe-a16d-5102d3945868 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:43.539273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:43.539960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:43.540248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:43.540524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:43.541270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:43.544222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:43.579217 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2955/5859] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:39:43 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:43.583866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:43.607447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd341-1d7d-4558-94a5-fb2370b295d4 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:43.625759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:43.626543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:43.627091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:43.627377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:43.628030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:43.630099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:43.720037 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2905/5860] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:39:43 2022] POST /identity/v3/groups => generated 326 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:43.721395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:43.738171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d756944-94e5-4328-8c6a-b4f15a6aec49 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:43.763161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:43.764059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:43.765278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:43.767447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/users/18bbaba1384641d3a20c44aba5b89537` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:43.778548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:43.793985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c3bc4c1361f14a59ae8f6c83e03aef6a, user_id=18bbaba1384641d3a20c44aba5b89537)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:43.796812 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:43.796812 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:39:43.796812 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:43.798102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:43.861360 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2956/5861] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:39:43 2022] PUT /identity/v3/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/users/18bbaba1384641d3a20c44aba5b89537 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:43.865643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:43.878212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbd0ed-5fd8-47f6-a3b9-1f92cc076341 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:44.031413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:44.032181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:44.032416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:44.032750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/680678646c424539be9960dddcd3baaf/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/roles/7b26e0c2cc94443ca6bf8a6d3072630f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:44.035015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=680678646c424539be9960dddcd3baaf, group_id=c3bc4c1361f14a59ae8f6c83e03aef6a, role_id=7b26e0c2cc94443ca6bf8a6d3072630f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:44.040775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:44.064423 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2906/5862] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:43 2022] PUT /identity/v3/domains/680678646c424539be9960dddcd3baaf/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/roles/7b26e0c2cc94443ca6bf8a6d3072630f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:44.068968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:44.403263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea774053-f3b1-4659-99d8-872fe23ae936 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:44.608027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18bbaba1384641d3a20c44aba5b89537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b3614fb4394015a90aac408631dfcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:44.608685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:44.609293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:44.609722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] PATH_INFO: `/v3/auth/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:44.610458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:44.611945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:44.688963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:44.728064 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2957/5863] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 31 05:39:44 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 660 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:44.732686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:44.857173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ece1a-bdcf-4d53-a2bf-a07348fe37c7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:44.863475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:44.864978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:44.865320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:44.865694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/680678646c424539be9960dddcd3baaf/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/roles/7b26e0c2cc94443ca6bf8a6d3072630f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:44.868747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=680678646c424539be9960dddcd3baaf, group_id=c3bc4c1361f14a59ae8f6c83e03aef6a, role_id=7b26e0c2cc94443ca6bf8a6d3072630f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:44.869876 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:44.869876 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:39:44.869876 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:39:44.871892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:44.883735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role 7b26e0c2cc94443ca6bf8a6d3072630f was removed from group c3bc4c1361f14a59ae8f6c83e03aef6a on domain 680678646c424539be9960dddcd3baaf. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:44.883924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:44.889179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:44.913853 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2907/5864] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:39:44 2022] DELETE /identity/v3/domains/680678646c424539be9960dddcd3baaf/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/roles/7b26e0c2cc94443ca6bf8a6d3072630f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:44.918944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:44.920777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:44.967221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226442-3797-42d3-b519-ab9aee5e46c5 tempest-TokensV3TestJSON-893354474 tempest-TokensV3TestJSON-893354474-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:45.083470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:45.084150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:45.084437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:45.084721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/users/18bbaba1384641d3a20c44aba5b89537` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:45.086533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c3bc4c1361f14a59ae8f6c83e03aef6a, user_id=18bbaba1384641d3a20c44aba5b89537)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:45.088659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:45.100555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.130589 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2958/5865] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:39:44 2022] DELETE /identity/v3/groups/c3bc4c1361f14a59ae8f6c83e03aef6a/users/18bbaba1384641d3a20c44aba5b89537 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:45.134976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:45.150509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f4df-7686-4a57-86ea-6e3e1502287d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:45.230174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:45.257459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:45.258112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:45.258433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:45.258709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups/c3bc4c1361f14a59ae8f6c83e03aef6a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:45.271460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c3bc4c1361f14a59ae8f6c83e03aef6a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:45.273775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:45.361759 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2908/5866] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:39:45 2022] DELETE /identity/v3/groups/c3bc4c1361f14a59ae8f6c83e03aef6a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:45.365989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:45.379862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc77542-349d-4e14-a6ba-4dce08ec0075 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:45.530247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:45.531242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:45.531476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:45.531748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles/7b26e0c2cc94443ca6bf8a6d3072630f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:45.534988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b26e0c2cc94443ca6bf8a6d3072630f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:45.537393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:45.635904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role 7b26e0c2cc94443ca6bf8a6d3072630f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:45.636202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.639817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.645452 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2959/5867] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:45 2022] DELETE /identity/v3/roles/7b26e0c2cc94443ca6bf8a6d3072630f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:45.649702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:45.651518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:45.673754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3ebcb-ac8a-44c8-9a7a-9e20a3229e7c tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:45.874940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:45.875667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:45.875958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:45.876345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/680678646c424539be9960dddcd3baaf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:45.877899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=680678646c424539be9960dddcd3baaf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:45.879692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:45.906881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '680678646c424539be9960dddcd3baaf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.907698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '680678646c424539be9960dddcd3baaf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.943589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '680678646c424539be9960dddcd3baaf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.945147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '680678646c424539be9960dddcd3baaf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:45.950990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2909/5868] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:45 2022] PATCH /identity/v3/domains/680678646c424539be9960dddcd3baaf => generated 277 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:45.954862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:45.972573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd261d-f31b-4a55-a72e-70d45103b7b6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:46.044879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:46.125912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:46.128978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:46.129639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:46.130287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/680678646c424539be9960dddcd3baaf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:46.157631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=680678646c424539be9960dddcd3baaf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:46.162615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:46.197530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '680678646c424539be9960dddcd3baaf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.201725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '680678646c424539be9960dddcd3baaf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.309078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680678646c424539be9960dddcd3baaf', 'request_id': 'req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.318618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680678646c424539be9960dddcd3baaf', 'request_id': 'req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.328050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680678646c424539be9960dddcd3baaf', 'request_id': 'req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.349498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] The token cache is being invalidate because project 680678646c424539be9960dddcd3baaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:46.350194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.351195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.382685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '680678646c424539be9960dddcd3baaf', 'request_id': 'req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.393099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '680678646c424539be9960dddcd3baaf', 'request_id': 'req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.393864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '680678646c424539be9960dddcd3baaf', 'request_id': 'req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.414777 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2960/5869] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:39:45 2022] DELETE /identity/v3/domains/680678646c424539be9960dddcd3baaf => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:46.418720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:46.420611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:46.437033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e045e2-b80f-4d1b-b6af-b41539577221 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:46.525545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:46.526345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:46.526638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:46.527261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c/users/18bbaba1384641d3a20c44aba5b89537/roles/ad8fb7d4e75f4e77abd1b35b7453e00f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:46.529552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bfdb9298e9904cba8bc3f74642bd9e3c, user_id=18bbaba1384641d3a20c44aba5b89537, role_id=ad8fb7d4e75f4e77abd1b35b7453e00f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:46.532285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:46.540313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role ad8fb7d4e75f4e77abd1b35b7453e00f was removed from user 18bbaba1384641d3a20c44aba5b89537 on domain bfdb9298e9904cba8bc3f74642bd9e3c. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:46.540616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.541411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.559429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:46.566546 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2910/5870] 10.222.0.23 () {58 vars in 1464 bytes} [Mon Oct 31 05:39:46 2022] DELETE /identity/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c/users/18bbaba1384641d3a20c44aba5b89537/roles/ad8fb7d4e75f4e77abd1b35b7453e00f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:46.572308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:46.575534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:46.594182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f58e6-0475-4e3f-a3e0-7788cd2e17e7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:46.677762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:46.678774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:46.679216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:46.679649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles/ad8fb7d4e75f4e77abd1b35b7453e00f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:46.681517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad8fb7d4e75f4e77abd1b35b7453e00f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:46.683925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:46.700085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:46.729522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role ad8fb7d4e75f4e77abd1b35b7453e00f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:46.729975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.730687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.733301 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2961/5871] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:46 2022] DELETE /identity/v3/roles/ad8fb7d4e75f4e77abd1b35b7453e00f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:46.737239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:46.739211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:46.753006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9d51-368e-45b9-b16b-adeffcdea8aa tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:46.847119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:46.847876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:46.848708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:46.848990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:46.850355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bfdb9298e9904cba8bc3f74642bd9e3c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:46.854025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:46.877195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.878333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.907833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.908541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:46.912127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2911/5872] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:46 2022] PATCH /identity/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c => generated 276 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:46.916079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:46.917783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:46.931541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e03fb6-8969-4e02-bbec-0ee2e92c75b2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:47.009675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:47.010418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:47.010811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:47.011271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:47.025408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bfdb9298e9904cba8bc3f74642bd9e3c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:47.027271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:47.051320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.054985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.109476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c', 'request_id': 'req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.118288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c', 'request_id': 'req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.124978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c', 'request_id': 'req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.139372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] The token cache is being invalidate because project bfdb9298e9904cba8bc3f74642bd9e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:47.139672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.140571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.148902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c', 'request_id': 'req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.152629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c', 'request_id': 'req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.153376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bfdb9298e9904cba8bc3f74642bd9e3c', 'request_id': 'req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.160181 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2962/5873] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:39:46 2022] DELETE /identity/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:47.166197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:47.166197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:47.181366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c032f9-60a7-4e17-b9ed-f107ac41571f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:47.248329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:47.249278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:47.249710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:47.250698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/5fb5bb51e06f49c2a31b033d2913633c/groups/df4a6455472f4daca48febc750290c10/roles/3c7690bd3bbd481ead4862703a62cba4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:47.252794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5fb5bb51e06f49c2a31b033d2913633c, group_id=df4a6455472f4daca48febc750290c10, role_id=3c7690bd3bbd481ead4862703a62cba4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:47.256264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:47.262077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role 3c7690bd3bbd481ead4862703a62cba4 was removed from group df4a6455472f4daca48febc750290c10 on domain 5fb5bb51e06f49c2a31b033d2913633c. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:47.262493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.263269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.281348 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2912/5874] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:39:47 2022] DELETE /identity/v3/domains/5fb5bb51e06f49c2a31b033d2913633c/groups/df4a6455472f4daca48febc750290c10/roles/3c7690bd3bbd481ead4862703a62cba4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:47.284991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:47.295096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:47.327133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c1c3d-08fb-4a9d-aa1e-531e8c3d3726 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:47.338616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:47.490232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:47.491373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:47.491947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:47.492434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups/df4a6455472f4daca48febc750290c10/users/18bbaba1384641d3a20c44aba5b89537` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:47.494574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=df4a6455472f4daca48febc750290c10, user_id=18bbaba1384641d3a20c44aba5b89537)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:47.497058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:47.522022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:47.554868 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2963/5875] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:39:47 2022] DELETE /identity/v3/groups/df4a6455472f4daca48febc750290c10/users/18bbaba1384641d3a20c44aba5b89537 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:47.558857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:47.560439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:47.583973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd9ab-6418-4277-a63c-3d1986ed2354 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:47.671448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:47.683577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:47.692820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:47.692820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:47.692820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/groups/df4a6455472f4daca48febc750290c10` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:47.692820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df4a6455472f4daca48febc750290c10)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:47.692820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:47.774399 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2913/5876] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:39:47 2022] DELETE /identity/v3/groups/df4a6455472f4daca48febc750290c10 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:47.778389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:47.811861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5770c-f53f-4353-85c9-b4665d18d3df tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:47.963488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:47.966120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:47.966572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:47.966958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles/3c7690bd3bbd481ead4862703a62cba4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:47.970489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c7690bd3bbd481ead4862703a62cba4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:47.994976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:48.088276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:48.091787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:48.154442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role 3c7690bd3bbd481ead4862703a62cba4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:48.154753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.155476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.160573 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2964/5877] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:47 2022] DELETE /identity/v3/roles/3c7690bd3bbd481ead4862703a62cba4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:48.161502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:48.162935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:48.310372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1485-f42f-4bab-8723-315685433883 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:48.329132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11cf14-1606-483c-9bf8-dea9c966ecb7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:48.340125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:48.340944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:48.341063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:48.341330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/5fb5bb51e06f49c2a31b033d2913633c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:48.345594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5fb5bb51e06f49c2a31b033d2913633c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:48.347268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:48.364223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:48.402195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.402977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.460054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.465013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.471443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2965/5878] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:48 2022] PATCH /identity/v3/domains/5fb5bb51e06f49c2a31b033d2913633c => generated 277 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:48.475383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:48.475752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:48.476035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:48.476380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:48.476601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:48.477397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:48.487617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:48.584363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:48.612942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b3c5d-6d2c-4105-af55-95a48789546b tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:48.630099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:48.631095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:48.631607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:48.631992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/5fb5bb51e06f49c2a31b033d2913633c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:48.633298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:48.635106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:48.654643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5fb5bb51e06f49c2a31b033d2913633c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:48.659814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:48.661544 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2914/5879] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:39:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:39:48.700605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.710382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.854134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c', 'request_id': 'req-1d0dfb51-1107-458b-884f-a48c68032729'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.875968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c', 'request_id': 'req-1d0dfb51-1107-458b-884f-a48c68032729'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.890713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c', 'request_id': 'req-1d0dfb51-1107-458b-884f-a48c68032729'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.917078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] The token cache is being invalidate because project 5fb5bb51e06f49c2a31b033d2913633c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:48.917789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.918196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.948178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c', 'request_id': 'req-1d0dfb51-1107-458b-884f-a48c68032729'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.952232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c', 'request_id': 'req-1d0dfb51-1107-458b-884f-a48c68032729'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.953136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5fb5bb51e06f49c2a31b033d2913633c', 'request_id': 'req-1d0dfb51-1107-458b-884f-a48c68032729'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:48.963743 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2966/5880] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:39:48 2022] DELETE /identity/v3/domains/5fb5bb51e06f49c2a31b033d2913633c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:48.965099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:48.997294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224ccc4-3721-4e30-b930-3c78e4436be3 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:49.107729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:49.108543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:49.109309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:49.109840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/41ae8296188b455ab2575ba2c9f1555c/users/18bbaba1384641d3a20c44aba5b89537/roles/b80ab32abea1446aa8b6d509356597f8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:49.112527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=41ae8296188b455ab2575ba2c9f1555c, user_id=18bbaba1384641d3a20c44aba5b89537, role_id=b80ab32abea1446aa8b6d509356597f8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:49.116275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:49.124033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role b80ab32abea1446aa8b6d509356597f8 was removed from user 18bbaba1384641d3a20c44aba5b89537 on domain 41ae8296188b455ab2575ba2c9f1555c. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:49.124468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.140455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.172548 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2915/5881] 10.222.0.23 () {58 vars in 1464 bytes} [Mon Oct 31 05:39:48 2022] DELETE /identity/v3/domains/41ae8296188b455ab2575ba2c9f1555c/users/18bbaba1384641d3a20c44aba5b89537/roles/b80ab32abea1446aa8b6d509356597f8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:49.176865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:49.179692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:49.187874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:49.204416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dfb51-1107-458b-884f-a48c68032729 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:49.328374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:49.329187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:49.329808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:49.330191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles/b80ab32abea1446aa8b6d509356597f8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:49.338471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b80ab32abea1446aa8b6d509356597f8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:49.340801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:49.478409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role b80ab32abea1446aa8b6d509356597f8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:49.478733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.480922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.489650 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2967/5882] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:49 2022] DELETE /identity/v3/roles/b80ab32abea1446aa8b6d509356597f8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:49.492838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:49.494664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:49.524092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44320658-8fef-4ec2-a94b-f380b3f15853 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:49.653236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:49.654052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:49.655179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:49.660115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/41ae8296188b455ab2575ba2c9f1555c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:49.663357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=41ae8296188b455ab2575ba2c9f1555c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:49.671797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:49.749284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.752502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.831632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.834751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:49.837924 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2916/5883] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:49 2022] PATCH /identity/v3/domains/41ae8296188b455ab2575ba2c9f1555c => generated 277 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:39:49.842001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:49.844461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:49.879217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e282d-597d-4436-8c0c-6475dc3cf9c2 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:50.045898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:50.047222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:50.047771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:50.048262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/41ae8296188b455ab2575ba2c9f1555c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:50.063617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=41ae8296188b455ab2575ba2c9f1555c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:50.067448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:50.109204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.116788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.216384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:50.248186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c', 'request_id': 'req-9b7ae8bb-c076-4e28-8171-2a00159aabe6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.290325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c', 'request_id': 'req-9b7ae8bb-c076-4e28-8171-2a00159aabe6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.327764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c', 'request_id': 'req-9b7ae8bb-c076-4e28-8171-2a00159aabe6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.369373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] The token cache is being invalidate because project 41ae8296188b455ab2575ba2c9f1555c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:50.370681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.389918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.409807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c', 'request_id': 'req-9b7ae8bb-c076-4e28-8171-2a00159aabe6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.414518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c', 'request_id': 'req-9b7ae8bb-c076-4e28-8171-2a00159aabe6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.415898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '41ae8296188b455ab2575ba2c9f1555c', 'request_id': 'req-9b7ae8bb-c076-4e28-8171-2a00159aabe6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:50.430267 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2968/5884] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:39:49 2022] DELETE /identity/v3/domains/41ae8296188b455ab2575ba2c9f1555c => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:50.431074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:50.432627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:50.455798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4cc00-0d7e-4763-9ad0-81440936ff30 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:50.545298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:50.662909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:50.664423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:50.664967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:50.666056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:50.666968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:50.670601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:50.707655 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2917/5885] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:39:50.712046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:50.714912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:50.741682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ae8bb-c076-4e28-8171-2a00159aabe6 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:50.750861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:50.754123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:50.754800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:50.755410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/03badf9b32074affb05448cbcfdf38c5/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:50.762375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(project_id=03badf9b32074affb05448cbcfdf38c5, user_id=70964db485d945cf8dde326cbbdec790, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:50.767527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:50.810241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2969/5886] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:50 2022] PUT /identity/v3/projects/03badf9b32074affb05448cbcfdf38c5/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:50.811507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:50.826067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6b2e5-5b9c-440e-8b44-518c0692f894 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:50.970297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:50.971107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:50.971675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:50.972094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:50.972921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:50.975682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:51.334090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2918/5887] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 31 05:39:50 2022] GET /identity/v3/auth/projects => generated 828 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:39:51.340185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:51.368434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d97ba0-5ca0-47db-80bb-eac972194c55 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:51.386376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:51.387237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:51.387871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:51.389197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/03badf9b32074affb05448cbcfdf38c5/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:51.402493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=03badf9b32074affb05448cbcfdf38c5, user_id=70964db485d945cf8dde326cbbdec790, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:51.406681 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:51.406681 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:39:51.406681 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:39:51.413859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:51.445912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role 14e4a1b541b244baaac32fd3e27cd6d1 was removed from user 70964db485d945cf8dde326cbbdec790 on project 03badf9b32074affb05448cbcfdf38c5. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:51.446786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:51.450417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:51.484247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2970/5888] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:39:51 2022] DELETE /identity/v3/projects/03badf9b32074affb05448cbcfdf38c5/users/70964db485d945cf8dde326cbbdec790/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:51.489831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:51.491960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:51.524504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c5351-9b48-4809-a75e-710bb17b2775 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:51.712193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:51.712822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:51.713109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:51.713389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:51.714052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:51.719200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:51.763488 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2919/5889] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:39:51 2022] POST /identity/v3/users => generated 321 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:51.767564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:51.783804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20ef4-9233-472f-8291-bb9836e65178 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:51.803221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:51.803848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:51.804140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:51.804418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:51.805061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:51.811337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:51.885484 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2971/5890] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:51 2022] POST /identity/v3/projects => generated 362 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:51.886775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:51.904582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8f6e-3ffd-4dba-9ef3-1946dec59dc8 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:51.974786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:52.090048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:52.090696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:52.090994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:52.091251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:52.091901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:52.097737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:52.166799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2920/5891] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:39:51 2022] POST /identity/v3/projects => generated 363 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:39:52.171234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:52.192355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebbd5-7250-44bc-a291-46e9a26e8f40 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:52.494173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:52.503596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:52.503596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:52.503596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:52.503596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:52.511990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:52.558932 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2972/5892] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:39:52 2022] POST /identity/v3/roles => generated 240 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:39:52.560202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:52.591847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0ef5-2b86-46c6-b751-54d21e2e6f00 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:52.614310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf3979-9057-4caf-b45a-d4a6d0557545 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:52.617917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3979-9057-4caf-b45a-d4a6d0557545 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:52.618429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3979-9057-4caf-b45a-d4a6d0557545 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:52.621994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3979-9057-4caf-b45a-d4a6d0557545 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/2589e39f2f55471d8e47723be75de422/users/9cafeed7bc534bf38ab624b1398b386d/roles/1d8153111a8d4738afe37fad704f981d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:52.687887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf3979-9057-4caf-b45a-d4a6d0557545 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2589e39f2f55471d8e47723be75de422, user_id=9cafeed7bc534bf38ab624b1398b386d, role_id=1d8153111a8d4738afe37fad704f981d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:52.694570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf3979-9057-4caf-b45a-d4a6d0557545 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:52.742469 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2921/5893] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:52 2022] PUT /identity/v3/projects/2589e39f2f55471d8e47723be75de422/users/9cafeed7bc534bf38ab624b1398b386d/roles/1d8153111a8d4738afe37fad704f981d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:52.746472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:52.776323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc064468-d46d-418d-bcc6-521cb95d486d tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:53.148387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:53.338850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda246-861c-4ee0-8dc0-519924933ddc tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:53.342453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda246-861c-4ee0-8dc0-519924933ddc tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:53.342453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda246-861c-4ee0-8dc0-519924933ddc tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:53.342453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda246-861c-4ee0-8dc0-519924933ddc tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/6af345d48b0f4237944e8b89c76edb7a/users/9cafeed7bc534bf38ab624b1398b386d/roles/1d8153111a8d4738afe37fad704f981d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:53.364980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbda246-861c-4ee0-8dc0-519924933ddc tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6af345d48b0f4237944e8b89c76edb7a, user_id=9cafeed7bc534bf38ab624b1398b386d, role_id=1d8153111a8d4738afe37fad704f981d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:53.385051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbda246-861c-4ee0-8dc0-519924933ddc tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:53.474673 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2973/5894] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:39:52 2022] PUT /identity/v3/projects/6af345d48b0f4237944e8b89c76edb7a/users/9cafeed7bc534bf38ab624b1398b386d/roles/1d8153111a8d4738afe37fad704f981d => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:53.479375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:53.479912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:53.480219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:53.611056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] MFA Rules not processed for user `9cafeed7bc534bf38ab624b1398b386d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:53.619367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:53.631799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2922/5895] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:53 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:39:53.633494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce4202-15fe-4ccd-9bd7-888a5caf5759 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:53.633986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce4202-15fe-4ccd-9bd7-888a5caf5759 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:53.634064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce4202-15fe-4ccd-9bd7-888a5caf5759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:53.666125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-12ce4202-15fe-4ccd-9bd7-888a5caf5759 None None] MFA Rules not processed for user `9cafeed7bc534bf38ab624b1398b386d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:53.668875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-12ce4202-15fe-4ccd-9bd7-888a5caf5759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:53.961096 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2974/5896] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 05:39:53.965412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:54.177199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721263b-c609-4ad0-85db-4dcb01d3eca9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:54.193631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:54.195808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:54.196464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:54.196970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:54.281018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:54.288202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:54.343227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2923/5897] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 05:39:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:54.348248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:54.349752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:54.350566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:54.395795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] MFA Rules not processed for user `9cafeed7bc534bf38ab624b1398b386d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:54.397573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:54.685202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2975/5898] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:54 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 05:39:54.686435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:54.728419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e3367-6c6e-423e-bffc-1608df12c568 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:54.778407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:54.779338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:54.779779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:54.780230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/roles/1d8153111a8d4738afe37fad704f981d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:54.785630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d8153111a8d4738afe37fad704f981d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:54.786939 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:39:54.786939 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:39:54.786939 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:39:54.791207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:54.991716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invalidating the token cache because role 1d8153111a8d4738afe37fad704f981d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:54.992025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:54.992798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:54.994700 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2924/5899] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:54 2022] DELETE /identity/v3/roles/1d8153111a8d4738afe37fad704f981d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:54.998861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:55.023439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0669545-491b-45c2-9631-970a3da8b60b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:55.235943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:55.242041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:55.243011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:55.247189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/6af345d48b0f4237944e8b89c76edb7a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:55.254986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6af345d48b0f4237944e8b89c76edb7a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:55.272071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:55.404648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:55.485946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af345d48b0f4237944e8b89c76edb7a', 'request_id': 'req-a8a4439b-8d86-4b62-a012-f5bed6df9774'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:55.508522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af345d48b0f4237944e8b89c76edb7a', 'request_id': 'req-a8a4439b-8d86-4b62-a012-f5bed6df9774'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:55.528857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af345d48b0f4237944e8b89c76edb7a', 'request_id': 'req-a8a4439b-8d86-4b62-a012-f5bed6df9774'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:55.567564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] The token cache is being invalidate because project 6af345d48b0f4237944e8b89c76edb7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:55.568447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:55.569703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:55.575346 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2976/5900] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:54 2022] DELETE /identity/v3/projects/6af345d48b0f4237944e8b89c76edb7a => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:39:55.579005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:55.580522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:55.619994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049025c9-4926-47bb-bfa2-40419ccdff5f tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:55.671386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:55.921353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:55.922198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:55.922503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:55.922791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/6af345d48b0f4237944e8b89c76edb7a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:55.958333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6af345d48b0f4237944e8b89c76edb7a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:55.963600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Could not find project: 6af345d48b0f4237944e8b89c76edb7a.: keystone.exception.ProjectNotFound: Could not find project: 6af345d48b0f4237944e8b89c76edb7a. Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 31 05:39:56.005119 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6af345d48b0f4237944e8b89c76edb7a. Oct 31 05:39:56.009450 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:56.011339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:56.013400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:56.021865 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2925/5901] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:55 2022] DELETE /identity/v3/projects/6af345d48b0f4237944e8b89c76edb7a => generated 113 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:39:56.037196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4439b-8d86-4b62-a012-f5bed6df9774 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:56.048481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:56.049444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:56.052043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:56.052520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/projects/2589e39f2f55471d8e47723be75de422` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:56.054857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2589e39f2f55471d8e47723be75de422)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:56.057052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:56.195360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2589e39f2f55471d8e47723be75de422', 'request_id': 'req-2f6d98b1-0576-442d-977d-d14d8fa54104'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.217473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2589e39f2f55471d8e47723be75de422', 'request_id': 'req-2f6d98b1-0576-442d-977d-d14d8fa54104'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.236016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2589e39f2f55471d8e47723be75de422', 'request_id': 'req-2f6d98b1-0576-442d-977d-d14d8fa54104'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.284450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] The token cache is being invalidate because project 2589e39f2f55471d8e47723be75de422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:56.284450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.288961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.290822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2977/5902] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:56 2022] DELETE /identity/v3/projects/2589e39f2f55471d8e47723be75de422 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:56.294830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:56.307481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:56.354052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929e3cd-b67e-44eb-996b-3a3c9ba3d2cd tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:56.523232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:56.523925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:56.524224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:56.524478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/users/9cafeed7bc534bf38ab624b1398b386d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:56.527508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9cafeed7bc534bf38ab624b1398b386d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:56.528798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:56.682591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cafeed7bc534bf38ab624b1398b386d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.712969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cafeed7bc534bf38ab624b1398b386d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.714789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cafeed7bc534bf38ab624b1398b386d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.715692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cafeed7bc534bf38ab624b1398b386d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.742656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cafeed7bc534bf38ab624b1398b386d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:56.784641 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2926/5903] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:56 2022] DELETE /identity/v3/users/9cafeed7bc534bf38ab624b1398b386d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:56.794832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:56.810922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d98b1-0576-442d-977d-d14d8fa54104 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:56.971776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:56.972438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:56.972726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:56.973040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/680678646c424539be9960dddcd3baaf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:57.004073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Could not find domain: 680678646c424539be9960dddcd3baaf.: keystone.exception.DomainNotFound: Could not find domain: 680678646c424539be9960dddcd3baaf. Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 680678646c424539be9960dddcd3baaf. Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:39:57.018929 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:39:57.021038 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 680678646c424539be9960dddcd3baaf. Oct 31 05:39:57.022024 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:39:57.039959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:57.042048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:57.043593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2978/5904] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:56 2022] PATCH /identity/v3/domains/680678646c424539be9960dddcd3baaf => generated 112 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:39:57.059954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfb1a-262f-4bfd-a33b-c4a51d3a70cb tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:57.090869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:57.091552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:57.091835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:57.092113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:57.123212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Could not find domain: bfdb9298e9904cba8bc3f74642bd9e3c.: keystone.exception.DomainNotFound: Could not find domain: bfdb9298e9904cba8bc3f74642bd9e3c. Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bfdb9298e9904cba8bc3f74642bd9e3c. Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:39:57.143296 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:39:57.144525 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bfdb9298e9904cba8bc3f74642bd9e3c. Oct 31 05:39:57.145992 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:57.153424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:57.161394 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2927/5905] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:57 2022] PATCH /identity/v3/domains/bfdb9298e9904cba8bc3f74642bd9e3c => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 05:39:57.168927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64012-726a-408c-bcd2-6930f7ad30a7 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:57.191240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:57.192146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:57.192582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:57.193008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/5fb5bb51e06f49c2a31b033d2913633c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:57.212625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Could not find domain: 5fb5bb51e06f49c2a31b033d2913633c.: keystone.exception.DomainNotFound: Could not find domain: 5fb5bb51e06f49c2a31b033d2913633c. Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5fb5bb51e06f49c2a31b033d2913633c. Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:39:57.245479 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:39:57.246670 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5fb5bb51e06f49c2a31b033d2913633c. Oct 31 05:39:57.247757 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:39:57.256885 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2979/5906] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:57 2022] PATCH /identity/v3/domains/5fb5bb51e06f49c2a31b033d2913633c => generated 112 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:39:57.261113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:57.277518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1084-721d-4921-8251-8c71de2617f9 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:57.305271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf4e6-c9a0-4d28-b102-2ee1d73ae6f1 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70964db485d945cf8dde326cbbdec790', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6bf663e66541a78651d57a7a991ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:57.306192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf4e6-c9a0-4d28-b102-2ee1d73ae6f1 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:57.306663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf4e6-c9a0-4d28-b102-2ee1d73ae6f1 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:57.307151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf4e6-c9a0-4d28-b102-2ee1d73ae6f1 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] PATH_INFO: `/v3/domains/41ae8296188b455ab2575ba2c9f1555c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:57.325429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbf4e6-c9a0-4d28-b102-2ee1d73ae6f1 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ddbbf4e6-c9a0-4d28-b102-2ee1d73ae6f1 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Could not find domain: 41ae8296188b455ab2575ba2c9f1555c.: keystone.exception.DomainNotFound: Could not find domain: 41ae8296188b455ab2575ba2c9f1555c. Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41ae8296188b455ab2575ba2c9f1555c. Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:39:57.339208 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:39:57.340348 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41ae8296188b455ab2575ba2c9f1555c. Oct 31 05:39:57.341242 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:39:57.350133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:57.354586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2928/5907] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:39:57 2022] PATCH /identity/v3/domains/41ae8296188b455ab2575ba2c9f1555c => generated 112 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:39:57.356733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:57.457762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:57.539429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede5b0-ec99-4c56-8673-f108579a8737 tempest-TokensV3TestJSON-1382789329 tempest-TokensV3TestJSON-1382789329-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:57.550252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:57.551137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:57.551518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:57.551973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] PATH_INFO: `/v3/users/505ca7df93f34f8b84379f1aa51a8178` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:57.553338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505ca7df93f34f8b84379f1aa51a8178)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:57.555520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:57.664889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505ca7df93f34f8b84379f1aa51a8178'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:57.692168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505ca7df93f34f8b84379f1aa51a8178'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:57.696103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505ca7df93f34f8b84379f1aa51a8178'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:57.697236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505ca7df93f34f8b84379f1aa51a8178'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:57.719795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505ca7df93f34f8b84379f1aa51a8178'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:57.757316 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2980/5908] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:57 2022] DELETE /identity/v3/users/505ca7df93f34f8b84379f1aa51a8178 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:57.761990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:57.762558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:57.763048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:57.821171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:39:57.822848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:57.842287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:58.068702 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2929/5909] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:39:58.084196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:58.086384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:58.245239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d389-cb45-403a-ad22-7f6d8ef829d3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:58.256034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:58.258653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:58.262660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:58.263163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:58.295365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:58.297007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:58.336322 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2981/5910] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:39:59.209572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:59.210755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:39:59.229814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd30fc-4b2c-411e-a63d-1666e6b61e87 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:59.253519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:59.254305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:59.254596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:59.254876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] PATH_INFO: `/v3/projects/03badf9b32074affb05448cbcfdf38c5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:59.256851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03badf9b32074affb05448cbcfdf38c5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:59.259071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:59.431906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03badf9b32074affb05448cbcfdf38c5', 'request_id': 'req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.445644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03badf9b32074affb05448cbcfdf38c5', 'request_id': 'req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.460736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03badf9b32074affb05448cbcfdf38c5', 'request_id': 'req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.482533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] The token cache is being invalidate because project 03badf9b32074affb05448cbcfdf38c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:39:59.483014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.484500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.493217 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2930/5911] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:39:59 2022] DELETE /identity/v3/projects/03badf9b32074affb05448cbcfdf38c5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:39:59.494905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:39:59.512236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f32f-a30d-4f5d-8f3b-edbd741c0ca0 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:39:59.621954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:39:59.639367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:39:59.640050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:39:59.640334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:39:59.640610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] PATH_INFO: `/v3/users/70964db485d945cf8dde326cbbdec790` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:39:59.642020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=70964db485d945cf8dde326cbbdec790)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:39:59.645848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:39:59.747166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70964db485d945cf8dde326cbbdec790'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.768763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70964db485d945cf8dde326cbbdec790'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.769526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70964db485d945cf8dde326cbbdec790'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.770434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70964db485d945cf8dde326cbbdec790'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.828707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70964db485d945cf8dde326cbbdec790'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:39:59.866388 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2982/5912] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:39:59 2022] DELETE /identity/v3/users/70964db485d945cf8dde326cbbdec790 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:01.797642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:01.799881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:01.877571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22e919-a1b1-4fc1-bd93-71aeb94cc2d9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:02.095822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:02.096716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:02.099320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:02.099794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] PATH_INFO: `/v3/projects/6d6bf663e66541a78651d57a7a991ae6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:02.107612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6bf663e66541a78651d57a7a991ae6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:02.109921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:02.176967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:02.267849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6bf663e66541a78651d57a7a991ae6', 'request_id': 'req-c237483f-6760-49bf-a0e3-75b1f0a0a785'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.295121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6bf663e66541a78651d57a7a991ae6', 'request_id': 'req-c237483f-6760-49bf-a0e3-75b1f0a0a785'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.314356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6bf663e66541a78651d57a7a991ae6', 'request_id': 'req-c237483f-6760-49bf-a0e3-75b1f0a0a785'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.340922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] The token cache is being invalidate because project 6d6bf663e66541a78651d57a7a991ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:02.341418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.343793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.346337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2931/5913] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:01 2022] DELETE /identity/v3/projects/6d6bf663e66541a78651d57a7a991ae6 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:02.351047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:02.352585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:02.425243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09475c-701a-4011-9bc6-a76d3e9f6cff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:02.667425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:02.668161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:02.668453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:02.668735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] PATH_INFO: `/v3/users/18bbaba1384641d3a20c44aba5b89537` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:02.673079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bbaba1384641d3a20c44aba5b89537)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:02.675258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:02.807985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.880488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:02.883561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.884444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.885450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.901770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-82d3ac17-7d3c-4611-9dff-70d29ccd2ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bbaba1384641d3a20c44aba5b89537'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:02.924515 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2983/5914] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:02 2022] DELETE /identity/v3/users/18bbaba1384641d3a20c44aba5b89537 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:04.083312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:04.085705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:04.112940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237483f-6760-49bf-a0e3-75b1f0a0a785 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:04.284090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:04.287453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:04.287957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:04.288401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] PATH_INFO: `/v3/projects/e4b3614fb4394015a90aac408631dfcd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:04.289999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b3614fb4394015a90aac408631dfcd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:04.292188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:04.409165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b3614fb4394015a90aac408631dfcd', 'request_id': 'req-4b1e5003-4704-4542-b4f4-140f0aa104d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:04.424266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b3614fb4394015a90aac408631dfcd', 'request_id': 'req-4b1e5003-4704-4542-b4f4-140f0aa104d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:04.491201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b3614fb4394015a90aac408631dfcd', 'request_id': 'req-4b1e5003-4704-4542-b4f4-140f0aa104d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:04.540624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] The token cache is being invalidate because project e4b3614fb4394015a90aac408631dfcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:04.541287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:04.542428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b1e5003-4704-4542-b4f4-140f0aa104d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:04.545305 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2932/5915] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:04 2022] DELETE /identity/v3/projects/e4b3614fb4394015a90aac408631dfcd => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:04.549857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:04.550398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:04.550499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:04.708401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:04.709146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:04.878614 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2984/5916] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:04.992811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:04.993103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:04.993385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.045316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:05.048082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:05.085868 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2933/5917] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:05.087133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:05.108468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7198c-4098-4e8f-a131-2e79052952d8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:05.135327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:05.135895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.136177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.136456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.137127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:05.137432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:05.139122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:05.173857 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2985/5918] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:05.180138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:05.194555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709fff-2325-48b5-90a7-530b1b008498 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:05.221190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:05.222524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.223134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.223490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.225145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:05.227255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:05.305317 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2934/5919] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:05 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:05.306575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:05.317154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6016-973c-4f5a-a2e7-7f8039de03bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:05.416193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:05.417243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.417857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.418389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.420118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:05.422614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:05.465736 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2986/5920] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:05 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:05.474124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:05.514483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d0ac9-c9d7-484b-9536-1e1b235879dd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:05.537240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:05.537894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.540997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.541301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.541991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:05.546631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:05.557048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:05.589129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:05.597241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2935/5921] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:05.607635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd21c7-5745-48a5-8cf9-fa787d567ee5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:05.626029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48ca7-a139-48c7-901d-fa76858cd8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:05.626704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48ca7-a139-48c7-901d-fa76858cd8bf admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.627242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48ca7-a139-48c7-901d-fa76858cd8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.627520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48ca7-a139-48c7-901d-fa76858cd8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.628177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48ca7-a139-48c7-901d-fa76858cd8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:05.634175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48ca7-a139-48c7-901d-fa76858cd8bf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:05.678683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:05.684039 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2987/5922] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:05.692850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4baba-af00-4a2d-a882-8870d193e4bc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:05.707500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:05.708982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.709553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.711498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] PATH_INFO: `/v3/projects/6ceed94e59c74f979fae421048cbbe41/users/2573da37832041af887d5409a06e7e07/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.787715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ceed94e59c74f979fae421048cbbe41, user_id=2573da37832041af887d5409a06e7e07, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:05.787715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:05.807993 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2936/5923] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:05 2022] PUT /identity/v3/projects/6ceed94e59c74f979fae421048cbbe41/users/2573da37832041af887d5409a06e7e07/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:05.822204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c1a4-1681-4b62-b516-648091491451 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:05.822514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c1a4-1681-4b62-b516-648091491451 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:05.822737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c1a4-1681-4b62-b516-648091491451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:05.909007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3554c1a4-1681-4b62-b516-648091491451 None None] MFA Rules not processed for user `2573da37832041af887d5409a06e7e07`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:05.910951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3554c1a4-1681-4b62-b516-648091491451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:05.945474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:06.112345 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2988/5924] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:06.117636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:06.307424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4c00-dc43-485f-b934-541f87d6a78e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:06.327510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:06.328404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:06.328785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:06.329160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:06.329907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:06.335067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:06.409032 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2937/5925] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:06 2022] POST /identity/v3/projects => generated 371 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:06.413886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c1a4-1681-4b62-b516-648091491451 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:06.437599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c1a4-1681-4b62-b516-648091491451 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:06.583971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:06.584937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:06.585389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:06.585827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:06.586663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:06.590168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:06.632869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:06.633153 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2989/5926] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:06 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:06.649140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f87cf4-eec3-4dbe-b965-c6a95e2ba993 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:06.664997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:06.665744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:06.666104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:06.666524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:06.667251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:06.669138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:06.698635 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2938/5927] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:06.704275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:06.720153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b553-28f7-4e81-a2bf-00f7e1a0dc75 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:06.735566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:06.736383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:06.736673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:06.736958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] PATH_INFO: `/v3/projects/c4771a46b467481a82dfc6ce9b9d92e0/users/81a7a35cfa2b4602972779fe94d9c9ad/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:06.813736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4771a46b467481a82dfc6ce9b9d92e0, user_id=81a7a35cfa2b4602972779fe94d9c9ad, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:06.823082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:06.856739 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2990/5928] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:06 2022] PUT /identity/v3/projects/c4771a46b467481a82dfc6ce9b9d92e0/users/81a7a35cfa2b4602972779fe94d9c9ad/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:06.857879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:06.872155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d16264-6d9c-4edf-aece-8923b0f4e78a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:06.951799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e29157-10cd-4c50-94c1-7b046ee831c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:06.952765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e29157-10cd-4c50-94c1-7b046ee831c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:06.953233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e29157-10cd-4c50-94c1-7b046ee831c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:06.953868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e29157-10cd-4c50-94c1-7b046ee831c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:06.954786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e29157-10cd-4c50-94c1-7b046ee831c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:06.956605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e29157-10cd-4c50-94c1-7b046ee831c2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:06.969636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2939/5929] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:06.974046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:07.005358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f08d8-de67-4221-a391-6f52d59d826b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:07.025139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:07.025842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.026132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.026552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] PATH_INFO: `/v3/projects/c4771a46b467481a82dfc6ce9b9d92e0/users/81a7a35cfa2b4602972779fe94d9c9ad/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.029233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4771a46b467481a82dfc6ce9b9d92e0, user_id=81a7a35cfa2b4602972779fe94d9c9ad, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:07.031972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:07.099379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2991/5930] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:06 2022] PUT /identity/v3/projects/c4771a46b467481a82dfc6ce9b9d92e0/users/81a7a35cfa2b4602972779fe94d9c9ad/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:07.110799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.111091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.111367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.179169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] MFA Rules not processed for user `81a7a35cfa2b4602972779fe94d9c9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:07.181090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:07.229572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:07.321502 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2940/5931] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:07.326031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:07.339168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c0aeb-0000-4d04-baed-d0f283450d25 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:07.353828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:07.354722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.354844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.355069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.355713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:07.357651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:07.449472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2992/5932] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:07 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:40:07.452892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:07.468048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6b9d-fa84-46cc-a63a-fa1779f33e07 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:07.624097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:07.629026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.629516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.629997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.630996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:07.632922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:07.679060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2941/5933] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:07 2022] POST /identity/v3/users => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:07.683134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:07.695732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120365-565e-4c75-a0ee-6b6622ab7b61 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:07.701584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:07.702791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.702998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.703282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.704418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:07.704730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:07.706849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18540c-2323-463c-b089-5406e6dd8b8a tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:07.767558 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2993/5934] 10.222.0.23 () {58 vars in 1157 bytes} [Mon Oct 31 05:40:07 2022] GET /identity/v3/users?domain_id=default => generated 9170 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:07.770169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:07.786396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67e69-3b75-4991-aabd-998ff05125db tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:07.803927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:07.805944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.806365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.807808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/users/5722edb2fe4645718ad1e9f6dbb40821` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.838438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:update_user(user_id=5722edb2fe4645718ad1e9f6dbb40821)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:07.839772 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:40:07.839772 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:40:07.839772 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:40:07.841271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:07.883573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5722edb2fe4645718ad1e9f6dbb40821'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:07.892999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invalidating the token cache because user 5722edb2fe4645718ad1e9f6dbb40821 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:07.893729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:07.894970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:07.897931 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2942/5935] 10.222.0.23 () {60 vars in 1244 bytes} [Mon Oct 31 05:40:07 2022] PATCH /identity/v3/users/5722edb2fe4645718ad1e9f6dbb40821 => generated 488 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:07.903691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.904582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.905100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.924778 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.auth.plugins.core [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] User is disabled: 5722edb2fe4645718ad1e9f6dbb40821: AssertionError: User is disabled: 5722edb2fe4645718ad1e9f6dbb40821 Oct 31 05:40:07.942419 n-d-862355-5 devstack@keystone.service[82000]: WARNING keystone.server.flask.application [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 05:40:07.944748 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2994/5936] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 43 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 31 05:40:07.948790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:07.950771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:07.967531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595073ca-4d42-49bd-af3a-f34849682b7b tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:07.975510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:07.976668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:07.977170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:07.977845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/users/5722edb2fe4645718ad1e9f6dbb40821` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:07.998861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5722edb2fe4645718ad1e9f6dbb40821)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:08.001491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:08.071465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5722edb2fe4645718ad1e9f6dbb40821'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.084118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5722edb2fe4645718ad1e9f6dbb40821'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.084925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5722edb2fe4645718ad1e9f6dbb40821'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.085630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5722edb2fe4645718ad1e9f6dbb40821'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.105562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5722edb2fe4645718ad1e9f6dbb40821'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.107537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:08.147835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2943/5937] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:07 2022] DELETE /identity/v3/users/5722edb2fe4645718ad1e9f6dbb40821 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:08.151524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:08.153729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:08.227511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:08.277048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be048f62-f834-42c4-8857-500f07e4ba26 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:08.282120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:08.282975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:08.283368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:08.283751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/projects/5439f3d646654f17be2ede6535cbebf7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:08.292351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5439f3d646654f17be2ede6535cbebf7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:08.292351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:08.362304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5439f3d646654f17be2ede6535cbebf7', 'request_id': 'req-03435aac-3dad-4fb2-bc3b-c42dac0968cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.385188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5439f3d646654f17be2ede6535cbebf7', 'request_id': 'req-03435aac-3dad-4fb2-bc3b-c42dac0968cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.404397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5439f3d646654f17be2ede6535cbebf7', 'request_id': 'req-03435aac-3dad-4fb2-bc3b-c42dac0968cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.432755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] The token cache is being invalidate because project 5439f3d646654f17be2ede6535cbebf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:08.432755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.432755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.435628 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2995/5938] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:08 2022] DELETE /identity/v3/projects/5439f3d646654f17be2ede6535cbebf7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:08.440882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:08.456488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd2d8-6ec3-4991-af49-84944b391a98 tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:08.567620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81a7a35cfa2b4602972779fe94d9c9ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4771a46b467481a82dfc6ce9b9d92e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:08.568283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:08.568571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:08.568857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:08.569515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:08.571516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5e035f00-3cc7-4d80-b2a2-9b5927ad35dc tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Could not find domain: a710556c99da45bb8987e9947058e9fe.: keystone.exception.DomainNotFound: Could not find domain: a710556c99da45bb8987e9947058e9fe. Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a710556c99da45bb8987e9947058e9fe. Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:40:08.588845 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:40:08.590027 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:40:08.591224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:40:08.592362 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:40:08.592362 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:40:08.592362 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a710556c99da45bb8987e9947058e9fe. Oct 31 05:40:08.592362 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:40:08.594026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2944/5939] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:08 2022] POST /identity/v3/users => generated 112 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 05:40:08.595525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:08.597191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:08.704996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03435aac-3dad-4fb2-bc3b-c42dac0968cd tempest-UsersNegativeTest-2013503536 tempest-UsersNegativeTest-2013503536-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:08.711757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:08.713364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:08.714099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:08.714857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] PATH_INFO: `/v3/users/2573da37832041af887d5409a06e7e07` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:08.718135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2573da37832041af887d5409a06e7e07)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:08.721006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:08.807191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2573da37832041af887d5409a06e7e07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.822591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2573da37832041af887d5409a06e7e07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.823342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2573da37832041af887d5409a06e7e07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.823964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2573da37832041af887d5409a06e7e07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.830727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:08.833720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2573da37832041af887d5409a06e7e07'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:08.859129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:08.859318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:08.859921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:08.863147 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2996/5940] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:08 2022] DELETE /identity/v3/users/2573da37832041af887d5409a06e7e07 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:08.896093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:08.897243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:08.980938 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2945/5941] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:08.993040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:08.994847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:09.089616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50600c9-1e81-4854-8f36-d6cb1362d19d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:09.093312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:09.093932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:09.094296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:09.094682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:09.105335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:09.107428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:09.119966 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2997/5942] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:09.563427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:09.564984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:09.578787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04474f2-10e2-4aaa-9db0-375aa404250e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:09.583721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:09.584566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:09.584856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:09.585134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] PATH_INFO: `/v3/projects/6ceed94e59c74f979fae421048cbbe41` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:09.586360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ceed94e59c74f979fae421048cbbe41)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:09.588599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:09.652831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ceed94e59c74f979fae421048cbbe41', 'request_id': 'req-48bb8c86-3467-46af-8bb4-676a6bbde085'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.661077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ceed94e59c74f979fae421048cbbe41', 'request_id': 'req-48bb8c86-3467-46af-8bb4-676a6bbde085'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.670898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ceed94e59c74f979fae421048cbbe41', 'request_id': 'req-48bb8c86-3467-46af-8bb4-676a6bbde085'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.684117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] The token cache is being invalidate because project 6ceed94e59c74f979fae421048cbbe41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:09.684408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.685074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.689529 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2946/5943] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:09 2022] DELETE /identity/v3/projects/6ceed94e59c74f979fae421048cbbe41 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:09.690815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:09.701871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c36c7b-c8e9-4000-8d20-06e0a619c6b5 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:09.795687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:09.796798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:09.797658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:09.798045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] PATH_INFO: `/v3/users/81a7a35cfa2b4602972779fe94d9c9ad` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:09.799332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a7a35cfa2b4602972779fe94d9c9ad)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:09.802501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:09.871769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a7a35cfa2b4602972779fe94d9c9ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.901287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a7a35cfa2b4602972779fe94d9c9ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.902181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a7a35cfa2b4602972779fe94d9c9ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.903136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a7a35cfa2b4602972779fe94d9c9ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.932554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a7a35cfa2b4602972779fe94d9c9ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:09.977564 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2998/5944] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:09 2022] DELETE /identity/v3/users/81a7a35cfa2b4602972779fe94d9c9ad => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:10.267876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:10.268764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:10.274892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:10.387829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8c86-3467-46af-8bb4-676a6bbde085 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:10.485943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:10.487570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:10.496862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:10.544081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:10.547902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:10.550772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:10.557499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:10.574846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:10.600686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94368fb-fe92-45ad-bb86-b0ea71976a5f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:10.606130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:10.606980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:10.607406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:10.607910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] PATH_INFO: `/v3/projects/c4771a46b467481a82dfc6ce9b9d92e0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:10.609216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4771a46b467481a82dfc6ce9b9d92e0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:10.611313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:10.635963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:10.639236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b34b-feb5-4572-bea2-c292440710a9 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:10.673772 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2947/5945] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:10.994998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4771a46b467481a82dfc6ce9b9d92e0', 'request_id': 'req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:11.032036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4771a46b467481a82dfc6ce9b9d92e0', 'request_id': 'req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:11.064177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4771a46b467481a82dfc6ce9b9d92e0', 'request_id': 'req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:11.111457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] The token cache is being invalidate because project c4771a46b467481a82dfc6ce9b9d92e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:11.111761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:11.117832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-faa78a77-f9b9-48a0-b798-9ca19a4f87e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:11.119976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 2999/5946] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:10 2022] DELETE /identity/v3/projects/c4771a46b467481a82dfc6ce9b9d92e0 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:11.125814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:11.126095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:11.126399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:11.243353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:11.244575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:11.435147 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2948/5947] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:11.443442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:11.443726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:11.443996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:11.500821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:11.502414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:11.523541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3000/5948] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:11.527839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:11.541946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0703-8f54-494f-ad35-0ee67756bee0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:11.552182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:11.552839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:11.553125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:11.553403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:11.554075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:11.554407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:11.560065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:11.584600 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2949/5949] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:11.588959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:11.604938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb9840-b95b-4962-9e8a-c5cd77359255 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:11.626414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:11.627795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:11.627795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:11.628031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:11.628480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:11.631066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:11.702343 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3001/5950] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:11 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:11.705495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:11.719735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f84461-d51d-4125-a022-0e621cfa6563 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:11.736985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:11.924821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:11.928383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:11.928787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:11.929168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:11.929954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:11.932048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:12.000143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:12.002754 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2950/5951] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:11 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:12.015522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce944d-8aa5-418d-a7f6-1bd21bd1f4e2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:12.048248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:12.048899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.049180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.049458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.050393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:12.052620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:12.079448 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3002/5952] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:12.080633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:12.102004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fd531-3f30-4283-9ba3-824275efb498 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:12.114798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c433c-0cc2-4858-8a7d-6f597249f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:12.116662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c433c-0cc2-4858-8a7d-6f597249f048 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.117153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c433c-0cc2-4858-8a7d-6f597249f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.117767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c433c-0cc2-4858-8a7d-6f597249f048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.118664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c433c-0cc2-4858-8a7d-6f597249f048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:12.121188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c433c-0cc2-4858-8a7d-6f597249f048 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:12.146943 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2951/5953] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:12.150412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:12.161540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c6946-de82-4684-95c1-f130bc97c867 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:12.166781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:12.167659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.168213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.168639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] PATH_INFO: `/v3/projects/0d9dd51a8a78481e90fe2860c706d4dd/users/a1a129bba1cd4a4b989e59d3f7949693/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.189719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9dd51a8a78481e90fe2860c706d4dd, user_id=a1a129bba1cd4a4b989e59d3f7949693, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:12.193654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:12.217026 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3003/5954] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:12 2022] PUT /identity/v3/projects/0d9dd51a8a78481e90fe2860c706d4dd/users/a1a129bba1cd4a4b989e59d3f7949693/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:12.228018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.228310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.228594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.267891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] MFA Rules not processed for user `a1a129bba1cd4a4b989e59d3f7949693`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:12.269188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:12.414466 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2952/5955] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:12.418912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:12.430897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a683c70-4795-4946-8a16-ee2bc004cc43 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:12.435726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4f7c2-25f4-43bb-888e-21b425f2c06b tempest-DefaultDomainTestJSON-903828108 tempest-DefaultDomainTestJSON-903828108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1a129bba1cd4a4b989e59d3f7949693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d9dd51a8a78481e90fe2860c706d4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:12.436489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f7c2-25f4-43bb-888e-21b425f2c06b tempest-DefaultDomainTestJSON-903828108 tempest-DefaultDomainTestJSON-903828108-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.436874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f7c2-25f4-43bb-888e-21b425f2c06b tempest-DefaultDomainTestJSON-903828108 tempest-DefaultDomainTestJSON-903828108-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.437235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f7c2-25f4-43bb-888e-21b425f2c06b tempest-DefaultDomainTestJSON-903828108 tempest-DefaultDomainTestJSON-903828108-project] PATH_INFO: `/v3/domains/default` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.438515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4f7c2-25f4-43bb-888e-21b425f2c06b tempest-DefaultDomainTestJSON-903828108 tempest-DefaultDomainTestJSON-903828108-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:12.440316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4f7c2-25f4-43bb-888e-21b425f2c06b tempest-DefaultDomainTestJSON-903828108 tempest-DefaultDomainTestJSON-903828108-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:12.442831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3004/5956] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 31 05:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:40:12.448110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:12.613132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fc13-59d7-4178-9ae2-71b9ebec01c6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:12.639803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:12.642581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.642979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.643372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] PATH_INFO: `/v3/users/a1a129bba1cd4a4b989e59d3f7949693` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.649990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a129bba1cd4a4b989e59d3f7949693)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:12.653494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:12.705040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:12.774811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a129bba1cd4a4b989e59d3f7949693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:12.794512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a129bba1cd4a4b989e59d3f7949693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:12.795177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a129bba1cd4a4b989e59d3f7949693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:12.795811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a129bba1cd4a4b989e59d3f7949693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:12.811037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a129bba1cd4a4b989e59d3f7949693'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:12.857835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2953/5957] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:12 2022] DELETE /identity/v3/users/a1a129bba1cd4a4b989e59d3f7949693 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:12.867798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:12.869606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:12.870174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:12.944807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:12.949221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:13.022715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:13.190136 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3005/5958] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:13.241542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:13.243304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:13.460855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3feee90-3da9-49c9-be5f-3d5fbc195d06 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:13.477306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a02b7-9922-4b9c-80ea-ee5da6c01e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:13.477971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a02b7-9922-4b9c-80ea-ee5da6c01e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:13.478285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a02b7-9922-4b9c-80ea-ee5da6c01e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:13.478704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a02b7-9922-4b9c-80ea-ee5da6c01e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:13.510475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a02b7-9922-4b9c-80ea-ee5da6c01e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:13.512285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a02b7-9922-4b9c-80ea-ee5da6c01e87 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:13.536166 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2954/5959] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:15.135880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:15.137456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:15.152392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860486-a18e-42bb-a991-f585a3f93539 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:15.157494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:15.158443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:15.158939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:15.159415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] PATH_INFO: `/v3/projects/0d9dd51a8a78481e90fe2860c706d4dd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:15.160988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9dd51a8a78481e90fe2860c706d4dd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:15.164246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:15.226353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9dd51a8a78481e90fe2860c706d4dd', 'request_id': 'req-c6bf47a6-7a76-4951-8dce-7b141c3fac01'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:15.233664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9dd51a8a78481e90fe2860c706d4dd', 'request_id': 'req-c6bf47a6-7a76-4951-8dce-7b141c3fac01'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:15.241979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9dd51a8a78481e90fe2860c706d4dd', 'request_id': 'req-c6bf47a6-7a76-4951-8dce-7b141c3fac01'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:15.264592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] The token cache is being invalidate because project 0d9dd51a8a78481e90fe2860c706d4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:15.266500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:15.267203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c6bf47a6-7a76-4951-8dce-7b141c3fac01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:15.273851 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3006/5960] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:15 2022] DELETE /identity/v3/projects/0d9dd51a8a78481e90fe2860c706d4dd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:15.280447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:15.281311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:15.281595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:15.323151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:15.324738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:15.450394 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2955/5961] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:15.461519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451b60f-b545-4468-b915-805117110051 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:15.462172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451b60f-b545-4468-b915-805117110051 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:15.462831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451b60f-b545-4468-b915-805117110051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:15.510567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6451b60f-b545-4468-b915-805117110051 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:15.510567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6451b60f-b545-4468-b915-805117110051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:15.516751 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3007/5962] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:15.521208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:15.533929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f87db-66b9-4db9-9b3d-fe16c877ba04 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:15.560650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:15.561788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:15.562444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:15.562934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:15.563845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:15.564359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:15.566966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:15.599031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2956/5963] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:15.601284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451b60f-b545-4468-b915-805117110051 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:15.619359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451b60f-b545-4468-b915-805117110051 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:15.626347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:15.626978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:15.627509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:15.627784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:15.629055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:15.632459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:15.730398 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3008/5964] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:15 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:15.733593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:15.758568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f60f9-4518-436b-a39e-5afc0c9814ce admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:15.786772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:15.999509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:16.000427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.000766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.001103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.001927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:16.004972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:16.047464 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2957/5965] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:15 2022] POST /identity/v3/users => generated 289 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:16.052234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:16.070107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3109-d58c-49a0-9108-d32dad88b49a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:16.076706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:16.077596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.077948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.078372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.079491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:16.082022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:16.115609 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3009/5966] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:16.119418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:16.135782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68531b-ba97-491d-8cc9-c036cebe81c1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:16.148777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ec54-07db-4f29-83b0-29f50b3fbb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:16.149425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ec54-07db-4f29-83b0-29f50b3fbb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.149702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ec54-07db-4f29-83b0-29f50b3fbb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.149977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ec54-07db-4f29-83b0-29f50b3fbb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.156985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ec54-07db-4f29-83b0-29f50b3fbb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:16.162062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ec54-07db-4f29-83b0-29f50b3fbb18 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:16.201291 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2958/5967] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:16.211715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:16.240620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d86c1-520f-4da2-95fc-8bd5d4fe4319 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:16.264069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:16.265308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.266804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.268060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] PATH_INFO: `/v3/projects/3a167484faea400c83631497d8f91167/users/894dd05fcf0e4bd8971fda56b8573083/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.308193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a167484faea400c83631497d8f91167, user_id=894dd05fcf0e4bd8971fda56b8573083, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:16.315178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:16.396117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3010/5968] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:16 2022] PUT /identity/v3/projects/3a167484faea400c83631497d8f91167/users/894dd05fcf0e4bd8971fda56b8573083/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:16.406846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.407698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.408638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.458994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:16.461954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:16.540694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] MFA Rules not processed for user `894dd05fcf0e4bd8971fda56b8573083`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:16.555160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:16.666734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:16.728131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b0b1b-3ec5-48b3-9ce0-16613e0fac95 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:16.749729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:16.750464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.750750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.751030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] PATH_INFO: `/v3/users/c9d5ec5af50a4be78cfd007565c7165d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.757774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d5ec5af50a4be78cfd007565c7165d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:16.759785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:16.795476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2959/5969] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:16.800584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:16.852426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e9e72-4c83-48de-a4c2-97b4f4103bbd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:16.866666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:16.869730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:16.871763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:16.872080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:16.879994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:16.884046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:16.926749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d5ec5af50a4be78cfd007565c7165d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:16.965132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d5ec5af50a4be78cfd007565c7165d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:16.968049 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2960/5970] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:16 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:16.970377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d5ec5af50a4be78cfd007565c7165d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:16.971539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d5ec5af50a4be78cfd007565c7165d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:16.977836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:16.985052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:16.998666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-53be3f9f-a203-46c7-a35d-d6170f5f42d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d5ec5af50a4be78cfd007565c7165d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:17.038789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3011/5971] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:16 2022] DELETE /identity/v3/users/c9d5ec5af50a4be78cfd007565c7165d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:17.044838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.046282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.047274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.128072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:17.137770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:17.192774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703d5da-a9b9-41d2-8880-dd8a2ae73017 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:17.207922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:17.351468 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3012/5972] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:17.379500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:17.381393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:17.402751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:17.403391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.403677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.403954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.409139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:17.411292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:17.463754 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2961/5973] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:16 2022] POST /identity/v3/users => generated 289 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:17.467422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:17.487584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97c17-6364-472e-b944-ceaae2116e00 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:17.503583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:17.504742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.505836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.506341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.507188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:17.509015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:17.541116 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2962/5974] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:17.546727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:17.562713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ea056-31fb-4195-9293-1b2ff945533f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:17.572099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a030c05-b818-42cc-b68a-387867ac99fe None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:17.583398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:17.584239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.584596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.586289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b37cd-21f1-4650-907d-7454f288914a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:17.586434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.587181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:17.587372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b37cd-21f1-4650-907d-7454f288914a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.587800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b37cd-21f1-4650-907d-7454f288914a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.588236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b37cd-21f1-4650-907d-7454f288914a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.593893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:17.615216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b37cd-21f1-4650-907d-7454f288914a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:17.617261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b37cd-21f1-4650-907d-7454f288914a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:17.626055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2963/5975] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:17.633582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:17.638624 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3013/5976] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:40:17.665996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf2402-15c6-4f46-8b18-bbdafbffb82a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:17.673805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:17.674540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.674824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.675102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] PATH_INFO: `/v3/projects/6525fa4ed52c44e58a2977f865077be7/users/1eb7cfe431a847b9bbf5f1de144729c8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.715005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6525fa4ed52c44e58a2977f865077be7, user_id=1eb7cfe431a847b9bbf5f1de144729c8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:17.717693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:17.766604 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2964/5977] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:17 2022] PUT /identity/v3/projects/6525fa4ed52c44e58a2977f865077be7/users/1eb7cfe431a847b9bbf5f1de144729c8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:17.777814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:17.778733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:17.779297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:17.820478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:17.854315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] MFA Rules not processed for user `1eb7cfe431a847b9bbf5f1de144729c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:17.858781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:18.024631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:18.026393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:18.071554 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3014/5978] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:18.089163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:18.090804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:18.173931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d571a-8f55-45fa-a4a3-ac5b68421b1f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:18.198265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:18.199592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:18.199592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:18.199592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] PATH_INFO: `/v3/projects/07bedfaaf2ad4e63b277c6ad874c6b5e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:18.201451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bedfaaf2ad4e63b277c6ad874c6b5e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:18.203726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:18.204662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97190-81f1-4a7d-a776-43294f584f25 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:18.210995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:18.212777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:18.214713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:18.216199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:18.218822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:18.337205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bedfaaf2ad4e63b277c6ad874c6b5e', 'request_id': 'req-0dd6ba9d-319c-483e-bce5-6901e47658e7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.345728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:18.348226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:18.352492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bedfaaf2ad4e63b277c6ad874c6b5e', 'request_id': 'req-0dd6ba9d-319c-483e-bce5-6901e47658e7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.353469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:18.375310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bedfaaf2ad4e63b277c6ad874c6b5e', 'request_id': 'req-0dd6ba9d-319c-483e-bce5-6901e47658e7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.389342 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3015/5979] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:40:18.401146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] The token cache is being invalidate because project 07bedfaaf2ad4e63b277c6ad874c6b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:18.401941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.403184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dd6ba9d-319c-483e-bce5-6901e47658e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.409378 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2965/5980] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:18 2022] DELETE /identity/v3/projects/07bedfaaf2ad4e63b277c6ad874c6b5e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:18.410733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:18.443048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0758ac-01bc-411e-83bf-73ffa9347dd8 service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:18.502778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:18.516779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:18.517037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:18.517397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:18.517685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] PATH_INFO: `/v3/users/8138a18b044f4ee4a3c3215873546505` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:18.519187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8138a18b044f4ee4a3c3215873546505)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:18.527563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:18.638533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:18.639070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:18.639535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:18.662276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8138a18b044f4ee4a3c3215873546505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.679355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8138a18b044f4ee4a3c3215873546505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.680622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:18.680841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8138a18b044f4ee4a3c3215873546505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.682183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:18.682347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8138a18b044f4ee4a3c3215873546505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.691034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8138a18b044f4ee4a3c3215873546505'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:18.707977 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3016/5981] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:18 2022] DELETE /identity/v3/users/8138a18b044f4ee4a3c3215873546505 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:18.808454 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2966/5982] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:40:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:18.930980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:18.932934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:19.046189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414cbf1-c73c-4d8d-a59f-5ee0096e17db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:19.059568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:19.062694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:19.063104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:19.063773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:19.064721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:19.065508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:19.083281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11344aa-f49a-4e51-8213-7a38d8fc93d5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:19.141492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:19.143429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:19.161903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:19.162577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:19.163107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:19.163494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] PATH_INFO: `/v3/projects/15e9867f1ac94862ad31c266716fc5a5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:19.164955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e9867f1ac94862ad31c266716fc5a5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:19.167582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:19.178839 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3017/5983] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:40:19.242844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e9867f1ac94862ad31c266716fc5a5', 'request_id': 'req-515a6ede-a1ad-4f75-8d00-786e47d27bce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.253317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e9867f1ac94862ad31c266716fc5a5', 'request_id': 'req-515a6ede-a1ad-4f75-8d00-786e47d27bce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.260783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:19.267363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e9867f1ac94862ad31c266716fc5a5', 'request_id': 'req-515a6ede-a1ad-4f75-8d00-786e47d27bce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.287735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] The token cache is being invalidate because project 15e9867f1ac94862ad31c266716fc5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:19.288304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.289437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.294802 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2967/5984] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:19 2022] DELETE /identity/v3/projects/15e9867f1ac94862ad31c266716fc5a5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:19.296586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:19.313890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9348e-622c-42c8-ae67-d57caadf5c05 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:19.328234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:19.396854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:19.397756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:19.397756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:19.398055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] PATH_INFO: `/v3/users/8fe3ce0a6a724f3289f56ce49f808a8e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:19.400036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe3ce0a6a724f3289f56ce49f808a8e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:19.401248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:19.466106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:19.468331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:19.479202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe3ce0a6a724f3289f56ce49f808a8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.501147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe3ce0a6a724f3289f56ce49f808a8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.501988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe3ce0a6a724f3289f56ce49f808a8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.503926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe3ce0a6a724f3289f56ce49f808a8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.518675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe3ce0a6a724f3289f56ce49f808a8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:19.542424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3018/5985] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:19 2022] DELETE /identity/v3/users/8fe3ce0a6a724f3289f56ce49f808a8e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:19.571736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a6ede-a1ad-4f75-8d00-786e47d27bce admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:19.638433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:19.639389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:19.639886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:19.640384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:19.643675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:19.732889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:19.734868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b559c8e-7777-4d38-b4cf-e541bcaa6b07 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:19.758653 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2968/5986] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:19.794640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:19.796718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:19.875334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:19.875632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:19.875900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:19.923146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:19.928312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:19.943942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6717a3-5ac1-4c44-b9ff-5344638e646e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:19.958003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:19.958923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:19.961283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:19.961801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] PATH_INFO: `/v3/projects/6b7fbdfad88b4fcda36e0650e942a4dc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:19.964543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b7fbdfad88b4fcda36e0650e942a4dc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:19.970781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:20.080271 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2969/5987] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:40:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:20.096636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:20.097062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:20.099538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:20.121054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b7fbdfad88b4fcda36e0650e942a4dc', 'request_id': 'req-6022fa2b-30cf-4c29-bb41-a3df991941d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:20.124541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:20.135490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b7fbdfad88b4fcda36e0650e942a4dc', 'request_id': 'req-6022fa2b-30cf-4c29-bb41-a3df991941d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:20.142733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b7fbdfad88b4fcda36e0650e942a4dc', 'request_id': 'req-6022fa2b-30cf-4c29-bb41-a3df991941d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:20.173700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] The token cache is being invalidate because project 6b7fbdfad88b4fcda36e0650e942a4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:20.174274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:20.175219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6022fa2b-30cf-4c29-bb41-a3df991941d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:20.177631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3019/5988] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:19 2022] DELETE /identity/v3/projects/6b7fbdfad88b4fcda36e0650e942a4dc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:20.358093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2f72-1b7e-4728-b8ca-9be070822bf1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:20.466403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:20.467119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:20.467373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:20.467774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:20.470322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:20.601880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf543-640c-4343-b6a0-e328631cf0e5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:20.601880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf543-640c-4343-b6a0-e328631cf0e5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:20.601880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf543-640c-4343-b6a0-e328631cf0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:20.628226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:20.635197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:20.663637 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2970/5989] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:40:20.674816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-138bf543-640c-4343-b6a0-e328631cf0e5 None None] MFA Rules not processed for user `3556d4ac9f1e4f6393e9f7fe6a16ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:20.677616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-138bf543-640c-4343-b6a0-e328631cf0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:20.829126 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3020/5990] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:20.979436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:20.980879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:21.090778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:21.118633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ca99c-b05f-4645-9b2e-bf1589c4ba02 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:21.129813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:21.130786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:21.131287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:21.131657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] PATH_INFO: `/v3/users/894dd05fcf0e4bd8971fda56b8573083` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:21.133961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894dd05fcf0e4bd8971fda56b8573083)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:21.136829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:21.256700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894dd05fcf0e4bd8971fda56b8573083'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:21.280472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894dd05fcf0e4bd8971fda56b8573083'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:21.281762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894dd05fcf0e4bd8971fda56b8573083'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:21.282747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894dd05fcf0e4bd8971fda56b8573083'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:21.296007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894dd05fcf0e4bd8971fda56b8573083'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:21.341010 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2971/5991] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:20 2022] DELETE /identity/v3/users/894dd05fcf0e4bd8971fda56b8573083 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:21.345490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:21.345949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:21.346419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:21.373263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:21.375661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:21.462978 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3021/5992] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:21.513598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:21.515740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:21.583031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abcb8e-7b88-4e4a-9749-6268c30666a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:21.587549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c7f8b-71ec-421a-8868-2023fe207cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:21.594611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7f8b-71ec-421a-8868-2023fe207cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:21.595133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7f8b-71ec-421a-8868-2023fe207cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:21.595564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7f8b-71ec-421a-8868-2023fe207cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:21.608886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c7f8b-71ec-421a-8868-2023fe207cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:21.611434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c7f8b-71ec-421a-8868-2023fe207cd2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:21.625887 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2972/5993] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:22.643755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:22.646588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:22.663906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266838-1aee-4d20-9918-eaadf4f4bd4b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:22.686740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:22.687884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:22.688248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:22.688508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] PATH_INFO: `/v3/projects/3a167484faea400c83631497d8f91167` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:22.690392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a167484faea400c83631497d8f91167)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:22.694571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:22.730973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:22.731418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:22.731581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:22.766962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] MFA Rules not processed for user `a2150305f8e240ce86b8008d84da243d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:22.768191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:22.830312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a167484faea400c83631497d8f91167', 'request_id': 'req-b08bae30-0955-467a-bcc1-74be758f7694'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:22.840780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a167484faea400c83631497d8f91167', 'request_id': 'req-b08bae30-0955-467a-bcc1-74be758f7694'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:22.857750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a167484faea400c83631497d8f91167', 'request_id': 'req-b08bae30-0955-467a-bcc1-74be758f7694'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:22.859908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:22.890693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] The token cache is being invalidate because project 3a167484faea400c83631497d8f91167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:22.890988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:22.891694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:22.896763 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3022/5994] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:22 2022] DELETE /identity/v3/projects/3a167484faea400c83631497d8f91167 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:22.899292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:22.902907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:22.919022 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2973/5995] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:23.100633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bae30-0955-467a-bcc1-74be758f7694 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:23.114859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:23.115567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:23.115858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:23.116247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] PATH_INFO: `/v3/users/1eb7cfe431a847b9bbf5f1de144729c8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:23.120496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb7cfe431a847b9bbf5f1de144729c8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:23.122610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:23.220593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb7cfe431a847b9bbf5f1de144729c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:23.240560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb7cfe431a847b9bbf5f1de144729c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:23.241443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb7cfe431a847b9bbf5f1de144729c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:23.242173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb7cfe431a847b9bbf5f1de144729c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:23.250097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3f2c8fd4-8d22-4e6e-a9dd-93c44c8d481e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb7cfe431a847b9bbf5f1de144729c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:23.311248 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3023/5996] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:22 2022] DELETE /identity/v3/users/1eb7cfe431a847b9bbf5f1de144729c8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:23.995747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:24.015551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48842e22-73f9-402b-b5b7-8f38496953be None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:24.054005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:24.141670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:24.142862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:24.143403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:24.143900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] PATH_INFO: `/v3/projects/6525fa4ed52c44e58a2977f865077be7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:24.147269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6525fa4ed52c44e58a2977f865077be7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:24.150463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:24.309611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6525fa4ed52c44e58a2977f865077be7', 'request_id': 'req-ebecf481-3e70-48cb-a9d2-1008e53f3e08'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:24.325611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6525fa4ed52c44e58a2977f865077be7', 'request_id': 'req-ebecf481-3e70-48cb-a9d2-1008e53f3e08'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:24.347021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6525fa4ed52c44e58a2977f865077be7', 'request_id': 'req-ebecf481-3e70-48cb-a9d2-1008e53f3e08'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:24.375956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] The token cache is being invalidate because project 6525fa4ed52c44e58a2977f865077be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:24.376570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:24.380299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebecf481-3e70-48cb-a9d2-1008e53f3e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:24.394283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2974/5997] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:23 2022] DELETE /identity/v3/projects/6525fa4ed52c44e58a2977f865077be7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:24.397476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:24.397960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:24.399080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:24.454713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:24.456138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:24.610454 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3024/5998] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:24.620555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:24.620851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:24.621137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:24.642302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:24.643533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:24.656055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2975/5999] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:24.657167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:24.667946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4174d28-77ae-464c-adc1-28c3b9406447 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:24.673764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:24.674554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:24.674844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:24.675146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:24.676503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:24.676804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:24.678557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:24.686682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:24.697239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:24.705860 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3025/6000] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:24.716655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5718-4b6b-45f3-982f-956ab5081e9b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:24.724941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:24.726559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:24.727205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:24.727713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:24.729065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:24.735995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:24.803970 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2976/6001] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:24 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:24.805186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:24.821131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522289b-5683-4b1d-a699-b36570ce41f0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:24.963012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:24.963602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:24.963891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:24.964231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:24.964828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:24.973575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.023621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.024369 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3026/6002] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:24 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:25.035824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fbb01-03d3-4428-9ba8-e60b1c5a32c2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.040510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.041141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.041426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.041706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.042405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:25.044096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.056023 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2977/6003] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:25.060432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.071611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d012-b778-4531-bcd2-0e9b620b7c91 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.079926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475320e7-6531-4c33-890d-0da7908c4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.082565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475320e7-6531-4c33-890d-0da7908c4073 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.082809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475320e7-6531-4c33-890d-0da7908c4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.083107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475320e7-6531-4c33-890d-0da7908c4073 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.083765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475320e7-6531-4c33-890d-0da7908c4073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:25.088269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475320e7-6531-4c33-890d-0da7908c4073 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.105266 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3027/6004] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:25.109248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.124272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d3f5-9186-4323-9d8c-392a96caef2f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.140027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.140722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.141000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.141278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] PATH_INFO: `/v3/projects/4a7b4c7155f746d8ad09754454d8b9bf/users/f09f42d198ff4c778416d84eef2522ee/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.183257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7b4c7155f746d8ad09754454d8b9bf, user_id=f09f42d198ff4c778416d84eef2522ee, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:25.185932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.225108 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2978/6005] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:25 2022] PUT /identity/v3/projects/4a7b4c7155f746d8ad09754454d8b9bf/users/f09f42d198ff4c778416d84eef2522ee/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:25.230938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.231492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.232000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.282604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] MFA Rules not processed for user `f09f42d198ff4c778416d84eef2522ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:25.283830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:25.552057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.555006 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3028/6006] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:25.626012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:25.651478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da4740-b3b8-42ce-833d-770a59a6a4e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.657717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.658597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.659030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.659478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.660309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:25.663105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.704907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2979/6007] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:25 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:25.710440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.740296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db9be-c934-49d3-a099-161dddc97dfe None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.862572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.863329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.863758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.863877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.864508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:25.869361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.894058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:25.915448 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3029/6008] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:25 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:25.923915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.935427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f82f52-1111-41f6-9ef0-01b542b7781b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.941856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.942809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.943167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.943447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:25.944095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:25.945697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:25.961938 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2980/6009] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:25.965852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:25.979219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154450-3555-47e5-b8c0-7f9a56fe5b67 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:25.990970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:25.991766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:25.993272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:25.993630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] PATH_INFO: `/v3/projects/5c41c21b430347ae97972224fb01e6b5/users/43d3f8016abd49bfad5b03d05af82c6c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:26.028652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c41c21b430347ae97972224fb01e6b5, user_id=43d3f8016abd49bfad5b03d05af82c6c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:26.031829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:26.060651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3030/6010] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:25 2022] PUT /identity/v3/projects/5c41c21b430347ae97972224fb01e6b5/users/43d3f8016abd49bfad5b03d05af82c6c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:26.064366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:26.082092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832460f5-3a9a-4beb-a92a-2ceed45bf1fb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:26.183533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b00bf-fa65-47ae-88fb-d8425945f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:26.184430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b00bf-fa65-47ae-88fb-d8425945f88b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:26.184873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b00bf-fa65-47ae-88fb-d8425945f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:26.185330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b00bf-fa65-47ae-88fb-d8425945f88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:26.186208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b00bf-fa65-47ae-88fb-d8425945f88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:26.188595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b00bf-fa65-47ae-88fb-d8425945f88b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:26.201348 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2981/6011] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:26.205160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:26.217688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae84ae-de72-4f8b-bf3a-997b5782dd3f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:26.224524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:26.225539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:26.226654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:26.227089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] PATH_INFO: `/v3/projects/5c41c21b430347ae97972224fb01e6b5/users/43d3f8016abd49bfad5b03d05af82c6c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:26.229944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c41c21b430347ae97972224fb01e6b5, user_id=43d3f8016abd49bfad5b03d05af82c6c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:26.234500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:26.268157 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3031/6012] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:26 2022] PUT /identity/v3/projects/5c41c21b430347ae97972224fb01e6b5/users/43d3f8016abd49bfad5b03d05af82c6c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:26.283000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:26.284012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:26.284553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:26.333394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] MFA Rules not processed for user `43d3f8016abd49bfad5b03d05af82c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:26.335765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:26.447095 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2982/6013] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:26.481404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:26.483221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:26.641478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725932-5835-46d3-832e-96da64d33603 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:26.645880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3679e2-79dd-4856-a97c-f213c833c107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:26.646549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3679e2-79dd-4856-a97c-f213c833c107 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:26.646840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3679e2-79dd-4856-a97c-f213c833c107 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:26.647113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3679e2-79dd-4856-a97c-f213c833c107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:26.661772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3679e2-79dd-4856-a97c-f213c833c107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:26.663953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3679e2-79dd-4856-a97c-f213c833c107 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:26.682450 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3032/6014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:29.794339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:29.841568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:29.865894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66518132-4a9a-4036-93d0-ad18dae05af7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:29.870826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:29.871737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:29.872090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:29.872441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] PATH_INFO: `/v3/users/f09f42d198ff4c778416d84eef2522ee` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:29.873701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09f42d198ff4c778416d84eef2522ee)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:29.875747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:29.933721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09f42d198ff4c778416d84eef2522ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:29.942902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09f42d198ff4c778416d84eef2522ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:29.943663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09f42d198ff4c778416d84eef2522ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:29.944350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09f42d198ff4c778416d84eef2522ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:29.953390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09f42d198ff4c778416d84eef2522ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:29.979040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2983/6015] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:29 2022] DELETE /identity/v3/users/f09f42d198ff4c778416d84eef2522ee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:29.983701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:29.985060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:29.985495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:30.011090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:30.014297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:30.106523 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3033/6016] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:30.116810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:30.118294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:30.187631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8325b6-96ab-4067-b91b-a6b388ffa30d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:30.193361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:30.194661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:30.194661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:30.194963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:30.211223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:30.212889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:30.227722 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2984/6017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:30.654657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:30.657094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:30.685605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad417c8-6f5d-4513-bac5-7dc9066bf36e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:30.704643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:30.705925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:30.706349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:30.707295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] PATH_INFO: `/v3/projects/4a7b4c7155f746d8ad09754454d8b9bf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:30.708853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7b4c7155f746d8ad09754454d8b9bf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:30.710828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:30.810782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7b4c7155f746d8ad09754454d8b9bf', 'request_id': 'req-2bd84544-e02f-4ac1-9a04-d72cb189240b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:30.819824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7b4c7155f746d8ad09754454d8b9bf', 'request_id': 'req-2bd84544-e02f-4ac1-9a04-d72cb189240b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:30.823277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:30.829649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7b4c7155f746d8ad09754454d8b9bf', 'request_id': 'req-2bd84544-e02f-4ac1-9a04-d72cb189240b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:30.864736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] The token cache is being invalidate because project 4a7b4c7155f746d8ad09754454d8b9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:30.865348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:30.866385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:30.868844 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3034/6018] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:30 2022] DELETE /identity/v3/projects/4a7b4c7155f746d8ad09754454d8b9bf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:30.872641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:30.885103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb005-0b3b-4d6c-88ec-f39d7d5dee3e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:30.987007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:30.987661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:30.989232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:30.989514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] PATH_INFO: `/v3/users/43d3f8016abd49bfad5b03d05af82c6c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:30.991051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d3f8016abd49bfad5b03d05af82c6c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:30.993335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:30.997684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:31.127792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d3f8016abd49bfad5b03d05af82c6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:31.147321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d3f8016abd49bfad5b03d05af82c6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:31.148347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d3f8016abd49bfad5b03d05af82c6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:31.149250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d3f8016abd49bfad5b03d05af82c6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:31.161829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-df93d601-7158-4ca9-a847-69fd98c746a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d3f8016abd49bfad5b03d05af82c6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:31.193156 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2985/6019] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:30 2022] DELETE /identity/v3/users/43d3f8016abd49bfad5b03d05af82c6c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:31.933409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:31.935438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:31.956351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd84544-e02f-4ac1-9a04-d72cb189240b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.048244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.049326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.049894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.050401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] PATH_INFO: `/v3/projects/5c41c21b430347ae97972224fb01e6b5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.052147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c41c21b430347ae97972224fb01e6b5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.054823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.117170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c41c21b430347ae97972224fb01e6b5', 'request_id': 'req-18c0a273-42c4-4463-aedb-fdb97e860e99'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:32.129283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c41c21b430347ae97972224fb01e6b5', 'request_id': 'req-18c0a273-42c4-4463-aedb-fdb97e860e99'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:32.138071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c41c21b430347ae97972224fb01e6b5', 'request_id': 'req-18c0a273-42c4-4463-aedb-fdb97e860e99'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:32.168635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] The token cache is being invalidate because project 5c41c21b430347ae97972224fb01e6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:32.169172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:32.170939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-18c0a273-42c4-4463-aedb-fdb97e860e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:32.172902 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3035/6020] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:31 2022] DELETE /identity/v3/projects/5c41c21b430347ae97972224fb01e6b5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:32.178674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.179540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.179964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.208165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:32.210480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:32.338935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2986/6021] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:32.348609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.348959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.349175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.388324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:32.393947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:32.407206 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3036/6022] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:32.412774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:32.424279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78adebb-83fa-4a04-809c-4d47ee3830df None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.429537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.430266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.430622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.431087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.432012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:32.432394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.434175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.452792 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2987/6023] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:40:32.458305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:32.474889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bb73b-ecf1-45d3-a23a-90e7435ed3b2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.484625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.485593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.485965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.486391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.487406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.491996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.538270 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3037/6024] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:32 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:32.542261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:32.556436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc3b3e-265f-4ca7-9cf0-43e4dd62c52b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.639463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.640397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.640691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.641157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.642463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.645969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.669728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:32.678197 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2988/6025] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:32 2022] POST /identity/v3/users => generated 282 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:32.682277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:32.699806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcc4a9-cd18-4bda-a8c3-e0d9ed9e490d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.706350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.708463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.708852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.709226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.709980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.711744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.749303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:32.749783 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3038/6026] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:32.764480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d87a21-569e-4dc8-85bd-133f4831e937 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.776208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee7e98-a04e-4aea-bc95-b00dd6bf51c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.776998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee7e98-a04e-4aea-bc95-b00dd6bf51c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.777959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee7e98-a04e-4aea-bc95-b00dd6bf51c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.778404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee7e98-a04e-4aea-bc95-b00dd6bf51c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.778946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee7e98-a04e-4aea-bc95-b00dd6bf51c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.782599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee7e98-a04e-4aea-bc95-b00dd6bf51c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.812388 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2989/6027] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:32.817693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:32.833657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768e30-5604-4033-bd89-e4e9857d89de admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:32.853874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:32.854713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.855214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.855590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] PATH_INFO: `/v3/projects/5f949b64d1b143bbb7f57886a9cf9d75/users/154df55fd78f4d8aaedd779ec8991dff/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:32.898819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f949b64d1b143bbb7f57886a9cf9d75, user_id=154df55fd78f4d8aaedd779ec8991dff, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:32.909482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:32.958118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:32.958353 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3039/6028] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:32 2022] PUT /identity/v3/projects/5f949b64d1b143bbb7f57886a9cf9d75/users/154df55fd78f4d8aaedd779ec8991dff/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:32.958784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:32.958784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.045616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] MFA Rules not processed for user `154df55fd78f4d8aaedd779ec8991dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:33.049140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:33.242185 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2990/6029] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:33.242894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:33.259047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:33.359701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f592ff-98ae-4335-a35d-712f9f9ea854 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:33.368615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:33.369661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.370208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.370967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.371889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:33.374865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:33.414044 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3040/6030] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:33 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:33.418230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:33.432553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba815f-9790-450d-91e3-87afe13b586c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:33.508244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:33.509042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.509461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.509816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.510712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:33.513024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:33.545553 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2991/6031] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:33 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:33.549223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:33.562460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1dc16-8bb3-45c6-b617-1aee93fdbe93 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:33.569333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:33.570185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.570655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.571028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.571785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:33.574422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:33.588264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3041/6032] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:33.592262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:33.613824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8f22-74ae-40e2-a63a-8f9439cbd594 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:33.620155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:33.621149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.621417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.621952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] PATH_INFO: `/v3/projects/2c0c40caaad244f9a82c0faa619bfcbf/users/79053ff3828d4d12938cbc3e93fb825f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.647563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0c40caaad244f9a82c0faa619bfcbf, user_id=79053ff3828d4d12938cbc3e93fb825f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:33.650700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:33.700068 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2992/6033] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:33 2022] PUT /identity/v3/projects/2c0c40caaad244f9a82c0faa619bfcbf/users/79053ff3828d4d12938cbc3e93fb825f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:33.703909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:33.716272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f46f6b-4a1a-4f6a-9af2-826f57592606 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:33.814178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e519a1-3e39-432c-8a55-e1c698c516e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:33.815050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e519a1-3e39-432c-8a55-e1c698c516e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.815439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e519a1-3e39-432c-8a55-e1c698c516e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.815977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e519a1-3e39-432c-8a55-e1c698c516e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.817745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e519a1-3e39-432c-8a55-e1c698c516e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:33.819618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e519a1-3e39-432c-8a55-e1c698c516e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:33.831444 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3042/6034] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:33.835891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:33.847055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18a10e-449d-4ec2-9a33-c480ec331396 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:33.853398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:33.854310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.854699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.855086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] PATH_INFO: `/v3/projects/2c0c40caaad244f9a82c0faa619bfcbf/users/79053ff3828d4d12938cbc3e93fb825f/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.857401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0c40caaad244f9a82c0faa619bfcbf, user_id=79053ff3828d4d12938cbc3e93fb825f, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:33.860401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:33.873566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2993/6035] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:33 2022] PUT /identity/v3/projects/2c0c40caaad244f9a82c0faa619bfcbf/users/79053ff3828d4d12938cbc3e93fb825f/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:33.886276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:33.886572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:33.886853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:33.926948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] MFA Rules not processed for user `79053ff3828d4d12938cbc3e93fb825f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:33.928355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:34.026948 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3043/6036] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:34.040188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:34.042529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:34.084890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:34.120988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75437b-a1b0-4e1a-b1d2-78839c058fbb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:34.126799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b24a9d-3eca-448b-8c23-4e3946301e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:34.127838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24a9d-3eca-448b-8c23-4e3946301e61 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:34.128289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24a9d-3eca-448b-8c23-4e3946301e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:34.129432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24a9d-3eca-448b-8c23-4e3946301e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:34.142893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24a9d-3eca-448b-8c23-4e3946301e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:34.145808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24a9d-3eca-448b-8c23-4e3946301e61 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:34.159091 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2994/6037] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:37.331452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:37.333148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:37.349423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:37.513153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034b339-3847-4c9b-a85c-22f78810be45 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:37.530516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:37.531581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:37.531976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:37.532482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] PATH_INFO: `/v3/users/0b6073d8736743ee90379237d801c3dd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:37.533818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6073d8736743ee90379237d801c3dd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:37.537098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:37.627276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6073d8736743ee90379237d801c3dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:37.654360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6073d8736743ee90379237d801c3dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:37.655326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6073d8736743ee90379237d801c3dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:37.656772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6073d8736743ee90379237d801c3dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:37.669160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6073d8736743ee90379237d801c3dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:37.705159 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3044/6038] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:37 2022] DELETE /identity/v3/users/0b6073d8736743ee90379237d801c3dd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:37.707672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:37.708156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:37.708270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:37.744799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:37.746038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:37.973011 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2995/6039] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:38.028749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:38.030404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:38.168144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:38.172044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:38.244924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70745c4-8b57-4b3b-be65-c059989ee0ff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:38.253207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:38.254527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:38.255019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:38.255476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:38.272956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:38.274526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:38.298198 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3045/6040] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:38.305837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6904-1957-4b7b-a42e-feaaec2fb9fa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:38.309721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:38.310688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:38.311179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:38.311536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:38.314369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:38.403286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:38.404834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:38.416534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2996/6041] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:39.229810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:39.232471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:39.271632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afdbdc-dd02-451e-a193-d691b180ffb0 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:39.277371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:39.278089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:39.278746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:39.279241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] PATH_INFO: `/v3/projects/5d851f950fdc4324a22726b4d780d869` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:39.280282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d851f950fdc4324a22726b4d780d869)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:39.282345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:39.324425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:39.400138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d851f950fdc4324a22726b4d780d869', 'request_id': 'req-1ac8452e-5c8d-4301-a121-71fc0adf528f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.417869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d851f950fdc4324a22726b4d780d869', 'request_id': 'req-1ac8452e-5c8d-4301-a121-71fc0adf528f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.448756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d851f950fdc4324a22726b4d780d869', 'request_id': 'req-1ac8452e-5c8d-4301-a121-71fc0adf528f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.475351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] The token cache is being invalidate because project 5d851f950fdc4324a22726b4d780d869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:39.475874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.476816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.478649 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3046/6042] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:39 2022] DELETE /identity/v3/projects/5d851f950fdc4324a22726b4d780d869 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:39.482632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:39.499616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611192-2bfa-4cc6-9cd4-bb1e1ed27389 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:39.556319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:39.616788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:39.617539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:39.617901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:39.618290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] PATH_INFO: `/v3/users/5e9303803dee4929b23d3637f3b1c99c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:39.619561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9303803dee4929b23d3637f3b1c99c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:39.621593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:39.721033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9303803dee4929b23d3637f3b1c99c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.750398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9303803dee4929b23d3637f3b1c99c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.751182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9303803dee4929b23d3637f3b1c99c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.752003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9303803dee4929b23d3637f3b1c99c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.764777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9303803dee4929b23d3637f3b1c99c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:39.810487 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2997/6043] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:39 2022] DELETE /identity/v3/users/5e9303803dee4929b23d3637f3b1c99c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:40.085207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:40.089161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:40.114832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8452e-5c8d-4301-a121-71fc0adf528f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:40.193022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:40.194190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.194819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.195358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] PATH_INFO: `/v3/projects/43bc05317f094edea727c86b08216354` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.197316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bc05317f094edea727c86b08216354)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:40.202555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:40.240995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:40.245411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:40.290177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92fa0a-0aa9-40be-83c7-d0934498dae5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:40.303225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:40.304035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.304247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.304531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] PATH_INFO: `/v3/users/154df55fd78f4d8aaedd779ec8991dff` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.306011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=154df55fd78f4d8aaedd779ec8991dff)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:40.308000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:40.355439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bc05317f094edea727c86b08216354', 'request_id': 'req-0638fa2e-7030-4d1a-9f37-45504fb2104b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.364862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bc05317f094edea727c86b08216354', 'request_id': 'req-0638fa2e-7030-4d1a-9f37-45504fb2104b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.384510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bc05317f094edea727c86b08216354', 'request_id': 'req-0638fa2e-7030-4d1a-9f37-45504fb2104b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.409299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] The token cache is being invalidate because project 43bc05317f094edea727c86b08216354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:40.409598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.412222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0638fa2e-7030-4d1a-9f37-45504fb2104b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.420155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3047/6044] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:40 2022] DELETE /identity/v3/projects/43bc05317f094edea727c86b08216354 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:40.421779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5bc8-aa84-4b89-b3d2-7606bad30b02 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.422078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5bc8-aa84-4b89-b3d2-7606bad30b02 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.422390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5bc8-aa84-4b89-b3d2-7606bad30b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.428898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154df55fd78f4d8aaedd779ec8991dff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.444252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154df55fd78f4d8aaedd779ec8991dff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.454228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154df55fd78f4d8aaedd779ec8991dff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.455382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154df55fd78f4d8aaedd779ec8991dff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.476483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-76cafb99-4c7f-4e1f-81f8-f052d106a25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154df55fd78f4d8aaedd779ec8991dff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:40.495170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-343d5bc8-aa84-4b89-b3d2-7606bad30b02 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:40.497598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-343d5bc8-aa84-4b89-b3d2-7606bad30b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:40.533766 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2998/6045] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:40 2022] DELETE /identity/v3/users/154df55fd78f4d8aaedd779ec8991dff => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:40.539043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.539366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.539616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.591509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:40.592959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:40.619740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:40.621096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:40.674852 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3048/6046] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:40.682760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.683309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.683737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.705535 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2999/6047] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:40.716289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:40.718976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:40.725713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:40.726942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:40.740049 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3049/6048] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:40.743782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:40.766586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feabc9-1195-40e2-96c6-f36b28001409 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:40.779096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:40.780822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.782854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.783203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.783944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:40.785384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:40.788195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:40.814748 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3050/6049] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:40:40.820416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:40.839573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6061-bbcf-4c1a-99fc-4065243d3b61 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:40.853110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:40.853849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.854225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.854575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.855287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:40.858073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:40.876988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d860f-d223-4db2-bb21-61e68b12dae4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:40.882745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:40.883449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:40.883802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:40.884192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:40.927194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:40.930006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:40.934447 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3051/6050] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:40 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:40.935499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:40.963338 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3000/6051] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:40:41.076516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfcfe6-9c7b-4e47-a10c-cefbc0e5d36f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.085281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.085939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.086247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.086532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.087202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.090669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.132781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3052/6052] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:40 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:41.136949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.148344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a7b2-c0f1-4c73-9842-22c6678ac256 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.159451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.160995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.161329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.161775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.167071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.168799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.191077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3001/6053] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:41.195047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.210761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8dc30-0827-41c4-b449-64ef6ea4b68f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.220556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22df26-cb89-4aa6-a24b-9db04d6e9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.223401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22df26-cb89-4aa6-a24b-9db04d6e9e53 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.223807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22df26-cb89-4aa6-a24b-9db04d6e9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.224190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22df26-cb89-4aa6-a24b-9db04d6e9e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.225058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22df26-cb89-4aa6-a24b-9db04d6e9e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.228751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22df26-cb89-4aa6-a24b-9db04d6e9e53 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.247673 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3053/6054] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:41.252244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.266882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05166-0446-43e9-947b-5b0cdec1aa79 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.275560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.276457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.276884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.277348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] PATH_INFO: `/v3/projects/c07062312478419891bd47c9bb90a4c2/users/ad150e03881b4cfdac07c430c2b549aa/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.303739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07062312478419891bd47c9bb90a4c2, user_id=ad150e03881b4cfdac07c430c2b549aa, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.306851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.326848 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3002/6055] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:41 2022] PUT /identity/v3/projects/c07062312478419891bd47c9bb90a4c2/users/ad150e03881b4cfdac07c430c2b549aa/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:41.338858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.339354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.339692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.392386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] MFA Rules not processed for user `ad150e03881b4cfdac07c430c2b549aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:41.393622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:41.503279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3054/6056] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:41.504990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.596691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df4b4-8395-4088-b783-ce20768fe2d5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.604528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.605570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.606006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.606437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.608775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.611338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.675188 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3003/6057] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:41 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:41.680074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.696274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c8ae8-619b-4a35-8b68-0a1191e08c9a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.704357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:41.787944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.788735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.789099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.789487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.790238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.792940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.827772 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3055/6058] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:41 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:41.828103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.841635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6cf28-fe3d-4a20-8704-74a8013a3359 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.878254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.879428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.879729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.880079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.881258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.882771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.888607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:41.898746 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3004/6059] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:41.900074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.913978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2a4a-6e37-4b23-bf27-5e458fa6c5e3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:41.919662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:41.920470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:41.921079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:41.921726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] PATH_INFO: `/v3/projects/3548f9626ff3470bbd20ff8c0dee5ed8/users/9039f31d41d944ffbcfdbf5f7f8c20fa/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:41.940272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3548f9626ff3470bbd20ff8c0dee5ed8, user_id=9039f31d41d944ffbcfdbf5f7f8c20fa, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:41.943483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:41.967809 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3056/6060] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:41 2022] PUT /identity/v3/projects/3548f9626ff3470bbd20ff8c0dee5ed8/users/9039f31d41d944ffbcfdbf5f7f8c20fa/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:41.970824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:41.982043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c86c7-77d2-4a88-887c-104cefd648ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:42.066905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ffae-c070-471a-9d0c-cc06e368c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:42.067545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ffae-c070-471a-9d0c-cc06e368c702 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:42.069099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ffae-c070-471a-9d0c-cc06e368c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:42.069099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ffae-c070-471a-9d0c-cc06e368c702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:42.070811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ffae-c070-471a-9d0c-cc06e368c702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:42.072974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ffae-c070-471a-9d0c-cc06e368c702 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:42.090746 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3005/6061] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:42.096063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:42.107732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b27-0a51-4038-a44f-8a5b698292d1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:42.113671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:42.120626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:42.125524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:42.125809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] PATH_INFO: `/v3/projects/3548f9626ff3470bbd20ff8c0dee5ed8/users/9039f31d41d944ffbcfdbf5f7f8c20fa/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:42.130718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3548f9626ff3470bbd20ff8c0dee5ed8, user_id=9039f31d41d944ffbcfdbf5f7f8c20fa, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:42.133408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:42.154240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3057/6062] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:42 2022] PUT /identity/v3/projects/3548f9626ff3470bbd20ff8c0dee5ed8/users/9039f31d41d944ffbcfdbf5f7f8c20fa/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:42.164431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:42.164785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:42.164999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:42.201784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] MFA Rules not processed for user `9039f31d41d944ffbcfdbf5f7f8c20fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:42.204112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:42.319130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3006/6063] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:42.334479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:42.425724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:42.428139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:42.484984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64949572-6951-471a-8f9f-a40fc48e021d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:42.497237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:42.498555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:42.498555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:42.498555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:42.522976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:42.524795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:42.546828 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3058/6064] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:42.596298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719aa3-b475-45df-86ab-e5ba82992243 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:42.604475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:42.608156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:42.608608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:42.608991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] PATH_INFO: `/v3/projects/5f949b64d1b143bbb7f57886a9cf9d75` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:42.612301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f949b64d1b143bbb7f57886a9cf9d75)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:42.618243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:42.664286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:42.748404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f949b64d1b143bbb7f57886a9cf9d75', 'request_id': 'req-fbf8b467-5145-4585-875e-a0aecdf31aa4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:42.765714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f949b64d1b143bbb7f57886a9cf9d75', 'request_id': 'req-fbf8b467-5145-4585-875e-a0aecdf31aa4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:42.776200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f949b64d1b143bbb7f57886a9cf9d75', 'request_id': 'req-fbf8b467-5145-4585-875e-a0aecdf31aa4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:42.806944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] The token cache is being invalidate because project 5f949b64d1b143bbb7f57886a9cf9d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:42.806944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:42.810493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:42.815047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3007/6065] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:42 2022] DELETE /identity/v3/projects/5f949b64d1b143bbb7f57886a9cf9d75 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:40:42.819255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:42.832739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49005c5-c048-4d71-b113-6de493da8440 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:42.961477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:42.962163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:42.964751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:42.965118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] PATH_INFO: `/v3/users/79053ff3828d4d12938cbc3e93fb825f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:42.970132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79053ff3828d4d12938cbc3e93fb825f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:42.976428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:43.001832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:43.136431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79053ff3828d4d12938cbc3e93fb825f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:43.206821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79053ff3828d4d12938cbc3e93fb825f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:43.208019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79053ff3828d4d12938cbc3e93fb825f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:43.210247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79053ff3828d4d12938cbc3e93fb825f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:43.228855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0c6ccc77-9145-4c2b-806d-9d197f780b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79053ff3828d4d12938cbc3e93fb825f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:43.260063 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3059/6066] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:40:42 2022] DELETE /identity/v3/users/79053ff3828d4d12938cbc3e93fb825f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:44.524953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:44.528240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:44.550858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b467-5145-4585-875e-a0aecdf31aa4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:44.805502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:44.808505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:44.825869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:44.825869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] PATH_INFO: `/v3/projects/2c0c40caaad244f9a82c0faa619bfcbf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:44.838524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0c40caaad244f9a82c0faa619bfcbf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:44.840759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:44.971920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0c40caaad244f9a82c0faa619bfcbf', 'request_id': 'req-ae71a4c0-4355-442a-8255-0e7440b314ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:44.985492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0c40caaad244f9a82c0faa619bfcbf', 'request_id': 'req-ae71a4c0-4355-442a-8255-0e7440b314ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:45.005271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0c40caaad244f9a82c0faa619bfcbf', 'request_id': 'req-ae71a4c0-4355-442a-8255-0e7440b314ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:45.034948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] The token cache is being invalidate because project 2c0c40caaad244f9a82c0faa619bfcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:45.035772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:45.036640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae71a4c0-4355-442a-8255-0e7440b314ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:45.038766 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3008/6067] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:44 2022] DELETE /identity/v3/projects/2c0c40caaad244f9a82c0faa619bfcbf => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:45.044212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.044659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.044786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.089858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:45.092164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:45.278804 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3060/6068] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:40:45.287659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.288003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.288390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.351929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:45.356941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:45.392729 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3009/6069] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:45.397310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:45.412493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae74f66-6dc2-4050-a16a-f3a5836dc6ff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:45.421566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:45.422634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.422634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.422848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.423475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:45.423787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:45.438481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:45.452271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3061/6070] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:45.456911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:45.470220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa799-b619-4ac5-9e9b-9e96356bb649 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:45.482948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:45.483594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.483881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.484159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.484821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:45.489309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:45.568975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3010/6071] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:45 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:45.573487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:45.594487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939bf10-9dd7-4801-bdd7-4c71f9ccd7ea admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:45.740378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:45.741033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.741319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.741598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.742363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:45.744270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:45.783699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:45.795608 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3062/6072] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:40:45 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:45.797098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:45.811225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11416-d422-4561-8b86-cc04bb593796 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:45.819780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:45.820672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.821146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.821579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.822713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:45.824562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:45.853578 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3011/6073] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:40:45.854343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:45.867557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7dff-1261-468b-8623-5c3abffde922 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:45.885095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8e0d5-2045-4f7b-91a1-2b73e7d3c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:45.885840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8e0d5-2045-4f7b-91a1-2b73e7d3c70f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.886005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8e0d5-2045-4f7b-91a1-2b73e7d3c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.886454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8e0d5-2045-4f7b-91a1-2b73e7d3c70f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.887112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8e0d5-2045-4f7b-91a1-2b73e7d3c70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:45.888752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8e0d5-2045-4f7b-91a1-2b73e7d3c70f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:45.923501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3063/6074] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:40:45.924796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:45.932086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:45.941212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e4ad-eb61-459a-a871-c39edbd41a19 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:45.963370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:45.964740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:45.965139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:45.965952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] PATH_INFO: `/v3/projects/d0b0a1f58973421f9e9f0b60c3685712/users/3adfd471f2a74bb4942335a0f31caeec/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:45.999230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b0a1f58973421f9e9f0b60c3685712, user_id=3adfd471f2a74bb4942335a0f31caeec, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:46.006783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:46.035752 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3012/6075] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:40:45 2022] PUT /identity/v3/projects/d0b0a1f58973421f9e9f0b60c3685712/users/3adfd471f2a74bb4942335a0f31caeec/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:46.046328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:46.046826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:46.046826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:46.102880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] MFA Rules not processed for user `3adfd471f2a74bb4942335a0f31caeec`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:40:46.103924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:46.245315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3064/6076] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:40:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:40:46.282855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:46.287852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:46.499658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03121-9169-4bf4-aca1-2238975c3ab4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:46.509081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:46.515928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:46.516218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:46.516502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:46.536079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:46.537594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:46.550300 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3013/6077] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:40:50.982309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:50.985329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:51.136455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6335d-cacf-4e44-b5bd-ad724e0be7b5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:51.144991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9039f31d41d944ffbcfdbf5f7f8c20fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3548f9626ff3470bbd20ff8c0dee5ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:51.145905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:51.146363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:51.146948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:51.149422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:51.149926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:51.166396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:51.207561 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3065/6078] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:51.209052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:51.224562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c33cda-bcef-4274-ad7e-a81a922290d5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:51.233405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9039f31d41d944ffbcfdbf5f7f8c20fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3548f9626ff3470bbd20ff8c0dee5ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:51.234268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:51.234563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:51.234845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:51.239428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:51.241501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:51.331234 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3014/6079] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:40:51 2022] POST /identity/v3/projects => generated 348 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:40:51.336573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:51.350587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335662-a4ae-4a73-8c0d-3093d6149964 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:51.518621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9039f31d41d944ffbcfdbf5f7f8c20fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3548f9626ff3470bbd20ff8c0dee5ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:51.519733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:51.522464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:51.526906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:51.528799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:40:51.529296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:51.532315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:51.564167 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3066/6080] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:40:52.156770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:52.184597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f20b-8c3a-40f7-a1b9-b63624eb6132 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:52.220992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9039f31d41d944ffbcfdbf5f7f8c20fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3548f9626ff3470bbd20ff8c0dee5ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:52.221673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:52.222518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:52.223009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] PATH_INFO: `/v3/projects/66c41ed3afdc4beaa5c439b1a001b0eb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:52.231405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66c41ed3afdc4beaa5c439b1a001b0eb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:52.233363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:52.391794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c41ed3afdc4beaa5c439b1a001b0eb', 'request_id': 'req-dbe011cc-1788-44a1-82b3-24590914b6d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:52.407516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c41ed3afdc4beaa5c439b1a001b0eb', 'request_id': 'req-dbe011cc-1788-44a1-82b3-24590914b6d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:52.428610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c41ed3afdc4beaa5c439b1a001b0eb', 'request_id': 'req-dbe011cc-1788-44a1-82b3-24590914b6d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:52.448507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] The token cache is being invalidate because project 66c41ed3afdc4beaa5c439b1a001b0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:40:52.449029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:52.449993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:40:52.452316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3015/6081] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:40:52 2022] DELETE /identity/v3/projects/66c41ed3afdc4beaa5c439b1a001b0eb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:40:52.464167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:40:52.466087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:52.486609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:40:52.591826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab347-a00d-440c-b711-7c410adcbec3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:40:52.719239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:40:52.720265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:40:52.720755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:40:52.721252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:40:52.725279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:40:52.813752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:40:52.815442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:40:52.850940 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3067/6082] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:02.226441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:02.228070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:02.452508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:02.516371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe011cc-1788-44a1-82b3-24590914b6d3 tempest-RoutersIpV6AdminTest-1993739184 tempest-RoutersIpV6AdminTest-1993739184-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:02.529177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:02.530844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:02.531133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:02.531412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:02.536917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:02.730006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:02.731708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:02.797820 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3016/6083] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:41:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:41:02.837888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=65 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:07.782483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:07.784155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:07.828564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772675e-1950-4b66-9d55-d0c5d371a76a service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:07.836032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:07.838250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:07.838888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:07.839371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:07.859816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:08.008291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:08.010482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:08.030318 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3068/6084] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:11.044006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:11.045867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:11.324388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7ae9-4cd0-44e2-80b1-8b38714dc636 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:11.342814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:11.343626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:11.345953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:11.346613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:11.350781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:11.491662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:11.498728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:11.523152 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3017/6085] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:16.938183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:16.939669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:17.129841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926f1af-cc28-4755-90c5-78907be523bf service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:17.138014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:17.138961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:17.139972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:17.140637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:17.143049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:17.171975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:17.179408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:17.225481 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3069/6086] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:21.509294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:24.986949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:24.991224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:25.022384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a642e-481e-4b82-bf74-9c3429ac4db7 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:25.033542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:25.034490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:25.040000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:25.040410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] PATH_INFO: `/v3/users/d21096fd76b44434bb2bb0633fc0376c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:25.041964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21096fd76b44434bb2bb0633fc0376c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:25.044335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:25.170207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21096fd76b44434bb2bb0633fc0376c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:25.191637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21096fd76b44434bb2bb0633fc0376c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:25.192294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21096fd76b44434bb2bb0633fc0376c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:25.192944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21096fd76b44434bb2bb0633fc0376c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:25.207994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21096fd76b44434bb2bb0633fc0376c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:25.246946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3018/6087] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:24 2022] DELETE /identity/v3/users/d21096fd76b44434bb2bb0633fc0376c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:26.033364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:26.057288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365ee36-9437-41cc-b036-9c3f89408a93 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:26.168161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:26.169674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:26.171429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:26.171794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] PATH_INFO: `/v3/projects/35238b920cd843fe8a1e86a85fc4f3ad` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:26.173228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35238b920cd843fe8a1e86a85fc4f3ad)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:26.176031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:26.227299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:26.256841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35238b920cd843fe8a1e86a85fc4f3ad', 'request_id': 'req-51817717-929f-4276-9ae2-29c3aa946862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.264123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35238b920cd843fe8a1e86a85fc4f3ad', 'request_id': 'req-51817717-929f-4276-9ae2-29c3aa946862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.271649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35238b920cd843fe8a1e86a85fc4f3ad', 'request_id': 'req-51817717-929f-4276-9ae2-29c3aa946862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.289437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] The token cache is being invalidate because project 35238b920cd843fe8a1e86a85fc4f3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:26.290476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.291477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.295405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3070/6088] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:26 2022] DELETE /identity/v3/projects/35238b920cd843fe8a1e86a85fc4f3ad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:26.297952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:26.299459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:26.321942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd6383-d01b-4702-b567-0014d3c63344 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:26.400767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:26.401662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:26.402304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:26.402985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] PATH_INFO: `/v3/users/27935f3fa953419080b90a3d399348fd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:26.404386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27935f3fa953419080b90a3d399348fd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:26.407600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:26.477001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27935f3fa953419080b90a3d399348fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.486333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27935f3fa953419080b90a3d399348fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.488146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27935f3fa953419080b90a3d399348fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.489427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27935f3fa953419080b90a3d399348fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.500272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5f857085-9813-4b59-82bd-76e492349f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27935f3fa953419080b90a3d399348fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:26.511113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:26.528552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3019/6089] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:26 2022] DELETE /identity/v3/users/27935f3fa953419080b90a3d399348fd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:27.063089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.064725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:27.105212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51817717-929f-4276-9ae2-29c3aa946862 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.176044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.176610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.176891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.177168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] PATH_INFO: `/v3/projects/6ae513cf120d4e59a6091b9a0264b1c4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.178673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae513cf120d4e59a6091b9a0264b1c4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.180853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:27.237932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae513cf120d4e59a6091b9a0264b1c4', 'request_id': 'req-936bb36d-a888-4908-a281-54b64b56957a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:27.245250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae513cf120d4e59a6091b9a0264b1c4', 'request_id': 'req-936bb36d-a888-4908-a281-54b64b56957a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:27.251708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae513cf120d4e59a6091b9a0264b1c4', 'request_id': 'req-936bb36d-a888-4908-a281-54b64b56957a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:27.271610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] The token cache is being invalidate because project 6ae513cf120d4e59a6091b9a0264b1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:27.272290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:27.273193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-936bb36d-a888-4908-a281-54b64b56957a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:27.275718 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3071/6090] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:27 2022] DELETE /identity/v3/projects/6ae513cf120d4e59a6091b9a0264b1c4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:27.280222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.280875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.281382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.309547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:27.310803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:27.384859 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3020/6091] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:41:27.392980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.393381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.393791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.420096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:27.421332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:27.430485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3072/6092] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:27.434624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.446027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2428c-d871-4e1b-924c-01c7668577b8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.451698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.452473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.452760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.453035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.453849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:41:27.455045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.457883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:27.486092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3021/6093] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:41:27.486656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.506127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df41a0b-86a0-4031-b065-83654bcd8f1f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.512422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.513320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.513709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.514088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.514999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.517090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:27.577310 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3073/6094] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:41:27.582216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.603175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a21d0-746f-41da-abf7-aa9c051d4aea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.677306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.677839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.678124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.678435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.679086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.681369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:27.712433 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3022/6095] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:41:27 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:41:27.714480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.726318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b66c39-6016-47da-ae53-c508e9cce05a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.731951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.735473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.735998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.736478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.737900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.740620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:27.742469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:27.757719 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3074/6096] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:41:27.759706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.776216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dfa55-4044-44e5-b441-1478fefdbd92 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.795411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa51b0-409b-4d51-bb22-766fdb114bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.796431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa51b0-409b-4d51-bb22-766fdb114bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.796431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa51b0-409b-4d51-bb22-766fdb114bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.796615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa51b0-409b-4d51-bb22-766fdb114bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.797282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa51b0-409b-4d51-bb22-766fdb114bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.799142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa51b0-409b-4d51-bb22-766fdb114bcc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:27.826400 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3023/6097] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:41:27.828055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:27.848783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e499-2e29-40b1-a064-56e64678d4f9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:27.891938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:27.905929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:27.906444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:27.906844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] PATH_INFO: `/v3/projects/cb6313a61b3f45fea2f48aee866b7ba4/users/e44979e46f754f7e9f847e285e4f43bb/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:27.975801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6313a61b3f45fea2f48aee866b7ba4, user_id=e44979e46f754f7e9f847e285e4f43bb, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:27.978908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:28.015907 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3075/6098] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:41:27 2022] PUT /identity/v3/projects/cb6313a61b3f45fea2f48aee866b7ba4/users/e44979e46f754f7e9f847e285e4f43bb/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:28.022232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace008-6702-4abc-aba8-b485a07262ec None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:28.022853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace008-6702-4abc-aba8-b485a07262ec None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:28.023366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace008-6702-4abc-aba8-b485a07262ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:28.046761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-adace008-6702-4abc-aba8-b485a07262ec None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:28.048149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-adace008-6702-4abc-aba8-b485a07262ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:28.124140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:28.139760 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3024/6099] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:28.185771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:28.189907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:28.314169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5d2c6-0875-4223-bcc3-f5e9eae9688a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:28.320664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff8f9-4e8f-40bb-9d6a-c29cecbf37d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:28.321582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff8f9-4e8f-40bb-9d6a-c29cecbf37d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:28.321978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff8f9-4e8f-40bb-9d6a-c29cecbf37d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:28.322368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff8f9-4e8f-40bb-9d6a-c29cecbf37d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:28.334900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff8f9-4e8f-40bb-9d6a-c29cecbf37d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:28.339558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff8f9-4e8f-40bb-9d6a-c29cecbf37d9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:28.345902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace008-6702-4abc-aba8-b485a07262ec None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:28.349082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-adace008-6702-4abc-aba8-b485a07262ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:28.354194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3076/6100] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:28.368161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace008-6702-4abc-aba8-b485a07262ec None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:28.373096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:28.373747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:28.374048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:28.374388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] PATH_INFO: `/v3/users/3adfd471f2a74bb4942335a0f31caeec` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:28.375727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adfd471f2a74bb4942335a0f31caeec)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:28.378438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:28.439249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adfd471f2a74bb4942335a0f31caeec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:28.449379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adfd471f2a74bb4942335a0f31caeec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:28.450425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adfd471f2a74bb4942335a0f31caeec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:28.451295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adfd471f2a74bb4942335a0f31caeec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:28.461319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adfd471f2a74bb4942335a0f31caeec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:28.489938 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3025/6101] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:28 2022] DELETE /identity/v3/users/3adfd471f2a74bb4942335a0f31caeec => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:28.491790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:28.492081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:28.492383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:28.527089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:28.529795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:28.610059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3077/6102] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:28.620758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:28.622237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:28.690206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edfb79-6297-43b2-83e6-4179b99b11ec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:28.694666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312638ed-dd9f-4e24-94ae-ab59a7f55c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:28.695293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312638ed-dd9f-4e24-94ae-ab59a7f55c72 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:28.695577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312638ed-dd9f-4e24-94ae-ab59a7f55c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:28.695855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312638ed-dd9f-4e24-94ae-ab59a7f55c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:28.705555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312638ed-dd9f-4e24-94ae-ab59a7f55c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:28.707557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312638ed-dd9f-4e24-94ae-ab59a7f55c72 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:28.718917 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3026/6103] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:28.927234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:28.928938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:28.944176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e784cf-6732-496d-b779-7d2f1ba8c3a8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:28.949761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:28.950828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:28.951508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:28.951960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] PATH_INFO: `/v3/projects/d0b0a1f58973421f9e9f0b60c3685712` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:28.953510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b0a1f58973421f9e9f0b60c3685712)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:28.955640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.028178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b0a1f58973421f9e9f0b60c3685712', 'request_id': 'req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:29.041334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b0a1f58973421f9e9f0b60c3685712', 'request_id': 'req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:29.050478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b0a1f58973421f9e9f0b60c3685712', 'request_id': 'req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:29.062633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:29.071237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] The token cache is being invalidate because project d0b0a1f58973421f9e9f0b60c3685712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:29.071237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:29.071729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-95aa631c-a7af-47e2-8bc2-9bd50e460eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:29.079073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.079190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.079406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.083252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3078/6104] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:28 2022] DELETE /identity/v3/projects/d0b0a1f58973421f9e9f0b60c3685712 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:29.113942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:29.115285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:29.262731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3027/6105] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:29.272495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.273034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.278231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.318597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:29.319970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:29.342007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3079/6106] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:29.346026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:29.357773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c199ae-b557-4734-8c1b-fa1143daca5f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:29.363397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:29.364501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.364995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.365429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.366295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:41:29.366761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:29.368559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.379255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:29.388096 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3028/6107] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:41:29.392100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:29.415194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db57a-dfff-47ed-9aee-14451f91fd3b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:29.421043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:29.421836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.422644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.423441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.424261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:29.427397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.468453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3080/6108] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:41:29 2022] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:41:29.472938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:29.490980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b720fc8-94cd-4c5a-9eea-1cf496a94ced admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:29.576322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:29.577106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.577461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.577807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.578586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:29.580671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.616319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3029/6109] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:41:29 2022] POST /identity/v3/users => generated 281 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:41:29.617561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:29.635900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02461e5-f6ae-4f9e-a17f-e36e37098473 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:29.641752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:29.642648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.643980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.644417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.645241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:29.647058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.664194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3081/6110] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:41:29.667867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:29.681230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c8f92-0e2e-4450-b525-8b76e4f7e480 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:29.687705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0e339-7ea7-4475-8dc3-6aa21b8c92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:29.689413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0e339-7ea7-4475-8dc3-6aa21b8c92eb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.690003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0e339-7ea7-4475-8dc3-6aa21b8c92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.691186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0e339-7ea7-4475-8dc3-6aa21b8c92eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.692421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0e339-7ea7-4475-8dc3-6aa21b8c92eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:29.696216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0e339-7ea7-4475-8dc3-6aa21b8c92eb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.730428 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3030/6111] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:41:29.731285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:29.743115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946e4dc-52f6-4d23-ab30-2ca8ccc9f951 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:29.749478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:29.750060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.750390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.751014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] PATH_INFO: `/v3/projects/7f9daf8743dc4e37876fc9348b3aa29e/users/9dbf9f8407d14d14b9779223ca4937cd/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.785687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9daf8743dc4e37876fc9348b3aa29e, user_id=9dbf9f8407d14d14b9779223ca4937cd, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:29.788595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:29.828702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:29.829388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:29.829909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:29.834281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3082/6112] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:41:29 2022] PUT /identity/v3/projects/7f9daf8743dc4e37876fc9348b3aa29e/users/9dbf9f8407d14d14b9779223ca4937cd/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:29.888575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] MFA Rules not processed for user `9dbf9f8407d14d14b9779223ca4937cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:29.890313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:30.055344 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3031/6113] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:30.071002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:30.072814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:30.164819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f56c2-89bf-49f2-b9fc-146da73ee4e9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:30.169326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ab82a-6b3a-41e8-945b-2dbbde9bb4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:30.181903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab82a-6b3a-41e8-945b-2dbbde9bb4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:30.183767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab82a-6b3a-41e8-945b-2dbbde9bb4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:30.184454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ab82a-6b3a-41e8-945b-2dbbde9bb4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:30.207453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ab82a-6b3a-41e8-945b-2dbbde9bb4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:30.211955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ab82a-6b3a-41e8-945b-2dbbde9bb4f4 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:30.225447 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3083/6114] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:32.844805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:32.847536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:32.979983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e47c03-3001-4954-a98b-466382fddbb9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:32.991843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:32.992665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:32.993062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:32.993459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:32.999217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:33.050382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:33.182631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:33.184863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f917-d1d7-4df0-b59e-26eb6b05f3ac service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:33.244756 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3032/6115] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:36.630983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:36.631850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:36.632288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:36.670404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] MFA Rules not processed for user `e44979e46f754f7e9f847e285e4f43bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:36.672586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:36.767692 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3084/6116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:36.780299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:36.780821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:36.780821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:36.822852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] MFA Rules not processed for user `e44979e46f754f7e9f847e285e4f43bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:36.824183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:36.833570 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3033/6117] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:36.846087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:36.849358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:36.870635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80fad0-9b87-48cd-b078-7360be4c989a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:36.880504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:36.881134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:36.881416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:36.881684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:36.891939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:36.895364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:36.918883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3085/6118] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:38.326203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:38.349002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b37a6-1118-4524-b1ed-aaa34d236f66 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:38.360164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:38.365860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:38.367254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:38.367684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:38.373394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:38.411121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:38.414870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f038-f185-4f98-8018-a0e5bbe45e9b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:38.460736 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3034/6119] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:46.900915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:48.436967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=32 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:48.647818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:48.718857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242c150-e6f2-4007-b7b5-c43d2b362a6e service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:48.724268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:48.725251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:48.725792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:48.726247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] PATH_INFO: `/v3/users/9dbf9f8407d14d14b9779223ca4937cd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:48.727901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbf9f8407d14d14b9779223ca4937cd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:48.730140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:48.798057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbf9f8407d14d14b9779223ca4937cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:48.812057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbf9f8407d14d14b9779223ca4937cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:48.812931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbf9f8407d14d14b9779223ca4937cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:48.813675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbf9f8407d14d14b9779223ca4937cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:48.822031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbf9f8407d14d14b9779223ca4937cd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:48.851290 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3086/6120] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:48 2022] DELETE /identity/v3/users/9dbf9f8407d14d14b9779223ca4937cd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:48.855838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:48.856131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:48.856408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:48.877277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:48.879636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:48.949907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3035/6121] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:48.957615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:48.959059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:49.044771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687789c-f79f-4f72-87f9-1e806487d139 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:49.048931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:49.050134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:49.050444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:49.051236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:49.061986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:49.063638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:49.077760 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3087/6122] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:41:49.143625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:49.148706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:49.333009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998a31a-61de-4856-ae47-9dc2bbfb6062 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:49.342046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:49.342878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:49.343271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:49.343645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:49.348409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:49.447277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:49.449723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a1634-ed77-4a46-acdc-114eb919efcf service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:49.469026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3036/6123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:49.760354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:49.762677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:49.794023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12657508-ee37-4e65-a790-b188817b3f7d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:49.806140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:49.807524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:49.807970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:49.809039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] PATH_INFO: `/v3/projects/7f9daf8743dc4e37876fc9348b3aa29e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:49.810711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9daf8743dc4e37876fc9348b3aa29e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:49.813670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:49.881619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:49.968958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9daf8743dc4e37876fc9348b3aa29e', 'request_id': 'req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:49.988893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9daf8743dc4e37876fc9348b3aa29e', 'request_id': 'req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:50.006676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9daf8743dc4e37876fc9348b3aa29e', 'request_id': 'req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:50.035546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] The token cache is being invalidate because project 7f9daf8743dc4e37876fc9348b3aa29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:50.036271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:50.038136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ddd96a7-aaa4-4f12-a23b-acfe7cf1e036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:50.042804 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3088/6124] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:49 2022] DELETE /identity/v3/projects/7f9daf8743dc4e37876fc9348b3aa29e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:50.047907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.049417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.049971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.144150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:50.148463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:50.215591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:50.254964 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3037/6125] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:50.261692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.262010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.262322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.294792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:50.296050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:50.306616 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3089/6126] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:50.310878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:50.321899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996904-a6ac-42e3-9d7b-e146a9ef6598 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:50.327875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:50.328628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.328914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.329192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.330289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:41:50.331117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:50.333112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:50.351820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:50.363051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92181f7-9a7d-41b2-9ec8-fc5246be3306 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:50.364207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3038/6127] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:41:50.369072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:50.369699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.369982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.370294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.371327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:50.373288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:50.431897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:50.442069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3090/6128] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:41:50 2022] POST /identity/v3/projects => generated 359 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:41:50.446996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2335-c266-4075-a9a7-77de40086ef7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:50.623369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:50.624229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.624754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.625638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.626641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:50.629771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:50.677035 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3039/6129] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:41:50 2022] POST /identity/v3/users => generated 280 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:41:50.681003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:50.701223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f91e88-2609-4c53-aaa3-65cf23249b54 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:50.714082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:50.714678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.714960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.715241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.715900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:50.717522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:50.767344 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3091/6130] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:41:50.769761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:50.788174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a495d-b2cd-44dc-9021-885aafba38d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:50.803393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883efb96-46d5-4eb0-8077-0382a23c46ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:50.804197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883efb96-46d5-4eb0-8077-0382a23c46ab admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.804592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883efb96-46d5-4eb0-8077-0382a23c46ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.804975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883efb96-46d5-4eb0-8077-0382a23c46ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.805768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883efb96-46d5-4eb0-8077-0382a23c46ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:50.809028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883efb96-46d5-4eb0-8077-0382a23c46ab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:50.842705 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3040/6131] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:41:50.847987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:50.864110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080369ff-8b58-4152-b013-7ce734dbddeb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:50.878783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:50.879645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.879932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.880217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] PATH_INFO: `/v3/projects/b28ec7c831ac4a08b982ecf101071795/users/3299f82ac72b4747ae68d1a48faf0538/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:50.917827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ec7c831ac4a08b982ecf101071795, user_id=3299f82ac72b4747ae68d1a48faf0538, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:50.921141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:50.963122 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3092/6132] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:41:50 2022] PUT /identity/v3/projects/b28ec7c831ac4a08b982ecf101071795/users/3299f82ac72b4747ae68d1a48faf0538/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:50.974795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:50.975386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:50.975643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:51.070082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] MFA Rules not processed for user `3299f82ac72b4747ae68d1a48faf0538`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:51.083953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:51.342906 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3041/6133] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:51.374132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:51.391025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:51.578715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59dcdb-54f4-42f8-92cc-8000747bdfe1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:51.587866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d7eb6-a12f-4a4c-8ac8-78e292cd44e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:51.593171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7eb6-a12f-4a4c-8ac8-78e292cd44e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:51.609186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7eb6-a12f-4a4c-8ac8-78e292cd44e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:51.609552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7eb6-a12f-4a4c-8ac8-78e292cd44e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:51.642549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d7eb6-a12f-4a4c-8ac8-78e292cd44e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:51.647612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d7eb6-a12f-4a4c-8ac8-78e292cd44e3 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:51.684723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3093/6134] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:56.568631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:56.575293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:56.678079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:56.745106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ab95d-9c86-4714-8fe3-b61dc1c6520d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:56.763613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:56.764302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:56.764585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:56.764861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] PATH_INFO: `/v3/users/ad150e03881b4cfdac07c430c2b549aa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:56.766169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad150e03881b4cfdac07c430c2b549aa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:56.768194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:56.873805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad150e03881b4cfdac07c430c2b549aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:56.885268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad150e03881b4cfdac07c430c2b549aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:56.886784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad150e03881b4cfdac07c430c2b549aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:56.887545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad150e03881b4cfdac07c430c2b549aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:56.897623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad150e03881b4cfdac07c430c2b549aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:56.946059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3042/6135] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:56 2022] DELETE /identity/v3/users/ad150e03881b4cfdac07c430c2b549aa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:56.950220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43819f97-279f-4278-80d3-68248579bf03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:56.950718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43819f97-279f-4278-80d3-68248579bf03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:56.950836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43819f97-279f-4278-80d3-68248579bf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:57.022313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-43819f97-279f-4278-80d3-68248579bf03 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:57.027702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-43819f97-279f-4278-80d3-68248579bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:57.092503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:57.137812 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3094/6136] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:57.157445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:57.159031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:57.281302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ea39c-eec0-413b-aa34-81e2deddd189 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:57.308047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:57.308863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:57.309379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:57.309778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:57.348999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:57.350837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:57.381244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3043/6137] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:57.954014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43819f97-279f-4278-80d3-68248579bf03 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:57.956622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-43819f97-279f-4278-80d3-68248579bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:57.992933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43819f97-279f-4278-80d3-68248579bf03 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:58.001368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:58.009912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:58.012598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:58.013482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:58.015965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:58.016505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] PATH_INFO: `/v3/projects/c07062312478419891bd47c9bb90a4c2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:58.022371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07062312478419891bd47c9bb90a4c2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:58.028551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:58.051968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534ef27-9c6c-49f1-8171-c3253ca07849 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:58.068602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:58.071136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:58.071136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:58.071368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] PATH_INFO: `/v3/users/2ca9764211034ce293f11f39be6e4dc2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:58.075196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca9764211034ce293f11f39be6e4dc2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:58.080178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:58.195505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07062312478419891bd47c9bb90a4c2', 'request_id': 'req-3a998d6a-ac3b-4539-a510-431d24f6ae7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.202866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca9764211034ce293f11f39be6e4dc2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.206334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07062312478419891bd47c9bb90a4c2', 'request_id': 'req-3a998d6a-ac3b-4539-a510-431d24f6ae7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.206750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:58.220776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca9764211034ce293f11f39be6e4dc2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.222334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca9764211034ce293f11f39be6e4dc2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.223449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca9764211034ce293f11f39be6e4dc2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.225903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07062312478419891bd47c9bb90a4c2', 'request_id': 'req-3a998d6a-ac3b-4539-a510-431d24f6ae7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.254888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db1d1c1f-839d-457d-8693-08ce55b4678f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca9764211034ce293f11f39be6e4dc2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.267264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] The token cache is being invalidate because project c07062312478419891bd47c9bb90a4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:58.269739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.271541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.274873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3095/6138] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:57 2022] DELETE /identity/v3/projects/c07062312478419891bd47c9bb90a4c2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:58.279173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:58.291155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:58.298746 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3044/6139] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:58 2022] DELETE /identity/v3/users/2ca9764211034ce293f11f39be6e4dc2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:41:58.303699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:58.303982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:58.304261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:58.351225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:58.352526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:58.480625 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3045/6140] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:41:58.482879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998d6a-ac3b-4539-a510-431d24f6ae7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:58.491402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:58.494421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:58.499784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:58.499784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:58.500112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:58.500399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] PATH_INFO: `/v3/users/9039f31d41d944ffbcfdbf5f7f8c20fa` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:58.514608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9039f31d41d944ffbcfdbf5f7f8c20fa)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:58.519614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:58.636307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed5c9-2785-496a-a6c0-1b536c14e81e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:58.647665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:58.648777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:58.649278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:58.653122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:58.656343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9039f31d41d944ffbcfdbf5f7f8c20fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.671743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:58.673613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:58.683096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9039f31d41d944ffbcfdbf5f7f8c20fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.684155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9039f31d41d944ffbcfdbf5f7f8c20fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.684784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9039f31d41d944ffbcfdbf5f7f8c20fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.691360 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3046/6141] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:41:58.699831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:58.709558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9039f31d41d944ffbcfdbf5f7f8c20fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:58.748825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3096/6142] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:58 2022] DELETE /identity/v3/users/9039f31d41d944ffbcfdbf5f7f8c20fa => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:59.349638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:59.367875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c540434-89f3-4d40-b70d-50a13fe312fc service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:59.505040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:59.506342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:59.506788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:59.507246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] PATH_INFO: `/v3/projects/3548f9626ff3470bbd20ff8c0dee5ed8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:59.508849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3548f9626ff3470bbd20ff8c0dee5ed8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:59.521828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:59.536515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:41:59.604960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:59.608456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:59.619771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3548f9626ff3470bbd20ff8c0dee5ed8', 'request_id': 'req-31d1d095-68df-4253-a234-7fedc1ea78e2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.627785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99a58-903c-420e-96f9-41e5cad6b692 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:41:59.631555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3548f9626ff3470bbd20ff8c0dee5ed8', 'request_id': 'req-31d1d095-68df-4253-a234-7fedc1ea78e2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.693548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3548f9626ff3470bbd20ff8c0dee5ed8', 'request_id': 'req-31d1d095-68df-4253-a234-7fedc1ea78e2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.734781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] The token cache is being invalidate because project 3548f9626ff3470bbd20ff8c0dee5ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:59.738395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.739634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31d1d095-68df-4253-a234-7fedc1ea78e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.747245 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3047/6143] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:59 2022] DELETE /identity/v3/projects/3548f9626ff3470bbd20ff8c0dee5ed8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:59.751152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430312a1-d82c-41d4-92f3-e023d6f65519 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:59.751552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430312a1-d82c-41d4-92f3-e023d6f65519 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:59.751932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430312a1-d82c-41d4-92f3-e023d6f65519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:59.776926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:41:59.777585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:59.777866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:59.778156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] PATH_INFO: `/v3/projects/afa3ffed09f641d19d6bdf41a18e3390` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:59.779434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa3ffed09f641d19d6bdf41a18e3390)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:41:59.781858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:41:59.803410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-430312a1-d82c-41d4-92f3-e023d6f65519 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:59.804801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-430312a1-d82c-41d4-92f3-e023d6f65519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:59.832265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3048/6144] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:41:59.836566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:41:59.837374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:41:59.838520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:41:59.854653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa3ffed09f641d19d6bdf41a18e3390', 'request_id': 'req-6e10303c-3e3f-4737-838d-8ec35b10c1e1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.865123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa3ffed09f641d19d6bdf41a18e3390', 'request_id': 'req-6e10303c-3e3f-4737-838d-8ec35b10c1e1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.868845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:41:59.870512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:41:59.875707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa3ffed09f641d19d6bdf41a18e3390', 'request_id': 'req-6e10303c-3e3f-4737-838d-8ec35b10c1e1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.905293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] The token cache is being invalidate because project afa3ffed09f641d19d6bdf41a18e3390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:41:59.907105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.909283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:41:59.919673 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3097/6145] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:41:59 2022] DELETE /identity/v3/projects/afa3ffed09f641d19d6bdf41a18e3390 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:41:59.924702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:41:59.926650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:00.003336 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3049/6146] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:00.004884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.024729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae309-9f61-4b15-a1f0-8d496e0ace63 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.051272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.053238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.053534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.053817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.054690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:00.055143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.056791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.057129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10303c-3e3f-4737-838d-8ec35b10c1e1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.062308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.063104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.063390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.063666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] PATH_INFO: `/v3/users/9ad23b6462bf4383b3550cc8f51eb590` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.064953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad23b6462bf4383b3550cc8f51eb590)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.067041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.084085 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3050/6147] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:00.085211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.103978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3178bc-a945-43da-8372-4ca608897393 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.107074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:00.113962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.115116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.115495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.115782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.116507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.119544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.157463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad23b6462bf4383b3550cc8f51eb590'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.177673 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3051/6148] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:00 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:00.178937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.192166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad23b6462bf4383b3550cc8f51eb590'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.193153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad23b6462bf4383b3550cc8f51eb590'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.194756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad23b6462bf4383b3550cc8f51eb590'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.211888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad23b6462bf4383b3550cc8f51eb590'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.241066 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3098/6149] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:41:59 2022] DELETE /identity/v3/users/9ad23b6462bf4383b3550cc8f51eb590 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:00.312461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb17e-1f9b-4481-94ac-af516b80d09a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.317479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:00.406557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.407323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.407750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.408100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.409787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.411977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.446555 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3052/6150] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:00 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:00.447235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.448705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:00.468092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0ea2e-4913-4437-ac49-789844c64223 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.475342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.476160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.476545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.478503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.479261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.481607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.500750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.512387 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3099/6151] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:00.515061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d871f1-d3f8-494f-ae92-7a003a8ef8a9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.522333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.522974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.523260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.523540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.524211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.525818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.584643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3053/6152] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:00.588864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.606314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92576-ade2-4228-8b24-482ba10dabad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.633072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c59626-21c5-4fd2-b7b4-9574ecf7bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.633775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59626-21c5-4fd2-b7b4-9574ecf7bfbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.634061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59626-21c5-4fd2-b7b4-9574ecf7bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.634370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59626-21c5-4fd2-b7b4-9574ecf7bfbe admin admin] PATH_INFO: `/v3/projects/db533d399100415e9dfa44c8502a3805/users/c3ad858e8bdc4462b20705b2fdb70d05/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.716558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:00.718532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:00.721177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c59626-21c5-4fd2-b7b4-9574ecf7bfbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=db533d399100415e9dfa44c8502a3805, user_id=c3ad858e8bdc4462b20705b2fdb70d05, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.737457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c59626-21c5-4fd2-b7b4-9574ecf7bfbe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.747112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96e03-59e3-4c81-bcac-e6480a5ac314 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:00.780068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:00.781028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.783632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.785099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] PATH_INFO: `/v3/projects/485e655ad3424d1b842b2e5a8f2b674d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.789544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485e655ad3424d1b842b2e5a8f2b674d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:00.797848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:00.811896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3100/6153] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:00 2022] PUT /identity/v3/projects/db533d399100415e9dfa44c8502a3805/users/c3ad858e8bdc4462b20705b2fdb70d05/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:00.813685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:00.814052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:00.814359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:00.913319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] MFA Rules not processed for user `c3ad858e8bdc4462b20705b2fdb70d05`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:00.914595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:00.931902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485e655ad3424d1b842b2e5a8f2b674d', 'request_id': 'req-5e37100b-b8be-41b9-8071-cddf4d651f84'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.948365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485e655ad3424d1b842b2e5a8f2b674d', 'request_id': 'req-5e37100b-b8be-41b9-8071-cddf4d651f84'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:00.991584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485e655ad3424d1b842b2e5a8f2b674d', 'request_id': 'req-5e37100b-b8be-41b9-8071-cddf4d651f84'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:01.027283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] The token cache is being invalidate because project 485e655ad3424d1b842b2e5a8f2b674d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:01.028934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:01.030027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e37100b-b8be-41b9-8071-cddf4d651f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:01.036195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3054/6154] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:00 2022] DELETE /identity/v3/projects/485e655ad3424d1b842b2e5a8f2b674d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:01.040929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a55f6c-d76f-48d5-bfa0-5ff78c400379 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.041374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a55f6c-d76f-48d5-bfa0-5ff78c400379 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.041669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a55f6c-d76f-48d5-bfa0-5ff78c400379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.074347 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3101/6155] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:01.076770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.079681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:01.087182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-59a55f6c-d76f-48d5-bfa0-5ff78c400379 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:01.088433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59a55f6c-d76f-48d5-bfa0-5ff78c400379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:01.171922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:01.184536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f80b-383c-42f3-ba85-a25fcdc64af0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.192656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.193419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.193706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.193987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.194731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.197369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.218654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3055/6156] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:01.227901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.228255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.228473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.232545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3102/6157] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:01.237762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.294840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:01.296081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:01.302435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:01.326297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed9fc3-af2f-4af9-bbaf-ee77ff149c99 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.335381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.336175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.336397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.336738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.337444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.339670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.373962 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3103/6158] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:01.378418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.390492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5bf8-3caf-40fa-8f2e-f14370b8b598 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.398184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.399055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.399431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.399719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.400785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.402701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.410041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3056/6159] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:01.414217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.417190 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3104/6160] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:01.420992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.425028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f01c6-84f1-40f7-9004-868f9fb302f7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.432588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90bd3-d8c0-48a7-9fa1-99a5cce07aa4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.433632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.434524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.436010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.436457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.437557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:01.438027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.440461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.440873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.441774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.442332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.442784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] PATH_INFO: `/v3/projects/30d30d3588d74d62833dbe4e59278efd/users/a5d6b4b1df8748a5822d78d222b82bef/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.458613 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3057/6161] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:01.473056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.474769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d30d3588d74d62833dbe4e59278efd, user_id=a5d6b4b1df8748a5822d78d222b82bef, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.477832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.492968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830008f-3895-49e7-b487-40c84b2af3f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.507488 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3105/6162] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:01 2022] PUT /identity/v3/projects/30d30d3588d74d62833dbe4e59278efd/users/a5d6b4b1df8748a5822d78d222b82bef/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:01.511541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.624811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092a01f-fafd-4125-af6b-4a2066dc70fb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.630977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.631652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.631941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.632221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.632873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.633096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.634016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.634557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.635053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.636016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.636909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.638262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.654285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3106/6163] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:01.655772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.669089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73443ee-2775-41c2-93f8-99ab749985ef admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.675027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fee5c-1a33-4151-9630-5a576ae041a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.675711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fee5c-1a33-4151-9630-5a576ae041a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.676155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fee5c-1a33-4151-9630-5a576ae041a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.676442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fee5c-1a33-4151-9630-5a576ae041a2 admin admin] PATH_INFO: `/v3/projects/30d30d3588d74d62833dbe4e59278efd/users/a5d6b4b1df8748a5822d78d222b82bef/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.680686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fee5c-1a33-4151-9630-5a576ae041a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d30d3588d74d62833dbe4e59278efd, user_id=a5d6b4b1df8748a5822d78d222b82bef, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.683425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fee5c-1a33-4151-9630-5a576ae041a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.690939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3058/6164] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:01.694645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.707449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3107/6165] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:01 2022] PUT /identity/v3/projects/30d30d3588d74d62833dbe4e59278efd/users/a5d6b4b1df8748a5822d78d222b82bef/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:01.709066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.709355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.709853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.770498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:01.785050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] MFA Rules not processed for user `a5d6b4b1df8748a5822d78d222b82bef`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:01.785293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92401f4c-9b50-4034-aa6e-94d1b17771f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.786403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:01.790668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.791364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.791718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.792052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.792823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.795319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.828078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3059/6166] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:42:01.829628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.854962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644d253-3558-44a7-97cd-43e819f1da44 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.865524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.867500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.867784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.869310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.870020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.874234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:01.890496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:01.921820 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3060/6167] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:01.923367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.929493 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3108/6168] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:01.941513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:01.943137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:01.951379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fdd32-6864-44c5-b801-f741e070a90a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:01.961867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:01.962834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:01.963124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:01.963405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:01.966405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:01.979797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:02.001998 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3061/6169] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:02.006847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:02.018737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b887-b7f1-43e5-b573-44bf122c8968 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:02.024664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ec17f-b57a-41fc-8390-32c5eb12b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:02.025684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec17f-b57a-41fc-8390-32c5eb12b3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:02.026177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec17f-b57a-41fc-8390-32c5eb12b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:02.026653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec17f-b57a-41fc-8390-32c5eb12b3d3 admin admin] PATH_INFO: `/v3/projects/36d037eb77b3412e87d066a9a17fe7ea/users/df56ab8b8c024e129db108d84bf2b983/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:02.053335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ec17f-b57a-41fc-8390-32c5eb12b3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d037eb77b3412e87d066a9a17fe7ea, user_id=df56ab8b8c024e129db108d84bf2b983, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:02.056758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb102dd-bd4e-4f00-a918-eb8b92a41903 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:02.061338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:02.062352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:02.062977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:02.063486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:02.067178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ec17f-b57a-41fc-8390-32c5eb12b3d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:02.077107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:02.080119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:02.098176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3062/6170] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:02 2022] PUT /identity/v3/projects/36d037eb77b3412e87d066a9a17fe7ea/users/df56ab8b8c024e129db108d84bf2b983/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:02.102316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:02.102659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:02.103149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:02.118983 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3109/6171] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:02.136735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] MFA Rules not processed for user `df56ab8b8c024e129db108d84bf2b983`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:02.137924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:02.285835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3063/6172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:02.301635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:02.302715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:02.450387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0c28-cbb1-49d9-9468-e08a126b85c3 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:02.577307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d956-894d-4741-9484-485389bfa425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:02.578323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d956-894d-4741-9484-485389bfa425 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:02.578763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d956-894d-4741-9484-485389bfa425 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:02.579213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d956-894d-4741-9484-485389bfa425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:02.591429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d956-894d-4741-9484-485389bfa425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:02.593168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d956-894d-4741-9484-485389bfa425 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:02.603797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:02.606229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3110/6173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:06.440991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:06.571630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893f3b0-0183-490b-9c53-769412aa8bd9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:06.577152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:06.578267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:06.578775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:06.579273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] PATH_INFO: `/v3/users/c3ad858e8bdc4462b20705b2fdb70d05` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:06.581554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ad858e8bdc4462b20705b2fdb70d05)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:06.583914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:06.692331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ad858e8bdc4462b20705b2fdb70d05'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:06.706997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ad858e8bdc4462b20705b2fdb70d05'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:06.707842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ad858e8bdc4462b20705b2fdb70d05'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:06.710891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ad858e8bdc4462b20705b2fdb70d05'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:06.714708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:06.724161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ad858e8bdc4462b20705b2fdb70d05'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:06.759839 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3064/6174] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:06 2022] DELETE /identity/v3/users/c3ad858e8bdc4462b20705b2fdb70d05 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:06.761608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:06.762044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:06.762733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:06.785730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:06.787115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:06.917754 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3111/6175] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:06.928586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:06.930076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:07.052047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633a9e-7c28-4bb6-b599-b0f7c2d078c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:07.066925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:07.067608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:07.067895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:07.068174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:07.086812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:07.088275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:07.117392 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3065/6176] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:07.832667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:07.833581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:07.862238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae12e2-81fc-4882-a8f2-5c08b19dffe0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:07.870559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:07.871242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:07.871522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:07.871955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] PATH_INFO: `/v3/projects/db533d399100415e9dfa44c8502a3805` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:07.889056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db533d399100415e9dfa44c8502a3805)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:07.936001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:08.114104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db533d399100415e9dfa44c8502a3805', 'request_id': 'req-459ed493-8b9d-4417-8bf8-dc963b2a2111'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.123190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db533d399100415e9dfa44c8502a3805', 'request_id': 'req-459ed493-8b9d-4417-8bf8-dc963b2a2111'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.133070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db533d399100415e9dfa44c8502a3805', 'request_id': 'req-459ed493-8b9d-4417-8bf8-dc963b2a2111'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.198053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] The token cache is being invalidate because project db533d399100415e9dfa44c8502a3805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:08.198457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.199956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.203110 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3112/6177] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:07 2022] DELETE /identity/v3/projects/db533d399100415e9dfa44c8502a3805 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:08.208036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:08.223347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40bcfc-a1bb-454b-907b-c1e3b022aef4 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:08.296692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:08.299616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:08.432476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:08.433724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:08.434185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:08.434585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] PATH_INFO: `/v3/users/a5d6b4b1df8748a5822d78d222b82bef` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:08.437088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d6b4b1df8748a5822d78d222b82bef)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:08.439469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:08.516771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d6b4b1df8748a5822d78d222b82bef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.532375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d6b4b1df8748a5822d78d222b82bef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.533821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d6b4b1df8748a5822d78d222b82bef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.535126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d6b4b1df8748a5822d78d222b82bef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.545232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ed493-8b9d-4417-8bf8-dc963b2a2111 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:08.548548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60553842-2b8f-4c65-89ed-56f5022c6f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d6b4b1df8748a5822d78d222b82bef'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.560013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:08.562058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:08.563583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:08.564158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] PATH_INFO: `/v3/users/3299f82ac72b4747ae68d1a48faf0538` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:08.565884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:08.568322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3299f82ac72b4747ae68d1a48faf0538)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:08.570730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:08.578182 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3066/6178] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:08 2022] DELETE /identity/v3/users/a5d6b4b1df8748a5822d78d222b82bef => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:08.622185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:08.664360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3299f82ac72b4747ae68d1a48faf0538'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.677732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3299f82ac72b4747ae68d1a48faf0538'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.678491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3299f82ac72b4747ae68d1a48faf0538'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.679224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3299f82ac72b4747ae68d1a48faf0538'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.687570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3299f82ac72b4747ae68d1a48faf0538'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:08.707449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3113/6179] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:08 2022] DELETE /identity/v3/users/3299f82ac72b4747ae68d1a48faf0538 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:08.711728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:08.712020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:08.712318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:08.753978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:08.755311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:08.877716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:08.879921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:08.929557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3067/6180] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:08.937842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:08.939676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:09.023420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7961c-ee5d-452d-b26a-1c4dd0203a08 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.031929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.032793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.034551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.039126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] PATH_INFO: `/v3/projects/30d30d3588d74d62833dbe4e59278efd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.040632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d30d3588d74d62833dbe4e59278efd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.042784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.114212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cb4b7-84cc-4d40-8d38-de30e5bbf2b1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.122981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d30d3588d74d62833dbe4e59278efd', 'request_id': 'req-c08b99ff-d185-4b40-8530-7f861eced8fb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:09.132861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d30d3588d74d62833dbe4e59278efd', 'request_id': 'req-c08b99ff-d185-4b40-8530-7f861eced8fb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:09.141741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d30d3588d74d62833dbe4e59278efd', 'request_id': 'req-c08b99ff-d185-4b40-8530-7f861eced8fb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:09.166574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] The token cache is being invalidate because project 30d30d3588d74d62833dbe4e59278efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:09.166941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:09.168575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c08b99ff-d185-4b40-8530-7f861eced8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:09.174868 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3114/6181] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:08 2022] DELETE /identity/v3/projects/30d30d3588d74d62833dbe4e59278efd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:09.179231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee98a2-d2df-4dde-a552-7001895b78b9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.179231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee98a2-d2df-4dde-a552-7001895b78b9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.179231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee98a2-d2df-4dde-a552-7001895b78b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.234551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-deee98a2-d2df-4dde-a552-7001895b78b9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:09.236288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-deee98a2-d2df-4dde-a552-7001895b78b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:09.240585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.241221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.241953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.242950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.246574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:09.329546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:09.392443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3115/6182] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:09.395324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.395799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.396179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.433068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:09.434509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:09.435627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.437085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.446062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3116/6183] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:09.451358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:09.458944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3068/6184] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:09.475305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c58a-31e0-48d3-b9a7-e3a0d54f37fc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.477793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.478672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.479025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.479385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.480142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:09.480672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.482390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.504737 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3117/6185] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:09.510714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:09.516339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:09.523433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e8d9f-c43f-4558-9e72-c0ac027e7c33 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.531577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.532253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.532544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.532824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.534006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.536309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.576522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3069/6186] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:09 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:09.580416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:09.594203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfd5ad-a50a-4f8d-90e7-b711fec2202c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.773527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.778652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.783143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.783143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.783143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.788963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.800582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:09.802414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:09.837167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6d88b-9212-4197-900c-cc80292889c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.855249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3118/6187] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:09 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:09.857092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:09.859463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.860147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.860437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.860718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] PATH_INFO: `/v3/projects/b28ec7c831ac4a08b982ecf101071795` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.865234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28ec7c831ac4a08b982ecf101071795)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.885905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.903011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d44c-f063-40d8-b4ca-b92164f2e1a6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:09.929172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:09.929820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:09.930104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:09.930411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:09.931070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:09.932685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:09.975140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3119/6188] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:09.975140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:10.012206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f72a2f-5166-430a-8852-f09fc2327441 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:10.024725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:10.026581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.027038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.027352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.028005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:10.033216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:10.065862 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3120/6189] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:10.066861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:10.078452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28ec7c831ac4a08b982ecf101071795', 'request_id': 'req-c95a6eef-4957-4b35-8e24-d739a6baa7aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:10.088711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28ec7c831ac4a08b982ecf101071795', 'request_id': 'req-c95a6eef-4957-4b35-8e24-d739a6baa7aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:10.089940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5314f-3e6c-4867-804c-03f4540128e4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:10.108214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28ec7c831ac4a08b982ecf101071795', 'request_id': 'req-c95a6eef-4957-4b35-8e24-d739a6baa7aa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:10.156421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] The token cache is being invalidate because project b28ec7c831ac4a08b982ecf101071795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:10.156753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:10.159986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c95a6eef-4957-4b35-8e24-d739a6baa7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:10.163639 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3070/6190] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:09 2022] DELETE /identity/v3/projects/b28ec7c831ac4a08b982ecf101071795 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:10.171504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ae0c1-8058-45c4-8ea5-5fb28556a3a9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.172010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ae0c1-8058-45c4-8ea5-5fb28556a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.172602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ae0c1-8058-45c4-8ea5-5fb28556a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.204556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-185ae0c1-8058-45c4-8ea5-5fb28556a3a9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:10.206403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-185ae0c1-8058-45c4-8ea5-5fb28556a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:10.228518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6e93-cffe-4559-a4be-4e76a4b0a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:10.229630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6e93-cffe-4559-a4be-4e76a4b0a290 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.230129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6e93-cffe-4559-a4be-4e76a4b0a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.230669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6e93-cffe-4559-a4be-4e76a4b0a290 admin admin] PATH_INFO: `/v3/projects/1a16be105e7b4be4a01d2282eb804586/users/071198adbd0d4bcbab789203fb205e88/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.253025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6e93-cffe-4559-a4be-4e76a4b0a290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a16be105e7b4be4a01d2282eb804586, user_id=071198adbd0d4bcbab789203fb205e88, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:10.273467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6e93-cffe-4559-a4be-4e76a4b0a290 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:10.325218 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3121/6191] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:10 2022] PUT /identity/v3/projects/1a16be105e7b4be4a01d2282eb804586/users/071198adbd0d4bcbab789203fb205e88/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:10.431695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3071/6192] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:10.436237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.436526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.436798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.445164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.445484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.445735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.462238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:10.501289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:10.502828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:10.560398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] MFA Rules not processed for user `071198adbd0d4bcbab789203fb205e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:10.561651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:10.634678 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3122/6193] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:10.640587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:10.653699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983626a7-9317-4312-8cb9-b9d7630003e0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:10.655693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:10.661132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:10.661989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.662462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.663478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.664487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:10.664960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:10.667627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:10.679796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3072/6194] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:10.684480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:10.686307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:10.694761 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3123/6195] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:10.698865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:10.712804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96e43-a436-4d4e-8283-5ab1abe61e9c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:10.719230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:10.719894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.720277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.721642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.722025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:10.724636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:10.774429 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3124/6196] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:10 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:10.780064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327ef1-478b-40fe-9795-fd478530ea83 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:10.787870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:10.883363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc24b-de06-4946-b16e-44818e5b58d9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:10.900692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:10.901516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.902457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.904254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.905609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:10.920662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:10.927869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:10.928812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:10.929399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:10.929830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:10.988333 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3125/6197] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:10 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:10.993631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.012690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524067-d626-4bbd-83b2-2b41ab419ea2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:11.021392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:11.022428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.022942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.023457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.024892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.029087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.045368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.046848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.056005 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3126/6198] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:11.059892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.069391 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3073/6199] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:11.075367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b581a5-beff-4af1-8dcd-7cbc1ab1c9c2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:11.081101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565859f7-2a2b-41af-bc5a-1a6f6b993480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:11.081840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565859f7-2a2b-41af-bc5a-1a6f6b993480 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.082275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565859f7-2a2b-41af-bc5a-1a6f6b993480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.082787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565859f7-2a2b-41af-bc5a-1a6f6b993480 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.083769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565859f7-2a2b-41af-bc5a-1a6f6b993480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.085609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565859f7-2a2b-41af-bc5a-1a6f6b993480 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.098623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3127/6200] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:11.102427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.114428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82ffc5-e6f0-4144-8e0a-ffc58f0650e7 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:11.119676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:11.120603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.121099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.121609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] PATH_INFO: `/v3/projects/a48e8671cfec4a779e288733525b2003/users/ce585d26726249d290afeb6d0641f206/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.156762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48e8671cfec4a779e288733525b2003, user_id=ce585d26726249d290afeb6d0641f206, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.165164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.198904 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3074/6201] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:11 2022] PUT /identity/v3/projects/a48e8671cfec4a779e288733525b2003/users/ce585d26726249d290afeb6d0641f206/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:11.209653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.209972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.210298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.318397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] MFA Rules not processed for user `ce585d26726249d290afeb6d0641f206`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:11.321871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:11.405598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:11.492209 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3128/6202] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:11.496814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.574183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:11.609821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a423-0507-49bd-93c9-f18f6c53ec8d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:11.623062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:11.624138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.624776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.625268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.626285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.635339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.711315 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3075/6203] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:11 2022] POST /identity/v3/projects => generated 401 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:11.715148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.731912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c3aa-9adf-4157-a1b4-2c8a2e8e3652 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:11.858441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:11.862584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.862882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.863166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.863990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.865796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.897936 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3129/6204] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:11 2022] POST /identity/v3/users => generated 307 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:11.903099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.916540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16054-0d0f-447c-921e-f46dde4d7cc4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:11.922329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:11.923409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:11.925548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:11.926476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:11.927369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:11.929591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:11.969314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3076/6205] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:11.975211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:11.989010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5117-cd51-4195-b289-7f0650672ea3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:12.004871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:12.005921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:12.006421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:12.006973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] PATH_INFO: `/v3/projects/5659d6fa02c2496e9a85511d67b6b051/users/58b98c348b7f4f2981f73ecfe7bcf129/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:12.055823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5659d6fa02c2496e9a85511d67b6b051, user_id=58b98c348b7f4f2981f73ecfe7bcf129, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:12.061969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:12.108221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:12.109167 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3130/6206] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:11 2022] PUT /identity/v3/projects/5659d6fa02c2496e9a85511d67b6b051/users/58b98c348b7f4f2981f73ecfe7bcf129/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:12.124819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4e50b-3ae4-4610-8fb1-f02d2cafdfb2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:12.298263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1733-3de9-4b57-aa0e-b542bd2ea649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:12.300092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1733-3de9-4b57-aa0e-b542bd2ea649 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:12.300720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1733-3de9-4b57-aa0e-b542bd2ea649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:12.301238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1733-3de9-4b57-aa0e-b542bd2ea649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:12.302357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1733-3de9-4b57-aa0e-b542bd2ea649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:12.304258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1733-3de9-4b57-aa0e-b542bd2ea649 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:12.338351 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3077/6207] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:12.341721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:12.358482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958daf7-b073-4512-b5bb-fddd48a91795 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:12.379187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:12.379424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:12.379705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:12.382270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] PATH_INFO: `/v3/projects/5659d6fa02c2496e9a85511d67b6b051/users/58b98c348b7f4f2981f73ecfe7bcf129/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:12.386924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5659d6fa02c2496e9a85511d67b6b051, user_id=58b98c348b7f4f2981f73ecfe7bcf129, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:12.389754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:12.414803 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3131/6208] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:12 2022] PUT /identity/v3/projects/5659d6fa02c2496e9a85511d67b6b051/users/58b98c348b7f4f2981f73ecfe7bcf129/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:12.425990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccd0e9-5e10-46e7-8788-efa5c7a72bf4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:12.426205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccd0e9-5e10-46e7-8788-efa5c7a72bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:12.426542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccd0e9-5e10-46e7-8788-efa5c7a72bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:12.467006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aaccd0e9-5e10-46e7-8788-efa5c7a72bf4 None None] MFA Rules not processed for user `58b98c348b7f4f2981f73ecfe7bcf129`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:12.468251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aaccd0e9-5e10-46e7-8788-efa5c7a72bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:12.652032 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3078/6209] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:12.658774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:12.660992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:12.719141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:12.719429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:12.719709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:12.777826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:12.779101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:12.847987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151dec0-2a2b-4290-838e-5da393321b13 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:12.863658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:12.864362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:12.864750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:12.865033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:12.873932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:12.889055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:12.890425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:12.930241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3132/6210] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:12 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:12.969413 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3079/6211] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:42:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:13.046928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:13.063596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c4f2b-d871-41d1-9fa4-eca6c817c124 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:13.084172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:13.084821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:13.085109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:13.085388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:13.097133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:13.099187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:13.129725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:13.272285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:13.273734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:13.308308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297cfc0-a33b-4966-b376-6ce37c8ac337 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:13.317976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3133/6212] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:13.323338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:13.325967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:13.326374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:13.327259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:13.353436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:13.355431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:13.381863 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3080/6213] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:42:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:42:16.921182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:17.135912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106cdf-6d1b-487d-9852-1a84b592b153 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:17.158747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:17.163739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:17.164098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:17.164385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:17.176058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:17.512765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:17.518044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014be26-3371-42e9-b0d7-07638d868cd7 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:17.579038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3134/6214] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:20.927321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:20.930090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:20.973767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df280b-856e-4270-bede-d73a8c4b1727 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:20.990857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:20.993019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:20.994508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:20.994981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] PATH_INFO: `/v3/users/df56ab8b8c024e129db108d84bf2b983` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:20.997910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df56ab8b8c024e129db108d84bf2b983)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:21.003136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:21.108615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df56ab8b8c024e129db108d84bf2b983'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:21.129963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df56ab8b8c024e129db108d84bf2b983'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:21.130656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df56ab8b8c024e129db108d84bf2b983'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:21.131441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df56ab8b8c024e129db108d84bf2b983'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:21.147638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df56ab8b8c024e129db108d84bf2b983'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:21.179588 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3081/6215] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:20 2022] DELETE /identity/v3/users/df56ab8b8c024e129db108d84bf2b983 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:21.181451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:21.181936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:21.183300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:21.214036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:21.215390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:21.435680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3135/6216] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:21.500453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:21.503273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:21.671748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:21.727525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1119ea-73da-44e2-9238-4e0e64244268 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:21.737741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4d363-659d-44cf-8d57-bb3c1b2c2534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:21.738562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4d363-659d-44cf-8d57-bb3c1b2c2534 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:21.738848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4d363-659d-44cf-8d57-bb3c1b2c2534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:21.739210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4d363-659d-44cf-8d57-bb3c1b2c2534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:21.759398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4d363-659d-44cf-8d57-bb3c1b2c2534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:21.763055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4d363-659d-44cf-8d57-bb3c1b2c2534 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:21.817513 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3082/6217] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:23.300362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:23.302539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:23.343100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ae27-5513-4404-a650-5c3724944e41 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:23.366175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:23.367141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:23.367632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:23.368358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] PATH_INFO: `/v3/projects/36d037eb77b3412e87d066a9a17fe7ea` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:23.375130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d037eb77b3412e87d066a9a17fe7ea)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:23.390124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:23.456879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:23.631463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d037eb77b3412e87d066a9a17fe7ea', 'request_id': 'req-17026b97-1bac-44d9-96d1-c5f720645498'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:23.657135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d037eb77b3412e87d066a9a17fe7ea', 'request_id': 'req-17026b97-1bac-44d9-96d1-c5f720645498'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:23.678826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d037eb77b3412e87d066a9a17fe7ea', 'request_id': 'req-17026b97-1bac-44d9-96d1-c5f720645498'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:23.712996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] The token cache is being invalidate because project 36d037eb77b3412e87d066a9a17fe7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:23.714114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:23.715253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17026b97-1bac-44d9-96d1-c5f720645498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:23.724411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3136/6218] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:23 2022] DELETE /identity/v3/projects/36d037eb77b3412e87d066a9a17fe7ea => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:23.729765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:23.731196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:23.731776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:23.776934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:23.778501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:23.948079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3083/6219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:23.949483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:23.949773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:23.950373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:24.007520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:24.017842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:24.041233 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3137/6220] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:24.045460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:24.064731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1a69-b6b9-4e7b-86eb-5dfbfc0dd1fe None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:24.084117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:24.084767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:24.085057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:24.085341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:24.086016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:24.086353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:24.087980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:24.135645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3084/6221] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:24.137283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:24.157368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8d13-9dea-4bf2-8f01-6db6946abe31 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:24.177294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:24.184548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:24.184887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:24.185168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:24.197342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:24.197342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:24.289548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:24.295019 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3138/6222] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:24 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:24.301641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b435d-ddec-4f25-b737-cc1ec7420d23 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:24.456648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:24.457552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:24.457828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:24.459263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:24.459939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:24.466458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:24.615423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:24.615990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3085/6223] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:24 2022] POST /identity/v3/users => generated 285 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:24.655327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda61b-2181-4428-98e4-3f3dfed0a631 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:24.699115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:24.706915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:24.707307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:24.707597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:24.713855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:24.715588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:24.812396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:24.813722 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3139/6224] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:24.813838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e292c-27b0-4100-b23c-bce51d08c385 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:24.825512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617cc69-b7d8-42ff-ade6-7e56f2379cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:24.828162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617cc69-b7d8-42ff-ade6-7e56f2379cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:24.829268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617cc69-b7d8-42ff-ade6-7e56f2379cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:24.831067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617cc69-b7d8-42ff-ade6-7e56f2379cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:24.833169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617cc69-b7d8-42ff-ade6-7e56f2379cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:24.834721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617cc69-b7d8-42ff-ade6-7e56f2379cfc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:24.890637 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3086/6225] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:24.897571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:24.919372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8897ab-df4b-4c87-b575-3d462c751606 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:24.953981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:24.954720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:24.955540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:24.955838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] PATH_INFO: `/v3/projects/7ba9b69df39e478f94016c312497860f/users/ee12d23d1ec24505b9dd25fa4fae58fc/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:25.023687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba9b69df39e478f94016c312497860f, user_id=ee12d23d1ec24505b9dd25fa4fae58fc, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:25.026459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:25.069825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3140/6226] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:24 2022] PUT /identity/v3/projects/7ba9b69df39e478f94016c312497860f/users/ee12d23d1ec24505b9dd25fa4fae58fc/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:25.082079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:25.082405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:25.082684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:25.161786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] MFA Rules not processed for user `ee12d23d1ec24505b9dd25fa4fae58fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:25.163096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:25.268134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:25.363932 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3087/6227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:25.372594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:25.376253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:25.555163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc56d7-01de-493b-8672-0c8be2cebc93 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:25.576648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda358d5-dafa-48bd-b094-b5bf1f0ef129 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:25.580409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda358d5-dafa-48bd-b094-b5bf1f0ef129 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:25.584672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda358d5-dafa-48bd-b094-b5bf1f0ef129 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:25.585628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda358d5-dafa-48bd-b094-b5bf1f0ef129 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:25.659880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda358d5-dafa-48bd-b094-b5bf1f0ef129 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:25.671338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda358d5-dafa-48bd-b094-b5bf1f0ef129 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:25.713294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3141/6228] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:26.813783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:26.819710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:27.079728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7786a-c6c8-49a2-a4dc-0310f7df76af None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:27.117345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:27.118033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:27.118427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:27.118713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] PATH_INFO: `/v3/users/ce585d26726249d290afeb6d0641f206` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:27.124414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce585d26726249d290afeb6d0641f206)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:27.126455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:27.300172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce585d26726249d290afeb6d0641f206'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:27.322225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce585d26726249d290afeb6d0641f206'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:27.322877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce585d26726249d290afeb6d0641f206'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:27.323559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce585d26726249d290afeb6d0641f206'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:27.334984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce585d26726249d290afeb6d0641f206'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:27.436115 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3088/6229] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:26 2022] DELETE /identity/v3/users/ce585d26726249d290afeb6d0641f206 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:27.441160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:27.441647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:27.441774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:27.523021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:27.526247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:27.572182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:27.710671 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3142/6230] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:27.735759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:27.737290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:27.933149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11316975-6341-45e2-a421-bf2e8afc95e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:27.951042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:27.951699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:27.951984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:27.952259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:27.998960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:28.000537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:28.030022 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3089/6231] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:29.400635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:29.402543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:29.426913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbaa96-d60c-4192-9290-2142dd941951 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:29.449876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:29.452665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:29.452961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:29.454520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] PATH_INFO: `/v3/projects/a48e8671cfec4a779e288733525b2003` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:29.465824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48e8671cfec4a779e288733525b2003)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:29.467804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:29.775730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48e8671cfec4a779e288733525b2003', 'request_id': 'req-9cd7770d-7085-41cf-8b6e-35d2787331ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:29.813098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48e8671cfec4a779e288733525b2003', 'request_id': 'req-9cd7770d-7085-41cf-8b6e-35d2787331ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:29.828655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48e8671cfec4a779e288733525b2003', 'request_id': 'req-9cd7770d-7085-41cf-8b6e-35d2787331ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:29.862748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] The token cache is being invalidate because project a48e8671cfec4a779e288733525b2003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:29.863340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:29.864345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:29.871283 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3143/6232] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:29 2022] DELETE /identity/v3/projects/a48e8671cfec4a779e288733525b2003 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:29.875152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:29.886963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:29.904943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514fc4-7283-4d47-b312-29c8e7b67601 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:30.077911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:30.078892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:30.079343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:30.080327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] PATH_INFO: `/v3/users/58b98c348b7f4f2981f73ecfe7bcf129` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:30.082984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b98c348b7f4f2981f73ecfe7bcf129)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:30.089227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:30.234529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b98c348b7f4f2981f73ecfe7bcf129'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:30.271838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b98c348b7f4f2981f73ecfe7bcf129'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:30.272829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b98c348b7f4f2981f73ecfe7bcf129'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:30.273719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b98c348b7f4f2981f73ecfe7bcf129'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:30.321471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b98c348b7f4f2981f73ecfe7bcf129'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:30.358796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3090/6233] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:29 2022] DELETE /identity/v3/users/58b98c348b7f4f2981f73ecfe7bcf129 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:31.647058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:31.649049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:31.679152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7770d-7085-41cf-8b6e-35d2787331ac admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:31.748122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:31.756303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:31.886654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:31.887613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:31.887901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:31.888181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] PATH_INFO: `/v3/projects/5659d6fa02c2496e9a85511d67b6b051` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:31.894925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5659d6fa02c2496e9a85511d67b6b051)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:31.897073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:32.044570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9532e-0a98-49ca-a4cb-b25c7fe63a0d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:32.073001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:32.078341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5659d6fa02c2496e9a85511d67b6b051', 'request_id': 'req-a7a46888-5037-458e-af29-061092ac6f61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.103260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5659d6fa02c2496e9a85511d67b6b051', 'request_id': 'req-a7a46888-5037-458e-af29-061092ac6f61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.115523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:32.121350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5659d6fa02c2496e9a85511d67b6b051', 'request_id': 'req-a7a46888-5037-458e-af29-061092ac6f61'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.151826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] The token cache is being invalidate because project 5659d6fa02c2496e9a85511d67b6b051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:32.152121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.161961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a7a46888-5037-458e-af29-061092ac6f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.163663 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3144/6234] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:31 2022] DELETE /identity/v3/projects/5659d6fa02c2496e9a85511d67b6b051 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:32.168667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:32.168960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:32.169244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:32.230833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:32.232374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:32.341698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:32.342527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:32.342822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:32.343105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:32.352752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:32.402205 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3145/6235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:32.402205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:32.404927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:32.406388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:32.417479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f263b-df80-4e8c-a596-746131caa699 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:32.447202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d703c-a550-410c-ba22-def380a5ccfd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:32.453806 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3091/6236] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:32.454077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:32.455690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:32.456342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:32.456921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] PATH_INFO: `/v3/users/3556d4ac9f1e4f6393e9f7fe6a16ec5a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:32.458349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3556d4ac9f1e4f6393e9f7fe6a16ec5a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:32.463086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:32.463386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:32.463674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:32.464309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:32.530481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:32.531805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:32.549383 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3092/6237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:32.553234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:32.571766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b124c-6b5f-4a23-8e26-82c066344075 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:32.582417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:32.583058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:32.583344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:32.583625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:32.585066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:32.585384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:32.585675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3556d4ac9f1e4f6393e9f7fe6a16ec5a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.587030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:32.623019 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3093/6238] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:42:32.624375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:32.629764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3556d4ac9f1e4f6393e9f7fe6a16ec5a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.631547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3556d4ac9f1e4f6393e9f7fe6a16ec5a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.636952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3556d4ac9f1e4f6393e9f7fe6a16ec5a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.646696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474d31-2537-44a0-a2bb-2996990823d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:32.658876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3556d4ac9f1e4f6393e9f7fe6a16ec5a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:32.663843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:32.664514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:32.664810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:32.665180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:32.665849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:32.667946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:32.687192 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3146/6239] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:32 2022] DELETE /identity/v3/users/3556d4ac9f1e4f6393e9f7fe6a16ec5a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:32.731342 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3094/6240] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:32 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:32.735895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:32.738468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:32.863652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:32.896626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1d24e-43bf-492d-9c13-863a5ae1b6bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:33.090445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:33.091146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.091428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.091962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.092618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:33.096667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:33.101317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:33.103841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:33.124954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18210-d9ff-4f46-b6ac-fa0a28421d11 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:33.148608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:33.149519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.150662 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3147/6241] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:32 2022] POST /identity/v3/users => generated 290 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:33.151486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.151923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] PATH_INFO: `/v3/projects/60ac370b81fd4fc09d2700123ab85d48` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.153376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ac370b81fd4fc09d2700123ab85d48)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:33.154876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:33.161500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:33.181189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adaff-a947-4fab-8e8b-200fc45b7bf0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:33.194319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:33.195594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.196017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.196685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.197444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:33.217036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:33.233606 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3148/6242] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:33.237415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:33.274590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a249b-358d-4473-a086-da5c40c0ba2c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:33.405384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ac370b81fd4fc09d2700123ab85d48', 'request_id': 'req-544e958f-5043-4d3e-a389-b08755b0769d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:33.430774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ac370b81fd4fc09d2700123ab85d48', 'request_id': 'req-544e958f-5043-4d3e-a389-b08755b0769d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:33.451752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ac370b81fd4fc09d2700123ab85d48', 'request_id': 'req-544e958f-5043-4d3e-a389-b08755b0769d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:33.489535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] The token cache is being invalidate because project 60ac370b81fd4fc09d2700123ab85d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:33.489897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:33.497197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-544e958f-5043-4d3e-a389-b08755b0769d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:33.501041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3095/6243] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:33 2022] DELETE /identity/v3/projects/60ac370b81fd4fc09d2700123ab85d48 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:33.509232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a619ed-e9b9-4a2b-bd96-5276a3b252e0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.509548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a619ed-e9b9-4a2b-bd96-5276a3b252e0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.509804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a619ed-e9b9-4a2b-bd96-5276a3b252e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.514387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:33.522845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.523136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.523413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.526991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:33.530812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:33.550793 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3149/6244] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:33.555803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:33.558074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:33.574731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5a619ed-e9b9-4a2b-bd96-5276a3b252e0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:33.576345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5a619ed-e9b9-4a2b-bd96-5276a3b252e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:33.585559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f5d3-4d1f-44af-9ad8-cabe675070e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:33.604510 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3096/6245] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:33.605230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66bd13-d3ba-4a93-bd90-24dd11a31d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:33.605940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66bd13-d3ba-4a93-bd90-24dd11a31d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.608158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.608453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.608731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.609452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66bd13-d3ba-4a93-bd90-24dd11a31d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.609807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66bd13-d3ba-4a93-bd90-24dd11a31d41 admin admin] PATH_INFO: `/v3/projects/4152222c0564432a8d2df90c2667b610/users/89cf5ca6cde74561b27590494600fe14/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.676018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66bd13-d3ba-4a93-bd90-24dd11a31d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4152222c0564432a8d2df90c2667b610, user_id=89cf5ca6cde74561b27590494600fe14, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:33.681772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66bd13-d3ba-4a93-bd90-24dd11a31d41 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:33.690505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:33.691887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:33.724965 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3097/6246] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:33.728059 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3150/6247] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:33 2022] PUT /identity/v3/projects/4152222c0564432a8d2df90c2667b610/users/89cf5ca6cde74561b27590494600fe14/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:33.729230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:33.739140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.739420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.740115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.750569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995086c8-8700-4990-b0d4-a9afa55ae45a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:33.896911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] MFA Rules not processed for user `89cf5ca6cde74561b27590494600fe14`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:33.898514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:33.936510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:33.961271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:33.986022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:33.987022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:33.987535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:33.987976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:33.989131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:33.989610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:33.991804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.016679 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3151/6248] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:34.021763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.038372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c85657-6445-4131-a2dc-a3d6b2b230b5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.044538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.045800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.046498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.046900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.047828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.049877 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3098/6249] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:34.054474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.055490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.091143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbeb1-2bb5-415c-8c14-97077aa57392 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.107979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.110125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.116460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3152/6250] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:34 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:34.116770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.117241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.118532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.119143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.122322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.231073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3099/6251] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:34 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:42:34.232197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.308718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bea2c-0477-4793-885a-491297bff7b8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.477351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.480158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.481252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.481986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.484571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.487874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.507845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38379a-84af-487f-8b2c-152d8d1646ab admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.529730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.530364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.530651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.530927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.531576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.534191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.557175 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3153/6252] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:34 2022] POST /identity/v3/users => generated 289 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:34.559933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.606041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3100/6253] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:34 2022] POST /identity/v3/users => generated 285 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:34.610078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.622181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082f0f-6e9d-421f-9d89-b028ff4e7f88 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.643578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8e508-c80e-4918-bd4c-24083b9272cc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.653450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.654102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.660889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.661315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.662032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.663699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.665751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.666417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.666699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.666973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.667626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.669240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.715130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3101/6254] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:34.716055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.720016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3154/6255] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:34.721758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.749364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779cdc-a104-4bf7-838d-220fc5ad78cb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.756584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f347f-dda1-4464-a282-0d85764a95b7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.773571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.774242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.775037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.775326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.775981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.777606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.782075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.782742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.783666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.783947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.793188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.797099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.821026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3102/6256] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:34.832781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.833544 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3155/6257] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:34.834592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.869336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45fa7f-42c6-41ee-baf6-0fa3c3fbb241 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.872623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e66e1-678c-4959-b45d-d2894bfd6b25 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:34.882999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.886355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.887237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.888754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] PATH_INFO: `/v3/projects/2bffff3ae59d4b88bbe88440cf9eb6f4/users/2202811f172c41a492cd381544f6f763/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.889886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4804c-9903-4590-be9b-b8e6008f5030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:34.891779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4804c-9903-4590-be9b-b8e6008f5030 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:34.896373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4804c-9903-4590-be9b-b8e6008f5030 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:34.898453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4804c-9903-4590-be9b-b8e6008f5030 admin admin] PATH_INFO: `/v3/projects/87bfa8a6e74a480783ec719757471634/users/aac6e1ea5bd04763be39a241af44ef1b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:34.939772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bffff3ae59d4b88bbe88440cf9eb6f4, user_id=2202811f172c41a492cd381544f6f763, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.942825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.953823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4804c-9903-4590-be9b-b8e6008f5030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bfa8a6e74a480783ec719757471634, user_id=aac6e1ea5bd04763be39a241af44ef1b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:34.957589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4804c-9903-4590-be9b-b8e6008f5030 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:34.986940 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3103/6258] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:34 2022] PUT /identity/v3/projects/2bffff3ae59d4b88bbe88440cf9eb6f4/users/2202811f172c41a492cd381544f6f763/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:34.989149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:34.994659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:35.013093 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3156/6259] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:34 2022] PUT /identity/v3/projects/87bfa8a6e74a480783ec719757471634/users/aac6e1ea5bd04763be39a241af44ef1b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:35.031596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08832c92-f040-4cc9-b1b7-731b25f56e9e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:35.042716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08832c92-f040-4cc9-b1b7-731b25f56e9e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:35.045893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08832c92-f040-4cc9-b1b7-731b25f56e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:35.084137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:35.144476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-08832c92-f040-4cc9-b1b7-731b25f56e9e None None] MFA Rules not processed for user `2202811f172c41a492cd381544f6f763`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:35.145923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-08832c92-f040-4cc9-b1b7-731b25f56e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:35.165259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:35.224949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74760bb7-fb95-4ada-9cf2-73d15321a4c3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:35.378653 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3157/6260] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:35.384886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:35.385329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:35.385858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:35.431181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:35.431181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:35.431181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:35.432093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:35.434049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:35.468342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:35.470008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:35.511120 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3104/6261] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:35.512084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:35.513315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] MFA Rules not processed for user `aac6e1ea5bd04763be39a241af44ef1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:35.522499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:35.657163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28339082-4b4e-440c-9960-66a0ad87d1d3 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:35.677007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:35.677007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:35.677007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:35.677007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:35.677475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:35.679342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:35.707623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3158/6262] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:35.711249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:35.741232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cecc3-ffbd-4e95-8946-ac74f9ba198d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:35.754580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:35.755534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:35.759623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:35.762472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:35.762723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:35.767739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:35.781904 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3105/6263] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:35 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:35.786654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:35.859683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3159/6264] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:35 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:35.863472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.182873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76918ce7-1744-4dff-ab0b-f6c397c424e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.194451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.195037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.195319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.195597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.196243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.198219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.200216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec60ac-d369-40e0-82d8-350eb56a1ee8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.225463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:36.260907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.262055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.262611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.263112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.266506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.272239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.277634 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3106/6265] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:35 2022] POST /identity/v3/users => generated 293 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:36.278753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.291133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:36.313608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac4b1-db1b-45a6-aa7c-d96ffac23fca admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.329109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.330753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.331269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.331731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.332740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.335213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.353325 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3107/6266] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:36.355078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.358584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3160/6267] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:35 2022] POST /identity/v3/users => generated 295 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:36.366634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.374375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7646a-8fba-4c18-8799-160cb913bc0d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.387215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.389310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.390688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.391076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6624c-c0f2-47bd-84cd-93eb8f054877 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.392015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] PATH_INFO: `/v3/projects/19c654628a5d458faf712fd4a0418222/users/ba3ba12ab394497b95e8be99bd871ae9/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.410278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.410922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.411213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.411498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.412156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.413786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.426030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c654628a5d458faf712fd4a0418222, user_id=ba3ba12ab394497b95e8be99bd871ae9, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.435778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.448827 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3161/6268] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:36.455939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.468290 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3108/6269] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:36 2022] PUT /identity/v3/projects/19c654628a5d458faf712fd4a0418222/users/ba3ba12ab394497b95e8be99bd871ae9/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:36.475170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.497005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ce86-f8aa-4314-b6b0-24d07a9ec88c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.657675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481313d-7542-451b-871b-c56f3e76c9c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.681660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.682279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.682585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.688282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.689144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.690850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.701748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:36.703517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:36.708641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:36.709027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] PATH_INFO: `/v3/projects/a4a289962ad948adb661c3acfcd26929/users/e6dc96f63f7e493c9778727fed121752/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:36.744683 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3109/6270] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:36.745650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.763672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a289962ad948adb661c3acfcd26929, user_id=e6dc96f63f7e493c9778727fed121752, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:36.773013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:36.795184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c213d7-273b-46fb-8003-fa6b4bdc169e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:36.812277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3162/6271] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:36 2022] PUT /identity/v3/projects/a4a289962ad948adb661c3acfcd26929/users/e6dc96f63f7e493c9778727fed121752/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:36.816295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:36.999758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba92a06-e653-4abe-be4a-72db1bd90c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:37.000983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92a06-e653-4abe-be4a-72db1bd90c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.003414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92a06-e653-4abe-be4a-72db1bd90c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.003784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92a06-e653-4abe-be4a-72db1bd90c40 admin admin] PATH_INFO: `/v3/projects/19c654628a5d458faf712fd4a0418222/users/ba3ba12ab394497b95e8be99bd871ae9/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.010934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba92a06-e653-4abe-be4a-72db1bd90c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c654628a5d458faf712fd4a0418222, user_id=ba3ba12ab394497b95e8be99bd871ae9, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:37.015761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6155a39-0baf-4863-954e-a9db71fa8460 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:37.021904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba92a06-e653-4abe-be4a-72db1bd90c40 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:37.036547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:37.037829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.039817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.040645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.042038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:37.046933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:37.062221 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3110/6272] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:36 2022] PUT /identity/v3/projects/19c654628a5d458faf712fd4a0418222/users/ba3ba12ab394497b95e8be99bd871ae9/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:37.077525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.095094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.096096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.120382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3163/6273] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:42:37.122734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:37.176148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0ad6d-ea6b-40be-b82a-54bf5562c36b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:37.232878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] MFA Rules not processed for user `ba3ba12ab394497b95e8be99bd871ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:37.236577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:37.369703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:37.452878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadda1e-cf00-4494-8d69-98a6420007aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:37.454014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadda1e-cf00-4494-8d69-98a6420007aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.454484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadda1e-cf00-4494-8d69-98a6420007aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.455458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadda1e-cf00-4494-8d69-98a6420007aa admin admin] PATH_INFO: `/v3/projects/a4a289962ad948adb661c3acfcd26929/users/e6dc96f63f7e493c9778727fed121752/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.463229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadda1e-cf00-4494-8d69-98a6420007aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a289962ad948adb661c3acfcd26929, user_id=e6dc96f63f7e493c9778727fed121752, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:37.466706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadda1e-cf00-4494-8d69-98a6420007aa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:37.472698 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3111/6274] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:37.476470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:37.477413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:37.498025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bb764-c056-4d4e-858a-11a809b5898a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:37.498885 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3164/6275] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:37 2022] PUT /identity/v3/projects/a4a289962ad948adb661c3acfcd26929/users/e6dc96f63f7e493c9778727fed121752/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:37.508804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.509411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.509854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.599501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] MFA Rules not processed for user `e6dc96f63f7e493c9778727fed121752`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:37.600861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:37.713356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:37.713991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.714577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.714878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.715525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:37.717151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:37.763734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3112/6276] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:42:37 2022] POST /identity/v3/domains => generated 277 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:37.765473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:37.833591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3165/6277] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:37.846383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:37.848822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:37.960944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc8117-98f2-45f3-ba1f-d405d0821236 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:37.971682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:37.972811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:37.973224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:37.973590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:37.975354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:37.980424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.049285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8f84c-5dcf-4593-abc0-c9733de1a751 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.116075 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3113/6278] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:37 2022] POST /identity/v3/projects => generated 403 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:38.118989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.254207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:38.254895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.255488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.255774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.256052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.289883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1f4a4-c7f3-4f6a-9159-79f97a5931b6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.310644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.311197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.311483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.311768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.312414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:38.322927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.350981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:38.371156 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3114/6279] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:42:38 2022] POST /identity/v3/groups => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:38.372283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.387956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92dda8-880b-4195-9aad-6be950ad1252 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.395293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.396131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.396597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.397084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.397927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:38.400318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.452556 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3115/6280] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:38 2022] POST /identity/v3/users => generated 445 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:38.453527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.471481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:38.475124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.480255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858eba-a85a-49d7-9ab1-77b410a11f40 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.494082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.494082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.494082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.494486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.494971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:38.496621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.507703 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3166/6281] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:42:38.542107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3116/6282] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:42:38 2022] POST /identity/v3/roles => generated 239 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:38.546815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.560627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef639b-7ea0-4180-b0d5-50e33833c668 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.567569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.568382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.568382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.568751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/groups/489df29fb8a54d8990b57955c0d84e3d/roles/73658f8cfb254d29ba941ce5fe40a63f/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.576818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, group_id=489df29fb8a54d8990b57955c0d84e3d, role_id=73658f8cfb254d29ba941ce5fe40a63f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:38.581859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.613305 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3167/6283] 10.222.0.23 () {60 vars in 1585 bytes} [Mon Oct 31 05:42:38 2022] PUT /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/groups/489df29fb8a54d8990b57955c0d84e3d/roles/73658f8cfb254d29ba941ce5fe40a63f/inherited_to_projects => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:38.616342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.629346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.632086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:38.632241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6655d40-705b-4440-a9b7-3e919635e50c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.813347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c266-1d58-4847-8b1b-4b942644b03e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.827382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.830849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.830849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.830849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.851897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.853870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.854187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.868217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/groups/489df29fb8a54d8990b57955c0d84e3d/roles/73658f8cfb254d29ba941ce5fe40a63f/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:38.872573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, group_id=489df29fb8a54d8990b57955c0d84e3d, role_id=73658f8cfb254d29ba941ce5fe40a63f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:38.875219 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:42:38.875219 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:42:38.875219 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:42:38.882173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:38.907674 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3117/6284] 10.222.0.23 () {58 vars in 1567 bytes} [Mon Oct 31 05:42:38 2022] HEAD /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/groups/489df29fb8a54d8990b57955c0d84e3d/roles/73658f8cfb254d29ba941ce5fe40a63f/inherited_to_projects => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:38.912717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:38.968508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14574ae-bfef-4546-934f-2f99fc91db08 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:38.987964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:38.990574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:38.992190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:38.992863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/groups/489df29fb8a54d8990b57955c0d84e3d/roles/73658f8cfb254d29ba941ce5fe40a63f/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:39.006826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, group_id=489df29fb8a54d8990b57955c0d84e3d, role_id=73658f8cfb254d29ba941ce5fe40a63f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:39.012331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:39.031127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role 73658f8cfb254d29ba941ce5fe40a63f was removed from group 489df29fb8a54d8990b57955c0d84e3d on project 6f378b9c04a14c989d4d0f083d1cfa1c. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:39.031472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:39.037384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:39.075387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:39.083829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:39.138665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3118/6285] 10.222.0.23 () {58 vars in 1569 bytes} [Mon Oct 31 05:42:38 2022] DELETE /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/groups/489df29fb8a54d8990b57955c0d84e3d/roles/73658f8cfb254d29ba941ce5fe40a63f/inherited_to_projects => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:39.139761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:39.144546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3168/6286] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:39.146922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:39.395511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e5d7-cd11-4a38-b1c2-5952a91ed606 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:39.406821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:39.407618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:39.408348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:39.408691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles/73658f8cfb254d29ba941ce5fe40a63f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:39.414402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_role(role_id=73658f8cfb254d29ba941ce5fe40a63f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:39.416319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:39.480423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:39.516563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role 73658f8cfb254d29ba941ce5fe40a63f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:39.516862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:39.518484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:39.520734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3119/6287] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:39 2022] DELETE /identity/v3/roles/73658f8cfb254d29ba941ce5fe40a63f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:39.526789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:39.545882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4e5da-8bef-450c-b4fc-8c736706c5db service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:39.762508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:39.763160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:39.764152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:39.764480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:39.766189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:39.771630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:39.788518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:39.840250 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3169/6288] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:42:39 2022] POST /identity/v3/roles => generated 239 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:42:39.841943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:39.843699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:39.885756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a1ff6-981a-44e5-8bfa-138d1530d498 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:39.901276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:39.905457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:39.905788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:39.906087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/f5157ed413384780b90dab9ab338b88f/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:39.948428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=f5157ed413384780b90dab9ab338b88f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:39.963196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:40.001109 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3120/6289] 10.222.0.23 () {60 vars in 1582 bytes} [Mon Oct 31 05:42:39 2022] PUT /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/f5157ed413384780b90dab9ab338b88f/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:40.007325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:40.025951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2ffa-ea65-450b-9987-0e44b93a77f0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:40.081713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:40.083694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:40.249738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:40.250485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:40.250776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:40.251060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/f5157ed413384780b90dab9ab338b88f/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:40.259283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=f5157ed413384780b90dab9ab338b88f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:40.264428 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:42:40.264428 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:42:40.264428 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:42:40.281626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:40.310465 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3170/6290] 10.222.0.23 () {58 vars in 1564 bytes} [Mon Oct 31 05:42:40 2022] HEAD /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/f5157ed413384780b90dab9ab338b88f/inherited_to_projects => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:40.315432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:40.328666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db50ce-6f5f-493f-a3db-e2d658ac94f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:40.342999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:40.343587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:40.343878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:40.344157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:40.347249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac48c8-12a8-4d8a-8af6-2e8ff307d822 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:40.350754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:40.359172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:40.361827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:40.362522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:40.362980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/f5157ed413384780b90dab9ab338b88f/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:40.365551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=f5157ed413384780b90dab9ab338b88f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:40.368750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:40.374872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role f5157ed413384780b90dab9ab338b88f was removed from user 51aeabba9deb46a7aad9b900ba1f4403 on project 6f378b9c04a14c989d4d0f083d1cfa1c. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:40.375394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:40.376555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:40.391689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:40.397369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:40.406758 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3171/6291] 10.222.0.23 () {58 vars in 1566 bytes} [Mon Oct 31 05:42:40 2022] DELETE /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/f5157ed413384780b90dab9ab338b88f/inherited_to_projects => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:40.412404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:40.414267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:40.427703 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3121/6292] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:40.711632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af746f7-35ff-4302-8cca-73c4e05bafde tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:40.723884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:40.726180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:40.726180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:40.726180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles/f5157ed413384780b90dab9ab338b88f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:40.728171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f5157ed413384780b90dab9ab338b88f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:40.732192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:40.808809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role f5157ed413384780b90dab9ab338b88f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:40.809143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:40.810805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:40.816520 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3172/6293] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:40 2022] DELETE /identity/v3/roles/f5157ed413384780b90dab9ab338b88f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:40.822016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:40.841207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe1e0-d940-4d65-9485-5c0c64fd72cf service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.012032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.012683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.012967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.013248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.013949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.016838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:41.056760 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3122/6294] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:42:40 2022] POST /identity/v3/roles => generated 239 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:41.057018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:41.057892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:41.084417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a691-cfb9-4850-975e-e7dd30ce6f76 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.136785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.137484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.137772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.138059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/ebfaad9406cc4dde812db16ed7012b73/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.144417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, group_id=489df29fb8a54d8990b57955c0d84e3d, role_id=ebfaad9406cc4dde812db16ed7012b73)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.148012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:41.178456 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3173/6295] 10.222.0.23 () {60 vars in 1582 bytes} [Mon Oct 31 05:42:41 2022] PUT /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/ebfaad9406cc4dde812db16ed7012b73/inherited_to_projects => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:41.183368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:41.197219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8210398-d26e-4c74-9c4e-ebd968bec7f2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.313366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.314165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.315315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.315626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.317390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=00b19356d904470ebea2d89a89b71aa6, group_id=489df29fb8a54d8990b57955c0d84e3d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.318454 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:42:41.318454 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:42:41.318454 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:42:41.321047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:41.334980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:41.347749 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3123/6296] 10.222.0.23 () {58 vars in 1464 bytes} [Mon Oct 31 05:42:41 2022] GET /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/inherited_to_projects => generated 447 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:41.362190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:41.374787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6359c3-e844-4d99-a275-020e276b0127 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.402129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.402876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.403165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.408737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/ebfaad9406cc4dde812db16ed7012b73/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.417824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, group_id=489df29fb8a54d8990b57955c0d84e3d, role_id=ebfaad9406cc4dde812db16ed7012b73)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.427420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:41.457714 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3174/6297] 10.222.0.23 () {58 vars in 1564 bytes} [Mon Oct 31 05:42:41 2022] HEAD /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/ebfaad9406cc4dde812db16ed7012b73/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:41.458245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:41.477525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f763a-927f-4fb7-9a01-f2b75e0362d4 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.494267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.495145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.495529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.495931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/ebfaad9406cc4dde812db16ed7012b73/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.502350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, group_id=489df29fb8a54d8990b57955c0d84e3d, role_id=ebfaad9406cc4dde812db16ed7012b73)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.508590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:41.521574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role ebfaad9406cc4dde812db16ed7012b73 was removed from group 489df29fb8a54d8990b57955c0d84e3d on domain 00b19356d904470ebea2d89a89b71aa6. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:41.522012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:41.524627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:41.553461 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3124/6298] 10.222.0.23 () {58 vars in 1566 bytes} [Mon Oct 31 05:42:41 2022] DELETE /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/groups/489df29fb8a54d8990b57955c0d84e3d/roles/ebfaad9406cc4dde812db16ed7012b73/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:41.557934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:41.559870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:41.603173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373b8e-434f-4f20-bccf-5d69ff71983c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.635610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:41.700546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.701300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.701496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.701759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles/ebfaad9406cc4dde812db16ed7012b73` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.705454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ebfaad9406cc4dde812db16ed7012b73)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.709967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:41.857784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role ebfaad9406cc4dde812db16ed7012b73 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:41.858086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:41.866720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:41.869684 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3175/6299] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:41 2022] DELETE /identity/v3/roles/ebfaad9406cc4dde812db16ed7012b73 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:41.874066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:41.923047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccb5db-44f5-4692-9693-6339aa9bde57 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:41.994303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:41.994981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:41.995271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:41.995549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:41.996285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:41.998060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:42.024050 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3125/6300] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:42:41 2022] POST /identity/v3/roles => generated 239 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:42.028826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:42.031094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:42.068464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6326-2819-4fb1-a67a-03a0b182e257 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:42.078335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:42.079383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:42.080580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:42.081070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/d34b9b48efbc49feb9c0756cfc6c3660/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:42.084530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=d34b9b48efbc49feb9c0756cfc6c3660)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:42.097423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:42.129591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3176/6301] 10.222.0.23 () {60 vars in 1579 bytes} [Mon Oct 31 05:42:42 2022] PUT /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/d34b9b48efbc49feb9c0756cfc6c3660/inherited_to_projects => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:42.135016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:42.151611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fef80-fbac-4f47-8e9c-9875ad6f68c0 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:42.347181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:42.347890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:42.348168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:42.348447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:42.350566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=00b19356d904470ebea2d89a89b71aa6, user_id=51aeabba9deb46a7aad9b900ba1f4403)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:42.354412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:42.390889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:42.391816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3126/6302] 10.222.0.23 () {58 vars in 1461 bytes} [Mon Oct 31 05:42:42 2022] GET /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/inherited_to_projects => generated 446 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:42.403992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dc143-d3be-4afd-9b8a-979e3cd20e8d tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:42.419659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:42.420367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:42.420666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:42.420941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/d34b9b48efbc49feb9c0756cfc6c3660/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:42.423263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=d34b9b48efbc49feb9c0756cfc6c3660)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:42.427275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:42.444264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3177/6303] 10.222.0.23 () {58 vars in 1561 bytes} [Mon Oct 31 05:42:42 2022] HEAD /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/d34b9b48efbc49feb9c0756cfc6c3660/inherited_to_projects => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:42.446234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:42.475765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0dd7-a4fa-48d2-8b73-af7ae5d59199 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:42.485518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:42.488742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:42.489036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:42.489315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/d34b9b48efbc49feb9c0756cfc6c3660/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:42.503303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=d34b9b48efbc49feb9c0756cfc6c3660)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:42.506237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:42.521749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role d34b9b48efbc49feb9c0756cfc6c3660 was removed from user 51aeabba9deb46a7aad9b900ba1f4403 on domain 00b19356d904470ebea2d89a89b71aa6. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:42.522042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:42.522819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:42.541457 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3127/6304] 10.222.0.23 () {58 vars in 1563 bytes} [Mon Oct 31 05:42:42 2022] DELETE /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/d34b9b48efbc49feb9c0756cfc6c3660/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:42.545830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:42.550848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:42.588907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc8f79-011b-409b-9d7c-665ba1607e22 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:42.784721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:42.785383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:42.785931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:42.786526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles/d34b9b48efbc49feb9c0756cfc6c3660` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:42.788144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d34b9b48efbc49feb9c0756cfc6c3660)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:42.790689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:42.911500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role d34b9b48efbc49feb9c0756cfc6c3660 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:42.911778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:42.913349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:42.918483 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3178/6305] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:42 2022] DELETE /identity/v3/roles/d34b9b48efbc49feb9c0756cfc6c3660 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:42.924465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:42.939929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ca79-23bd-47b6-b9cb-325b05bed44f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:43.046647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:43.071759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:43.072768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:43.073345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:43.073635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:43.074372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:43.076301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:43.109493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:43.111766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:43.113729 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3128/6306] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:42:42 2022] POST /identity/v3/roles => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:43.134659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f57f-b8ac-4037-98b8-421465d9c461 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:43.145840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:43.146651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:43.147005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:43.147284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:43.148135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:43.152764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:43.308360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:43.376144 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3179/6307] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:43 2022] POST /identity/v3/projects => generated 408 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:42:43.378694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:43.397412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1956fe4-1ac5-4039-b8d0-d014879b6dae tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:43.689346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:43.690433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:43.690433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:43.690832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/ae3dae7b4814400988b8c5c4e136eb66/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:43.708158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=ae3dae7b4814400988b8c5c4e136eb66)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:43.710561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:43.778928 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3129/6308] 10.222.0.23 () {60 vars in 1579 bytes} [Mon Oct 31 05:42:43 2022] PUT /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/ae3dae7b4814400988b8c5c4e136eb66/inherited_to_projects => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:43.783166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:43.809088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14249db-e863-42c4-8e4e-7baa687009f8 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:44.086864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:44.090096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:44.091353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:44.091746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:44.092623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Adding query filter params (scope.project.id=6f378b9c04a14c989d4d0f083d1cfa1c, user.id=51aeabba9deb46a7aad9b900ba1f4403) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:44.096876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:44.098815 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:42:44.098815 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:42:44.098815 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:42:44.101812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:44.246782 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3180/6309] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:42:43 2022] GET /identity/v3/role_assignments?scope.project.id=6f378b9c04a14c989d4d0f083d1cfa1c&user.id=51aeabba9deb46a7aad9b900ba1f4403&effective => generated 648 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:42:44.253029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:44.270048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86706983-f6e3-45a9-8553-f7c292278aeb tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:44.290064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:44.290938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:44.291416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:44.291907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:44.292907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Adding query filter params (scope.project.id=65faa4dcdf1c4cf585cb7fc82e34fa03, user.id=51aeabba9deb46a7aad9b900ba1f4403) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:44.293419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:44.295963 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:42:44.295963 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:42:44.295963 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:42:44.299789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:44.544816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3130/6310] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:42:44 2022] GET /identity/v3/role_assignments?scope.project.id=65faa4dcdf1c4cf585cb7fc82e34fa03&user.id=51aeabba9deb46a7aad9b900ba1f4403&effective => generated 648 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:44.550417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:44.601558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4838849-8805-4ee4-8bc7-3fe04fc695a5 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:44.628577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:44.629575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:44.629865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:44.630168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/ae3dae7b4814400988b8c5c4e136eb66/inherited_to_projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:44.645060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=00b19356d904470ebea2d89a89b71aa6, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=ae3dae7b4814400988b8c5c4e136eb66)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:44.650986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:44.677824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role ae3dae7b4814400988b8c5c4e136eb66 was removed from user 51aeabba9deb46a7aad9b900ba1f4403 on domain 00b19356d904470ebea2d89a89b71aa6. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:44.678173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:44.682424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7e17b6b9-2d0a-4c92-b708-1681f865f286 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:44.750963 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3181/6311] 10.222.0.23 () {58 vars in 1563 bytes} [Mon Oct 31 05:42:44 2022] DELETE /identity/v3/OS-INHERIT/domains/00b19356d904470ebea2d89a89b71aa6/users/51aeabba9deb46a7aad9b900ba1f4403/roles/ae3dae7b4814400988b8c5c4e136eb66/inherited_to_projects => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:44.753006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:44.754945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:44.809527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d3f17-f4c4-4500-b96a-4934a038ba36 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:44.949260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:44.949798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:44.949798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:44.984456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] MFA Rules not processed for user `e44979e46f754f7e9f847e285e4f43bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:44.988093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:45.103549 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3182/6312] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:45.130982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:45.131816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:45.132110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:45.132561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:45.134054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Adding query filter params (scope.project.id=6f378b9c04a14c989d4d0f083d1cfa1c, user.id=51aeabba9deb46a7aad9b900ba1f4403) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:45.135069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:45.141372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:45.273307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:45.333138 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3131/6313] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:42:44 2022] GET /identity/v3/role_assignments?scope.project.id=6f378b9c04a14c989d4d0f083d1cfa1c&user.id=51aeabba9deb46a7aad9b900ba1f4403&effective => generated 228 bytes in 581 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:42:45.334588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:45.354500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898001-8397-4b8a-8296-caa917e6b854 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:45.367709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:45.368515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:45.368905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:45.369287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:45.370428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Adding query filter params (scope.project.id=65faa4dcdf1c4cf585cb7fc82e34fa03, user.id=51aeabba9deb46a7aad9b900ba1f4403) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:45.370840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:45.373883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:45.578256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:45.596712 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3183/6314] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:42:45 2022] GET /identity/v3/role_assignments?scope.project.id=65faa4dcdf1c4cf585cb7fc82e34fa03&user.id=51aeabba9deb46a7aad9b900ba1f4403&effective => generated 228 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:45.600690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:45.620512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20740bf-d9fa-4c44-a866-a19ef8ab6287 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:45.641670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:45.642453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:45.642754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:45.643017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/projects/65faa4dcdf1c4cf585cb7fc82e34fa03` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:45.646111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65faa4dcdf1c4cf585cb7fc82e34fa03)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:45.653442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:45.782197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65faa4dcdf1c4cf585cb7fc82e34fa03', 'request_id': 'req-e9b627be-5688-4f16-b4ed-205f5d67299a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:45.789260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65faa4dcdf1c4cf585cb7fc82e34fa03', 'request_id': 'req-e9b627be-5688-4f16-b4ed-205f5d67299a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:45.806784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65faa4dcdf1c4cf585cb7fc82e34fa03', 'request_id': 'req-e9b627be-5688-4f16-b4ed-205f5d67299a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:45.829803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] The token cache is being invalidate because project 65faa4dcdf1c4cf585cb7fc82e34fa03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:45.830171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:45.830912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:45.832766 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3132/6315] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:45 2022] DELETE /identity/v3/projects/65faa4dcdf1c4cf585cb7fc82e34fa03 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:45.836848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:45.839126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:45.880251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd64db-36a1-46b0-b534-3683f9897b54 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:46.070544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:46.071242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:46.071242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:46.071564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles/ae3dae7b4814400988b8c5c4e136eb66` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:46.074197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ae3dae7b4814400988b8c5c4e136eb66)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:46.075867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:46.225788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role ae3dae7b4814400988b8c5c4e136eb66 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:46.226100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:46.229134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:46.232050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3184/6316] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:45 2022] DELETE /identity/v3/roles/ae3dae7b4814400988b8c5c4e136eb66 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:46.237196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:46.260275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b627be-5688-4f16-b4ed-205f5d67299a tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:46.444273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:46.445247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:46.445700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:46.446253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:46.447097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:46.449261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:46.496837 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3133/6317] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:42:46 2022] POST /identity/v3/roles => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:46.502403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:46.503910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:46.531583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a982-64a3-420d-bc08-b8b5636e692e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:46.544307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:46.545201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:46.545495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:46.545782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:46.546488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:46.548494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:46.637532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3185/6318] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:46 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:46.638593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:46.652608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709ec2-8bfb-4b27-81e7-7f1ed486f4c6 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:46.825079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:46.830434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:46.830907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:46.833666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/cf92f58f96324c8cb8628bc203ea66d5/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:46.840959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=cf92f58f96324c8cb8628bc203ea66d5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:46.853083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:46.873435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:46.910336 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3134/6319] 10.222.0.23 () {60 vars in 1582 bytes} [Mon Oct 31 05:42:46 2022] PUT /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/cf92f58f96324c8cb8628bc203ea66d5/inherited_to_projects => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:46.910592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:46.960198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5af61-60da-4ef7-9f78-407dfeb55be2 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:47.109526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:47.112075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:47.113976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:47.114323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:47.116414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Adding query filter params (scope.project.id=c195e9bfba5f49b88c5cacc454b12210, user.id=51aeabba9deb46a7aad9b900ba1f4403) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:47.116928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:47.123325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:47.231854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:47.278115 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3186/6320] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:42:46 2022] GET /identity/v3/role_assignments?scope.project.id=c195e9bfba5f49b88c5cacc454b12210&user.id=51aeabba9deb46a7aad9b900ba1f4403&effective => generated 649 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:47.288347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:47.316020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7ad27-f7c2-4c04-b003-9589ada99509 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:47.324704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:47.325403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:47.325675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:47.325958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/cf92f58f96324c8cb8628bc203ea66d5/inherited_to_projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:47.340656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f378b9c04a14c989d4d0f083d1cfa1c, user_id=51aeabba9deb46a7aad9b900ba1f4403, role_id=cf92f58f96324c8cb8628bc203ea66d5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:47.343583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:47.352565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role cf92f58f96324c8cb8628bc203ea66d5 was removed from user 51aeabba9deb46a7aad9b900ba1f4403 on project 6f378b9c04a14c989d4d0f083d1cfa1c. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:47.352885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:47.353663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:47.377481 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3135/6321] 10.222.0.23 () {58 vars in 1566 bytes} [Mon Oct 31 05:42:47 2022] DELETE /identity/v3/OS-INHERIT/projects/6f378b9c04a14c989d4d0f083d1cfa1c/users/51aeabba9deb46a7aad9b900ba1f4403/roles/cf92f58f96324c8cb8628bc203ea66d5/inherited_to_projects => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:47.381859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:47.384581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:47.424188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8249a-5475-49a0-9e3e-17c8e201c0d7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:47.560726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:47.575163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:47.575163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:47.575163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:47.575163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Adding query filter params (scope.project.id=c195e9bfba5f49b88c5cacc454b12210, user.id=51aeabba9deb46a7aad9b900ba1f4403) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:47.575644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:47.575644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:47.755712 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3187/6322] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:42:47 2022] GET /identity/v3/role_assignments?scope.project.id=c195e9bfba5f49b88c5cacc454b12210&user.id=51aeabba9deb46a7aad9b900ba1f4403&effective => generated 228 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:47.759088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:47.776428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5fc59-2b0c-452d-a40e-120a8ee674b7 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:47.801080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:47.802710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:47.804105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:47.806764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/projects/c195e9bfba5f49b88c5cacc454b12210` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:47.815570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c195e9bfba5f49b88c5cacc454b12210)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:47.819084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:47.945116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c195e9bfba5f49b88c5cacc454b12210', 'request_id': 'req-f9784672-e7cb-466e-abec-868c1379fd77'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:47.963551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c195e9bfba5f49b88c5cacc454b12210', 'request_id': 'req-f9784672-e7cb-466e-abec-868c1379fd77'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:47.984805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c195e9bfba5f49b88c5cacc454b12210', 'request_id': 'req-f9784672-e7cb-466e-abec-868c1379fd77'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.023865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] The token cache is being invalidate because project c195e9bfba5f49b88c5cacc454b12210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:48.024182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.025889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.033011 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3136/6323] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:47 2022] DELETE /identity/v3/projects/c195e9bfba5f49b88c5cacc454b12210 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:48.036950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:48.039498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:48.116494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e31433-0ddb-4cd0-b743-e663c8e9e115 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:48.192007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:48.195092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:48.282873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:48.283655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:48.283936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:48.301932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/roles/cf92f58f96324c8cb8628bc203ea66d5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:48.310824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cf92f58f96324c8cb8628bc203ea66d5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:48.312513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:48.458564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invalidating the token cache because role cf92f58f96324c8cb8628bc203ea66d5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:48.459519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.464067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.469040 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3188/6324] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:48 2022] DELETE /identity/v3/roles/cf92f58f96324c8cb8628bc203ea66d5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:48.475658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:48.478644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:48.505757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:48.527136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784672-e7cb-466e-abec-868c1379fd77 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:48.747041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c586d-3fb6-4d12-9dfb-6fd2c4dfc476 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:48.771919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:48.776861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:48.778082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:48.778082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:48.778082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/users/51aeabba9deb46a7aad9b900ba1f4403` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:48.783249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_user(user_id=51aeabba9deb46a7aad9b900ba1f4403)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:48.788796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:48.827019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:48.827645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:48.827862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:48.828142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:48.859814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:48.908506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:48.911020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:48.950559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51aeabba9deb46a7aad9b900ba1f4403'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.980777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51aeabba9deb46a7aad9b900ba1f4403'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.983434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51aeabba9deb46a7aad9b900ba1f4403'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:48.991152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51aeabba9deb46a7aad9b900ba1f4403'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.000283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51aeabba9deb46a7aad9b900ba1f4403'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.003695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3137/6325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 811 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:49.029958 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3189/6326] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:48 2022] DELETE /identity/v3/users/51aeabba9deb46a7aad9b900ba1f4403 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:49.034877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:49.058340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f5fe-117d-4b93-b12b-7a9666c00e92 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:49.217285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:49.227361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:49.228008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:49.228913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/groups/489df29fb8a54d8990b57955c0d84e3d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:49.234814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_group(group_id=489df29fb8a54d8990b57955c0d84e3d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:49.242889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:49.363603 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3138/6327] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:42:49 2022] DELETE /identity/v3/groups/489df29fb8a54d8990b57955c0d84e3d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:49.367134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:49.368817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:49.403961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63422e06-1473-4d8d-9195-66b1ae526bf9 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:49.593049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:49.595978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:49.596904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:49.597788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/projects/6f378b9c04a14c989d4d0f083d1cfa1c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:49.599511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f378b9c04a14c989d4d0f083d1cfa1c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:49.601603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:49.646323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:49.667483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f378b9c04a14c989d4d0f083d1cfa1c', 'request_id': 'req-c8a10978-c7fa-4363-b688-9e89d442172e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.675742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f378b9c04a14c989d4d0f083d1cfa1c', 'request_id': 'req-c8a10978-c7fa-4363-b688-9e89d442172e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.682912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f378b9c04a14c989d4d0f083d1cfa1c', 'request_id': 'req-c8a10978-c7fa-4363-b688-9e89d442172e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.712738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] The token cache is being invalidate because project 6f378b9c04a14c989d4d0f083d1cfa1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:49.713058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.713799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:49.728698 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3190/6328] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:49 2022] DELETE /identity/v3/projects/6f378b9c04a14c989d4d0f083d1cfa1c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:49.732591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:49.734652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:49.759696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040be4c-7046-42ff-89fd-c60c0a33464c tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:49.766969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:49.770337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:49.904581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:49.907168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:49.909971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:49.910691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/domains/00b19356d904470ebea2d89a89b71aa6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:49.914099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=00b19356d904470ebea2d89a89b71aa6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:49.918040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:49.969291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a10978-c7fa-4363-b688-9e89d442172e tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:49.987396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:49.988031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:49.988331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:49.988586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:49.990866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:49.999213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '00b19356d904470ebea2d89a89b71aa6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.000414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '00b19356d904470ebea2d89a89b71aa6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.017227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:50.020458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:50.053071 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3191/6329] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:42:50.084214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '00b19356d904470ebea2d89a89b71aa6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.086064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '00b19356d904470ebea2d89a89b71aa6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.094707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:50.094914 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3139/6330] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:42:49 2022] PATCH /identity/v3/domains/00b19356d904470ebea2d89a89b71aa6 => generated 278 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:42:50.116244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6254a-3a0b-4f45-b776-0e7703793d4b service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:50.234624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3ba12ab394497b95e8be99bd871ae9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19c654628a5d458faf712fd4a0418222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:50.236830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:50.237322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:50.238026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] PATH_INFO: `/v3/domains/00b19356d904470ebea2d89a89b71aa6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:50.255627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=00b19356d904470ebea2d89a89b71aa6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:50.269764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:50.320284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '00b19356d904470ebea2d89a89b71aa6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.326591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '00b19356d904470ebea2d89a89b71aa6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.349850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:50.463144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b19356d904470ebea2d89a89b71aa6', 'request_id': 'req-ec481dbf-9837-454f-9a5f-c59c4585d530'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.478293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b19356d904470ebea2d89a89b71aa6', 'request_id': 'req-ec481dbf-9837-454f-9a5f-c59c4585d530'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.493308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b19356d904470ebea2d89a89b71aa6', 'request_id': 'req-ec481dbf-9837-454f-9a5f-c59c4585d530'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.533521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] The token cache is being invalidate because project 00b19356d904470ebea2d89a89b71aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:50.533827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.535521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.556778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '00b19356d904470ebea2d89a89b71aa6', 'request_id': 'req-ec481dbf-9837-454f-9a5f-c59c4585d530'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.568365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '00b19356d904470ebea2d89a89b71aa6', 'request_id': 'req-ec481dbf-9837-454f-9a5f-c59c4585d530'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.570509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '00b19356d904470ebea2d89a89b71aa6', 'request_id': 'req-ec481dbf-9837-454f-9a5f-c59c4585d530'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:50.581677 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3192/6331] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:42:50 2022] DELETE /identity/v3/domains/00b19356d904470ebea2d89a89b71aa6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:50.585457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:50.586947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:50.607811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:50.755710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f2f5-b378-4be4-9eb4-9b141674227f tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:50.760845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:50.762619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:50.939452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:50.943045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:50.945073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:50.945839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] PATH_INFO: `/v3/users/2202811f172c41a492cd381544f6f763` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:50.950541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2202811f172c41a492cd381544f6f763)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:50.955528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481dbf-9837-454f-9a5f-c59c4585d530 tempest-InheritsV3TestJSON-1288657159 tempest-InheritsV3TestJSON-1288657159-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:50.958074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:51.006036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:51.010055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:51.010362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:51.010653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] PATH_INFO: `/v3/users/89cf5ca6cde74561b27590494600fe14` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:51.018214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cf5ca6cde74561b27590494600fe14)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:51.028225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:51.109470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2202811f172c41a492cd381544f6f763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.122449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2202811f172c41a492cd381544f6f763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.123947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2202811f172c41a492cd381544f6f763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.125526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2202811f172c41a492cd381544f6f763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.138472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db847e82-098d-452c-971e-3d665d3d3e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2202811f172c41a492cd381544f6f763'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.168852 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3140/6332] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:50 2022] DELETE /identity/v3/users/2202811f172c41a492cd381544f6f763 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:51.173372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:51.173999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:51.178619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:51.179950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cf5ca6cde74561b27590494600fe14'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.198345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cf5ca6cde74561b27590494600fe14'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.199074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cf5ca6cde74561b27590494600fe14'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.199690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cf5ca6cde74561b27590494600fe14'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.212884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f4d639fa-075a-41bd-80f4-97ed0e45deea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cf5ca6cde74561b27590494600fe14'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:51.235109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:51.236374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:51.249861 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3193/6333] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:50 2022] DELETE /identity/v3/users/89cf5ca6cde74561b27590494600fe14 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:51.254671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:51.254950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:51.255229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:51.324839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:51.348458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:51.349674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:51.409655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:51.520009 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3141/6334] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:51.531194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:51.534900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:51.584404 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3194/6335] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:51.592425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:51.593842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:51.671567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca43340-525b-4be8-a808-998c126fae33 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:51.750404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f627-c8fd-4f9e-a417-b6ce3371ac3e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:51.759069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:51.760442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:51.761258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:51.762579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:51.776337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:51.776337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:51.776337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:51.776337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:51.801665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:51.805360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:51.805936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:51.809636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:51.822979 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3142/6336] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:42:51.849324 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3195/6337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:42:52.636076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:52.638337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:52.660734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cca84-8ab0-48af-bf7d-36237c31a32e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:52.672687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:52.674169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:52.674458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:52.674737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] PATH_INFO: `/v3/projects/4152222c0564432a8d2df90c2667b610` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:52.677442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4152222c0564432a8d2df90c2667b610)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:52.679585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:52.835496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4152222c0564432a8d2df90c2667b610', 'request_id': 'req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:52.851634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4152222c0564432a8d2df90c2667b610', 'request_id': 'req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:52.864604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4152222c0564432a8d2df90c2667b610', 'request_id': 'req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:52.880460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] The token cache is being invalidate because project 4152222c0564432a8d2df90c2667b610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:52.881103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:52.882073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:52.884299 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3143/6338] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:52 2022] DELETE /identity/v3/projects/4152222c0564432a8d2df90c2667b610 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:52.888396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:52.900025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358146b2-8567-43d2-a970-0da0ed0f055b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:52.965233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:52.967837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:53.045136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:53.046062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:53.046376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:53.049549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] PATH_INFO: `/v3/users/aac6e1ea5bd04763be39a241af44ef1b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:53.054400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac6e1ea5bd04763be39a241af44ef1b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:53.061546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:53.073231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:53.195846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac6e1ea5bd04763be39a241af44ef1b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.201105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:53.202718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a3a7-63b1-4b30-b6e1-2412145cfc94 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:53.209158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:53.210078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:53.210557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:53.211099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] PATH_INFO: `/v3/projects/2bffff3ae59d4b88bbe88440cf9eb6f4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:53.218201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bffff3ae59d4b88bbe88440cf9eb6f4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:53.221943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:53.258649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac6e1ea5bd04763be39a241af44ef1b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.258649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac6e1ea5bd04763be39a241af44ef1b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.261944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac6e1ea5bd04763be39a241af44ef1b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.312882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac6e1ea5bd04763be39a241af44ef1b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.327584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bffff3ae59d4b88bbe88440cf9eb6f4', 'request_id': 'req-d0070dd2-3458-4c55-9cd1-5894abbc0be8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.338748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bffff3ae59d4b88bbe88440cf9eb6f4', 'request_id': 'req-d0070dd2-3458-4c55-9cd1-5894abbc0be8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.368466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bffff3ae59d4b88bbe88440cf9eb6f4', 'request_id': 'req-d0070dd2-3458-4c55-9cd1-5894abbc0be8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.380880 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3196/6339] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:52 2022] DELETE /identity/v3/users/aac6e1ea5bd04763be39a241af44ef1b => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:53.404898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] The token cache is being invalidate because project 2bffff3ae59d4b88bbe88440cf9eb6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:53.405402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.414923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.426365 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3144/6340] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:52 2022] DELETE /identity/v3/projects/2bffff3ae59d4b88bbe88440cf9eb6f4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:42:53.427177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:53.428855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:53.646349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119615f-8185-453d-90a7-73975e415a00 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:53.683186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:53.683950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:53.686532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:53.686939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] PATH_INFO: `/v3/users/ba3ba12ab394497b95e8be99bd871ae9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:53.692029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3ba12ab394497b95e8be99bd871ae9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:53.699056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:53.812876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3ba12ab394497b95e8be99bd871ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.840708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3ba12ab394497b95e8be99bd871ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.843070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3ba12ab394497b95e8be99bd871ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.846513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3ba12ab394497b95e8be99bd871ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.868987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3ba12ab394497b95e8be99bd871ae9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:53.898119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3197/6341] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:53 2022] DELETE /identity/v3/users/ba3ba12ab394497b95e8be99bd871ae9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:53.946472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:53.947957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:54.185540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:54.187243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:54.234927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070dd2-3458-4c55-9cd1-5894abbc0be8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:54.385283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:54.396212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:54.397123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:54.397469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:54.397831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] PATH_INFO: `/v3/users/071198adbd0d4bcbab789203fb205e88` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:54.399653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071198adbd0d4bcbab789203fb205e88)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:54.403528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:54.408880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:54.449586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16046-4c90-4857-83b5-8a8a52dddb95 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:54.463138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:54.465078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:54.466179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:54.466531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] PATH_INFO: `/v3/projects/87bfa8a6e74a480783ec719757471634` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:54.471509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87bfa8a6e74a480783ec719757471634)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:54.476109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:54.545221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071198adbd0d4bcbab789203fb205e88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.602454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87bfa8a6e74a480783ec719757471634', 'request_id': 'req-b349c7ac-52f8-48a0-bc45-b6e0566a1323'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.603163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071198adbd0d4bcbab789203fb205e88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.604696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071198adbd0d4bcbab789203fb205e88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.606017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071198adbd0d4bcbab789203fb205e88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.611665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87bfa8a6e74a480783ec719757471634', 'request_id': 'req-b349c7ac-52f8-48a0-bc45-b6e0566a1323'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.623176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87bfa8a6e74a480783ec719757471634', 'request_id': 'req-b349c7ac-52f8-48a0-bc45-b6e0566a1323'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.639659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e835b161-5f4a-4038-a9ce-5fdbc9bc83f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071198adbd0d4bcbab789203fb205e88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.665893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] The token cache is being invalidate because project 87bfa8a6e74a480783ec719757471634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:54.666216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.668636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:54.674548 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3198/6342] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:54 2022] DELETE /identity/v3/projects/87bfa8a6e74a480783ec719757471634 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:54.675840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:54.677335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:54.786994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3145/6343] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:53 2022] DELETE /identity/v3/users/071198adbd0d4bcbab789203fb205e88 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:54.792841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:54.792841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:54.792841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:54.880796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c7ac-52f8-48a0-bc45-b6e0566a1323 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:54.916475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:54.917566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:55.072124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:55.072811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.073476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.073784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] PATH_INFO: `/v3/users/e6dc96f63f7e493c9778727fed121752` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.075338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dc96f63f7e493c9778727fed121752)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:55.077446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:55.130769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:55.137078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3146/6344] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:55.140639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:55.146699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:55.187786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0883c-6d3a-409d-80db-5bc813f1a3e8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:55.201913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dc96f63f7e493c9778727fed121752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.208419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:55.209115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.209411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.209676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] PATH_INFO: `/v3/projects/19c654628a5d458faf712fd4a0418222` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.218660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c654628a5d458faf712fd4a0418222)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:55.220854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:55.252508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dc96f63f7e493c9778727fed121752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.254915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dc96f63f7e493c9778727fed121752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.257511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dc96f63f7e493c9778727fed121752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.281025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dc96f63f7e493c9778727fed121752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.322486 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3199/6345] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:42:54 2022] DELETE /identity/v3/users/e6dc96f63f7e493c9778727fed121752 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:55.323484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:55.327515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:55.349074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c654628a5d458faf712fd4a0418222', 'request_id': 'req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.356171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c654628a5d458faf712fd4a0418222', 'request_id': 'req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.365633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c654628a5d458faf712fd4a0418222', 'request_id': 'req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.380254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:55.385900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] The token cache is being invalidate because project 19c654628a5d458faf712fd4a0418222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:55.386504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.387692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c74dd5ae-a1c4-41f9-a78b-dc674c613cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:55.390277 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3147/6346] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:55 2022] DELETE /identity/v3/projects/19c654628a5d458faf712fd4a0418222 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:55.396702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38349-4294-41b2-b044-3554f32c47b1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.397684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38349-4294-41b2-b044-3554f32c47b1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.398133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38349-4294-41b2-b044-3554f32c47b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.427606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-69c38349-4294-41b2-b044-3554f32c47b1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:55.429364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69c38349-4294-41b2-b044-3554f32c47b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:55.504043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bef32-3ec7-40ec-bb48-1f2a750d92ff admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:55.599619 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3148/6347] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:55.609076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.609416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.609795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.648163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:55.649069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.649421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.649767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.656541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:55.674618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:55.678319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:55.680680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:55.683305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:55.697320 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3149/6348] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:42:55.702163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:55.713371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3200/6349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:55.741034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7323b-760e-4faf-a694-8dfbf19170b5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:55.748389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:55.749740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.750277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.750761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.751973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:55.751973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:55.753602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:55.772828 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3150/6350] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:55.775058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:55.808711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a27fe-60ba-4be4-8100-16462bc0b066 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:55.817453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:55.818444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.818929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.819398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:55.820268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:55.823143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:55.870492 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3201/6351] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:55 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:55.872185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:55.887563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fcaa4-d60e-4c68-94ae-9db54dc4918e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:55.981092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:55.981840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:55.982444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:55.996778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:55.999677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:56.002616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.004004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:56.008394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:56.042660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1921e1-4560-4cef-a2b9-b489f7fede73 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.048658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3151/6352] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:55 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:56.049705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:56.063544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be50d9-6677-4aec-9802-0843fa3a0753 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.071113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:56.072745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.074362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.074682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] PATH_INFO: `/v3/projects/1a16be105e7b4be4a01d2282eb804586` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.077825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a16be105e7b4be4a01d2282eb804586)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:56.078700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:56.080063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.080868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.081153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.081814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:56.083692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:56.087543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:56.118329 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3152/6353] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:56.122406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:56.146950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17129e69-9c78-4343-85ae-bdabf6c3bd14 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.153195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:56.154127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.154663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.155346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.156206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:56.159361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:56.181879 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3153/6354] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:56.191872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:56.208304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47684d9-25b9-4239-9795-206b1829ac88 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.230259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255470b4-f486-452b-ab63-2140fca16a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:56.231144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255470b4-f486-452b-ab63-2140fca16a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.231429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255470b4-f486-452b-ab63-2140fca16a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.231709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255470b4-f486-452b-ab63-2140fca16a45 admin admin] PATH_INFO: `/v3/projects/55cb6f51112843b2b297e8ed44e8213c/users/a5d3c8bc4bfa45689dfec568499f9b15/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.247408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:56.280625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a16be105e7b4be4a01d2282eb804586', 'request_id': 'req-da9ba443-ee64-4d19-9870-b71d5c60c77b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.290863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a16be105e7b4be4a01d2282eb804586', 'request_id': 'req-da9ba443-ee64-4d19-9870-b71d5c60c77b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.292865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255470b4-f486-452b-ab63-2140fca16a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cb6f51112843b2b297e8ed44e8213c, user_id=a5d3c8bc4bfa45689dfec568499f9b15, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:56.306710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a16be105e7b4be4a01d2282eb804586', 'request_id': 'req-da9ba443-ee64-4d19-9870-b71d5c60c77b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.307018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255470b4-f486-452b-ab63-2140fca16a45 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:56.335129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] The token cache is being invalidate because project 1a16be105e7b4be4a01d2282eb804586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:56.335427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.336120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.347835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3202/6355] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:55 2022] DELETE /identity/v3/projects/1a16be105e7b4be4a01d2282eb804586 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:56.348792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:56.350334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:56.350900 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3154/6356] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:56 2022] PUT /identity/v3/projects/55cb6f51112843b2b297e8ed44e8213c/users/a5d3c8bc4bfa45689dfec568499f9b15/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:56.368360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1c41-655b-4629-b87c-5f1c44c51919 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.368714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1c41-655b-4629-b87c-5f1c44c51919 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.368917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1c41-655b-4629-b87c-5f1c44c51919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.446402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-73af1c41-655b-4629-b87c-5f1c44c51919 None None] MFA Rules not processed for user `a5d3c8bc4bfa45689dfec568499f9b15`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:56.457151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-73af1c41-655b-4629-b87c-5f1c44c51919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:56.491794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ba443-ee64-4d19-9870-b71d5c60c77b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.513830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:56.641668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:56.641668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.642839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.643117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] PATH_INFO: `/v3/projects/a4a289962ad948adb661c3acfcd26929` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.646912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a289962ad948adb661c3acfcd26929)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:56.649120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:56.684674 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3155/6357] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:56.684674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.684674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.684674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.727373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:56.736823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:56.757441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a289962ad948adb661c3acfcd26929', 'request_id': 'req-1ee68426-48fe-4a01-b436-81255a905404'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.768367 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3156/6358] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:56.777375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a289962ad948adb661c3acfcd26929', 'request_id': 'req-1ee68426-48fe-4a01-b436-81255a905404'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.779926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:56.789799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a289962ad948adb661c3acfcd26929', 'request_id': 'req-1ee68426-48fe-4a01-b436-81255a905404'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.792386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:56.828791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:56.841246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] The token cache is being invalidate because project a4a289962ad948adb661c3acfcd26929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:42:56.841923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.842702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:42:56.853734 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3203/6359] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:42:56 2022] DELETE /identity/v3/projects/a4a289962ad948adb661c3acfcd26929 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:56.854749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:56.857042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:56.938768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af091-105c-4e5b-ad7d-43aa88b4c7f4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.974808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68426-48fe-4a01-b436-81255a905404 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:56.981014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:56.982120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:56.982426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:56.982699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:56.985051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:57.051806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:57.054765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.054765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.054765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.055912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:57.071942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.073532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:57.087119 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3157/6360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:57.088209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:57.089799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:57.199241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.201966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4a167-b976-47bb-98d2-413da2dc3e1e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:57.218999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927f925-f61d-48f3-8c0e-7b16473aca4c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:57.220736 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3204/6361] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:57.222459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4098f8-b9fb-46e0-801e-9a78915757e8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.222827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4098f8-b9fb-46e0-801e-9a78915757e8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.223123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4098f8-b9fb-46e0-801e-9a78915757e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.244347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:57.244995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.245281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.245558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.253330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.255621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:57.274006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6d4098f8-b9fb-46e0-801e-9a78915757e8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:57.277903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d4098f8-b9fb-46e0-801e-9a78915757e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:57.281226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:57.316854 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3205/6362] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:57.320874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.321171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.321447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.333646 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3158/6363] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/projects => generated 389 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:57.333646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:57.379806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:57.383393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:57.495464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fee6f-35a3-4e13-a035-0adc53ef903b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:57.502865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:57.503950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.505673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.506166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.507051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:57.511124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.513905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:57.556450 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3159/6364] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:57.564238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:57.570319 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3206/6365] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:57.572598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:57.589323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77256f-e275-49b5-9d40-c8d33e375ce4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:57.595305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecdb39-ab03-4d1b-8786-45fe2e2a06a3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:57.611016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c647-7f4e-451a-871a-e53645cd3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:57.611675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c647-7f4e-451a-871a-e53645cd3aed admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.611955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c647-7f4e-451a-871a-e53645cd3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.612161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:57.612305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c647-7f4e-451a-871a-e53645cd3aed admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.613000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.613227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86c647-7f4e-451a-871a-e53645cd3aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.613599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.614502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.617145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.617688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86c647-7f4e-451a-871a-e53645cd3aed admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:57.622738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:57.691932 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3160/6366] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:57.693645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.693943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.694246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.739680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:57.741216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:57.749036 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3207/6367] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:57.753635 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3161/6368] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:57.754849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:57.760149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:57.780831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601832-91f4-4d3b-b3d4-baf816cc13cd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:57.825328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:57.975825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7199-1053-4b23-9c4e-83086695eef7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:57.989169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:57.989951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:57.990688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:57.990688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:57.991459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:57.993644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.012967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.013906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.014404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.014855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.015680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.021392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.026429 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3208/6369] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:58.026429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.071566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71480ea7-a04a-4cf2-970b-4495dff61cdc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.072104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3162/6370] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:57 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:58.073131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.090161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.090811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.091091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.091367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.092024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:42:58.095947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafa49e-c42b-4db1-8b68-de2887c42d0b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.097541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.101003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.115352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.116265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.116560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.116842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] PATH_INFO: `/v3/projects/941ad590a61b48e9b191fa5498d1e7f6/users/d2b0847e6e3448b0a697eaad1093a483/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.141033 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3209/6371] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:58.141576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.153459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad5a6-c10e-4567-b359-6e008af6db30 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.158881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.160171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.160171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.160171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.160688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.163110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.167214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=941ad590a61b48e9b191fa5498d1e7f6, user_id=d2b0847e6e3448b0a697eaad1093a483, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.175486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.176583 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3210/6372] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:58.177139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.190108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859678-e769-44a3-b27a-62f5d138d7eb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.196638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.197339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.197619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.197901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.198695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.200735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.208282 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3163/6373] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:58 2022] PUT /identity/v3/projects/941ad590a61b48e9b191fa5498d1e7f6/users/d2b0847e6e3448b0a697eaad1093a483/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:58.209342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.239209 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3211/6374] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:42:58 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:58.240565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.351726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:58.412677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa42b8-7082-4282-b405-e0f6759d89ad admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.426493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.427125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.427402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.427673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.429797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.431116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.436758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88533e-abd8-4161-ab69-9f13f157e90e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.450641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.451306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.452892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.455106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.456303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.460507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.461388 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3212/6375] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:58.462990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.476742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59905e2b-4068-4ef8-b749-cfda984866b7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.479205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3164/6376] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:58.480782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.488194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.489050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.489393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.489740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.490404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.492344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.504769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2e78-7471-49fc-beb0-0ee7f5a8223a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.518438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.519260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.519547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.520106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] PATH_INFO: `/v3/projects/941ad590a61b48e9b191fa5498d1e7f6/users/d2b0847e6e3448b0a697eaad1093a483/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.524305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941ad590a61b48e9b191fa5498d1e7f6, user_id=d2b0847e6e3448b0a697eaad1093a483, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.528642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.542221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3213/6377] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:42:58 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:58.542221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.570939 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3165/6378] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:58 2022] PUT /identity/v3/projects/941ad590a61b48e9b191fa5498d1e7f6/users/d2b0847e6e3448b0a697eaad1093a483/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:58.570939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.571531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53daf4-7ff2-4d84-a25f-f3e2c093a0fc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.659395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:58.689642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e3edc-26d7-429d-bc01-784e1c308a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.691066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e3edc-26d7-429d-bc01-784e1c308a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.691747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e3edc-26d7-429d-bc01-784e1c308a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.692245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e3edc-26d7-429d-bc01-784e1c308a19 admin admin] PATH_INFO: `/v3/projects/cf075627d80b427c8966491bed06ba1b/users/babe2e2c31884aedb58092cd832a2bc1/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.721131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e3edc-26d7-429d-bc01-784e1c308a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf075627d80b427c8966491bed06ba1b, user_id=babe2e2c31884aedb58092cd832a2bc1, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.725001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e3edc-26d7-429d-bc01-784e1c308a19 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.731353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faebf4-10ee-4475-8522-9da8dbdcb630 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:58.770190 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3214/6379] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:58 2022] PUT /identity/v3/projects/cf075627d80b427c8966491bed06ba1b/users/babe2e2c31884aedb58092cd832a2bc1/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:58.770406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:58.770406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.770406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.770406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.770758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:58.770851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c2f5-0bb7-4448-bd77-d5cd5b0b7325 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:58.770851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c2f5-0bb7-4448-bd77-d5cd5b0b7325 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:58.770851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c2f5-0bb7-4448-bd77-d5cd5b0b7325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:58.771073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:58.781997 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3166/6380] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:58.781997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:58.785345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:58.835955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6aa4c2f5-0bb7-4448-bd77-d5cd5b0b7325 None None] MFA Rules not processed for user `d2b0847e6e3448b0a697eaad1093a483`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:58.837259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6aa4c2f5-0bb7-4448-bd77-d5cd5b0b7325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:59.001891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895353a-61b4-46d5-98e5-277c6b9826e3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:59.050793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:59.083878 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3215/6381] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:59.083878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.084191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.084471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.150523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:59.152482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.154634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.155102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.158734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:59.177818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] MFA Rules not processed for user `babe2e2c31884aedb58092cd832a2bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:59.180078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:59.193356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:59.196464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:59.229278 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3167/6382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:59.240898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:59.365019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e2c4-1032-45b2-8441-2a5e87334aff service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:59.375929 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3216/6383] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:42:59.375929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:59.381157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:59.381802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.382416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.382718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.383376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:59.386588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:59.409748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea81d-5485-40b3-8d31-b6b99c920483 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:59.415524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:59.416521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.416810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.417088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects/55cb6f51112843b2b297e8ed44e8213c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.418189 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3168/6384] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:42:59.420128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:59.427778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:get_project(project_id=55cb6f51112843b2b297e8ed44e8213c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:59.432071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:59.433939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3217/6385] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:42:59 2022] GET /identity/v3/projects/55cb6f51112843b2b297e8ed44e8213c => generated 385 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:42:59.434855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:59.491746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0426-b947-45f0-92b2-d04f720ab49e tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:59.511991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:59.513303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.513303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.513303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] PATH_INFO: `/v3/projects/ec3dafdfbd78428886e9eea63bfd555f/users/a258995ccb4a4d31a83f7483ea1e85ec/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.557411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3dafdfbd78428886e9eea63bfd555f, user_id=a258995ccb4a4d31a83f7483ea1e85ec, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:59.561367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:59.591793 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3218/6386] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:42:59 2022] PUT /identity/v3/projects/ec3dafdfbd78428886e9eea63bfd555f/users/a258995ccb4a4d31a83f7483ea1e85ec/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:42:59.592851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:42:59.622230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:59.645322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415e1bd-947c-4648-b6d5-add9e9be9b46 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:59.756550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:59.757335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.758226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.758672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.769518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fff01-27b4-40e1-85d6-1c6bdf9b45eb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:42:59.782048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093f51-5232-4439-a3a9-604992655592 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:42:59.784416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093f51-5232-4439-a3a9-604992655592 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.784977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093f51-5232-4439-a3a9-604992655592 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.786439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093f51-5232-4439-a3a9-604992655592 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.788434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf093f51-5232-4439-a3a9-604992655592 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:59.790494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf093f51-5232-4439-a3a9-604992655592 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:59.861847 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3219/6387] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:42:59 2022] POST /identity/v3/projects => generated 338 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:42:59.863367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:42:59.864529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:42:59.864529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:42:59.864976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:42:59.908950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:42:59.910748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:42:59.941954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] MFA Rules not processed for user `a258995ccb4a4d31a83f7483ea1e85ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:42:59.945714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:42:59.964531 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3169/6388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:42:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:42:59.965667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.003606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f76cc-125c-481b-a8c8-72426b3e3cb5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.125574 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3220/6389] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:42:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:00.138108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.138786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.140229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.141411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.144763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.147559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.149368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:00.157391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.199887 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3170/6390] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:42:59 2022] GET /identity/v3/projects => generated 5815 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:00.206380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.227700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9029-ac17-4ab0-8128-2c1672077bad tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.237824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.238766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.239958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.239958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects/55cb6f51112843b2b297e8ed44e8213c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.241164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:get_project(project_id=55cb6f51112843b2b297e8ed44e8213c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.243603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.251585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3171/6391] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects/55cb6f51112843b2b297e8ed44e8213c => generated 385 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:00.251585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.281372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cf995-46f7-45f5-9579-6c07d6538204 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.313927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.314781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.315081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.315382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects/32ac08f3d80a4e03a742daa200ef770e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.325293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:get_project(project_id=32ac08f3d80a4e03a742daa200ef770e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.327982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.335102 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3172/6392] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects/32ac08f3d80a4e03a742daa200ef770e => generated 338 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:00.336674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.337349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b51ab-8fbb-4bbd-9893-6c90b0fcf237 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.350944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317ea4-a2c0-42ca-ad58-393235ef4ed1 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.351808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.354419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.354781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.355129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.357355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a396-00a2-40f8-babb-11f23fd2061a tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.358068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a396-00a2-40f8-babb-11f23fd2061a tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.358456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a396-00a2-40f8-babb-11f23fd2061a tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.358805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a396-00a2-40f8-babb-11f23fd2061a tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.359782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a396-00a2-40f8-babb-11f23fd2061a tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.364012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a396-00a2-40f8-babb-11f23fd2061a tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.378240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.380098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.390424 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3173/6393] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects => generated 5815 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:00.392578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.393064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.393496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.410702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3221/6394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:43:00.411625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.439700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:00.443531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:00.447569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943cbd-6942-4b64-a86b-5e8d1f23b581 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.457218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.458288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.459698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.460084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.460868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:00.461281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.466137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.509976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3222/6395] 10.222.0.23 () {58 vars in 1166 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects?domain_id=default => generated 5484 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:00.515363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.527534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23889407-a481-43ef-87c8-2772b93a328b tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.539683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.540570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.540949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.541444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.542366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.546061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.578446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:00.601160 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3223/6396] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects => generated 5815 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:00.604435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.607756 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3174/6397] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:43:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:00.623060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.623060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:00.646866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f861764-96ea-4042-a093-bd925737f3ff tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.662160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.663080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.663462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.663835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.664752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:00.665160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.667190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.697698 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3224/6398] 10.222.0.23 () {58 vars in 1166 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects?domain_id=default => generated 5484 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:00.699138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.713081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c430-e3ee-448e-91e8-9e5144c6b3dd tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.729953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:00.735095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.735095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.735095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.749832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.749832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.749832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.812155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3225/6399] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects => generated 5815 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:00.816417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.818175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f2a25-bd62-4cb5-b48b-9f3ff6da0754 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.831119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.832195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.833766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.834112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.838757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f7c9-8ebe-41e6-ab49-d76f71d211b2 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.849052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.851096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.852027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.853217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.853217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.853217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-92000732) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:00.857730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.859413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.862693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:00.898314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3175/6400] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:43:00.908712 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3226/6401] 10.222.0.23 () {58 vars in 1228 bytes} [Mon Oct 31 05:43:00 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-92000732 => generated 531 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:00.914090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:00.932109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a63a5-d41b-4260-9bbc-505ceb51ab16 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:00.943310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b0847e6e3448b0a697eaad1093a483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941ad590a61b48e9b191fa5498d1e7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:00.944846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:00.946463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:00.947511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] PATH_INFO: `/v3/projects/32ac08f3d80a4e03a742daa200ef770e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:00.950774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32ac08f3d80a4e03a742daa200ef770e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:00.955848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:01.099773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ac08f3d80a4e03a742daa200ef770e', 'request_id': 'req-42655a97-b978-4eff-8e18-2f935303b038'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.106918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ac08f3d80a4e03a742daa200ef770e', 'request_id': 'req-42655a97-b978-4eff-8e18-2f935303b038'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.129492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ac08f3d80a4e03a742daa200ef770e', 'request_id': 'req-42655a97-b978-4eff-8e18-2f935303b038'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.161163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] The token cache is being invalidate because project 32ac08f3d80a4e03a742daa200ef770e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:01.163373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.165203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-42655a97-b978-4eff-8e18-2f935303b038 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.170241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3176/6402] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:00 2022] DELETE /identity/v3/projects/32ac08f3d80a4e03a742daa200ef770e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:01.178757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:01.180787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:01.349711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36959d-bf25-4d0e-a03d-fe5c43984e94 tempest-ListProjectsStaticTestJSON-1548444367 tempest-ListProjectsStaticTestJSON-1548444367-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:01.514487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:01.515176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:01.515455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:01.515683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] PATH_INFO: `/v3/users/a5d3c8bc4bfa45689dfec568499f9b15` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:01.517532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d3c8bc4bfa45689dfec568499f9b15)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:01.522479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:01.727375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d3c8bc4bfa45689dfec568499f9b15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.775337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d3c8bc4bfa45689dfec568499f9b15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.788501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d3c8bc4bfa45689dfec568499f9b15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.790815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d3c8bc4bfa45689dfec568499f9b15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.813363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:01.824850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d3c8bc4bfa45689dfec568499f9b15'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:01.867988 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3227/6403] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:01 2022] DELETE /identity/v3/users/a5d3c8bc4bfa45689dfec568499f9b15 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:01.872447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:01.873437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:01.878064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:02.003781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:02.015852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:02.474481 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3177/6404] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:02.611198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:02.646461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:02.834679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaf997-d9ab-488d-8b4e-276992adef83 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:02.839259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:02.839996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:02.840565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:02.841452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:02.852503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:02.854297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:02.878381 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3228/6405] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:03.295491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:03.297780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:03.353932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4696e-1c1c-4557-986d-22f5f4d6464d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:03.375692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:03.382227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:03.383655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:03.384851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] PATH_INFO: `/v3/projects/55cb6f51112843b2b297e8ed44e8213c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:03.388023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cb6f51112843b2b297e8ed44e8213c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:03.396476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:03.632622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cb6f51112843b2b297e8ed44e8213c', 'request_id': 'req-c3756c18-2c03-41b6-b4c0-5929c4604e34'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:03.657468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cb6f51112843b2b297e8ed44e8213c', 'request_id': 'req-c3756c18-2c03-41b6-b4c0-5929c4604e34'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:03.667851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:03.693088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cb6f51112843b2b297e8ed44e8213c', 'request_id': 'req-c3756c18-2c03-41b6-b4c0-5929c4604e34'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:03.741625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] The token cache is being invalidate because project 55cb6f51112843b2b297e8ed44e8213c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:03.742126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:03.748577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:03.751084 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3178/6406] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:03 2022] DELETE /identity/v3/projects/55cb6f51112843b2b297e8ed44e8213c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:03.757922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:03.783908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b267-8305-42ae-bfa2-e5a5c622e710 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:03.991007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:03.991718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:03.992188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:03.997916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] PATH_INFO: `/v3/users/d2b0847e6e3448b0a697eaad1093a483` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:03.999548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b0847e6e3448b0a697eaad1093a483)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:04.002125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:04.169766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b0847e6e3448b0a697eaad1093a483'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:04.211689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b0847e6e3448b0a697eaad1093a483'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:04.212462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b0847e6e3448b0a697eaad1093a483'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:04.213085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b0847e6e3448b0a697eaad1093a483'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:04.241222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f01fbcb-f89f-470c-b42b-555a2a725014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b0847e6e3448b0a697eaad1093a483'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:04.300277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3229/6407] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:03 2022] DELETE /identity/v3/users/d2b0847e6e3448b0a697eaad1093a483 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:05.388849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:05.391064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:05.420858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756c18-2c03-41b6-b4c0-5929c4604e34 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:05.587227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:05.588389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:05.588855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:05.589306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] PATH_INFO: `/v3/projects/941ad590a61b48e9b191fa5498d1e7f6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:05.590829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941ad590a61b48e9b191fa5498d1e7f6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:05.593090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:05.686543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941ad590a61b48e9b191fa5498d1e7f6', 'request_id': 'req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:05.700273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941ad590a61b48e9b191fa5498d1e7f6', 'request_id': 'req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:05.717230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941ad590a61b48e9b191fa5498d1e7f6', 'request_id': 'req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:05.739723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] The token cache is being invalidate because project 941ad590a61b48e9b191fa5498d1e7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:05.739836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:05.740491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0e4e98f-9e9b-4b8b-a451-2e2e34b1adb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:05.748518 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3179/6408] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:05 2022] DELETE /identity/v3/projects/941ad590a61b48e9b191fa5498d1e7f6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:05.749710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:05.750247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:05.750350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:05.818104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:05.819537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:05.839204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:06.050625 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3230/6409] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:06.052826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.053367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.053847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.082822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:06.084666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:06.100687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:06.108090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3180/6410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:06.113923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdf507-4224-4e31-b5a0-d8b6acb7c993 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:06.121320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:06.122386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.124050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.124551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.127570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:06.128657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:06.133293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:06.164738 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3231/6411] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:06.165312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:06.181733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8b45-ad2a-4b08-a328-1404d4897b60 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:06.193745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:06.194436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.194721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.194996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.210315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:06.212440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:06.298966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3181/6412] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:06 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:06.302744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:06.317115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693b96-fb46-4a7a-b8b5-6577c6cf63e3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:06.502920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:06.504814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.506773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.507245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.508852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:06.512651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:06.572034 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3232/6413] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:06 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:06.576495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:06.588444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768bfc9-ae04-422d-a4ec-1511a790c199 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:06.629134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:06.632785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.633182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.636416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.638112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:06.640526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:06.675876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:06.676473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3182/6414] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:06.691517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4c92-3038-4f45-acc3-c587233b22b9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:06.714577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9246c-0710-4b2d-be99-e960fa818bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:06.719949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9246c-0710-4b2d-be99-e960fa818bfa admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.719949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9246c-0710-4b2d-be99-e960fa818bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.719949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9246c-0710-4b2d-be99-e960fa818bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.723808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9246c-0710-4b2d-be99-e960fa818bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:06.736409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9246c-0710-4b2d-be99-e960fa818bfa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:06.764605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3233/6415] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:06.769910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:06.785883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143521b1-202a-4f48-97c4-7eec5d9ae57b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:06.815136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:06.816179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.816688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.817190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] PATH_INFO: `/v3/projects/ee0f1992a7864483a1410de315caf818/users/590922ef74ee44e18b683d42441f3282/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.843935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0f1992a7864483a1410de315caf818, user_id=590922ef74ee44e18b683d42441f3282, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:06.847982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:06.890820 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3183/6416] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:06 2022] PUT /identity/v3/projects/ee0f1992a7864483a1410de315caf818/users/590922ef74ee44e18b683d42441f3282/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:06.898525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:06.898525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:06.898525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:06.955445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] MFA Rules not processed for user `590922ef74ee44e18b683d42441f3282`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:06.957923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:07.215909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:07.216163 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3234/6417] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:07.271516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:07.455883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9163-e43c-4843-ac78-db3570db2875 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:07.471997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:07.472725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:07.473166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:07.473641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:07.474515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:07.476791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:07.591092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3184/6418] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:07 2022] POST /identity/v3/projects => generated 365 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:07.596778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:07.604758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:07.630840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f9e7-6db3-40f2-83a6-c220d8df7faa None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:07.773009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:07.773857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:07.776447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:07.777511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:07.779531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:07.786526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:07.844857 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3235/6419] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:07 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:07.848872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:07.870892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a314535-7b47-427a-b4b0-20eaf03168a7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:07.890810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:07.899544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:07.901116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:07.903087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:07.904486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:07.907446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:07.953139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:07.973078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3185/6420] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:07.985051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589cad-9d14-42a2-8225-d1887f969a69 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:08.025379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:08.027254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:08.027525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:08.027838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] PATH_INFO: `/v3/projects/4c5ee7bf8f124969b7402f75d87c87ba/users/a781ee951f8b452f89b95a7dbb064f43/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:08.097167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5ee7bf8f124969b7402f75d87c87ba, user_id=a781ee951f8b452f89b95a7dbb064f43, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:08.100027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:08.152131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:08.152485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3236/6421] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:07 2022] PUT /identity/v3/projects/4c5ee7bf8f124969b7402f75d87c87ba/users/a781ee951f8b452f89b95a7dbb064f43/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:08.180920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102bdd7-a425-4cb8-9d6b-b06780e18765 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:08.355582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb6b8-a1e4-4b2d-b0c1-d80b6b08f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:08.356250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb6b8-a1e4-4b2d-b0c1-d80b6b08f263 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:08.356535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb6b8-a1e4-4b2d-b0c1-d80b6b08f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:08.356838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb6b8-a1e4-4b2d-b0c1-d80b6b08f263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:08.358094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb6b8-a1e4-4b2d-b0c1-d80b6b08f263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:08.359302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb6b8-a1e4-4b2d-b0c1-d80b6b08f263 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:08.415130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:08.415620 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3186/6422] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:08.431223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addee4ee-54cb-4373-a40b-b4e048732b8d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:08.448781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:08.449482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:08.449767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:08.450188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] PATH_INFO: `/v3/projects/4c5ee7bf8f124969b7402f75d87c87ba/users/a781ee951f8b452f89b95a7dbb064f43/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:08.456541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5ee7bf8f124969b7402f75d87c87ba, user_id=a781ee951f8b452f89b95a7dbb064f43, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:08.470490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:08.525476 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3237/6423] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:08 2022] PUT /identity/v3/projects/4c5ee7bf8f124969b7402f75d87c87ba/users/a781ee951f8b452f89b95a7dbb064f43/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:08.536639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:08.536941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:08.537221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:08.660222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] MFA Rules not processed for user `a781ee951f8b452f89b95a7dbb064f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:08.661463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:08.919609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:08.945560 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3187/6424] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:08.949075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028191ae-1b2c-4811-b696-c8f266d0fc5b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:08.956645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:08.957566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:08.958258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:08.958742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:08.959766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:08.962250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.010441 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3238/6425] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:08 2022] POST /identity/v3/roles => generated 234 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:09.010649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:09.028824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbc28-9906-4518-8614-6542211577c3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:09.044300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:09.045103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:09.045439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:09.045738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:09.046621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:09.048681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.093549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:09.111684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:09.118130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3188/6426] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:09 2022] POST /identity/v3/roles => generated 233 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:09.144021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f19b69-283a-424c-bb74-a97f439a9b6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:09.161772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:09.164148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:09.165011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:09.166540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:09.177158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:09.183196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.241313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:09.246583 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3239/6427] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:09 2022] POST /identity/v3/roles => generated 235 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:09.257430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9d68-6dab-480a-a81f-51a791ff1f58 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:09.273786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:09.274771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:09.275250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:09.275743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:09.276635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:09.280759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.326246 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3189/6428] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:43:09 2022] POST /identity/v3/domains => generated 276 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:09.335228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:09.371249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64eb86-a386-4a4b-80f6-01b2a706ee0c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:09.556029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:09.557392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:09.557586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:09.558599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:09.560327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:09.563324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.648371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3240/6429] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:09 2022] POST /identity/v3/projects => generated 400 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:09.650361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:09.666087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39641-ef46-4894-85d0-45d114eeb487 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:09.880682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:09.881559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:09.882004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:09.883489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:09.884338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:09.901076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.929111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3190/6430] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:43:09 2022] POST /identity/v3/groups => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:09.933657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:09.970646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b621a4-7870-4a6e-8d60-fe20f6809a3a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:09.970646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:09.970646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:09.971440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:09.971855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:09.972874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:09.975345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:09.979198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:10.028174 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3241/6431] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:09 2022] POST /identity/v3/roles => generated 234 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:10.029280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:10.045569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f4aac-e546-4463-9894-bed72f5a0b20 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:10.056731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:10.057371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:10.057658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:10.057939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:10.059073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:10.060581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:10.119013 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3191/6432] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:10 2022] POST /identity/v3/users => generated 439 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:10.123188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:10.148892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed878d5-773e-4ea5-ba46-e20133065e03 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:10.163501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:10.164144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:10.164505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:10.168041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:10.169368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:10.173157 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:10.173157 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:10.173157 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:10.179074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:10.223292 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3242/6433] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:10 2022] POST /identity/v3/roles => generated 269 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:10.225345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:10.241207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89b78b-ca06-4aa4-9d6c-2c106c158b1e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:10.254885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:10.255809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:10.257963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:10.259094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/f2612fb425e547b5beb295fb55f26f5b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:10.304418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=f2612fb425e547b5beb295fb55f26f5b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:10.308766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:10.358898 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3192/6434] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:10 2022] PUT /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/f2612fb425e547b5beb295fb55f26f5b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:10.364416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:10.390897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d19fce-a231-4e2a-9b91-740a94002912 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:10.575809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:10.576634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:10.576989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:10.577371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:10.578499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Adding query filter params (scope.project.id=8ca1a60a80ac4aa9a5a615277154773a, user.id=16fe5181b20d49de82e4c4e7ec1a9d7b) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:10.578999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:10.581894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:10.771925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:10.774284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3243/6435] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:43:10 2022] GET /identity/v3/role_assignments?scope.project.id=8ca1a60a80ac4aa9a5a615277154773a&user.id=16fe5181b20d49de82e4c4e7ec1a9d7b&effective => generated 228 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:10.788095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12ec72-a5c9-4188-a056-962ba3cc5991 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:10.801051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:10.802024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:10.805167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:10.805630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/f2612fb425e547b5beb295fb55f26f5b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:10.812325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=f2612fb425e547b5beb295fb55f26f5b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:10.815970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:10.833849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role f2612fb425e547b5beb295fb55f26f5b was removed from user 16fe5181b20d49de82e4c4e7ec1a9d7b on project 8ca1a60a80ac4aa9a5a615277154773a. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:10.834420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:10.835815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:10.877929 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3193/6436] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:43:10 2022] DELETE /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/f2612fb425e547b5beb295fb55f26f5b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:10.882960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:10.884916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:10.918264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e2e3-b221-46cb-8637-bbae10033917 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:11.097727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:11.098786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:11.099108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:11.099488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/f2612fb425e547b5beb295fb55f26f5b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:11.100806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f2612fb425e547b5beb295fb55f26f5b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:11.101892 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:11.101892 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:11.101892 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:11.102993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:11.161612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role f2612fb425e547b5beb295fb55f26f5b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:11.162415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:11.163259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:11.166318 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3244/6437] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:10 2022] DELETE /identity/v3/roles/f2612fb425e547b5beb295fb55f26f5b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:11.174966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:11.210547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232dba-70f8-4230-ac14-d7ca04515ec2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:11.439248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:11.440244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:11.440633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:11.441006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/3fd8cb80d662477e9dc91c9683fc3417` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:11.446113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=3fd8cb80d662477e9dc91c9683fc3417)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:11.454711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:11.552839 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3194/6438] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:11 2022] PUT /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/3fd8cb80d662477e9dc91c9683fc3417 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:11.554511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:11.556315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:11.592470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:11.609539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881951e-fd44-4828-83f9-e5bb3c294d46 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:11.788617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:11.789242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:11.789507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:11.789786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:11.793736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:11.794815 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:11.794815 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:11.794815 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:11.795880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:11.875800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3245/6439] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:11 2022] PUT /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 518 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:11.877720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:11.906951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e627677-ae13-47e9-8961-f3b6883deaf4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:11.964267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:12.089389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:12.090003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:12.090377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:12.090705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:12.091448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Adding query filter params (scope.project.id=8ca1a60a80ac4aa9a5a615277154773a, user.id=16fe5181b20d49de82e4c4e7ec1a9d7b) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:12.091765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:12.109235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:12.233576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3195/6440] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:43:11 2022] GET /identity/v3/role_assignments?scope.project.id=8ca1a60a80ac4aa9a5a615277154773a&user.id=16fe5181b20d49de82e4c4e7ec1a9d7b&effective => generated 1061 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:12.234959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:12.255261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdff6b-f2b7-4859-ae9b-b8f529e152af tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:12.270101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:12.283264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:12.284797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:12.285256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:12.289848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:12.295369 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:12.295369 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:12.295369 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:12.296445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:12.311072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3246/6441] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:12 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:12.315941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:12.328552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab4396-7227-4c36-aac5-1940ef8c4742 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:12.477394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:12.478199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:12.478628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:12.478915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:12.479652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Adding query filter params (scope.project.id=8ca1a60a80ac4aa9a5a615277154773a, user.id=16fe5181b20d49de82e4c4e7ec1a9d7b) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:12.479962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:12.482325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:12.635066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3196/6442] 10.222.0.23 () {58 vars in 1356 bytes} [Mon Oct 31 05:43:12 2022] GET /identity/v3/role_assignments?scope.project.id=8ca1a60a80ac4aa9a5a615277154773a&user.id=16fe5181b20d49de82e4c4e7ec1a9d7b&effective => generated 577 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:12.639991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:12.660085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55265-3a22-446f-bb7f-3c15e93a7e15 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:12.672120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:12.674299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:12.674587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:12.674867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:12.681410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:12.685449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517.: keystone.exception.ImpliedRoleNotFound: 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517. Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = query.one() Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:12.743405 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 31 05:43:12.745542 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 31 05:43:12.746894 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 31 05:43:12.746894 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 31 05:43:12.746894 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 31 05:43:12.746894 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517. Oct 31 05:43:12.746894 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:12.750298 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3247/6443] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:12 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 137 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:43:12.756297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:12.771420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17304631-dee5-4e89-a8fe-0dfe7c3e2987 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:12.777766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:12.778503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:12.778788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:12.779068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/3fd8cb80d662477e9dc91c9683fc3417` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:12.781524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=3fd8cb80d662477e9dc91c9683fc3417)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:12.785129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:12.792591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 3fd8cb80d662477e9dc91c9683fc3417 was removed from user 16fe5181b20d49de82e4c4e7ec1a9d7b on project 8ca1a60a80ac4aa9a5a615277154773a. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:12.792894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:12.793930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:12.835901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:12.836574 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3197/6444] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:43:12 2022] DELETE /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/3fd8cb80d662477e9dc91c9683fc3417 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:12.838428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:12.879936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90409db-f198-4fec-a5a8-cc44ff5b3631 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:12.979613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:12.980908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:12.982001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:12.982385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:12.983195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:12.984886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.032058 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3248/6445] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:12 2022] POST /identity/v3/roles => generated 272 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:13.041637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.056307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131fcb-bc63-42a7-a11c-18d7bbb6fd6e tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.069321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.073587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.075619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.076161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.078601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Adding query filter params (domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:13.079276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:13.081588 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:13.081588 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:13.081588 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:13.087532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.090555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:13.108783 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3198/6446] 10.222.0.23 () {58 vars in 1207 bytes} [Mon Oct 31 05:43:13 2022] GET /identity/v3/roles?domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d => generated 409 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:13.110080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.131456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894257da-74a4-40ca-a160-eb3846a436fa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.145472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.146363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.146660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.146947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/2213038b8d6c449a92ffdd10eabb3334` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.160735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2213038b8d6c449a92ffdd10eabb3334)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:13.163437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.224714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 2213038b8d6c449a92ffdd10eabb3334 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:13.225109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:13.226097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:13.230100 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3249/6447] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:13 2022] DELETE /identity/v3/roles/2213038b8d6c449a92ffdd10eabb3334 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:13.234516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.237915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:13.284221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604657-18e1-4b44-85d2-1e06c58a1749 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.494492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.495461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.496817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.497361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.499254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Adding query filter params (domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:13.500741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:13.506181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.524286 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3199/6448] 10.222.0.23 () {58 vars in 1207 bytes} [Mon Oct 31 05:43:13 2022] GET /identity/v3/roles?domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d => generated 148 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:13.528550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.544033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81a95-f7ef-4f3a-9b53-8d4ca255251a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.550520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.551835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.552313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.552761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/2213038b8d6c449a92ffdd10eabb3334` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.585659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Could not find role: 2213038b8d6c449a92ffdd10eabb3334.: keystone.exception.RoleNotFound: Could not find role: 2213038b8d6c449a92ffdd10eabb3334. Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 31 05:43:13.591145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:43:13.592579 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2213038b8d6c449a92ffdd10eabb3334. Oct 31 05:43:13.593851 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:13.604739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.605561 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3250/6449] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:13 2022] DELETE /identity/v3/roles/2213038b8d6c449a92ffdd10eabb3334 => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:43:13.640932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86642a13-2db4-46c0-bd34-db4fd57ef705 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.654970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.656000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.656360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.656725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.666032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:13.668972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.698342 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3200/6450] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:13 2022] PUT /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:13.702872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.719201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:13.723887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe861-ecba-4472-b5f5-c849ffe3b770 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.836283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.837355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.837802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.838252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.840426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, group_id=fec1af1139c24af3ad3a7d00ee435bf2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:13.841589 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:13.841589 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:13.841589 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:13.843834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.875563 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3251/6451] 10.222.0.23 () {58 vars in 1365 bytes} [Mon Oct 31 05:43:13 2022] GET /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles => generated 409 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:13.877312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.893629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0bda3-e779-4c21-9381-c6e99d479dbd tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.919145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.919853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.920138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.920571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:13.922811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:13.925529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:13.958466 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3201/6452] 10.222.0.23 () {58 vars in 1465 bytes} [Mon Oct 31 05:43:13 2022] HEAD /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:13.959711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:13.977951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9d7a-e828-4b4d-bca2-c87e3ca89004 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:13.995843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:13.996546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:13.996834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:13.997122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:14.007502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:14.011827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:14.036706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role e4333a0634d640e0937b9af89d50f80e was removed from group fec1af1139c24af3ad3a7d00ee435bf2 on domain 4ac7dcf5e7cc459eb74ddd029e24de7d. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:14.037792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:14.040244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:14.076518 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3252/6453] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:43:13 2022] DELETE /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:14.084602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:14.087254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:14.114501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021d08-dff0-4f3d-8641-334b6c9b03fb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:14.311621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:14.312480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:14.312848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:14.313239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:14.316484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:14.320861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:14.352054 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3202/6454] 10.222.0.23 () {60 vars in 1486 bytes} [Mon Oct 31 05:43:14 2022] PUT /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:14.356268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:14.377160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34372-fa9e-4cdd-86a7-a52a19e2e3b6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:14.603896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd374d8-4964-4693-8a4e-665e30969cb3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:14.605537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd374d8-4964-4693-8a4e-665e30969cb3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:14.606037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd374d8-4964-4693-8a4e-665e30969cb3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:14.606541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd374d8-4964-4693-8a4e-665e30969cb3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:14.612213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd374d8-4964-4693-8a4e-665e30969cb3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_grants(project_id=8ca1a60a80ac4aa9a5a615277154773a, group_id=fec1af1139c24af3ad3a7d00ee435bf2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:14.615850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd374d8-4964-4693-8a4e-665e30969cb3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:14.655224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:14.666159 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3253/6455] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:43:14 2022] GET /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles => generated 410 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:14.668902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24d45-cdd4-495e-902d-894a4156393d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:14.683877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:14.684990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:14.685356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:14.685704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/groups/fec1af1139c24af3ad3a7d00ee435bf2/users/16fe5181b20d49de82e4c4e7ec1a9d7b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:14.691624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:14.693762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:14.779503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:14.780258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:14.780823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:14.786613 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3203/6456] 10.222.0.23 () {60 vars in 1360 bytes} [Mon Oct 31 05:43:14 2022] PUT /identity/v3/groups/fec1af1139c24af3ad3a7d00ee435bf2/users/16fe5181b20d49de82e4c4e7ec1a9d7b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:14.867290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] MFA Rules not processed for user `16fe5181b20d49de82e4c4e7ec1a9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:14.868761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:14.969758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:15.029288 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3254/6457] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:14 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:15.033683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.153573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:15.184935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5ebb4-ae66-4092-a138-9a20d122996f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.191457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.192145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.192431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.192845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.195327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.198114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.206206 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3204/6458] 10.222.0.23 () {58 vars in 1468 bytes} [Mon Oct 31 05:43:15 2022] HEAD /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:15.210915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.222690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba8132-4007-47ed-9a0f-e1754d6cbabc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.227611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.228290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.228575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.229575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.231626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.234287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.241299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role e4333a0634d640e0937b9af89d50f80e was removed from group fec1af1139c24af3ad3a7d00ee435bf2 on project 8ca1a60a80ac4aa9a5a615277154773a. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:15.241633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:15.242642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:15.296541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3255/6459] 10.222.0.23 () {58 vars in 1470 bytes} [Mon Oct 31 05:43:15 2022] DELETE /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:15.301190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.303053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:15.330592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f74b8-c13e-47de-933b-1573be2ca5e0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.417898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.419209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.419600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.420267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/groups/fec1af1139c24af3ad3a7d00ee435bf2/users/16fe5181b20d49de82e4c4e7ec1a9d7b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.422166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.425039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.444407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '16fe5181b20d49de82e4c4e7ec1a9d7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:15.467540 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3205/6460] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:43:15 2022] DELETE /identity/v3/groups/fec1af1139c24af3ad3a7d00ee435bf2/users/16fe5181b20d49de82e4c4e7ec1a9d7b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:15.475378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.497100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9091b-143c-4728-9066-09a57472f3f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.599479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.600295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.600572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.600854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.602875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.603848 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:15.603848 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:15.603848 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:15.604750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.619313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3256/6461] 10.222.0.23 () {60 vars in 1381 bytes} [Mon Oct 31 05:43:15 2022] PUT /identity/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:15.620767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.636297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f22e40-0830-4c01-93cb-dd9ac4a9bda5 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.643808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.644781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.645244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.645730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.647272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.649050 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:15.649050 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:15.649050 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:15.650599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.668843 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3206/6462] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 31 05:43:15 2022] GET /identity/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles => generated 375 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:15.673708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.688203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010bc6-2cc2-4230-a47b-2a3cb1f62915 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.694356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.695088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.695451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.695855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.697813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.699050 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:15.699050 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:15.699050 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:15.700297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.712250 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3257/6463] 10.222.0.23 () {58 vars in 1363 bytes} [Mon Oct 31 05:43:15 2022] HEAD /identity/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:15.713143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.731950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bef90-2b75-4bfa-b2cb-0f78a429037a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.741783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.742868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.743348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.743692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.745643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.746773 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:15.746773 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:15.746773 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:15.748370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.767331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3207/6464] 10.222.0.23 () {58 vars in 1365 bytes} [Mon Oct 31 05:43:15 2022] DELETE /identity/v3/system/groups/fec1af1139c24af3ad3a7d00ee435bf2/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:15.772530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.788115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692cbd8-7f02-42e0-b286-03a057031052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:15.796013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:15.797005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:15.797448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:15.798453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:15.831291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:15.853934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:15.910947 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3258/6465] 10.222.0.23 () {60 vars in 1480 bytes} [Mon Oct 31 05:43:15 2022] PUT /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:15.915167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:15.927780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f4c3d-51f1-405c-9b0d-3a36508ea64d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.112602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.113463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.113772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.114037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.117030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.122203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.148604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.168071 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3208/6466] 10.222.0.23 () {58 vars in 1362 bytes} [Mon Oct 31 05:43:15 2022] GET /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles => generated 408 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:16.176340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7864d-8253-4363-b9aa-fe8d9b65b571 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.186274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.186983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.187279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.187618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.192219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.197587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.206639 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3259/6467] 10.222.0.23 () {58 vars in 1462 bytes} [Mon Oct 31 05:43:16 2022] HEAD /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:16.212965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.233988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804319-7c6c-41e8-8e32-c86276fcd461 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.241653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.243243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.243547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.243973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.246517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.252632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.259474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role e4333a0634d640e0937b9af89d50f80e was removed from user 16fe5181b20d49de82e4c4e7ec1a9d7b on domain 4ac7dcf5e7cc459eb74ddd029e24de7d. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:16.259683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:16.260331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:16.296166 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3209/6468] 10.222.0.23 () {58 vars in 1464 bytes} [Mon Oct 31 05:43:16 2022] DELETE /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:16.306354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.309180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:16.340849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58fa3-e61d-41f6-aa97-7c077798a8f8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.426029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.426783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.427069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.427352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.429672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.432485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.456307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.456865 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3260/6469] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:16 2022] PUT /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:16.473841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39818c1c-146c-4433-8a52-18cffd612583 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.497403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:16.596644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.597892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.598453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.598974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.601045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_grants(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.603945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.623579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.625978 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3210/6470] 10.222.0.23 () {58 vars in 1365 bytes} [Mon Oct 31 05:43:16 2022] GET /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles => generated 409 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:16.635381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918efb-1279-4809-9616-dadbcf6e7a72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.640530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.641299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.643005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.643533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.646816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.650168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.658423 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3261/6471] 10.222.0.23 () {58 vars in 1465 bytes} [Mon Oct 31 05:43:16 2022] HEAD /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:16.662938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.676601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cccc0e-7335-4fb7-b3d4-57c874105296 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.682411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.683434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.683945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.684598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.687312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8ca1a60a80ac4aa9a5a615277154773a, user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.690448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.696803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role e4333a0634d640e0937b9af89d50f80e was removed from user 16fe5181b20d49de82e4c4e7ec1a9d7b on project 8ca1a60a80ac4aa9a5a615277154773a. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:16.697400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:16.698374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:16.717483 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3211/6472] 10.222.0.23 () {58 vars in 1467 bytes} [Mon Oct 31 05:43:16 2022] DELETE /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:16.723415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.725336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:16.733879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:16.741830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51efa45-f908-4b37-ac45-599f90fce3de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.835975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.836835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.837227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.837651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.839995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.841241 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:16.841241 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:16.841241 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:16.842492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.862357 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3262/6473] 10.222.0.23 () {60 vars in 1378 bytes} [Mon Oct 31 05:43:16 2022] PUT /identity/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:16.862957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.881199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f07d9f-7a4d-4b3b-8ef0-65e95c07736f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.886520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.887194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.887485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.887763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.889457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=16fe5181b20d49de82e4c4e7ec1a9d7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.890756 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:16.890756 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:16.890756 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:16.892051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.913685 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3212/6474] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 31 05:43:16 2022] GET /identity/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:16.915247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.926788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f045f-eed2-4d8c-85a3-b90fc026cb0b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.932703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.933613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.934062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.934771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.936638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.937819 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:16.937819 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:16.937819 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:16.940249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:16.946352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3263/6475] 10.222.0.23 () {58 vars in 1360 bytes} [Mon Oct 31 05:43:16 2022] HEAD /identity/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:16.951165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:16.966954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97a13b-070c-4b22-bb58-db2eb5f6bda7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:16.974849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:16.975683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:16.976072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:16.976458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:16.978560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=16fe5181b20d49de82e4c4e7ec1a9d7b, role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:16.980063 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:16.980063 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:16.980063 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:16.981519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.003289 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3213/6476] 10.222.0.23 () {58 vars in 1362 bytes} [Mon Oct 31 05:43:16 2022] DELETE /identity/v3/system/users/16fe5181b20d49de82e4c4e7ec1a9d7b/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:17.008935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.024275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b064ed-5756-4aaf-b376-97c3c0d75f81 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.031583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.034114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.034675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.036043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.037438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.039672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.067563 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3264/6477] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:17 2022] POST /identity/v3/roles => generated 270 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.072314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.092949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23675f1f-eed2-41e1-8c0a-ca13bcfc15a9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.127861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.128513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.128801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.129079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.130021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.131127 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:17.131127 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:17.131127 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:17.132347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.156626 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3214/6478] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:17 2022] POST /identity/v3/roles => generated 269 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.159145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.173596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d49f9f-a933-47a1-abe8-72e6676c4261 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.190516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.191426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.191527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.191738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/41bbfd5567494048804b5aa8716a8054` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.193765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=747d68cf7c0f4dcc834173d25c4ffafe, implied_role_id=41bbfd5567494048804b5aa8716a8054)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.198827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.273117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3265/6479] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:17 2022] PUT /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/41bbfd5567494048804b5aa8716a8054 => generated 530 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.274586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.299872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7dfb-5261-41fc-a62a-396933b02d90 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.388731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.390873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.391391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.392800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.393694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.397334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.440507 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3215/6480] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:43:17 2022] POST /identity/v3/domains => generated 277 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.444633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.464991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bd149-f6ae-4d40-b7e2-619886434c6f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.577806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.579510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.580733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.581593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.582663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.584912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.619960 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3266/6481] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:17 2022] POST /identity/v3/roles => generated 270 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.624240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.642352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1749e-2adf-4b04-8fef-c13f9904fc9a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.654759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.655464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.655730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.656010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/96c41b5f84c5446b86e6453f8a240f17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.663013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=747d68cf7c0f4dcc834173d25c4ffafe, implied_role_id=96c41b5f84c5446b86e6453f8a240f17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.665963 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:17.665963 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:17.665963 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:17.666922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.731679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3216/6482] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:17 2022] PUT /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/96c41b5f84c5446b86e6453f8a240f17 => generated 531 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.735643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.752234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e79ed-e519-4479-b76e-0005d3f5a9f1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.822559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:17.841489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.842413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.842847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.843256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.846870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=747d68cf7c0f4dcc834173d25c4ffafe, implied_role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.848682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:17.894815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3267/6483] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:17 2022] PUT /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/e4333a0634d640e0937b9af89d50f80e => generated 525 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:17.895553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:17.908062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0aed5-0296-4660-b7e8-5e3116505ede tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:17.927320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:17.983731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:17.984421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:17.984713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:17.984991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/e4333a0634d640e0937b9af89d50f80e/implies/747d68cf7c0f4dcc834173d25c4ffafe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:17.987240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e4333a0634d640e0937b9af89d50f80e, implied_role_id=747d68cf7c0f4dcc834173d25c4ffafe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:17.989794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] 747d68cf7c0f4dcc834173d25c4ffafe cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 747d68cf7c0f4dcc834173d25c4ffafe cannot be an implied roles. Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 31 05:43:18.018411 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 31 05:43:18.019811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:43:18.019811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:43:18.019811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 31 05:43:18.019811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 31 05:43:18.019811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 747d68cf7c0f4dcc834173d25c4ffafe cannot be an implied roles. Oct 31 05:43:18.019811 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:43:18.020373 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3217/6484] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:17 2022] PUT /identity/v3/roles/e4333a0634d640e0937b9af89d50f80e/implies/747d68cf7c0f4dcc834173d25c4ffafe => generated 116 bytes in 125 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 31 05:43:18.024159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:18.041658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e296-9ffa-4ce1-9a98-4b78d1d93196 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:18.047298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:18.048869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:18.049217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:18.049530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:18.051566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=747d68cf7c0f4dcc834173d25c4ffafe, implied_role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:18.053375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:18.073121 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3268/6485] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:18 2022] DELETE /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:18.074856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:18.088509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3101-3bab-4596-b523-fe9af52b61bf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:18.188675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:18.189987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:18.190389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:18.190679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/96c41b5f84c5446b86e6453f8a240f17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:18.192753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=747d68cf7c0f4dcc834173d25c4ffafe, implied_role_id=96c41b5f84c5446b86e6453f8a240f17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:18.193915 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:18.193915 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:18.193915 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:18.195469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:18.225627 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3218/6486] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:18 2022] DELETE /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/96c41b5f84c5446b86e6453f8a240f17 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:18.226985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:18.245736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eed0f3-3e70-436e-8069-00d50add332a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:18.310406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:18.312311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:18.350923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:18.351601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:18.351891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:18.352186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/96c41b5f84c5446b86e6453f8a240f17` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:18.354029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=96c41b5f84c5446b86e6453f8a240f17)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:18.355887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:18.430292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 96c41b5f84c5446b86e6453f8a240f17 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:18.430592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.432929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.438729 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3269/6487] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:18 2022] DELETE /identity/v3/roles/96c41b5f84c5446b86e6453f8a240f17 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:18.439850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:18.441328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:18.484056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0194-5d2f-43e8-ae9c-4ff972a798c1 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:18.567188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:18.580165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:18.580954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:18.581341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:18.581738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] PATH_INFO: `/v3/users/babe2e2c31884aedb58092cd832a2bc1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:18.585325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babe2e2c31884aedb58092cd832a2bc1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:18.588871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:18.600876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5965-2d8b-4dc2-a9ca-5e57f044fc92 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:18.608522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:18.609192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:18.609480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:18.609779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/055396a4223e4420aa2c895386e75ba3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:18.662521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=055396a4223e4420aa2c895386e75ba3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:18.664671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:18.703387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:18.723963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babe2e2c31884aedb58092cd832a2bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.731333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '055396a4223e4420aa2c895386e75ba3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.740083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babe2e2c31884aedb58092cd832a2bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.740870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babe2e2c31884aedb58092cd832a2bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.741580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babe2e2c31884aedb58092cd832a2bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.750817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '055396a4223e4420aa2c895386e75ba3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.755227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dfdfaa87-5681-4938-bdd9-4b1389180776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babe2e2c31884aedb58092cd832a2bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.806841 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3219/6488] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:18 2022] DELETE /identity/v3/users/babe2e2c31884aedb58092cd832a2bc1 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:18.808442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:18.808690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:18.808973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:18.825224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '055396a4223e4420aa2c895386e75ba3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.825224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '055396a4223e4420aa2c895386e75ba3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:18.830362 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3270/6489] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:43:18 2022] PATCH /identity/v3/domains/055396a4223e4420aa2c895386e75ba3 => generated 278 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:18.840860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:18.842889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:18.864247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:18.865780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:18.933925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b500-f020-4b0c-8d02-6bf87269fdb4 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:18.994251 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3220/6490] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:19.002771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:19.004319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:19.031552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:19.032342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.032641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.032918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/055396a4223e4420aa2c895386e75ba3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.044920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=055396a4223e4420aa2c895386e75ba3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:19.046960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:19.073626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '055396a4223e4420aa2c895386e75ba3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.076778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d9c2-4a94-4452-bfbe-59af55df166d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:19.077441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '055396a4223e4420aa2c895386e75ba3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.081657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:19.083453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.083991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.084488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.095809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:19.097784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:19.108674 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3221/6491] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:19.142727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055396a4223e4420aa2c895386e75ba3', 'request_id': 'req-8aee7ac0-0714-43e8-9744-5c1d03733d18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.149996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055396a4223e4420aa2c895386e75ba3', 'request_id': 'req-8aee7ac0-0714-43e8-9744-5c1d03733d18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.151602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:19.159162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055396a4223e4420aa2c895386e75ba3', 'request_id': 'req-8aee7ac0-0714-43e8-9744-5c1d03733d18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.197145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] The token cache is being invalidate because project 055396a4223e4420aa2c895386e75ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:19.197843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.200100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.211387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '055396a4223e4420aa2c895386e75ba3', 'request_id': 'req-8aee7ac0-0714-43e8-9744-5c1d03733d18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.215570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '055396a4223e4420aa2c895386e75ba3', 'request_id': 'req-8aee7ac0-0714-43e8-9744-5c1d03733d18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.216567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '055396a4223e4420aa2c895386e75ba3', 'request_id': 'req-8aee7ac0-0714-43e8-9744-5c1d03733d18'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.224798 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3271/6492] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:43:18 2022] DELETE /identity/v3/domains/055396a4223e4420aa2c895386e75ba3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:19.229119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:19.240388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1639-e3e3-4eb3-856e-06ec58e55a2a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:19.259866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:19.337587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:19.339445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:19.364274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:19.365202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.365638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.365971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/41bbfd5567494048804b5aa8716a8054` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.368170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=747d68cf7c0f4dcc834173d25c4ffafe, implied_role_id=41bbfd5567494048804b5aa8716a8054)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:19.371763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:19.387117 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3222/6493] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:19 2022] DELETE /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe/implies/41bbfd5567494048804b5aa8716a8054 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:19.392818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:19.395478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:19.464494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7ac0-0714-43e8-9744-5c1d03733d18 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:19.479381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b07e77-548c-407d-8aa4-bcb90c3f2cdf tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:19.486101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:19.486976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.487414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.487765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/41bbfd5567494048804b5aa8716a8054` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.489463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=41bbfd5567494048804b5aa8716a8054)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:19.490165 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:19.490165 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:19.490165 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:19.491360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:19.559475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 41bbfd5567494048804b5aa8716a8054 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:19.560100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.561457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.565443 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3223/6494] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:19 2022] DELETE /identity/v3/roles/41bbfd5567494048804b5aa8716a8054 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:19.571597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:19.574501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:19.601642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:19.602627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.603759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.604293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] PATH_INFO: `/v3/projects/cf075627d80b427c8966491bed06ba1b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.607525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf075627d80b427c8966491bed06ba1b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:19.613326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:19.727031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf075627d80b427c8966491bed06ba1b', 'request_id': 'req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.736991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37032-a9dd-4a82-badb-ec9d475365de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:19.738625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf075627d80b427c8966491bed06ba1b', 'request_id': 'req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.756278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf075627d80b427c8966491bed06ba1b', 'request_id': 'req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.781178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:19.782359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:19.789037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] The token cache is being invalidate because project cf075627d80b427c8966491bed06ba1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:19.789037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.790874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-930e6b31-d3d9-4474-9bb3-e985d16d1a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.796553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3272/6495] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:19 2022] DELETE /identity/v3/projects/cf075627d80b427c8966491bed06ba1b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:19.800707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0bfac-3dfa-4432-8874-fba7ae160a2e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.802793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0bfac-3dfa-4432-8874-fba7ae160a2e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.803214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0bfac-3dfa-4432-8874-fba7ae160a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.840560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9be0bfac-3dfa-4432-8874-fba7ae160a2e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:19.843365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9be0bfac-3dfa-4432-8874-fba7ae160a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:19.872014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:19.873597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.874853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.875196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:19.880314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=747d68cf7c0f4dcc834173d25c4ffafe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:19.883692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:19.946588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 747d68cf7c0f4dcc834173d25c4ffafe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:19.947075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.948078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:19.953574 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3224/6496] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:19 2022] DELETE /identity/v3/roles/747d68cf7c0f4dcc834173d25c4ffafe => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:19.959965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:19.963332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:19.975491 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3273/6497] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:19.983208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:19.984030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:19.984494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.020197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:20.021408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:20.126864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f327f2-270f-4d4c-978d-93f882e1d4c3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.137643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.138349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.138637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.139045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.144090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.145713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.161154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3274/6498] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:20.162352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.181233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9928a-4c8d-4449-8037-12db31a55ac8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.187641 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3225/6499] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:19 2022] PUT /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 518 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:20.192308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.325086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea844ae-19d9-49b9-b1b5-0414be25a041 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.328197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.328733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.330333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.330641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.331326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:20.331632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.334637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.342082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.342820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.343263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.343554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.345434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.347001 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:20.347001 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:20.347001 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:20.347923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.348872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.349735 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:20.349735 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:20.349735 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:20.350625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.366066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3226/6500] 10.222.0.23 () {58 vars in 1345 bytes} [Mon Oct 31 05:43:20 2022] HEAD /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:20.367713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.385224 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3275/6501] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:20.385660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.389502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0a63a-fd9d-481e-9a87-5d42be93b40c tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.396491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.397189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.397639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.397929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.399689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.400130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82149e3a-ac0c-4dfa-8c3f-dea8e4ed1f4f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.401421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.404298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:20.405866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.406704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.406994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.408731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.409542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.411499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.413650 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3227/6502] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:43:20 2022] GET /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 518 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:20.414984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.417600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:20.456648 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3276/6503] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:20 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:20.456648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.474175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:20.512057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc93f-5f76-455f-b34a-0b19693a3071 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.551940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d2aa-620b-4187-9b31-0cfcf9f21d34 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.565037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.565647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.565936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.566254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.567967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.570275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.584541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3277/6504] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:20 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:20.589407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.616356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.617366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.617889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.618890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.621696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:20.668149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aefc2-8499-43d7-af97-aae891c882de tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.674075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.674819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.675104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.675389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.676038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.678137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.707533 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3278/6505] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:20 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:20.708443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.718498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.720814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.729869 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3228/6506] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:43:20.730844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.786777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:20.810257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc2f1-1edb-4e37-b7ec-c7385ff9c25b service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.816131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.816850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.817208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.817559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.818345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.820132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.840707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb6a76-70f4-491a-ac65-14380a3341a9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.842700 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3229/6507] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:20 2022] GET /identity/v3/roles => generated 2320 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:20.844120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.852860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.854385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.854747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.855765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.858134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45ca6-2244-4157-979a-8403fb87b9a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.862929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.863558 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:20.863558 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:20.863558 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:20.863881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.864564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.865393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.865393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.866999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.867120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.867644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.882684 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3230/6508] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:20 2022] GET /identity/v3/roles => generated 2320 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:20.886928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.896157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8ca8-0217-4095-b61c-82ba73bdce81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517.: keystone.exception.ImpliedRoleNotFound: 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517. Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = query.one() Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:20.896397 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 31 05:43:20.897766 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 31 05:43:20.899043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 31 05:43:20.899043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517. Oct 31 05:43:20.899043 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:20.903781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3279/6509] 10.222.0.23 () {58 vars in 1344 bytes} [Mon Oct 31 05:43:20 2022] GET /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 137 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:43:20.904373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0ea8c-3d40-468a-b135-57bd4154480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.905065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0ea8c-3d40-468a-b135-57bd4154480b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.905626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0ea8c-3d40-468a-b135-57bd4154480b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.905979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0ea8c-3d40-468a-b135-57bd4154480b admin admin] PATH_INFO: `/v3/projects/c5044cc484234410aa090b9f0d81052a/users/46d52fbd16474f6397a5c3f3ee4e11e1/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.906857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.928597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba02494-d31f-4c5a-917d-01e14856cb13 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:20.939193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:20.940110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:20.940593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:20.942182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:20.944309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.946964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.957221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0ea8c-3d40-468a-b135-57bd4154480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5044cc484234410aa090b9f0d81052a, user_id=46d52fbd16474f6397a5c3f3ee4e11e1, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:20.960756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0ea8c-3d40-468a-b135-57bd4154480b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517.: keystone.exception.ImpliedRoleNotFound: 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517. Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = query.one() Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:20.965999 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 31 05:43:20.967338 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 31 05:43:20.968549 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 31 05:43:20.968549 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 31 05:43:20.968549 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 31 05:43:20.968549 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 3fd8cb80d662477e9dc91c9683fc3417 does not imply 67a2493708aa422e8a06412afc7bb517. Oct 31 05:43:20.968549 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:20.976247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3280/6510] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:20 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 137 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:43:20.983008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:20.998680 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3231/6511] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:20 2022] PUT /identity/v3/projects/c5044cc484234410aa090b9f0d81052a/users/46d52fbd16474f6397a5c3f3ee4e11e1/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:21.013019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.013293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.013679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.023411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ead19-b416-4228-8e43-3b628b5dea71 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:21.060471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] MFA Rules not processed for user `46d52fbd16474f6397a5c3f3ee4e11e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:21.061973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:21.067129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:21.137675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:21.138929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.139438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.139932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.142739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:21.144744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:21.187901 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3281/6512] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:20 2022] PUT /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 518 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:21.192885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:21.210314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3232/6513] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:21.223884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:21.225701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:21.330677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c9ff-c2f6-4199-a582-47d419c00f6e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:21.383448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efacbfa-e623-442a-9f6c-d90776b11dcb tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:21.397252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:21.398203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.398678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.399110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.403006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=6905d0f95e9e434296cd22912afd817e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:21.405049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:21.406705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:21.407656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.410439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.410824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.421199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:21.519130 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3282/6514] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:21 2022] PUT /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e => generated 520 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:21.520394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:21.539269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:21.545744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:21.595734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3233/6515] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:43:21.637330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:21.767590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71132bf-ac9d-4baf-829e-c7c3756f1cc2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:21.774706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:21.776496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.777035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.777558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.779514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6905d0f95e9e434296cd22912afd817e, implied_role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:21.783057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:21.828654 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3283/6516] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:21 2022] PUT /identity/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e => generated 520 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:21.833312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:21.842089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf5b37-9189-4391-bfc5-4c2ec3968a13 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:21.865701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:21.926256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:21.927321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.927766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.928392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] PATH_INFO: `/v3/users/46d52fbd16474f6397a5c3f3ee4e11e1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.929808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d52fbd16474f6397a5c3f3ee4e11e1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:21.932485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:21.963760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7210b-987d-4357-ac21-1acf7a656f72 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:21.968649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:21.969402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:21.969853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:21.970262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:21.971095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:21.972429 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:21.972429 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:21.972429 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:21.973849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.037294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3284/6517] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 31 05:43:21 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:22.040343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.047022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d52fbd16474f6397a5c3f3ee4e11e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:22.066660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d52fbd16474f6397a5c3f3ee4e11e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:22.067723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d52fbd16474f6397a5c3f3ee4e11e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:22.068401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d52fbd16474f6397a5c3f3ee4e11e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:22.069913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:22.079034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a30828-ca3a-40f9-9885-c567f4b7823a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.086233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ad8a467-5b3f-40c7-ae3d-b7691ea251a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d52fbd16474f6397a5c3f3ee4e11e1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:22.091384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.092527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.093008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.094098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.098401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6905d0f95e9e434296cd22912afd817e, implied_role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.101124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.119951 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3285/6518] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:22 2022] DELETE /identity/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:22.121025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.128655 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3234/6519] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:21 2022] DELETE /identity/v3/users/46d52fbd16474f6397a5c3f3ee4e11e1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:22.128836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:22.130452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.130840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.131130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.160367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:22.161678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:22.249694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26be623-0401-4b62-b2b2-49c8d18457d8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.304573 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3235/6520] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:22.316236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.318685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:22.345962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.347179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.347481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.347772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.350012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=6905d0f95e9e434296cd22912afd817e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.352310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.365033 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3286/6521] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:22 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:22.372968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.453254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:22.500786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ee1c-6eca-4525-8905-6596809ad3f3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.512680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.513635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.514105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.514611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.516585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.518449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.537333 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3287/6522] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:22 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:22.542922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.589950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d80b-41b5-482e-aee7-2b5ee1848f6e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.624815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cb774-77e4-442d-aff7-20bb3c143e85 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.634190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.634849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.635140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.635522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.636490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.638365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.652526 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3288/6523] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:22 2022] GET /identity/v3/roles => generated 2320 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:22.661392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.663385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.664375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.664760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.665136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.691462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38ace-b145-426f-bf1e-10835234049b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.699014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.700103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.700603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.701094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.701975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.703847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.725880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:22.726996 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3289/6524] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:43:22 2022] POST /identity/v3/roles => generated 235 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:22.734540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.755562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d6b0-e8cc-45ce-94f4-067f92bc43c9 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.763728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.764614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.764907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.765220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/858bf9e3de86405a95916c730e751312` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.768444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:update_role(role_id=858bf9e3de86405a95916c730e751312)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.770363 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:22.770363 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:22.770363 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:22.771175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.772118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.774258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.801806 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3236/6525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:22.816245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3290/6526] 10.222.0.23 () {60 vars in 1243 bytes} [Mon Oct 31 05:43:22 2022] PATCH /identity/v3/roles/858bf9e3de86405a95916c730e751312 => generated 236 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:22.817475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.832068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2f128-0201-47b0-9639-1176e7b7c35a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.837527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.842733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.843272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.844028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/858bf9e3de86405a95916c730e751312` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.857860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:get_role(role_id=858bf9e3de86405a95916c730e751312)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.859273 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:22.859273 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:22.859273 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:22.861259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.863519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3237/6527] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:43:22 2022] GET /identity/v3/roles/858bf9e3de86405a95916c730e751312 => generated 236 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:22.867390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.888091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829eb19-c0ed-4b8c-8ce5-80ce64622fe7 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.897316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.899733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.900237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.900734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.906347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.906347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:22.921873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3291/6528] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:22 2022] GET /identity/v3/roles => generated 2547 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:22.923758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:22.943072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f7e8-1194-48d5-b68b-6a7bf71b7303 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:22.948605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:22.949297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:22.949663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:22.950019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/858bf9e3de86405a95916c730e751312` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:22.951721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_role(role_id=858bf9e3de86405a95916c730e751312)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:22.954663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:23.017283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 858bf9e3de86405a95916c730e751312 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:23.018003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:23.019250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:23.021615 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3238/6529] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:22 2022] DELETE /identity/v3/roles/858bf9e3de86405a95916c730e751312 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:23.026939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:23.029490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:23.048468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46395b95-0b4b-40d3-9ae8-533b514886a8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:23.164918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:23.165739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:23.166120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:23.166803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:23.168756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:23.171596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:23.242515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:23.273556 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3292/6530] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:23 2022] PUT /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 518 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:23.278086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:23.307956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462cb58-0f3a-46af-adc3-db8d2caa64d2 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:23.417602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:23.418421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:23.418714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:23.419002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:23.420735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=6905d0f95e9e434296cd22912afd817e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:23.422390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:23.473029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:23.488305 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3239/6531] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:23 2022] PUT /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e => generated 520 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:23.493643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2494e-796d-4067-a90d-643381c6bdcc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:23.659928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:23.660691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:23.661084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:23.661371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:23.668867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6905d0f95e9e434296cd22912afd817e, implied_role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:23.670927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:23.729229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3293/6532] 10.222.0.23 () {60 vars in 1363 bytes} [Mon Oct 31 05:43:23 2022] PUT /identity/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e => generated 520 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:23.731474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:23.753801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ef4fd-cd6b-4530-af2d-5ef9b8d7250a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:23.882743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:23.883776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:23.884290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:23.884732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/6905d0f95e9e434296cd22912afd817e/implies` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:23.886027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=6905d0f95e9e434296cd22912afd817e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:23.887278 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:23.887278 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:43:23.887278 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:43:23.888817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:23.901248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:23.909945 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3240/6533] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 31 05:43:23 2022] GET /identity/v3/roles/6905d0f95e9e434296cd22912afd817e/implies => generated 489 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:23.917440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5101fd-47c2-4780-a872-ebee0a691e05 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:23.923458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:23.924693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:23.925148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:23.925592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:23.926949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:23.928224 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:43:23.928224 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:43:23.928224 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:43:23.929628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:23.942005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:23.948724 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3294/6534] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 31 05:43:23 2022] GET /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies => generated 658 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:23.950508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:23.958906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10931d-65ea-4127-8031-76acdd568acc tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:23.972152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:23.973197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:23.973682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:23.974126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:23.978374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6905d0f95e9e434296cd22912afd817e, implied_role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:23.980186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:24.004350 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3241/6535] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:23 2022] DELETE /identity/v3/roles/6905d0f95e9e434296cd22912afd817e/implies/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:24.008826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:24.023266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57f052-688b-4154-b538-30ff91a400d3 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:24.109405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:24.113771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:24.206397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:24.207146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.207382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.207677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.215207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=6905d0f95e9e434296cd22912afd817e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:24.216789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:24.248111 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3295/6536] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:24 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/6905d0f95e9e434296cd22912afd817e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:24.252130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:24.296054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0ee0-d5fb-46a2-a480-1a54c10e111f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:24.382504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e98e-56eb-4637-8f86-df7655e6907b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:24.399416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:24.400134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.400423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.400703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.403463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3fd8cb80d662477e9dc91c9683fc3417, implied_role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:24.405111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:24.428357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:24.430327 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3296/6537] 10.222.0.23 () {58 vars in 1347 bytes} [Mon Oct 31 05:43:24 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417/implies/67a2493708aa422e8a06412afc7bb517 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:24.431593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.432133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.433167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] PATH_INFO: `/v3/projects/c5044cc484234410aa090b9f0d81052a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.435631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:24.436855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5044cc484234410aa090b9f0d81052a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:24.443111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:24.444492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:24.582976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997027b-5bee-45c6-9938-13529357644f tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:24.604216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5044cc484234410aa090b9f0d81052a', 'request_id': 'req-b60387d5-da96-445c-8735-80a5b308055a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.640946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5044cc484234410aa090b9f0d81052a', 'request_id': 'req-b60387d5-da96-445c-8735-80a5b308055a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.660090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5044cc484234410aa090b9f0d81052a', 'request_id': 'req-b60387d5-da96-445c-8735-80a5b308055a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.673827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:24.674978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.675465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.676049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/055396a4223e4420aa2c895386e75ba3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.685005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:43:24.686303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] The token cache is being invalidate because project c5044cc484234410aa090b9f0d81052a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:24.686627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.692415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b60387d5-da96-445c-8735-80a5b308055a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Could not find domain: 055396a4223e4420aa2c895386e75ba3.: keystone.exception.DomainNotFound: Could not find domain: 055396a4223e4420aa2c895386e75ba3. Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 055396a4223e4420aa2c895386e75ba3. Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:43:24.693566 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:43:24.695092 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 055396a4223e4420aa2c895386e75ba3. Oct 31 05:43:24.696408 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:43:24.698232 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3242/6538] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:24 2022] DELETE /identity/v3/projects/c5044cc484234410aa090b9f0d81052a => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:24.699667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c642cab-e2b8-4dce-8d1c-00901414c6af None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.699859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c642cab-e2b8-4dce-8d1c-00901414c6af None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.700249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c642cab-e2b8-4dce-8d1c-00901414c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.700427 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3297/6539] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:43:24 2022] PATCH /identity/v3/domains/055396a4223e4420aa2c895386e75ba3 => generated 112 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 05:43:24.703259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:24.706550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:24.725007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625976d3-d9de-4f66-86b2-c3df0042dcfa tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:24.731659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:24.733458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.733932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.735911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/users/16fe5181b20d49de82e4c4e7ec1a9d7b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.741743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_user(user_id=16fe5181b20d49de82e4c4e7ec1a9d7b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:24.744119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:24.750522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0c642cab-e2b8-4dce-8d1c-00901414c6af None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:24.755588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c642cab-e2b8-4dce-8d1c-00901414c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:24.826711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:24.885369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16fe5181b20d49de82e4c4e7ec1a9d7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.912681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3243/6540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:24.933134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:24.933427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:24.933708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:24.948233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16fe5181b20d49de82e4c4e7ec1a9d7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.949309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16fe5181b20d49de82e4c4e7ec1a9d7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.950460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16fe5181b20d49de82e4c4e7ec1a9d7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:24.989372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16fe5181b20d49de82e4c4e7ec1a9d7b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:25.007295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:25.008563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:25.024413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3298/6541] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:24 2022] DELETE /identity/v3/users/16fe5181b20d49de82e4c4e7ec1a9d7b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:25.025684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.028609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:25.035342 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3244/6542] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:25.038792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.049657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de488dd-9e36-44b7-87b4-ec07effc6f7c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.096084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:25.123919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.124552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.125098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.125387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.126891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:25.127203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.128981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.149643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3245/6543] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:25.150675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.166733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288169d-f7da-4133-ba15-f7286e092c8f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.173361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.174205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.174350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.174621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.175268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.177645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.182480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9e41-8ac3-43d3-8830-3fb9af8cf81a tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.189893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.191631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.192142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.193145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/e4333a0634d640e0937b9af89d50f80e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.195242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e4333a0634d640e0937b9af89d50f80e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.198066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.218831 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3246/6544] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:25 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:25.223905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.268605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role e4333a0634d640e0937b9af89d50f80e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:25.269426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:25.270512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:25.272886 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3299/6545] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:25 2022] DELETE /identity/v3/roles/e4333a0634d640e0937b9af89d50f80e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:25.276627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.280279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:25.338304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb08a86-66fe-40ae-9327-74f79c6ddf38 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.396674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74fc69-4d09-451a-88e4-cd4048364ab6 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.403591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.404645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.405849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.406448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/groups/fec1af1139c24af3ad3a7d00ee435bf2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.408964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fec1af1139c24af3ad3a7d00ee435bf2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.415276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.441459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:25.468466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff8f88-0c01-4ee0-9789-b3b962c89b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.469219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8f88-0c01-4ee0-9789-b3b962c89b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.469704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8f88-0c01-4ee0-9789-b3b962c89b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.478816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8f88-0c01-4ee0-9789-b3b962c89b6b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.479645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff8f88-0c01-4ee0-9789-b3b962c89b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.482882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff8f88-0c01-4ee0-9789-b3b962c89b6b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.516971 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3247/6546] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:25 2022] POST /identity/v3/users => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:25.518465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214495de-32b9-4427-abac-144e08b147ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.519099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214495de-32b9-4427-abac-144e08b147ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.519099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214495de-32b9-4427-abac-144e08b147ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.546658 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3300/6547] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:43:25 2022] DELETE /identity/v3/groups/fec1af1139c24af3ad3a7d00ee435bf2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:25.548423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.550701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:25.555822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-214495de-32b9-4427-abac-144e08b147ff None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:25.556909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-214495de-32b9-4427-abac-144e08b147ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:25.655234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:25.687310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a57d2e-1034-4bf6-a96f-9b5e937a3cd8 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.689107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3248/6548] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:43:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:25.691884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214495de-32b9-4427-abac-144e08b147ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.706006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.706856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.707243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.707620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.708704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.713575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.740261 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3301/6549] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:25 2022] GET /identity/v3/roles => generated 2095 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:25.742440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.745219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:25.838858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214495de-32b9-4427-abac-144e08b147ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.845967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.846775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.846988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.847268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/projects/8ca1a60a80ac4aa9a5a615277154773a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.848776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ca1a60a80ac4aa9a5a615277154773a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.850989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.882407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6636-2b32-4f46-9595-f885cea31a15 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.890226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:25.890966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:25.892376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:25.892376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:25.904424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:25.906889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:25.921154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3302/6550] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:43:25.922031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:25.940625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c6e-254a-4307-ad1b-0fe40a6a10d7 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:25.980527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca1a60a80ac4aa9a5a615277154773a', 'request_id': 'req-7d1cba94-c935-436b-951c-bf367d43c052'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:25.990717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca1a60a80ac4aa9a5a615277154773a', 'request_id': 'req-7d1cba94-c935-436b-951c-bf367d43c052'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.015387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca1a60a80ac4aa9a5a615277154773a', 'request_id': 'req-7d1cba94-c935-436b-951c-bf367d43c052'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.049556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] The token cache is being invalidate because project 8ca1a60a80ac4aa9a5a615277154773a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:26.049885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.050697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.055475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3249/6551] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:25 2022] DELETE /identity/v3/projects/8ca1a60a80ac4aa9a5a615277154773a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:26.056685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.066447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.096095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:26.109869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.116297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.116720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.117228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.118447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.120678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.149523 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3303/6552] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:25 2022] GET /identity/v3/roles => generated 2095 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:26.150828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.152694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.168027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ffd5-4dc3-4b11-99d3-885f1a747c7f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.174252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05df8ad-a198-4af6-8bcb-c88ad64e7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.175083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df8ad-a198-4af6-8bcb-c88ad64e7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.175476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df8ad-a198-4af6-8bcb-c88ad64e7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.175849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df8ad-a198-4af6-8bcb-c88ad64e7989 admin admin] PATH_INFO: `/v3/projects/1bcd9cfa3eba4cf98f9f575fdee1384a/users/016a068259ea494e8b40380e20ae97b5/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.177146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cba94-c935-436b-951c-bf367d43c052 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.183190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.183908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.184120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.184417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.185652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.187538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.195216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05df8ad-a198-4af6-8bcb-c88ad64e7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcd9cfa3eba4cf98f9f575fdee1384a, user_id=016a068259ea494e8b40380e20ae97b5, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.200291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05df8ad-a198-4af6-8bcb-c88ad64e7989 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.221677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.222834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.237479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3304/6553] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:26 2022] PUT /identity/v3/projects/1bcd9cfa3eba4cf98f9f575fdee1384a/users/016a068259ea494e8b40380e20ae97b5/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:26.239121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.239584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.240001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.267219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.268089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.271093 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3250/6554] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:43:26 2022] PATCH /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d => generated 277 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:26.274828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.277078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.289748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] MFA Rules not processed for user `016a068259ea494e8b40380e20ae97b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:26.291150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.348912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:26.372578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ee888-4b49-48fd-99fd-9cf44741350d tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.381375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.384066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.384066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.384066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.396724 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3305/6555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:26.405322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4ac7dcf5e7cc459eb74ddd029e24de7d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.408120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.408692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.410853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.438064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.459221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.501264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:26.507414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d', 'request_id': 'req-454154d3-3fdc-48fc-8167-54b6f07d60f0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.518284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d', 'request_id': 'req-454154d3-3fdc-48fc-8167-54b6f07d60f0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.528172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d', 'request_id': 'req-454154d3-3fdc-48fc-8167-54b6f07d60f0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.545543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] The token cache is being invalidate because project 4ac7dcf5e7cc459eb74ddd029e24de7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:26.546634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.547608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.557591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d', 'request_id': 'req-454154d3-3fdc-48fc-8167-54b6f07d60f0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.558727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d', 'request_id': 'req-454154d3-3fdc-48fc-8167-54b6f07d60f0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.559658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4ac7dcf5e7cc459eb74ddd029e24de7d', 'request_id': 'req-454154d3-3fdc-48fc-8167-54b6f07d60f0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.567228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4d92-8e3a-4ad6-b664-debe45f6f022 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.570516 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3251/6556] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:43:26 2022] DELETE /identity/v3/domains/4ac7dcf5e7cc459eb74ddd029e24de7d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:26.574672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.576936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.674312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454154d3-3fdc-48fc-8167-54b6f07d60f0 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.678400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.679373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.679642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.681225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.681892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.682725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.683713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.684273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.684948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/6905d0f95e9e434296cd22912afd817e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.686964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6905d0f95e9e434296cd22912afd817e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.687377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.690414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.752477 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3306/6557] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:26 2022] POST /identity/v3/projects => generated 401 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:26.753878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.758538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.794341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 6905d0f95e9e434296cd22912afd817e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:26.794696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.795324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:26.801037 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3252/6558] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:26 2022] DELETE /identity/v3/roles/6905d0f95e9e434296cd22912afd817e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:26.802841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:26.804635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:26.883056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd23b-2b4e-49b5-a58f-bebc2ba0ec03 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.910605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:26.941340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9071b50-751c-46e8-ab1a-a5fb1bb8e30b tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:26.947183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:26.947992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:26.948379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:26.948672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/67a2493708aa422e8a06412afc7bb517` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:26.950451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_role(role_id=67a2493708aa422e8a06412afc7bb517)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:26.952217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:26.976836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:27.034108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.034108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.034405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 67a2493708aa422e8a06412afc7bb517 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:27.034509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.034614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.035339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.035719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.037318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.038646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.046195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3253/6559] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:26 2022] DELETE /identity/v3/roles/67a2493708aa422e8a06412afc7bb517 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:27.049542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.053035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.076341 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3307/6560] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:26 2022] POST /identity/v3/users => generated 307 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:27.083272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.085507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.106301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774b917-f730-4bc0-bb22-274a859ed21b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.173216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db78b-4cdb-4e95-837f-a714f677db56 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.184528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.185908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.186411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.186847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.187941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.189450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a781ee951f8b452f89b95a7dbb064f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c5ee7bf8f124969b7402f75d87c87ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.190497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.191070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.191637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.191999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] PATH_INFO: `/v3/roles/3fd8cb80d662477e9dc91c9683fc3417` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.197818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3fd8cb80d662477e9dc91c9683fc3417)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.199558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.203777 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3308/6561] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:27 2022] GET /identity/v3/roles => generated 1645 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:27.214480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.226207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2054f3-f085-46f4-bf60-de1cd9d5fd8d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.233278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.234034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.234530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.234813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] PATH_INFO: `/v3/projects/e0b31b10826342fdb43d646e0f9607c4/users/9b31da2f589e448388740381649a9b89/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.258956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b31b10826342fdb43d646e0f9607c4, user_id=9b31da2f589e448388740381649a9b89, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.261959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.286559 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3309/6562] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:27 2022] PUT /identity/v3/projects/e0b31b10826342fdb43d646e0f9607c4/users/9b31da2f589e448388740381649a9b89/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:27.290413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.291351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invalidating the token cache because role 3fd8cb80d662477e9dc91c9683fc3417 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:27.291717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.293751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.296381 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3254/6563] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:27 2022] DELETE /identity/v3/roles/3fd8cb80d662477e9dc91c9683fc3417 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:27.301879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.303347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.392858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c01dd6-06f5-41e5-aa8e-55faa8911f23 tempest-RolesV3TestJSON-348236525 tempest-RolesV3TestJSON-348236525-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.400064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.401091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.402664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.404065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] PATH_INFO: `/v3/users/590922ef74ee44e18b683d42441f3282` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.410821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590922ef74ee44e18b683d42441f3282)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.416200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.417690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979995c8-7069-4d56-9530-b4f87e36ff94 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.423908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.424507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.424796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.425076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.425740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.427569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.442431 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3310/6564] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:27.445431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.455655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.483532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ae3c-65fb-4d2f-8118-1517f10a3234 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.492189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56c39d-0286-46df-9f4a-9e4fc95fd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.492993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c39d-0286-46df-9f4a-9e4fc95fd6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.493280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c39d-0286-46df-9f4a-9e4fc95fd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.493738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c39d-0286-46df-9f4a-9e4fc95fd6cf admin admin] PATH_INFO: `/v3/projects/e0b31b10826342fdb43d646e0f9607c4/users/9b31da2f589e448388740381649a9b89/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.501892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56c39d-0286-46df-9f4a-9e4fc95fd6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b31b10826342fdb43d646e0f9607c4, user_id=9b31da2f589e448388740381649a9b89, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.505817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56c39d-0286-46df-9f4a-9e4fc95fd6cf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.530444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590922ef74ee44e18b683d42441f3282'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.531229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:27.538753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:27.554017 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3311/6565] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:27 2022] PUT /identity/v3/projects/e0b31b10826342fdb43d646e0f9607c4/users/9b31da2f589e448388740381649a9b89/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:27.555972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.556304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.556628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.566434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590922ef74ee44e18b683d42441f3282'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.567270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590922ef74ee44e18b683d42441f3282'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.574978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590922ef74ee44e18b683d42441f3282'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.588672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68d8adbb-5d69-49c3-bcef-6a648d034cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590922ef74ee44e18b683d42441f3282'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:27.616178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] MFA Rules not processed for user `9b31da2f589e448388740381649a9b89`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:27.617685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.629389 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3255/6566] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:27 2022] DELETE /identity/v3/users/590922ef74ee44e18b683d42441f3282 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:27.634374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.634912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.635488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.663995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:27.666872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.724620 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3312/6567] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:27.737782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.741907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.767682 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3256/6568] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:27.791659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:27.793543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:27.884813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405836b-6833-435d-8f9b-d3fe729c08a7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.925185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2cbb-af89-4545-ab3d-54640849ba00 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:27.931077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.931913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.932637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.932988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:27.948170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:27.948961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:27.969444 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3257/6569] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:27.996686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:27.997344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:27.997626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:27.997905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:28.075734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:28.092495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:28.095996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:28.109911 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3313/6570] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:28.333249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:28.335517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:28.363456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1c9c-4b7d-44f5-8408-e8ca9c7cc98a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:28.373317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:28.373987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:28.374305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:28.375088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] PATH_INFO: `/v3/users/016a068259ea494e8b40380e20ae97b5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:28.382223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=016a068259ea494e8b40380e20ae97b5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:28.384181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:28.437136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:28.438881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:28.462343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ab4d-5cf8-48c7-9e44-0b0eaa9fd0c8 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:28.491376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016a068259ea494e8b40380e20ae97b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.503315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:28.504286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:28.505015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:28.505483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] PATH_INFO: `/v3/projects/ee0f1992a7864483a1410de315caf818` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:28.506504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016a068259ea494e8b40380e20ae97b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.507387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016a068259ea494e8b40380e20ae97b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.507876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0f1992a7864483a1410de315caf818)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:28.508106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016a068259ea494e8b40380e20ae97b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.510906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:28.521057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7b217c51-ae5a-4dd6-9492-0dae300423e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016a068259ea494e8b40380e20ae97b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.523272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:28.554448 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3258/6571] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:28 2022] DELETE /identity/v3/users/016a068259ea494e8b40380e20ae97b5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:28.558800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:28.559203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:28.559587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:28.589867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:28.591736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:28.614189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0f1992a7864483a1410de315caf818', 'request_id': 'req-59a72385-214d-4327-9902-a4a2a8fce203'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.634737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0f1992a7864483a1410de315caf818', 'request_id': 'req-59a72385-214d-4327-9902-a4a2a8fce203'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.642724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0f1992a7864483a1410de315caf818', 'request_id': 'req-59a72385-214d-4327-9902-a4a2a8fce203'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.663590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] The token cache is being invalidate because project ee0f1992a7864483a1410de315caf818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:28.663905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.669447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.671399 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3314/6572] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:28 2022] DELETE /identity/v3/projects/ee0f1992a7864483a1410de315caf818 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:28.675735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:28.679253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:28.710340 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3259/6573] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:28.721907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:28.724618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:28.805571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a72385-214d-4327-9902-a4a2a8fce203 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:28.811267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:28.811931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:28.812816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:28.813107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] PATH_INFO: `/v3/users/a781ee951f8b452f89b95a7dbb064f43` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:28.814894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a781ee951f8b452f89b95a7dbb064f43)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:28.817718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:28.848694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca2b2c-09a1-4f61-810d-78eb270af5e8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:28.858543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:28.859244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:28.859535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:28.859815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:28.897442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:28.903289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:28.925141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a781ee951f8b452f89b95a7dbb064f43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.943471 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3260/6574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:43:28.956211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a781ee951f8b452f89b95a7dbb064f43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.958140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a781ee951f8b452f89b95a7dbb064f43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.959733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a781ee951f8b452f89b95a7dbb064f43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.993354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a781ee951f8b452f89b95a7dbb064f43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:28.996161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:29.047277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3315/6575] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:28 2022] DELETE /identity/v3/users/a781ee951f8b452f89b95a7dbb064f43 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:29.558228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:29.559749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:29.581755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bd10e-a176-42ec-bd02-45d4ff7770f4 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:29.583948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:29.586586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:29.699096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ef142-0851-4ab6-9de0-7cd62f774493 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:29.707224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:29.709010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:29.709306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:29.709589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] PATH_INFO: `/v3/projects/4c5ee7bf8f124969b7402f75d87c87ba` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:29.710841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5ee7bf8f124969b7402f75d87c87ba)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:29.713298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:29.734420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:29.736342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:29.736898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:29.737410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] PATH_INFO: `/v3/projects/1bcd9cfa3eba4cf98f9f575fdee1384a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:29.739627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcd9cfa3eba4cf98f9f575fdee1384a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:29.742460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:29.792278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5ee7bf8f124969b7402f75d87c87ba', 'request_id': 'req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.803676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5ee7bf8f124969b7402f75d87c87ba', 'request_id': 'req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.808489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:29.815895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5ee7bf8f124969b7402f75d87c87ba', 'request_id': 'req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.833236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] The token cache is being invalidate because project 4c5ee7bf8f124969b7402f75d87c87ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:29.834916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.836526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ae6d3b8d-8f30-4e36-a975-c2df9fe6ffce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.842255 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3316/6576] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:29 2022] DELETE /identity/v3/projects/4c5ee7bf8f124969b7402f75d87c87ba => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:29.844321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9b06-c680-4eb1-84ad-d24ba566f471 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:29.845440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9b06-c680-4eb1-84ad-d24ba566f471 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:29.846331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9b06-c680-4eb1-84ad-d24ba566f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:29.856235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcd9cfa3eba4cf98f9f575fdee1384a', 'request_id': 'req-5a9a9054-718d-46b3-a85a-e2376078a184'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.867950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcd9cfa3eba4cf98f9f575fdee1384a', 'request_id': 'req-5a9a9054-718d-46b3-a85a-e2376078a184'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.873544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0c9a9b06-c680-4eb1-84ad-d24ba566f471 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:29.875195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0c9a9b06-c680-4eb1-84ad-d24ba566f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:29.909386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcd9cfa3eba4cf98f9f575fdee1384a', 'request_id': 'req-5a9a9054-718d-46b3-a85a-e2376078a184'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.929332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] The token cache is being invalidate because project 1bcd9cfa3eba4cf98f9f575fdee1384a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:29.929664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.931682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:29.935975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3261/6577] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:29 2022] DELETE /identity/v3/projects/1bcd9cfa3eba4cf98f9f575fdee1384a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:29.940239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:29.944246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:30.010500 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3317/6578] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:30.013040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.013338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.013625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.062276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:30.063613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:30.117615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a9054-718d-46b3-a85a-e2376078a184 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:30.128925 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3318/6579] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:30.133152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.137169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:30.138123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.138363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.138594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] PATH_INFO: `/v3/users/9b31da2f589e448388740381649a9b89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.140123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b31da2f589e448388740381649a9b89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:30.143346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:30.167144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f67ed-18e4-4b8e-9983-78e3e7240d03 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:30.175916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:30.177332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.177950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.178630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.183080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:30.183755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:30.187144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:30.248015 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3319/6580] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:30.252703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.282797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:30.306639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84c80-6f2a-4d6c-9fb9-1e95584b0010 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:30.320329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:30.330862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.331253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.331614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.336685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:30.339634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:30.352350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b31da2f589e448388740381649a9b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:30.376053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b31da2f589e448388740381649a9b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:30.376851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b31da2f589e448388740381649a9b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:30.377640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b31da2f589e448388740381649a9b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:30.388558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b31da2f589e448388740381649a9b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:30.405208 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3320/6581] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:30 2022] POST /identity/v3/projects => generated 397 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:30.406076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.412974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:30.436676 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3262/6582] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:29 2022] DELETE /identity/v3/users/9b31da2f589e448388740381649a9b89 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:30.550840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e00327-0ef2-4bd0-b9bd-971fd9b0c0bb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:30.633496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:30.635119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.635793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.636323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.637685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:30.666601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:30.735743 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3321/6583] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:30 2022] POST /identity/v3/users => generated 305 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:30.741850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.757287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd76b39-e993-4d72-bfb9-4c9d00f3393a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:30.773470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:30.774123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.774436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.774711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.781873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:30.783757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:30.810420 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3263/6584] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:30.814579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.825943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f80f6-db1f-4009-afdf-db70a32dcdd5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:30.844792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:30.845595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:30.845983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:30.846387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] PATH_INFO: `/v3/projects/d1b848b8f70d4d2c9dddbdfebb035bfe/users/a66455256ff84a12a5cc2a5ffe7395a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:30.883267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b848b8f70d4d2c9dddbdfebb035bfe, user_id=a66455256ff84a12a5cc2a5ffe7395a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:30.886576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:30.922171 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3322/6585] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:30 2022] PUT /identity/v3/projects/d1b848b8f70d4d2c9dddbdfebb035bfe/users/a66455256ff84a12a5cc2a5ffe7395a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:30.927003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.973922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:30.976264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:30.979930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecefd26-1044-48e4-b74b-72999fc10adb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.080643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:31.115633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:31.133536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.134188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.135106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.135396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.136053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.137667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.146287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8393af6-07c5-4ae1-a480-9631355e242f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.148911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3264/6586] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:31.153047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.166390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.167258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.167981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.168427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] PATH_INFO: `/v3/projects/e0b31b10826342fdb43d646e0f9607c4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.169950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b31b10826342fdb43d646e0f9607c4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.170946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee86fb-78a1-4520-b0a2-205da2c8ca11 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.172368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.176066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161faf0-a891-4055-9602-984c8b2e9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.177464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161faf0-a891-4055-9602-984c8b2e9071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.177863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161faf0-a891-4055-9602-984c8b2e9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.178289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161faf0-a891-4055-9602-984c8b2e9071 admin admin] PATH_INFO: `/v3/projects/d1b848b8f70d4d2c9dddbdfebb035bfe/users/a66455256ff84a12a5cc2a5ffe7395a3/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.181076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161faf0-a891-4055-9602-984c8b2e9071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b848b8f70d4d2c9dddbdfebb035bfe, user_id=a66455256ff84a12a5cc2a5ffe7395a3, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.193382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161faf0-a891-4055-9602-984c8b2e9071 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.218198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3265/6587] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:31 2022] PUT /identity/v3/projects/d1b848b8f70d4d2c9dddbdfebb035bfe/users/a66455256ff84a12a5cc2a5ffe7395a3/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:31.232162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.232624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.233007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.302327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b31b10826342fdb43d646e0f9607c4', 'request_id': 'req-067739e3-315d-4fec-8aa5-5f4e4a09aeac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:31.311045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b31b10826342fdb43d646e0f9607c4', 'request_id': 'req-067739e3-315d-4fec-8aa5-5f4e4a09aeac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:31.312401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] MFA Rules not processed for user `a66455256ff84a12a5cc2a5ffe7395a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:31.314524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:31.328181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b31b10826342fdb43d646e0f9607c4', 'request_id': 'req-067739e3-315d-4fec-8aa5-5f4e4a09aeac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:31.371065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] The token cache is being invalidate because project e0b31b10826342fdb43d646e0f9607c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:31.374808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:31.377082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-067739e3-315d-4fec-8aa5-5f4e4a09aeac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:31.381195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3323/6588] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:30 2022] DELETE /identity/v3/projects/e0b31b10826342fdb43d646e0f9607c4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:31.389104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78749901-b28f-4f24-9447-bba4604c7ad5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.389399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78749901-b28f-4f24-9447-bba4604c7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.393117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78749901-b28f-4f24-9447-bba4604c7ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.441474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-78749901-b28f-4f24-9447-bba4604c7ad5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:31.441474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-78749901-b28f-4f24-9447-bba4604c7ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:31.499669 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3266/6589] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:31.501027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.502716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:31.584321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3324/6590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:31.586054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.586321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.586598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.620349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:31.622110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:31.624962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365560be-cebe-4b2e-81f6-d6d6542d1b69 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.634313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.635717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.636715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.638223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.640352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.643117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.651767 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3325/6591] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:31.653365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.674327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3100e-74d4-4c9c-893a-134b8e4e0c38 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.684363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.685740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.686328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.686826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.687718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:31.688306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.690201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.710090 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3326/6592] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:31.716262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.723641 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3267/6593] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/projects => generated 397 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:31.724753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.748331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c38d-d9c5-43b8-bf1b-7808392700b9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.776772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:31.863534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.864155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.864440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.864712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.865355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.867323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.878533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:31.880474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e112d-fed1-4c83-9813-d58e3b807fe6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:31.885990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:31.890276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:31.890773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:31.891495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:31.893642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:31.896788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:31.923101 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3327/6594] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:31.929351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.930101 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3268/6595] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:31.931255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:31.943796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08946af-0743-411a-b0c6-4ebea873fa23 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.061914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.063044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.064132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.064589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.065556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.070215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.099292 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3269/6596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:32.099804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.118589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d480a5-cc8a-4d68-b18a-1ef99cfa9734 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.130201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.131039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.131441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.132049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.132703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.134411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15072-573b-4e40-8a45-1acef4ded757 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.138644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.152257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.153476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.153802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.154092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.155258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.157979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.179557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3270/6597] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:32.184585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.186281 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3328/6598] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:31 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:32.187322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.207664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6d35-edfa-44f8-a6b1-0c3f04ac4904 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.208867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423ab2e-b58d-4455-b445-272323da21b6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.228683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dad407-b6cf-4712-9c30-2293093e7379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.228683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad407-b6cf-4712-9c30-2293093e7379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.228683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad407-b6cf-4712-9c30-2293093e7379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.228683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad407-b6cf-4712-9c30-2293093e7379 admin admin] PATH_INFO: `/v3/projects/5d664900038a440bbadf74963673e83b/users/87cd740b455d4456b1619b99b4c0086d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.230795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.231435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.231720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.231998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.232650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.234305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.242404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dad407-b6cf-4712-9c30-2293093e7379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d664900038a440bbadf74963673e83b, user_id=87cd740b455d4456b1619b99b4c0086d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.245175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dad407-b6cf-4712-9c30-2293093e7379 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.256631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3329/6599] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:32.260830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.275412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3271/6600] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:32 2022] PUT /identity/v3/projects/5d664900038a440bbadf74963673e83b/users/87cd740b455d4456b1619b99b4c0086d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:32.284691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0743-d27d-4c9a-b1e5-8aee87f0ad85 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.287318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.287701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.288021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.328255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] MFA Rules not processed for user `87cd740b455d4456b1619b99b4c0086d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:32.331715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:32.377074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.377501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.377786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.378064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.378807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.380708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.404756 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3330/6601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:32.409433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.428923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3fe7-7d68-40b4-bda8-3d3cef966cef admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.447147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50168d1c-0bfd-4cac-b7a8-d2cd2f88f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.447946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50168d1c-0bfd-4cac-b7a8-d2cd2f88f9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.448322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50168d1c-0bfd-4cac-b7a8-d2cd2f88f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.448697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50168d1c-0bfd-4cac-b7a8-d2cd2f88f9f3 admin admin] PATH_INFO: `/v3/projects/ba7e4508ab0f43309271783d8abcf1dd/users/d5043f2a72e94da2b1946cfcc1c9d3af/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.451752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:32.464072 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3272/6602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:32.478478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.480813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:32.487508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50168d1c-0bfd-4cac-b7a8-d2cd2f88f9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7e4508ab0f43309271783d8abcf1dd, user_id=d5043f2a72e94da2b1946cfcc1c9d3af, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.491443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50168d1c-0bfd-4cac-b7a8-d2cd2f88f9f3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.516765 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3331/6603] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:32 2022] PUT /identity/v3/projects/ba7e4508ab0f43309271783d8abcf1dd/users/d5043f2a72e94da2b1946cfcc1c9d3af/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:32.524337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.524716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.525064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.566082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:32.567214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efeccf-8bc4-4276-8482-a10a51434b9b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.567395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:32.627214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:32.643291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.644092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.646684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.647027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.682188 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3332/6604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:32.696975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:32.699158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:32.753580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.755434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.774608 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3273/6605] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:32 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:32.806835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d7048-4a79-440d-8a87-59ef80b7fcea None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:32.812475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1054-f5d2-43ea-a0ad-c7dfc6455b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:32.814993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1054-f5d2-43ea-a0ad-c7dfc6455b5e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:32.815334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1054-f5d2-43ea-a0ad-c7dfc6455b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:32.815786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1054-f5d2-43ea-a0ad-c7dfc6455b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:32.836441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef1054-f5d2-43ea-a0ad-c7dfc6455b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:32.838033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef1054-f5d2-43ea-a0ad-c7dfc6455b5e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:32.871643 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3333/6606] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:33.704756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:33.716237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19197e-052c-4732-8c4b-38f933c3469e service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:33.722873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:33.723604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:33.723896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:33.724196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] PATH_INFO: `/v3/users/a66455256ff84a12a5cc2a5ffe7395a3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:33.725578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66455256ff84a12a5cc2a5ffe7395a3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:33.727921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:33.813417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66455256ff84a12a5cc2a5ffe7395a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:33.828683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66455256ff84a12a5cc2a5ffe7395a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:33.832968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66455256ff84a12a5cc2a5ffe7395a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:33.834194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66455256ff84a12a5cc2a5ffe7395a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:33.841590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:33.869577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d0341894-8069-4899-9fe5-9fe6b2115df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66455256ff84a12a5cc2a5ffe7395a3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:33.911107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3274/6607] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:33 2022] DELETE /identity/v3/users/a66455256ff84a12a5cc2a5ffe7395a3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:33.915455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:33.915970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:33.916078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:33.942805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:33.944763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:34.029677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:34.029971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:34.030421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:34.080623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3334/6608] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:34.083353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:34.089169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:34.108894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] MFA Rules not processed for user `d5043f2a72e94da2b1946cfcc1c9d3af`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:34.112950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:34.225009 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3275/6609] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:34.232379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:34.233881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:34.297726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d555ea-277b-40f7-adc9-5c0fc913da13 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:34.335830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:34.336643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:34.336996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:34.337208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:34.366535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:34.368521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:34.393289 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3335/6610] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:34.457080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd368-bdb8-42b1-80c0-b4219927c35b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:34.468639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:34.469647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:34.469934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:34.471240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:34.484523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:34.487530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:34.503422 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3276/6611] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:43:34.718625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:34.720800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:34.747207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7b432-9e88-43d6-b9da-2c80eb38f603 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:34.758638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:34.761941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:34.762574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:34.765724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] PATH_INFO: `/v3/users/ee12d23d1ec24505b9dd25fa4fae58fc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:34.768608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee12d23d1ec24505b9dd25fa4fae58fc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:34.771511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:34.784280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:34.787965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:34.814719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c116-41cb-416b-8715-272fc7bad8a3 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:34.821240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:34.822238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:34.822758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:34.823239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] PATH_INFO: `/v3/projects/d1b848b8f70d4d2c9dddbdfebb035bfe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:34.824710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b848b8f70d4d2c9dddbdfebb035bfe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:34.827172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:34.847342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:34.908385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee12d23d1ec24505b9dd25fa4fae58fc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.941779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee12d23d1ec24505b9dd25fa4fae58fc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.944345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee12d23d1ec24505b9dd25fa4fae58fc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.962524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee12d23d1ec24505b9dd25fa4fae58fc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.962759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b848b8f70d4d2c9dddbdfebb035bfe', 'request_id': 'req-fa5931a0-69fb-4f29-b663-2494c519d757'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.964635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b848b8f70d4d2c9dddbdfebb035bfe', 'request_id': 'req-fa5931a0-69fb-4f29-b663-2494c519d757'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.972792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:34.982882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16aa39ff-fc3d-42fc-a6b0-89589ac9644e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee12d23d1ec24505b9dd25fa4fae58fc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:34.983812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b848b8f70d4d2c9dddbdfebb035bfe', 'request_id': 'req-fa5931a0-69fb-4f29-b663-2494c519d757'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.006743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] The token cache is being invalidate because project d1b848b8f70d4d2c9dddbdfebb035bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:35.007054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.010108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.013002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3336/6612] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:34 2022] DELETE /identity/v3/users/ee12d23d1ec24505b9dd25fa4fae58fc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:35.020440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:35.020920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:35.021417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:35.021560 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3277/6613] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:34 2022] DELETE /identity/v3/projects/d1b848b8f70d4d2c9dddbdfebb035bfe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:35.022398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:35.027050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:35.064948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:35.071057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:35.131999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5931a0-69fb-4f29-b663-2494c519d757 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:35.190383 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3337/6614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:35.201619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:35.205275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:35.251063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:35.251806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:35.252601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:35.252967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] PATH_INFO: `/v3/users/87cd740b455d4456b1619b99b4c0086d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:35.255358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cd740b455d4456b1619b99b4c0086d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:35.257682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:35.314860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a34a4-a16a-4e85-95bf-ff45d2428ded None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:35.319128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:35.319533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:35.320188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:35.320188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:35.333913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:35.335903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:35.358991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cd740b455d4456b1619b99b4c0086d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.365653 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3338/6615] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:35.372198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cd740b455d4456b1619b99b4c0086d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.373150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cd740b455d4456b1619b99b4c0086d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.374699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cd740b455d4456b1619b99b4c0086d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.386013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cd740b455d4456b1619b99b4c0086d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:35.420659 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3278/6616] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:35 2022] DELETE /identity/v3/users/87cd740b455d4456b1619b99b4c0086d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:36.116050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:36.117555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:36.135404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:36.136894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:36.156042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7677c-973c-45b0-9cdc-f9f7a7919297 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:36.243400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:36.274765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:36.318442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:36.320032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.320543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.321045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] PATH_INFO: `/v3/projects/7ba9b69df39e478f94016c312497860f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.323116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba9b69df39e478f94016c312497860f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:36.325527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:36.351962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a5fa8-12ac-427b-8a13-5724d52514e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:36.357371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:36.358289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.358742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.359181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] PATH_INFO: `/v3/projects/5d664900038a440bbadf74963673e83b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.361704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d664900038a440bbadf74963673e83b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:36.363925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:36.658963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba9b69df39e478f94016c312497860f', 'request_id': 'req-574df3d2-94a1-4041-9667-a40e74c0db42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.658963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba9b69df39e478f94016c312497860f', 'request_id': 'req-574df3d2-94a1-4041-9667-a40e74c0db42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.662171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d664900038a440bbadf74963673e83b', 'request_id': 'req-6aa02395-7302-4739-b1df-0b663b46a2ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.662666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba9b69df39e478f94016c312497860f', 'request_id': 'req-574df3d2-94a1-4041-9667-a40e74c0db42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.662666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] The token cache is being invalidate because project 7ba9b69df39e478f94016c312497860f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:36.662666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.662666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-574df3d2-94a1-4041-9667-a40e74c0db42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.662666 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3339/6617] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:36 2022] DELETE /identity/v3/projects/7ba9b69df39e478f94016c312497860f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:36.663501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6957-a863-4645-89ff-e3b14d4b42d9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.663501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6957-a863-4645-89ff-e3b14d4b42d9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.663501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6957-a863-4645-89ff-e3b14d4b42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.664227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d664900038a440bbadf74963673e83b', 'request_id': 'req-6aa02395-7302-4739-b1df-0b663b46a2ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.664227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d664900038a440bbadf74963673e83b', 'request_id': 'req-6aa02395-7302-4739-b1df-0b663b46a2ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.664672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-173c6957-a863-4645-89ff-e3b14d4b42d9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:36.664672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-173c6957-a863-4645-89ff-e3b14d4b42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:36.665091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] The token cache is being invalidate because project 5d664900038a440bbadf74963673e83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:36.665091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.665091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6aa02395-7302-4739-b1df-0b663b46a2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:36.665091 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3279/6618] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:36 2022] DELETE /identity/v3/projects/5d664900038a440bbadf74963673e83b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:36.665091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2bf7d-203b-45db-b0ea-f2ab8484406d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.665928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2bf7d-203b-45db-b0ea-f2ab8484406d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.665928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2bf7d-203b-45db-b0ea-f2ab8484406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.665928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9ad2bf7d-203b-45db-b0ea-f2ab8484406d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:36.665928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ad2bf7d-203b-45db-b0ea-f2ab8484406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:36.675480 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3340/6619] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:36.685483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.685823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.686107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.715004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:36.716746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:36.726785 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3341/6620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:36.732385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:36.747498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30673ad5-09aa-4ee1-b2ea-8afb83f59019 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:36.754530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:36.755677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.756460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.756978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.759392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:36.760132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:36.762553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:36.779262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3342/6621] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:36.786007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:36.799372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1a4ce-e915-479c-9733-6ea25789566f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:36.806314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:36.807142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.807578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.808018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.808817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:36.809168 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3280/6622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:36.811582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:36.818089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.818651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.819120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.856718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:36.858173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:36.873588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3343/6623] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:36 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:36.881322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:36.882445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3281/6624] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:36.883223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:36.895276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c101-7ca4-4643-8c2c-2572c6974851 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:36.943744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:36.952646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:36.978181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:36.978796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.979163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.979479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.980890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:36.981197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:36.983288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:36.984847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519d851-c647-447d-9e65-ad165dfa9ab9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:36.995227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:36.995876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:36.996155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:36.996583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:36.997402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.000029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.001263 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3282/6625] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:37.007026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.049144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5d20-ae7d-44ed-baf8-987bcf5dcf1c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.055237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3344/6626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:36 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:37.056332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.059193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.059882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.060214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.060478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.061304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.063913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.073345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548effe2-650b-46c7-a579-d74ea192ea94 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.080369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.080885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.081175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.081454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.082141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.083744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.097053 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3345/6627] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:37.101145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.114197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aaa652-1229-420f-9667-57285ab49e2c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.119478 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3283/6628] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:37.120440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.230465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0191a9-cf39-4851-b4c9-fc8b3a9b2254 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.241401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.242214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.242672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.243024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.244003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.245533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a78f1-9fcd-4acb-a17d-a38958b6ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.246193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a78f1-9fcd-4acb-a17d-a38958b6ef55 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.246334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.246495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a78f1-9fcd-4acb-a17d-a38958b6ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.246735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a78f1-9fcd-4acb-a17d-a38958b6ef55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.247386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a78f1-9fcd-4acb-a17d-a38958b6ef55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.248989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a78f1-9fcd-4acb-a17d-a38958b6ef55 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.265241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3346/6629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:37.268517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed550c-5519-4263-9a6c-b0c2bd7d2707 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.268921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed550c-5519-4263-9a6c-b0c2bd7d2707 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.269205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed550c-5519-4263-9a6c-b0c2bd7d2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.283536 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3284/6630] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:37.283536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.299804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e68474-bc24-4f4f-a136-24f063c9caaf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.305739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.306387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.306894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.307185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] PATH_INFO: `/v3/projects/7e3fcb9a911f4e73877d25649b67cd95/users/0005cf1c5e004b919cb8579e7067d506/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.307686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0bed550c-5519-4263-9a6c-b0c2bd7d2707 None None] MFA Rules not processed for user `d5043f2a72e94da2b1946cfcc1c9d3af`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:37.309450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0bed550c-5519-4263-9a6c-b0c2bd7d2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:37.332840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3fcb9a911f4e73877d25649b67cd95, user_id=0005cf1c5e004b919cb8579e7067d506, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.336550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.356119 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3285/6631] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:37 2022] PUT /identity/v3/projects/7e3fcb9a911f4e73877d25649b67cd95/users/0005cf1c5e004b919cb8579e7067d506/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:37.357491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.397026 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3347/6632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:37.398738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.400666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.401149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.446704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce280a6-de07-4fd2-9479-58ecdd500553 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.448620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:37.449848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:37.459154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.460225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.460482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.460807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.461471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.463115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.467758 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3348/6633] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:37.477255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.481846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:37.491561 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3286/6634] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:37.502019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.519559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88885141-9f4f-4763-9b33-dd3e7ab73060 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.524970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.525591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.525896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.526138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.526824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.528450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.541018 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3287/6635] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:37.545339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.559231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:37.566671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bfccb-f678-4402-83bb-f83d462504c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.573684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fec12a-59ac-4684-9915-b0b88bc9eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.574433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fec12a-59ac-4684-9915-b0b88bc9eced admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.574722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fec12a-59ac-4684-9915-b0b88bc9eced admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.575164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fec12a-59ac-4684-9915-b0b88bc9eced admin admin] PATH_INFO: `/v3/projects/e99519b354db4097a290b9e2bb5b3ec7/users/3f7d6d04463543759fa37ba77d858833/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.581030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:37.599725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fec12a-59ac-4684-9915-b0b88bc9eced admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99519b354db4097a290b9e2bb5b3ec7, user_id=3f7d6d04463543759fa37ba77d858833, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.602835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fec12a-59ac-4684-9915-b0b88bc9eced admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.611761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f4c0-53be-4803-9487-32ff945d45a8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.623125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.626986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.627271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.631228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.651665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3288/6636] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:37 2022] PUT /identity/v3/projects/e99519b354db4097a290b9e2bb5b3ec7/users/3f7d6d04463543759fa37ba77d858833/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:37.651886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.651886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.653768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.654067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.654369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.664660 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3349/6637] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:37.687454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] MFA Rules not processed for user `3f7d6d04463543759fa37ba77d858833`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:37.688784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:37.764650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.766134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:37.784975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9ea5-5f13-4853-bc6e-2d3fd8d20a02 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.790625 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3289/6638] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:37.795637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:37.856151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.857323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.857657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.857963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.860753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:37.877283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.879314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.895453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3350/6639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:43:37.899567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982538-dfc1-4e19-892f-75102e1100ea None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:37.921876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:37.922734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:37.923257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:37.924107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:37.924970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:37.927750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:37.975725 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3290/6640] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:37.977549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:38.013714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dfbe1-803a-47fb-9226-953e8ccb6d7b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:38.169312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:38.169967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:38.170546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:38.170840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:38.171499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:38.173526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:38.219140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3351/6641] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:37 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:38.221655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:38.264197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b3f0b-1106-4855-a0e2-f2f83cdcfb2a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:38.287939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:38.288593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:38.288878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:38.289158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:38.293098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:38.306736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:38.349790 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3291/6642] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:38.354563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:38.403253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa12f1f-612d-497a-833b-c4c7f1c9ad01 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:38.414315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e1236-5f33-42a3-af8b-f2532ca551e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:38.416559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1236-5f33-42a3-af8b-f2532ca551e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:38.416696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1236-5f33-42a3-af8b-f2532ca551e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:38.418020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1236-5f33-42a3-af8b-f2532ca551e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:38.420848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e1236-5f33-42a3-af8b-f2532ca551e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:38.423356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e1236-5f33-42a3-af8b-f2532ca551e3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:38.453146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:38.454404 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3352/6643] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:38.472591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdb8d9-bb3d-48d0-bdaf-a70e7cb47ce7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:38.481472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:38.483052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:38.483603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:38.484105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] PATH_INFO: `/v3/projects/d6a0c4410cee4050921dda69d21d9002/users/74b17a4e3e7f466e8033dfad00a3cd38/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:38.512381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a0c4410cee4050921dda69d21d9002, user_id=74b17a4e3e7f466e8033dfad00a3cd38, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:38.519707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:38.552435 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3292/6644] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:38 2022] PUT /identity/v3/projects/d6a0c4410cee4050921dda69d21d9002/users/74b17a4e3e7f466e8033dfad00a3cd38/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:38.563286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:38.563581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:38.563864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:38.601326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] MFA Rules not processed for user `74b17a4e3e7f466e8033dfad00a3cd38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:38.603368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:38.777128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:38.790249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3353/6645] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:38.811444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:38.813448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:38.873527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:38.962389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daea5c-03c6-418b-9146-df7b0d5bcb82 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:38.966332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:38.967051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:38.967612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:38.968536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:39.055049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:39.055049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:39.070031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3293/6646] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:39.243761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:39.279975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97589f-e39d-4201-ad5c-3c87ffe42d42 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:39.300658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17fe32-d8b6-4d5b-8af5-0ef77b74c9c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:39.301381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17fe32-d8b6-4d5b-8af5-0ef77b74c9c5 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:39.301672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17fe32-d8b6-4d5b-8af5-0ef77b74c9c5 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:39.301954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17fe32-d8b6-4d5b-8af5-0ef77b74c9c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:39.323426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17fe32-d8b6-4d5b-8af5-0ef77b74c9c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:39.325657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17fe32-d8b6-4d5b-8af5-0ef77b74c9c5 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:39.393214 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3354/6647] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:43:40.184676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:40.348990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156640-901e-4c4c-9587-30bfc6a74778 service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:40.361195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:40.361747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:40.362036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:40.362345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] PATH_INFO: `/v3/users/3f7d6d04463543759fa37ba77d858833` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:40.365899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7d6d04463543759fa37ba77d858833)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:40.373772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:40.536409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7d6d04463543759fa37ba77d858833'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:40.560649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7d6d04463543759fa37ba77d858833'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:40.561447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7d6d04463543759fa37ba77d858833'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:40.562231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7d6d04463543759fa37ba77d858833'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:40.573763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7d6d04463543759fa37ba77d858833'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:40.599264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:40.622539 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3294/6648] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:40 2022] DELETE /identity/v3/users/3f7d6d04463543759fa37ba77d858833 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:40.623909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:40.624739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:40.625208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:40.664869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:40.666434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:40.791396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3355/6649] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:40.954360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:40.965157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:41.110481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6806475-b889-4f7d-8b2b-00fe2432aab1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:41.117750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:41.118554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:41.118937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:41.119319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:41.165851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:41.170804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:41.197545 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3295/6650] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:42.248109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:42.250261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:42.272863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620568fe-c3e0-46a6-86f0-d5d8a04ca04d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:42.294344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:42.295379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:42.295817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:42.296275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] PATH_INFO: `/v3/projects/e99519b354db4097a290b9e2bb5b3ec7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:42.298225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99519b354db4097a290b9e2bb5b3ec7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:42.300452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:42.447181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99519b354db4097a290b9e2bb5b3ec7', 'request_id': 'req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.455360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99519b354db4097a290b9e2bb5b3ec7', 'request_id': 'req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.484470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99519b354db4097a290b9e2bb5b3ec7', 'request_id': 'req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.524874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] The token cache is being invalidate because project e99519b354db4097a290b9e2bb5b3ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:42.525171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.525979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.527749 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3356/6651] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:42 2022] DELETE /identity/v3/projects/e99519b354db4097a290b9e2bb5b3ec7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:42.533207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:42.544825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc32d80-f794-405e-a192-a9f7b75e650e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:42.656081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:42.656421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:42.656778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:42.657032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] PATH_INFO: `/v3/users/74b17a4e3e7f466e8033dfad00a3cd38` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:42.660033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b17a4e3e7f466e8033dfad00a3cd38)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:42.676341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:42.818629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b17a4e3e7f466e8033dfad00a3cd38'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.843749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b17a4e3e7f466e8033dfad00a3cd38'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.845457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b17a4e3e7f466e8033dfad00a3cd38'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.846267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b17a4e3e7f466e8033dfad00a3cd38'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.865809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-820fc289-f20f-4ba6-a676-bf3b59e9574d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b17a4e3e7f466e8033dfad00a3cd38'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:42.912107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3296/6652] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:42 2022] DELETE /identity/v3/users/74b17a4e3e7f466e8033dfad00a3cd38 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:43.430545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:43.434075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:43.466003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14a0af-fc41-4328-9e44-6cfb6e44d31d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:43.697966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:43.698964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:43.699449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:43.699937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] PATH_INFO: `/v3/projects/d6a0c4410cee4050921dda69d21d9002` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:43.701597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a0c4410cee4050921dda69d21d9002)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:43.703866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:43.716940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:43.787529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a0c4410cee4050921dda69d21d9002', 'request_id': 'req-f1af9f8d-34e6-4f12-86ac-3de1f8362862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:43.808533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a0c4410cee4050921dda69d21d9002', 'request_id': 'req-f1af9f8d-34e6-4f12-86ac-3de1f8362862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:43.839091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a0c4410cee4050921dda69d21d9002', 'request_id': 'req-f1af9f8d-34e6-4f12-86ac-3de1f8362862'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:43.890280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] The token cache is being invalidate because project d6a0c4410cee4050921dda69d21d9002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:43.891451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:43.894552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f1af9f8d-34e6-4f12-86ac-3de1f8362862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:43.908671 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3357/6653] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:43 2022] DELETE /identity/v3/projects/d6a0c4410cee4050921dda69d21d9002 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:43.915002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:43.916641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:43.917352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:43.999467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:44.002078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:44.050014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:44.207160 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3297/6654] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:43:44.215572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.215867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.216150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.255653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:44.256908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:44.280900 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3358/6655] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:44.285018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:44.302093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3031-1fb9-41dc-9811-8c342b143900 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:44.314774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:44.315698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.316145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.316598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.317421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:44.318476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:44.321105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:44.355167 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3298/6656] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:43:44.360757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:44.399201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17f03-d004-461b-9895-161cf9ad1ff0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:44.417433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:44.417433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.417433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.417433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.418259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:44.420351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:44.476309 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3359/6657] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:44 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:44.480737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:44.495475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da878f6b-c265-44c6-bb63-1d2e24b4722c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:44.623058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:44.623904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.624192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.624469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.625131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:44.627701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:44.689460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:44.690083 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3299/6658] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:44 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:44.736349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1f3a9-3ed2-45cc-bbca-d7765fab67fe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:44.754194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:44.755195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.756383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.756748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.757494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:44.761030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:44.797292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:44.798701 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3360/6659] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:44.810023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea9af-d41d-4ecd-8a5b-153969f1fb63 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:44.823160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed639458-6874-4866-9e77-655a127a6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:44.824519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639458-6874-4866-9e77-655a127a6caf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.825703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639458-6874-4866-9e77-655a127a6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.827122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639458-6874-4866-9e77-655a127a6caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.830025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639458-6874-4866-9e77-655a127a6caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:44.833125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639458-6874-4866-9e77-655a127a6caf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:44.865504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3300/6660] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:44.869569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:44.892796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826aa15-cd6d-406b-87ba-be0932141e7f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:44.909303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:44.910110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:44.910467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:44.910774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] PATH_INFO: `/v3/projects/03e8a2e73ec4424ca2f2609e7eecc489/users/bef670faba384936883af428a4c8b6a7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:44.951275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e8a2e73ec4424ca2f2609e7eecc489, user_id=bef670faba384936883af428a4c8b6a7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:44.958325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:44.996856 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3361/6661] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:44 2022] PUT /identity/v3/projects/03e8a2e73ec4424ca2f2609e7eecc489/users/bef670faba384936883af428a4c8b6a7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:45.002351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:45.002881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:45.003296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:45.090012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] MFA Rules not processed for user `bef670faba384936883af428a4c8b6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:45.091534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:45.233295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3301/6662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:45.240535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:45.443591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545675c0-6154-471d-b6ec-8f7c88bfd48a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:45.461830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:45.463299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:45.463982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:45.464510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:45.465423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:45.468053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:45.553360 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3362/6663] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:45 2022] POST /identity/v3/projects => generated 367 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:45.554655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:45.583277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1832-1f2d-4bbe-b3e5-46022c5093fe None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:45.609684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:45.764255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:45.765016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:45.765562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:45.766021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:45.767014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:45.769815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:45.838565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3302/6664] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:45 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:45.842650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:45.868992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a9431-2c9f-4b84-a934-7cb8c89d784c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:45.884258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:45.885164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:45.885719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:45.886098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:45.887269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:45.889468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:45.913278 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3363/6665] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:45.917697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:45.994893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33c531-ffeb-4254-9723-586cfa74af3e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:46.041302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:46.042076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:46.042408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:46.044306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] PATH_INFO: `/v3/projects/97255fcdd96e4a54822b6c9b838d909b/users/8338d25c2b7c425aa268c3cfb35b76e7/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:46.100650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97255fcdd96e4a54822b6c9b838d909b, user_id=8338d25c2b7c425aa268c3cfb35b76e7, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:46.104743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:46.168623 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3303/6666] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:45 2022] PUT /identity/v3/projects/97255fcdd96e4a54822b6c9b838d909b/users/8338d25c2b7c425aa268c3cfb35b76e7/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:46.175461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:46.213205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd233e0-4c04-425d-b0c3-8949f7a6065b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:46.243657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:46.384216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff8dde-38fa-402e-939c-d9b24834a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:46.385322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff8dde-38fa-402e-939c-d9b24834a2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:46.385610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff8dde-38fa-402e-939c-d9b24834a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:46.385887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff8dde-38fa-402e-939c-d9b24834a2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:46.388767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff8dde-38fa-402e-939c-d9b24834a2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:46.394913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff8dde-38fa-402e-939c-d9b24834a2c5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:46.430684 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3364/6667] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:46.434563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:46.458441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a40ca-b547-482e-a5b9-e12216a8f64a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:46.479754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:46.482848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:46.483294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:46.483589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] PATH_INFO: `/v3/projects/97255fcdd96e4a54822b6c9b838d909b/users/8338d25c2b7c425aa268c3cfb35b76e7/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:46.496203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97255fcdd96e4a54822b6c9b838d909b, user_id=8338d25c2b7c425aa268c3cfb35b76e7, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:46.498558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:46.522248 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3304/6668] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:46 2022] PUT /identity/v3/projects/97255fcdd96e4a54822b6c9b838d909b/users/8338d25c2b7c425aa268c3cfb35b76e7/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:46.526949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54589e-9522-4f05-ab03-1c55889a3772 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:46.527567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54589e-9522-4f05-ab03-1c55889a3772 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:46.527857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54589e-9522-4f05-ab03-1c55889a3772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:46.600481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ab54589e-9522-4f05-ab03-1c55889a3772 None None] MFA Rules not processed for user `8338d25c2b7c425aa268c3cfb35b76e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:46.602033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab54589e-9522-4f05-ab03-1c55889a3772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:46.817643 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3365/6669] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:46.879334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:46.881593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:47.008189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c463-0e07-4d1d-801b-eb787db6ffe0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:47.018535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da749c55-c578-4486-a0a6-f44ae1aca9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:47.018876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da749c55-c578-4486-a0a6-f44ae1aca9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:47.019161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da749c55-c578-4486-a0a6-f44ae1aca9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:47.019435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da749c55-c578-4486-a0a6-f44ae1aca9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:47.059136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da749c55-c578-4486-a0a6-f44ae1aca9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:47.060629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da749c55-c578-4486-a0a6-f44ae1aca9c3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:47.088027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3305/6670] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:47.523693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:47.524425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:47.525221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:47.569517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] MFA Rules not processed for user `e44979e46f754f7e9f847e285e4f43bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:47.571113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:47.712086 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3366/6671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:48.604665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e82f8-165d-4333-8445-3419a56af49e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:48.605119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e82f8-165d-4333-8445-3419a56af49e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:48.605209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e82f8-165d-4333-8445-3419a56af49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:48.667783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-714e82f8-165d-4333-8445-3419a56af49e None None] MFA Rules not processed for user `0005cf1c5e004b919cb8579e7067d506`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:48.669290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-714e82f8-165d-4333-8445-3419a56af49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:48.794840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:48.826762 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3306/6672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:48.835418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:48.836948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:48.942138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:48.991997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44287f-25f0-4a73-8883-e64a792dee8e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:49.015335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:49.016804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:49.017270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:49.017710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:49.018811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:49.021767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:49.119414 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3367/6673] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:48 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:49.120080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e82f8-165d-4333-8445-3419a56af49e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:49.148187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e82f8-165d-4333-8445-3419a56af49e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:49.429612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:49.431032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:49.431318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:49.431592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:49.432252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:49.434271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:49.537366 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3307/6674] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:49 2022] POST /identity/v3/users => generated 297 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:49.540956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:49.556967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6523-9827-48be-96b9-56aefb5d1985 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:49.563585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:49.564586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:49.565419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:49.565933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:49.566891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:49.568894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:49.585233 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3368/6675] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:49.589849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:49.603044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b4f0c-3b37-48d4-a9a6-2ed8392e053b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:49.611854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:49.612704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:49.612998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:49.613343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] PATH_INFO: `/v3/projects/5c518f9e07c44b21a3dde493ff2e09eb/users/7d7ba18e92f541f68ead36cfb703062c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:49.677850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c518f9e07c44b21a3dde493ff2e09eb, user_id=7d7ba18e92f541f68ead36cfb703062c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:49.680672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:49.704692 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3308/6676] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:49 2022] PUT /identity/v3/projects/5c518f9e07c44b21a3dde493ff2e09eb/users/7d7ba18e92f541f68ead36cfb703062c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:43:49.709118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:49.724113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffb545-5a6c-4152-b235-aee40cfa374d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:49.896783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:49.897427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:49.898096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:49.899037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:49.899860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:49.902038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:49.931065 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3369/6677] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:43:49.932653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:49.948684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a8143-803c-4f6b-a0e1-5a830d3f37d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:49.975854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d2de4-6afc-4398-a473-ad98cc10cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:49.977325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d2de4-6afc-4398-a473-ad98cc10cf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:49.977839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d2de4-6afc-4398-a473-ad98cc10cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:49.979195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d2de4-6afc-4398-a473-ad98cc10cf53 admin admin] PATH_INFO: `/v3/projects/5c518f9e07c44b21a3dde493ff2e09eb/users/7d7ba18e92f541f68ead36cfb703062c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:49.992522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d2de4-6afc-4398-a473-ad98cc10cf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c518f9e07c44b21a3dde493ff2e09eb, user_id=7d7ba18e92f541f68ead36cfb703062c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:49.995491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d2de4-6afc-4398-a473-ad98cc10cf53 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:50.018645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3309/6678] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:49 2022] PUT /identity/v3/projects/5c518f9e07c44b21a3dde493ff2e09eb/users/7d7ba18e92f541f68ead36cfb703062c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:51.684080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:51.722194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e9cd7-ae0f-4432-b7fa-14bedca08d08 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:51.886405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:51.887857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:51.887857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:51.887857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] PATH_INFO: `/v3/users/bef670faba384936883af428a4c8b6a7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:51.889582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef670faba384936883af428a4c8b6a7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:51.894670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:52.056511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef670faba384936883af428a4c8b6a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:52.059182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:52.094734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef670faba384936883af428a4c8b6a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:52.101006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef670faba384936883af428a4c8b6a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:52.102075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef670faba384936883af428a4c8b6a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:52.117395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef670faba384936883af428a4c8b6a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:52.140328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3370/6679] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:51 2022] DELETE /identity/v3/users/bef670faba384936883af428a4c8b6a7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:52.144836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:52.145390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:52.145390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:52.177271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:52.181733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:52.339082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3310/6680] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:52.381510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:52.384303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:52.551410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad36c6-9b38-4a87-bbd8-9099f9995cd6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:52.564378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:52.565280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:52.565769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:52.566241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:52.591144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:52.594157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:52.621854 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3371/6681] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:43:53.817819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:53.819482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:53.840823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c6d38-d57d-4ddf-a6a2-08cbacc991c6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:53.853986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:53.854735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:53.855011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:53.855292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] PATH_INFO: `/v3/projects/03e8a2e73ec4424ca2f2609e7eecc489` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:53.857018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e8a2e73ec4424ca2f2609e7eecc489)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:53.861451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:53.991293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:54.002294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e8a2e73ec4424ca2f2609e7eecc489', 'request_id': 'req-2e196266-d431-41aa-afd4-4acaa0eb89ff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.015623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e8a2e73ec4424ca2f2609e7eecc489', 'request_id': 'req-2e196266-d431-41aa-afd4-4acaa0eb89ff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.036497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e8a2e73ec4424ca2f2609e7eecc489', 'request_id': 'req-2e196266-d431-41aa-afd4-4acaa0eb89ff'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.054620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] The token cache is being invalidate because project 03e8a2e73ec4424ca2f2609e7eecc489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:54.054918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.057667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.061111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3311/6682] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:53 2022] DELETE /identity/v3/projects/03e8a2e73ec4424ca2f2609e7eecc489 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:54.064639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:54.075301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4313-1994-4cab-a526-d428bc48532f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:54.228318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:54.228990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:54.229274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:54.229556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] PATH_INFO: `/v3/users/8338d25c2b7c425aa268c3cfb35b76e7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:54.231671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8338d25c2b7c425aa268c3cfb35b76e7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:54.243927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:54.339887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8338d25c2b7c425aa268c3cfb35b76e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.371360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8338d25c2b7c425aa268c3cfb35b76e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.372423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8338d25c2b7c425aa268c3cfb35b76e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.373243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8338d25c2b7c425aa268c3cfb35b76e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.386768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:54.393272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9f51a004-c923-4aca-a396-ed15c83848bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8338d25c2b7c425aa268c3cfb35b76e7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:54.429285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3372/6683] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:43:54 2022] DELETE /identity/v3/users/8338d25c2b7c425aa268c3cfb35b76e7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:56.920178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:56.921746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:56.944518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196266-d431-41aa-afd4-4acaa0eb89ff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:57.232591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:57.238353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:57.248073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:57.248735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] PATH_INFO: `/v3/projects/97255fcdd96e4a54822b6c9b838d909b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:57.252396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97255fcdd96e4a54822b6c9b838d909b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:57.274254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:57.356095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97255fcdd96e4a54822b6c9b838d909b', 'request_id': 'req-ee463a40-f7dd-4527-b86c-8e141369c5e3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:57.365842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97255fcdd96e4a54822b6c9b838d909b', 'request_id': 'req-ee463a40-f7dd-4527-b86c-8e141369c5e3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:57.377838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97255fcdd96e4a54822b6c9b838d909b', 'request_id': 'req-ee463a40-f7dd-4527-b86c-8e141369c5e3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:57.399325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] The token cache is being invalidate because project 97255fcdd96e4a54822b6c9b838d909b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:43:57.399911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:57.400896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee463a40-f7dd-4527-b86c-8e141369c5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:43:57.403088 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3312/6684] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:43:56 2022] DELETE /identity/v3/projects/97255fcdd96e4a54822b6c9b838d909b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:57.408810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:57.409321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:57.409321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:57.439145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:57.440570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:57.545396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3373/6685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:57.554386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:57.555133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:57.555596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:57.585475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:57.586776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:57.601781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:57.620208 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3313/6686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:57.625101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbcc5b-fe31-41e5-90c7-b2142463738f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:57.638095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:57.639277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:57.639818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:57.640320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:57.642088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:43:57.642864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:57.645334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:57.682252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3374/6687] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:43:57.682460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:57.701868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9ab6-d4fc-478e-96bb-bfa818d36313 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:57.709358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:57.710490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:57.711018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:57.711313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:57.711971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:57.713915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:57.771883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3314/6688] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:57 2022] POST /identity/v3/projects => generated 407 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:57.781377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:57.827031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2140d-5def-46c0-b08b-40021965e339 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:58.060585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:58.061375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:58.073114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:58.073596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:58.074499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:58.081873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:58.162785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:58.163367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3375/6689] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:57 2022] POST /identity/v3/users => generated 304 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:43:58.207043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe19a-5787-43b4-aa11-84f21dff1b80 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:58.237121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:58.237889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:58.238268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:58.238615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:58.246294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:58.248060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:58.275271 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3315/6690] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:58.279898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:58.298063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56945-bf07-459c-b9fb-016da60f9de1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:58.308393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c9e43-2139-4681-bfdb-1e70c108120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:58.309919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9e43-2139-4681-bfdb-1e70c108120c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:58.310446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9e43-2139-4681-bfdb-1e70c108120c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:58.310927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9e43-2139-4681-bfdb-1e70c108120c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:58.311814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c9e43-2139-4681-bfdb-1e70c108120c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:58.314436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c9e43-2139-4681-bfdb-1e70c108120c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:58.367599 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3376/6691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:58.368864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:58.385662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db731f-82d9-477a-8aa6-f2488e6c58ad admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:58.404990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:58.405701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:58.405992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:58.406302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] PATH_INFO: `/v3/projects/e893433677514f9eaeab3aef34a87cff/users/2cf9180f66da4f0882fb0efbfb7e4277/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:58.443133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e893433677514f9eaeab3aef34a87cff, user_id=2cf9180f66da4f0882fb0efbfb7e4277, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:58.452855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:58.474104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:58.492076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3316/6692] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:58 2022] PUT /identity/v3/projects/e893433677514f9eaeab3aef34a87cff/users/2cf9180f66da4f0882fb0efbfb7e4277/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:58.494527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:58.495349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:58.495878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:58.568575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] MFA Rules not processed for user `2cf9180f66da4f0882fb0efbfb7e4277`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:58.572911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:58.702755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:58.794740 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3377/6693] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:58.799562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:58.954575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c719e6-f217-4eac-b9a6-cef1e55b35a7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:58.965560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:58.966360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:58.966652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:58.966952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:58.967653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:58.971933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:59.032781 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3317/6694] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:43:58 2022] POST /identity/v3/projects => generated 405 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:59.036639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:59.061760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30baf-d0a5-43a2-9b99-d0bd8240c912 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:59.144106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:59.144882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:59.145233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:59.145571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:59.146318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:59.148584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:59.183689 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3378/6695] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:43:59 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:43:59.187845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:59.211393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e2c27-de1e-4d85-916a-185cf6ac8b71 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:59.221520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:59.222317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:59.222673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:59.223013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:59.224062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:59.227564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:59.263225 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3318/6696] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:59.267649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:59.283243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116903-39ef-4b51-9ec4-f1feebd9c35c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:59.296161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:59.299623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:59.300023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:59.300876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] PATH_INFO: `/v3/projects/076153d4466944f387d0dc5e31d507e5/users/bddeed41142e429da8c3ee623407923e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:59.338521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076153d4466944f387d0dc5e31d507e5, user_id=bddeed41142e429da8c3ee623407923e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:59.341791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:59.371189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3379/6697] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:59 2022] PUT /identity/v3/projects/076153d4466944f387d0dc5e31d507e5/users/bddeed41142e429da8c3ee623407923e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:59.375029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:59.390601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa0d05-dadb-42bf-a0cc-d2076eca029f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:59.539175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd072-93f7-4f80-b2aa-9f0e23ec071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:59.539872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd072-93f7-4f80-b2aa-9f0e23ec071a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:59.540159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd072-93f7-4f80-b2aa-9f0e23ec071a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:59.540482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd072-93f7-4f80-b2aa-9f0e23ec071a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:59.541194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cd072-93f7-4f80-b2aa-9f0e23ec071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:59.543375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cd072-93f7-4f80-b2aa-9f0e23ec071a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:59.596065 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3319/6698] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:43:59.600769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:59.618360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7042d-7a55-4f8c-9719-056abfad8c42 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:43:59.631760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:43:59.632956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:59.638756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:59.641522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] PATH_INFO: `/v3/projects/076153d4466944f387d0dc5e31d507e5/users/bddeed41142e429da8c3ee623407923e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:59.643868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076153d4466944f387d0dc5e31d507e5, user_id=bddeed41142e429da8c3ee623407923e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:43:59.664834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:43:59.706061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3380/6699] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:43:59 2022] PUT /identity/v3/projects/076153d4466944f387d0dc5e31d507e5/users/bddeed41142e429da8c3ee623407923e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:43:59.717587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:43:59.717941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:43:59.718206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:43:59.792965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] MFA Rules not processed for user `bddeed41142e429da8c3ee623407923e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:43:59.794320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:43:59.935910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:43:59.973294 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3320/6700] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:43:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:43:59.973999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:43:59.977781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:00.110718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d09a6-07d0-4c7d-861d-967c14f92183 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:00.136581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c910599-e870-4496-9946-aea009fba647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:00.140592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910599-e870-4496-9946-aea009fba647 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:00.141224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910599-e870-4496-9946-aea009fba647 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:00.141549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910599-e870-4496-9946-aea009fba647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:00.390020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:00.409698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910599-e870-4496-9946-aea009fba647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:00.411465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910599-e870-4496-9946-aea009fba647 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:00.435552 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3381/6701] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:43:59 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:44:01.272410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:01.274004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:01.451886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676faf-5215-4b04-afdb-ecbedccc7d4a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:01.471725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:01.472821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:01.473025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:01.473371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:01.508300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:01.510351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:01.544026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3321/6702] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:01 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:03.354608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862689-6d75-4edd-bc3c-af52eae4d1b5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:03.355496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862689-6d75-4edd-bc3c-af52eae4d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:03.355946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862689-6d75-4edd-bc3c-af52eae4d1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:03.426283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-50862689-6d75-4edd-bc3c-af52eae4d1b5 None None] MFA Rules not processed for user `7d7ba18e92f541f68ead36cfb703062c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:03.427956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-50862689-6d75-4edd-bc3c-af52eae4d1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:03.621656 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3382/6703] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:03.635563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:03.637561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:03.733297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95557c-72a2-4bb8-88ef-4d93687095bd service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:03.743447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:03.744542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:03.745107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:03.745560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:03.748354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:03.844634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:03.846110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:03.878622 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3322/6704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:05.849096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0ce25-f6f7-4fe5-b81c-ece9585985a6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:05.849633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0ce25-f6f7-4fe5-b81c-ece9585985a6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:05.849761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0ce25-f6f7-4fe5-b81c-ece9585985a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:05.901328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-29f0ce25-f6f7-4fe5-b81c-ece9585985a6 None None] MFA Rules not processed for user `d5043f2a72e94da2b1946cfcc1c9d3af`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:05.904409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29f0ce25-f6f7-4fe5-b81c-ece9585985a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:06.077285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3383/6705] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:13.867037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:13.913867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:14.098450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc9726-b262-4989-8d85-58a232dd35df service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:14.104385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:14.104991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:14.105349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:14.105698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] PATH_INFO: `/v3/users/2cf9180f66da4f0882fb0efbfb7e4277` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:14.107116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf9180f66da4f0882fb0efbfb7e4277)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:14.109728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:14.212460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf9180f66da4f0882fb0efbfb7e4277'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:14.233603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf9180f66da4f0882fb0efbfb7e4277'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:14.234271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf9180f66da4f0882fb0efbfb7e4277'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:14.237029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf9180f66da4f0882fb0efbfb7e4277'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:14.254397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf9180f66da4f0882fb0efbfb7e4277'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:14.308157 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3323/6706] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:13 2022] DELETE /identity/v3/users/2cf9180f66da4f0882fb0efbfb7e4277 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:14.314203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:14.314794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:14.314794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:14.354823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:14.356275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:14.511868 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3384/6707] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:14.531789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:14.534515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:14.707914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ec27-21f3-4194-9256-bb009b469c07 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:14.727027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:14.729626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:14.730102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:14.730419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:14.755041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:14.756804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:14.781980 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3324/6708] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:15.342740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:15.347016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:15.377223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922be0a0-31cc-4756-8e39-9b18fc0e6ce1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:15.388162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:15.388668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:15.388951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:15.393378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] PATH_INFO: `/v3/projects/e893433677514f9eaeab3aef34a87cff` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:15.395911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e893433677514f9eaeab3aef34a87cff)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:15.402505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:15.457132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:15.541829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e893433677514f9eaeab3aef34a87cff', 'request_id': 'req-43865711-9c12-4bb5-aa85-7b72cd45c067'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.558566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e893433677514f9eaeab3aef34a87cff', 'request_id': 'req-43865711-9c12-4bb5-aa85-7b72cd45c067'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.577080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e893433677514f9eaeab3aef34a87cff', 'request_id': 'req-43865711-9c12-4bb5-aa85-7b72cd45c067'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.616291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] The token cache is being invalidate because project e893433677514f9eaeab3aef34a87cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:15.616801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.617868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.623119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3385/6709] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:15 2022] DELETE /identity/v3/projects/e893433677514f9eaeab3aef34a87cff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:15.623857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:15.647579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb5da-08e1-44f0-bdaa-c86438aea026 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:15.699968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:15.791879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:15.792830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:15.793284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:15.793753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] PATH_INFO: `/v3/users/bddeed41142e429da8c3ee623407923e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:15.795362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bddeed41142e429da8c3ee623407923e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:15.798123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:15.972134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bddeed41142e429da8c3ee623407923e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.988728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bddeed41142e429da8c3ee623407923e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.989903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bddeed41142e429da8c3ee623407923e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:15.990926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bddeed41142e429da8c3ee623407923e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.017271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-01a4d785-edd2-4542-b627-a36f8180adb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bddeed41142e429da8c3ee623407923e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.042340 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3325/6710] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:15 2022] DELETE /identity/v3/users/bddeed41142e429da8c3ee623407923e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:16.589192 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:16.591297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:16.638140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865711-9c12-4bb5-aa85-7b72cd45c067 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:16.777451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:16.778284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:16.778575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:16.778853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] PATH_INFO: `/v3/projects/076153d4466944f387d0dc5e31d507e5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:16.784738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076153d4466944f387d0dc5e31d507e5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:16.786775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:16.912534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076153d4466944f387d0dc5e31d507e5', 'request_id': 'req-aee96dc1-6b34-46b1-b565-0a9908f07354'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.939390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076153d4466944f387d0dc5e31d507e5', 'request_id': 'req-aee96dc1-6b34-46b1-b565-0a9908f07354'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.955574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076153d4466944f387d0dc5e31d507e5', 'request_id': 'req-aee96dc1-6b34-46b1-b565-0a9908f07354'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.987299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] The token cache is being invalidate because project 076153d4466944f387d0dc5e31d507e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:16.987600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.988713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aee96dc1-6b34-46b1-b565-0a9908f07354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:16.996334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:16.996786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:16.997065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:16.999551 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3386/6711] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:16 2022] DELETE /identity/v3/projects/076153d4466944f387d0dc5e31d507e5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:17.046517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:17.052593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:17.302645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:17.303110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:17.303434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:17.307802 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3326/6712] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:17.350111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:17.351400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:17.386297 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3387/6713] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:17.391313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:17.412281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16ee15-fdf4-4bc2-9bfe-f0b967b30734 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:17.420590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:17.421690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:17.423058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:17.423625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:17.425806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:44:17.426750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:17.428908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:17.472638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:17.473821 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3327/6714] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:44:17.522743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1f02-9f12-4df5-9f53-5409fa68ae71 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:17.587295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:17.590036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:17.590626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:17.591773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:17.593337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:17.597364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:17.676364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:17.689316 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3388/6715] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:17 2022] POST /identity/v3/projects => generated 399 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:44:17.694300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412aac-866b-4226-8ac4-528b391ccee9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:17.788929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:17.881938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:17.883931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:17.884609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:17.885126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:17.888119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:17.892915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:17.947696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:17.959820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:17.962522 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3328/6716] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:17 2022] POST /identity/v3/users => generated 300 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:17.972004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378b3e-c2c6-4baf-83fe-da971b643ec9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:17.986707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:17.989232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:17.991678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:17.995221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:17.996398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:17.998765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:18.048436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:18.064228 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3389/6717] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:44:18.069210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cae3b-828c-48cc-8e80-83606f8342f2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:18.085712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b753e-0f29-4420-9369-dbbc0a520244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:18.086460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b753e-0f29-4420-9369-dbbc0a520244 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:18.090185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b753e-0f29-4420-9369-dbbc0a520244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:18.090729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b753e-0f29-4420-9369-dbbc0a520244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:18.092598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b753e-0f29-4420-9369-dbbc0a520244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:18.096453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b753e-0f29-4420-9369-dbbc0a520244 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:18.138350 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3329/6718] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:18.143201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:18.159205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab0d8-7ed5-4e90-8dc2-1bfae654084c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:18.167651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:18.168941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:18.169446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:18.170019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] PATH_INFO: `/v3/projects/2849c86d494f40969cf8e95b1a54f34a/users/4f8ce7f2557448958aa7eec54a9de966/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:18.204723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2849c86d494f40969cf8e95b1a54f34a, user_id=4f8ce7f2557448958aa7eec54a9de966, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:18.212579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:18.262450 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3390/6719] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:18 2022] PUT /identity/v3/projects/2849c86d494f40969cf8e95b1a54f34a/users/4f8ce7f2557448958aa7eec54a9de966/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:18.264536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:18.264536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:18.264783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:18.386884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] MFA Rules not processed for user `4f8ce7f2557448958aa7eec54a9de966`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:18.388122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:18.730823 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3330/6720] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:18.733175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:18.893726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824234-3511-428f-afef-dc0b2878d81f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:18.909456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:18.910602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:18.911087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:18.911719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:18.912582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:18.915289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:19.006702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3391/6721] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:18 2022] POST /identity/v3/projects => generated 399 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:19.011105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:19.062461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c0e8c-3a72-4329-adc1-a6a4b3f64b06 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:19.186858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:19.188359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:19.189043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:19.189507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:19.190391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:19.192765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:19.344992 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3331/6722] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:19 2022] POST /identity/v3/users => generated 306 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:19.349677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:19.375707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6fc7-fe8d-46b4-90ca-5b99d217029b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:19.384455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:19.385800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:19.386329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:19.387089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:19.388503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:19.391320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:19.421489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:19.433134 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3392/6723] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:19.441337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba298803-d6e5-42a8-9e83-48dee83ce5ca admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:19.456538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:19.457657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:19.458117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:19.458625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] PATH_INFO: `/v3/projects/9c1c399645294a54ad1b94603d344bbe/users/3164624635f7424eb09b43d16a088035/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:19.500712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1c399645294a54ad1b94603d344bbe, user_id=3164624635f7424eb09b43d16a088035, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:19.511334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:19.547741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:19.548753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3332/6724] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:19 2022] PUT /identity/v3/projects/9c1c399645294a54ad1b94603d344bbe/users/3164624635f7424eb09b43d16a088035/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:19.564834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703d968-3c24-42c8-8edc-472b532407fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:19.650307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac6b27-92ea-4794-801f-d29491b5c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:19.651402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac6b27-92ea-4794-801f-d29491b5c196 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:19.651955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac6b27-92ea-4794-801f-d29491b5c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:19.652422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac6b27-92ea-4794-801f-d29491b5c196 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:19.653406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac6b27-92ea-4794-801f-d29491b5c196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:19.655637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac6b27-92ea-4794-801f-d29491b5c196 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:19.674244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:19.676803 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3393/6725] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:19.681562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:19.689341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d469e4a-61bf-4955-97a6-5433d8212e9a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:19.697977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:19.699876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:19.700835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:19.702373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] PATH_INFO: `/v3/projects/9c1c399645294a54ad1b94603d344bbe/users/3164624635f7424eb09b43d16a088035/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:19.709303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1c399645294a54ad1b94603d344bbe, user_id=3164624635f7424eb09b43d16a088035, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:19.712291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:19.744477 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3333/6726] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:19 2022] PUT /identity/v3/projects/9c1c399645294a54ad1b94603d344bbe/users/3164624635f7424eb09b43d16a088035/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:19.748102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:19.748990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:19.749456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:19.789808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] MFA Rules not processed for user `3164624635f7424eb09b43d16a088035`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:19.791418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:19.915901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:20.038195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3394/6727] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:44:20.051838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:20.053750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:20.147863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5f11-d0c2-4eb7-8f65-158ca94ca9f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:20.162597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:20.163834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:20.164177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:20.164530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:20.298843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:20.300323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:20.334780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3334/6728] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:20.903596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:20.905352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:21.041847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d720532-83d1-4f5f-b3c8-1c9c4f280a66 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:21.049111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:21.052590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:21.053673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:21.054095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:21.065634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:21.067561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:21.080382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3395/6729] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:22.105343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:22.107027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:22.215884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d2e9-dbd9-4d1d-8a83-d0bc46347ffb service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:22.227442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:22.228914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:22.229198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:22.230500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] PATH_INFO: `/v3/users/e44979e46f754f7e9f847e285e4f43bb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:22.231918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44979e46f754f7e9f847e285e4f43bb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:22.234094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:22.317885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:22.320241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44979e46f754f7e9f847e285e4f43bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:22.335960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44979e46f754f7e9f847e285e4f43bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:22.336756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44979e46f754f7e9f847e285e4f43bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:22.337949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44979e46f754f7e9f847e285e4f43bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:22.350112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7ee98ab-8cbc-4887-a645-4375902f258b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44979e46f754f7e9f847e285e4f43bb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:22.376986 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3335/6730] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:22 2022] DELETE /identity/v3/users/e44979e46f754f7e9f847e285e4f43bb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:22.797861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:22.851337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e9c2-1d48-4f3e-bac4-78c4a2f5dba6 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:22.982404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:22.988314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:22.988633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:22.989022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] PATH_INFO: `/v3/projects/cb6313a61b3f45fea2f48aee866b7ba4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:22.991631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6313a61b3f45fea2f48aee866b7ba4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:22.997640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:23.098405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6313a61b3f45fea2f48aee866b7ba4', 'request_id': 'req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:23.101841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:23.110631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6313a61b3f45fea2f48aee866b7ba4', 'request_id': 'req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:23.122353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6313a61b3f45fea2f48aee866b7ba4', 'request_id': 'req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:23.147846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] The token cache is being invalidate because project cb6313a61b3f45fea2f48aee866b7ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:23.148467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:23.150135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4334347-077c-4e7f-bf26-7fdc66b0dbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:23.157849 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3396/6731] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:22 2022] DELETE /identity/v3/projects/cb6313a61b3f45fea2f48aee866b7ba4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:23.164102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:23.164611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:23.164703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:23.210547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:23.225104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:23.393745 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3336/6732] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:23.402117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:23.402443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:23.403186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:23.456758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:23.467057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:23.497676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3397/6733] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:23.505027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:23.526755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c892e41-f42a-4460-a3f8-27436ffb968a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:23.547611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:23.551100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:23.553956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:23.558426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:23.560402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:44:23.561126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:23.566630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:23.588461 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3337/6734] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:44:23.589153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:23.610181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b40acd-fccd-43b5-8a0b-a8e39349806a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:23.617425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:23.617860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:23.618173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:23.618686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:23.619883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:23.622514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:23.665291 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3398/6735] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:23 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:23.670045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:23.687044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658412-e3e5-49fc-bcb7-a2ad0379dc69 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:23.848097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:23.848730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:23.849009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:23.849282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:23.851718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:23.863573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:23.950884 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3338/6736] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:23 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:23.955463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:23.981609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75f65c-646b-4d01-af8a-475b782e9215 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:23.995430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:23.996400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:23.996881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:23.997351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:23.998624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:24.001673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:24.029039 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3399/6737] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:24.034334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:24.057560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37688987-7a95-4c87-ae98-39ee0ee8fd92 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:24.065644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd116f-9097-4d68-9c72-559cb75c3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:24.066425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd116f-9097-4d68-9c72-559cb75c3d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:24.066829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd116f-9097-4d68-9c72-559cb75c3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:24.067176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd116f-9097-4d68-9c72-559cb75c3d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:24.067984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd116f-9097-4d68-9c72-559cb75c3d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:24.071768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd116f-9097-4d68-9c72-559cb75c3d66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:24.091712 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3339/6738] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:24.095285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:24.114074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27e72-9b2c-4aef-b5fa-872f63aae4a2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:24.128503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:24.129209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:24.129638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:24.130189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] PATH_INFO: `/v3/projects/163a495a56ed4c8e9835cb35b27de6b3/users/6a8f3221bcb944dcb4b38194f2cd90ad/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:24.172728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163a495a56ed4c8e9835cb35b27de6b3, user_id=6a8f3221bcb944dcb4b38194f2cd90ad, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:24.177621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:24.211702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3400/6739] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:24 2022] PUT /identity/v3/projects/163a495a56ed4c8e9835cb35b27de6b3/users/6a8f3221bcb944dcb4b38194f2cd90ad/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:24.217248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:24.217745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:24.217838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:24.273935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:24.278951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:24.353583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:24.434324 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3340/6740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:24.443172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:24.445079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:24.570519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c26d5-a5e9-4513-bb92-f82e84cb83a0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:24.581877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:24.582681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:24.583103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:24.583449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:24.617548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:24.619597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:24.637104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3401/6741] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:44:33.043857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:33.045567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:33.229194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28dd57-5e89-4dc3-aeaa-2d003fe57f3d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:33.245879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:33.251469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:33.252041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:33.252536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:33.257270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:33.563199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:33.563199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709da4ae-8d9f-45b9-bbd6-b0e954cab3e0 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:33.615665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3341/6742] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:34.628733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=58,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:34.924712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:34.927614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:34.961608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe93c-243b-4b57-a170-aa4427df7088 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:34.989942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:34.991279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:34.993006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:34.995907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] PATH_INFO: `/v3/users/c23f31668bce435f87b8ec48da3b5f75` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:34.999164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23f31668bce435f87b8ec48da3b5f75)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:35.004263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:35.162994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23f31668bce435f87b8ec48da3b5f75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:35.224431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23f31668bce435f87b8ec48da3b5f75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:35.225510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23f31668bce435f87b8ec48da3b5f75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:35.226516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23f31668bce435f87b8ec48da3b5f75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:35.250841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23f31668bce435f87b8ec48da3b5f75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:35.303577 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3402/6743] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:34 2022] DELETE /identity/v3/users/c23f31668bce435f87b8ec48da3b5f75 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:35.308610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe138-8354-4e2e-8a1c-cfdd02514e2a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:35.309106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe138-8354-4e2e-8a1c-cfdd02514e2a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:35.309106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe138-8354-4e2e-8a1c-cfdd02514e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:35.349517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-559fe138-8354-4e2e-8a1c-cfdd02514e2a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:35.351485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-559fe138-8354-4e2e-8a1c-cfdd02514e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:35.498315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:35.545272 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3342/6744] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:35.608684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:35.612373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:35.889162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d66673-e720-4324-82e7-5b762efb2aee admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:35.905036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:35.909931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:35.910246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:35.910523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:35.970809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:35.982322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:36.020981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:36.021214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:36.021502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:36.032430 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3403/6745] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:36.301574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:36.311793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:36.438517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:36.441029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:36.471039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17738e9-9208-4f18-ac3b-128a22daa008 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:36.478275 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3343/6746] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:36.507201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:36.519818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:36.520744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:36.521214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] PATH_INFO: `/v3/users/4f8ce7f2557448958aa7eec54a9de966` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:36.522876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8ce7f2557448958aa7eec54a9de966)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:36.530590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:36.580994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:36.582710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:36.652828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8ce7f2557448958aa7eec54a9de966'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:36.675145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8ce7f2557448958aa7eec54a9de966'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:36.676193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8ce7f2557448958aa7eec54a9de966'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:36.676805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8ce7f2557448958aa7eec54a9de966'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:36.685379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:36.690991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-712c5c0a-80d6-4ca9-a127-9363668f1e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8ce7f2557448958aa7eec54a9de966'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:36.719822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3404/6747] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:36 2022] DELETE /identity/v3/users/4f8ce7f2557448958aa7eec54a9de966 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:36.724156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:36.724696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:36.724982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:36.789061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:36.791963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:36.889549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce2227-9612-4e06-a45d-9a4b192304a5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:36.972848 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3405/6748] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:36.993083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:36.994547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.146879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:37.147530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.148104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.148104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.159149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.186103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:37.208284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827980a2-a995-4ea5-adce-b2b546e8c78f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:37.228429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:37.229488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.230554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.231096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.259195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:37.261611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:37.290450 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3406/6749] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:44:37.292295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:37.296022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.327797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2ad2-5969-4096-ae95-f87b166808ad service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:37.341986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:37.344946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bd8c-1ec7-41cb-b833-7619ac41e372 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:37.351866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:37.352691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.353042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.354307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] PATH_INFO: `/v3/projects/03795a954fb2485ead31ca60cf4d5afd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.356715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03795a954fb2485ead31ca60cf4d5afd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:37.362104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:37.366825 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3344/6750] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:44:37.368342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eec16-d1eb-4c2e-ab8f-332ab129e2d1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.369560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eec16-d1eb-4c2e-ab8f-332ab129e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.371066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eec16-d1eb-4c2e-ab8f-332ab129e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.440841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-882eec16-d1eb-4c2e-ab8f-332ab129e2d1 None None] MFA Rules not processed for user `6a8f3221bcb944dcb4b38194f2cd90ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:37.442077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-882eec16-d1eb-4c2e-ab8f-332ab129e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.515049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03795a954fb2485ead31ca60cf4d5afd', 'request_id': 'req-12ecac60-bc4e-4af6-837a-b8a5cc863412'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:37.532828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03795a954fb2485ead31ca60cf4d5afd', 'request_id': 'req-12ecac60-bc4e-4af6-837a-b8a5cc863412'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:37.564495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03795a954fb2485ead31ca60cf4d5afd', 'request_id': 'req-12ecac60-bc4e-4af6-837a-b8a5cc863412'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:37.607660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] The token cache is being invalidate because project 03795a954fb2485ead31ca60cf4d5afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:37.607959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:37.610322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-12ecac60-bc4e-4af6-837a-b8a5cc863412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:37.615537 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3407/6751] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:37 2022] DELETE /identity/v3/projects/03795a954fb2485ead31ca60cf4d5afd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:37.620477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.620759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.621031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.678629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:37.679875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.686932 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3345/6752] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:37.702181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5183-2b55-4aa6-8aeb-1e3abe2b740f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.704803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5183-2b55-4aa6-8aeb-1e3abe2b740f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.705287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5183-2b55-4aa6-8aeb-1e3abe2b740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.707444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:37.787384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d92d5183-2b55-4aa6-8aeb-1e3abe2b740f None None] MFA Rules not processed for user `6a8f3221bcb944dcb4b38194f2cd90ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:37.795159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d92d5183-2b55-4aa6-8aeb-1e3abe2b740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.821025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3408/6753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:44:37.822082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:37.823449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:37.862328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbac23-9dcd-467a-b597-f63ada2de8ef None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:37.876088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:37.876905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:37.877260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:37.877615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] PATH_INFO: `/v3/users/a258995ccb4a4d31a83f7483ea1e85ec` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:37.879351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a258995ccb4a4d31a83f7483ea1e85ec)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:37.881722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:38.000262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a258995ccb4a4d31a83f7483ea1e85ec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.022424 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3346/6754] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:44:38.028742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:38.029033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:38.029313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:38.074260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a258995ccb4a4d31a83f7483ea1e85ec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.074260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a258995ccb4a4d31a83f7483ea1e85ec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.080654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a258995ccb4a4d31a83f7483ea1e85ec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.103718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a258995ccb4a4d31a83f7483ea1e85ec'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.112745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:38.126810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.149017 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3409/6755] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:37 2022] DELETE /identity/v3/users/a258995ccb4a4d31a83f7483ea1e85ec => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:38.150625 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3347/6756] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:38.152828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:38.154969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:38.158170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.159985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.341728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:38.407269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8ce4a-86e7-4a23-ae34-a0d324c617db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:38.415160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe8662-e69e-4ff8-b487-d87e00e3c28d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:38.419932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:38.421225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:38.421504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:38.426288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] PATH_INFO: `/v3/projects/2849c86d494f40969cf8e95b1a54f34a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:38.431205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2849c86d494f40969cf8e95b1a54f34a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:38.433164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:38.565438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:38.609635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2849c86d494f40969cf8e95b1a54f34a', 'request_id': 'req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.619764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2849c86d494f40969cf8e95b1a54f34a', 'request_id': 'req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.629657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2849c86d494f40969cf8e95b1a54f34a', 'request_id': 'req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.660433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] The token cache is being invalidate because project 2849c86d494f40969cf8e95b1a54f34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:38.661242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.662132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7d204ad5-8f44-4a24-a8b8-14a1191e1b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:38.663383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:38.664198 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3410/6757] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:38 2022] DELETE /identity/v3/projects/2849c86d494f40969cf8e95b1a54f34a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:38.665694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:38.666134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:38.666284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:38.666476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:38.666746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:38.666872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:38.671712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.693230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:38.694794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.854993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:38.859456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:38.861983 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3411/6758] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:38.865474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:38.870050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.884085 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3348/6759] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:38.884975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:38.892000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.899673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1f848-ab83-48db-aa6f-89d783bda9b2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:38.906594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:38.907728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:38.908224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:38.908829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:38.909856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:44:38.910452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:38.912318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:38.919928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d28b39-0e36-47a3-95ae-70aad0b5d7e8 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:38.935760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:38.936670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:38.937054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:38.937469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] PATH_INFO: `/v3/users/3164624635f7424eb09b43d16a088035` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:38.938018 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3412/6760] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:44:38.939114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3164624635f7424eb09b43d16a088035)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:38.939491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:38.941605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:38.942513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:39.055825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3164624635f7424eb09b43d16a088035'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:39.075499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ede66-1249-431f-8677-71e1d7ab20be admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:39.077696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3164624635f7424eb09b43d16a088035'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:39.079141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3164624635f7424eb09b43d16a088035'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:39.080815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3164624635f7424eb09b43d16a088035'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:39.087089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:39.087963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:39.088417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:39.088889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:39.098263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:39.099565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3164624635f7424eb09b43d16a088035'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:39.110913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:39.134773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:39.142470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:39.146456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3349/6761] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:38 2022] DELETE /identity/v3/users/3164624635f7424eb09b43d16a088035 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:39.147074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:39.148434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:39.185330 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3413/6762] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:39.266089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f727b5-35fa-4fea-a002-af9eecd9064e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:39.276942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:39.277749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:39.278043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:39.279518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:39.280580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:39.284279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:39.361386 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3350/6763] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:39 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:39.365000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:39.379215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230ac67-a964-403d-93de-585f27e47b5a service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:39.489450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:39.529115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:39.529766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:39.530052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:39.530364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:39.531620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:39.538751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:39.622742 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3414/6764] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:39 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:39.628831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:39.643515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c147-3dc0-407a-a8eb-2c2719851964 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:39.673410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:39.675600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:39.689064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:39.692374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:39.697835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:39.697835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:39.698846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:39.712614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:39.728293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482402a-724b-4268-9c65-e31195288e99 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:39.781580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:39.789771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:39.794570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:39.795502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] PATH_INFO: `/v3/projects/9c1c399645294a54ad1b94603d344bbe` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:39.799985 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3351/6765] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:39.805007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1c399645294a54ad1b94603d344bbe)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:39.805897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:39.817936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:39.869019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb8843-8208-42ce-9369-458fc0cf89f1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:39.919787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:39.921232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:39.926210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:39.929026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:39.933376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:39.940007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:40.005478 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3352/6766] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:40.011727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:40.107345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b8f3-45b3-4640-9b74-cb012f0b7309 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:40.134468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1c399645294a54ad1b94603d344bbe', 'request_id': 'req-ab09d912-8921-47d0-9500-107ab317280b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:40.161321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1c399645294a54ad1b94603d344bbe', 'request_id': 'req-ab09d912-8921-47d0-9500-107ab317280b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:40.184257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1c399645294a54ad1b94603d344bbe', 'request_id': 'req-ab09d912-8921-47d0-9500-107ab317280b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:40.213419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] The token cache is being invalidate because project 9c1c399645294a54ad1b94603d344bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:40.214242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:40.216083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab09d912-8921-47d0-9500-107ab317280b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:40.220834 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3415/6767] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:39 2022] DELETE /identity/v3/projects/9c1c399645294a54ad1b94603d344bbe => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:40.227180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ad55-6280-48da-be7d-8c6d4509cbb6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:40.227485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ad55-6280-48da-be7d-8c6d4509cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:40.227750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ad55-6280-48da-be7d-8c6d4509cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:40.292818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4eb6ad55-6280-48da-be7d-8c6d4509cbb6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:40.302061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4eb6ad55-6280-48da-be7d-8c6d4509cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:40.349273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:40.353501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:40.357390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:40.358451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] PATH_INFO: `/v3/projects/3f6b12ae893045e088ba4250383f32ea/users/d8f7dedc2e03434985135727219e0d42/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:40.450974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6b12ae893045e088ba4250383f32ea, user_id=d8f7dedc2e03434985135727219e0d42, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:40.457873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:40.553047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3353/6768] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:40 2022] PUT /identity/v3/projects/3f6b12ae893045e088ba4250383f32ea/users/d8f7dedc2e03434985135727219e0d42/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:40.555740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:40.568188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:40.593713 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3416/6769] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:44:40.601219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:40.601517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:40.603670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:40.671322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:40.753766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c870-4759-4644-ad9b-af55ff23e49a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:40.766686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] MFA Rules not processed for user `d8f7dedc2e03434985135727219e0d42`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:40.767949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:40.768541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:40.770922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:40.774693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:40.775796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:40.784914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:40.830331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:40.832445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb9089-a92e-4fb1-b27c-653e4f807a86 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:40.849552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3354/6770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:40.854440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:40.854767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:40.855041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:40.904677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:40.909980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:40.920490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:40.983780 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3417/6771] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:40.988410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:40.994180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:41.144973 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3355/6772] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:41.161749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:41.171002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:41.298042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307863f-3d3e-4f8a-b914-5120d2cdd984 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:41.322221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:41.322888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:41.323168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:41.323438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] PATH_INFO: `/v3/projects/ec3dafdfbd78428886e9eea63bfd555f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:41.331062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3dafdfbd78428886e9eea63bfd555f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:41.334253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:41.407562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2061a-4de1-432f-bb0b-f6dd98d93dd9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:41.442060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3dafdfbd78428886e9eea63bfd555f', 'request_id': 'req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:41.457578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3dafdfbd78428886e9eea63bfd555f', 'request_id': 'req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:41.469654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3dafdfbd78428886e9eea63bfd555f', 'request_id': 'req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:41.504800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] The token cache is being invalidate because project ec3dafdfbd78428886e9eea63bfd555f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:41.505113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:41.506899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:41.514574 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3418/6773] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:40 2022] DELETE /identity/v3/projects/ec3dafdfbd78428886e9eea63bfd555f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:41.516087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:41.521021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:41.686507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:41.687184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:41.687493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:41.688193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:41.708323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:41.754902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8cbf1-fe14-450e-9c59-e6835ce11a93 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:41.772629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:41.773280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:41.773564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:41.773844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:41.774784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:44:41.775057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:41.786866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6d350-fb69-4fcf-9730-4035944905c8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:41.837389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3419/6774] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:44:41.845204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:41.845505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:41.845789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:41.892064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:41.899342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:41.914239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:41.946010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:41.951560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1a7ba-9e59-4fcd-85e0-c91bff0a41bd service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:41.962913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3420/6775] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:41.963837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:41.980583 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3356/6776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:41.985243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:41.985809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:41.986697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.027969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bcd15-7237-4fb2-af2e-19cb8270719c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:42.049793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:42.052840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:42.064352 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3357/6777] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:42.079476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:42.083699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:42.084066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:42.087407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.088133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:42.090504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:42.104039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:42.117116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:42.148150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e66a2-4803-40ff-9612-623068124cc0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:42.164238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:42.164951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:42.166240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:42.167869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.180736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:44:42.187139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:42.194290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:42.194851 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3421/6778] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:41 2022] POST /identity/v3/projects => generated 397 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:42.196656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:42.269423 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3358/6779] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:44:42.270264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:42.307000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bdd54-bcbe-44fd-9e7a-a7b718695d02 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:42.525313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843608b-dac6-453b-95ba-8c7e166b3329 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:42.528837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:42.530162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:42.531586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:42.532519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.534228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:42.536766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:42.573029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:42.575284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:42.577966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:42.579158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.581203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:42.589467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:42.621799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3359/6780] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:42 2022] POST /identity/v3/projects => generated 365 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:42.623091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:42.691322 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3422/6781] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:42 2022] POST /identity/v3/users => generated 299 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:42.692281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:42.752258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee54f-5b51-49ab-811e-d469f5537ce3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:42.825955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560530e7-766d-46ad-b58e-2a4c29d85432 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:42.846869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:42.847635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:42.848021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:42.848400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.849342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:42.851587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:42.931213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:42.939603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:42.941820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:42.943239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:42.945429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:42.956611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:42.959901 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3360/6782] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:42 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:42.962705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.017270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1edc9f-449a-4afe-875d-9e23ef958829 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.017458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3423/6783] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:43.019154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.036547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.040339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.042310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.042667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.045810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.054761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.059652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad500-f0dc-4a4a-a0ad-4860d8f1e47d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.089396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.091256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.095124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.097033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.098665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.106637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.110490 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3361/6784] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:43.111977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.161233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e91c-b973-47b6-94a0-bd400a5172f1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.167033 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3424/6785] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:43.169031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.206915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.216535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.217950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.222072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.225726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.230407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.251019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca871e-deae-4f15-84a0-0a9fda0d6cdc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.279059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f21793-4ce5-4308-8c2d-8bf8f2346140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.284193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21793-4ce5-4308-8c2d-8bf8f2346140 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.284488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21793-4ce5-4308-8c2d-8bf8f2346140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.288040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21793-4ce5-4308-8c2d-8bf8f2346140 admin admin] PATH_INFO: `/v3/projects/5a82203bc65d41ee8151e16f75aae863/users/589c83708f8d4aeb8f208d02308b6583/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.321988 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3362/6786] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:43.326625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.382183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f21793-4ce5-4308-8c2d-8bf8f2346140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a82203bc65d41ee8151e16f75aae863, user_id=589c83708f8d4aeb8f208d02308b6583, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.382815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d297487-e992-43d5-b348-28b010714b4d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.392210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f21793-4ce5-4308-8c2d-8bf8f2346140 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.402247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924533c-af40-4250-85a3-609747bf57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.406788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924533c-af40-4250-85a3-609747bf57ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.407232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924533c-af40-4250-85a3-609747bf57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.408188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924533c-af40-4250-85a3-609747bf57ac admin admin] PATH_INFO: `/v3/projects/72d96b1acb624949b603a8df2acef085/users/bd693c76b1694649a3223facbb823ce4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.428493 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3425/6787] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:43 2022] PUT /identity/v3/projects/5a82203bc65d41ee8151e16f75aae863/users/589c83708f8d4aeb8f208d02308b6583/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:43.440488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.440850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.441121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.479814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924533c-af40-4250-85a3-609747bf57ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d96b1acb624949b603a8df2acef085, user_id=bd693c76b1694649a3223facbb823ce4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.486970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924533c-af40-4250-85a3-609747bf57ac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.494680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:43.531738 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3363/6788] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:43 2022] PUT /identity/v3/projects/72d96b1acb624949b603a8df2acef085/users/bd693c76b1694649a3223facbb823ce4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:44:43.542063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] MFA Rules not processed for user `589c83708f8d4aeb8f208d02308b6583`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:43.544856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:43.549732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.550435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.554661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.617126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] MFA Rules not processed for user `bd693c76b1694649a3223facbb823ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:43.618478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:43.620872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:43.730418 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3426/6789] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:43.739293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.740938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:43.772827 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3364/6790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:43.780423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:43.782318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:43.892717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff9178-d8f5-472c-b022-57824a24f8a3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.899277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864594-cc0f-4912-bedf-c720dbacb6d1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:43.907616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.908414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.908706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.908980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.918954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:43.922023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:43.926459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:43.927170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:43.931511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.934947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.951575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:43.957174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:43.964565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3427/6791] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:43.980462 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3365/6792] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:44:47.153120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:47.154857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:47.568100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707d94-0b3e-4462-bc0a-004d11a0df6d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:47.596939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:47.597521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:47.597806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:47.598084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:47.616369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:47.715316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:47.717328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:47.779815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3428/6793] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:50.804020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:50.815898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:50.865555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff848b5-91a7-458c-a43c-02f6fa9b9262 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:50.914964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:50.915621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:50.915912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:50.916192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:50.923553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:51.297506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:51.306821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3149b2f-d1f1-43ea-8def-85e114f64ebf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:51.350521 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3366/6794] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:53.836486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:53.838794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:53.884251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5c78-18a8-4160-bffd-b8c8d829b989 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:53.917630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:53.917630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:53.917966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:53.918183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] PATH_INFO: `/v3/users/d8f7dedc2e03434985135727219e0d42` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:53.925480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f7dedc2e03434985135727219e0d42)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:53.945180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:54.088197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f7dedc2e03434985135727219e0d42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:54.114908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:54.134839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f7dedc2e03434985135727219e0d42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:54.137199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f7dedc2e03434985135727219e0d42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:54.138492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f7dedc2e03434985135727219e0d42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:54.161257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f7dedc2e03434985135727219e0d42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:54.194115 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3429/6795] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:44:53 2022] DELETE /identity/v3/users/d8f7dedc2e03434985135727219e0d42 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:54.199808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:54.200354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:54.200605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:54.268089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:54.269936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:54.307332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:54.480432 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3367/6796] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:54.512043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:54.517385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:54.740783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a566aac-df18-468c-bb66-1832c8210eaf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:54.763123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76391ab-725b-4ff6-bde3-2d13eee1f571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:54.763787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76391ab-725b-4ff6-bde3-2d13eee1f571 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:54.764841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76391ab-725b-4ff6-bde3-2d13eee1f571 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:54.765702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76391ab-725b-4ff6-bde3-2d13eee1f571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:54.833773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76391ab-725b-4ff6-bde3-2d13eee1f571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:54.844982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76391ab-725b-4ff6-bde3-2d13eee1f571 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:54.875498 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3430/6797] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:44:57.619732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:57.621234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:57.647715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b91bc-32c0-4de9-addb-69ab698525b6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:57.654327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:57.655479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:57.656121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:57.667445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] PATH_INFO: `/v3/projects/3f6b12ae893045e088ba4250383f32ea` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:57.670233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6b12ae893045e088ba4250383f32ea)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:57.674979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:57.789569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6b12ae893045e088ba4250383f32ea', 'request_id': 'req-3424e670-4487-4a35-9bc6-b85603e906c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:57.803664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6b12ae893045e088ba4250383f32ea', 'request_id': 'req-3424e670-4487-4a35-9bc6-b85603e906c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:57.820392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6b12ae893045e088ba4250383f32ea', 'request_id': 'req-3424e670-4487-4a35-9bc6-b85603e906c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:57.844160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] The token cache is being invalidate because project 3f6b12ae893045e088ba4250383f32ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:44:57.844552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:57.846636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3424e670-4487-4a35-9bc6-b85603e906c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:44:57.855006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3368/6798] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:44:57 2022] DELETE /identity/v3/projects/3f6b12ae893045e088ba4250383f32ea => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:57.857051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:57.857576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:57.857699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:57.920798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:57.927173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:58.065293 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3431/6799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:58.075881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:58.076374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:58.076945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:58.197035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:58.210052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:58.250238 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3369/6800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:58.254511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:58.270927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73def6-7fd0-4092-bcf2-536633c619d3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:58.292683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:58.307095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:58.307546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:58.307978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:58.309301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:44:58.309301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:58.318011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:58.403343 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3432/6801] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:44:58.405120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:58.419388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30535bbb-3991-4780-8258-5c7a96b241fd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:58.443658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:58.446349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:58.447854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:58.449945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:58.454260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:58.461199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:58.559604 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3370/6802] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:58 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:44:58.566032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:58.595466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c665ff-4852-4323-a143-5ea88734197c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:58.801698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:58.802517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:58.802858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:58.803215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:58.803965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:58.806372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:58.836581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:58.896038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3433/6803] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:58 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:58.898217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:58.918333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fc9c-d94d-49f4-b6f6-105a8220807b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:58.940814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:58.943754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:58.944145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:58.944505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:58.945283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:58.956270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:58.993554 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3371/6804] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:44:58.995254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:59.012433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084fa0-d04f-4555-a55c-8514d35b8da3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:59.038195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbe045-faf1-45c1-be2d-8f9af6267e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:59.039157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbe045-faf1-45c1-be2d-8f9af6267e6c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:59.039558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbe045-faf1-45c1-be2d-8f9af6267e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:59.039943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbe045-faf1-45c1-be2d-8f9af6267e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:59.040719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbe045-faf1-45c1-be2d-8f9af6267e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:59.042792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbe045-faf1-45c1-be2d-8f9af6267e6c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:59.078720 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3434/6805] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:44:59.080253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:59.101286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef552b-6dc4-4ec5-ac57-8e846925835b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:59.116921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:59.117784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:59.120187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:59.120187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] PATH_INFO: `/v3/projects/abf43ad0512245edac45cfe98331f9ba/users/1a9207a868db4cc5873222440caea5da/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:59.186011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf43ad0512245edac45cfe98331f9ba, user_id=1a9207a868db4cc5873222440caea5da, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:59.188930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:59.231808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3372/6806] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:44:59 2022] PUT /identity/v3/projects/abf43ad0512245edac45cfe98331f9ba/users/1a9207a868db4cc5873222440caea5da/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:44:59.244118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:59.244581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:59.245369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:59.339119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] MFA Rules not processed for user `1a9207a868db4cc5873222440caea5da`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:44:59.340469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:44:59.564863 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3435/6807] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:44:59.570787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:59.680982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:44:59.729807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e7564-82d2-4d79-8b40-fee7bfee9318 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:44:59.745882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:44:59.746724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:44:59.747134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:44:59.747529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:44:59.748297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:44:59.753093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:44:59.820722 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3373/6808] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:44:59 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:44:59.822452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:44:59.840061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6b6d-7a76-4514-87e5-57c1f2950b03 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:00.035129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:00.035794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:00.036187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:00.036540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:00.037266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:00.043441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:00.109369 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3436/6809] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:44:59 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:00.112617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:00.129460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493f21-b2f8-478e-8e93-fffed6aa7398 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:00.147693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba546d-75e5-4b48-b313-9e48e6ca26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:00.150050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba546d-75e5-4b48-b313-9e48e6ca26d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:00.150373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba546d-75e5-4b48-b313-9e48e6ca26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:00.153597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba546d-75e5-4b48-b313-9e48e6ca26d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:00.155602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba546d-75e5-4b48-b313-9e48e6ca26d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:00.162759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba546d-75e5-4b48-b313-9e48e6ca26d6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:00.198364 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3374/6810] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:00.203106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:00.226809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d8fcb-0310-4cf2-8619-6fba3017427c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:00.249411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:00.250189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:00.250460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:00.250737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] PATH_INFO: `/v3/projects/fefaa88df2b347c7b7e8eacf84900ebd/users/951c436269b5474299fa6f753ab1ecdf/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:00.333167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefaa88df2b347c7b7e8eacf84900ebd, user_id=951c436269b5474299fa6f753ab1ecdf, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:00.349493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:00.405072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3437/6811] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:00 2022] PUT /identity/v3/projects/fefaa88df2b347c7b7e8eacf84900ebd/users/951c436269b5474299fa6f753ab1ecdf/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:00.408026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:00.408590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:00.409070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:00.506254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] MFA Rules not processed for user `951c436269b5474299fa6f753ab1ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:00.508053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:00.725708 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3375/6812] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:00 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:00.873251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:00.875211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:01.006852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:01.091958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95e35-a831-4408-8a73-f1ba97aa1453 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:01.118995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:01.120043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:01.121310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:01.121832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:01.168241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:01.169875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:01.189115 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3438/6813] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:45:03.437760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:03.679576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040149-ddc5-468c-8719-871a7918b862 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:03.696775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:03.697457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:03.697745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:03.705305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] PATH_INFO: `/v3/users/1a9207a868db4cc5873222440caea5da` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:03.712312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9207a868db4cc5873222440caea5da)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:03.719250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:03.732755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:03.756956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9c41-b789-4342-9f39-f501a60e6bc3 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:03.786496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:03.787545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:03.787893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:03.788245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:03.790963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:03.837257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:03.844234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9207a868db4cc5873222440caea5da'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:03.862057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9207a868db4cc5873222440caea5da'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:03.862723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9207a868db4cc5873222440caea5da'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:03.863788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9207a868db4cc5873222440caea5da'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:03.877166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56ab7d41-69ab-401e-9231-ab4d122929a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9207a868db4cc5873222440caea5da'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:03.954270 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3376/6814] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:03 2022] DELETE /identity/v3/users/1a9207a868db4cc5873222440caea5da => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:03.958958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:03.959550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:03.960069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:04.019716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:04.021345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:04.032719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:04.037802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:04.057046 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3439/6815] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:45:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:45:04.320933 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3377/6816] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:04.361561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:04.363336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:04.698705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70849361-b4bd-4d18-b710-faf3d4891686 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:04.851450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:04.852166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:04.852380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:04.852622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:04.871208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:04.873490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:04.889382 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3440/6817] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:45:06.334651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:06.337615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:06.366543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44286fdd-d724-4571-8ff7-c56078fcac2c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:06.403756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:06.404435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:06.404728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:06.405037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] PATH_INFO: `/v3/users/a2150305f8e240ce86b8008d84da243d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:06.417518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2150305f8e240ce86b8008d84da243d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:06.419538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:06.426653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:06.428957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:06.468631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c96f-7645-4848-a21e-75d2925d49d1 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:06.508990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:06.510928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:06.511389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:06.515449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] PATH_INFO: `/v3/projects/abf43ad0512245edac45cfe98331f9ba` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:06.517103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf43ad0512245edac45cfe98331f9ba)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:06.519278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:06.585016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:06.596144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2150305f8e240ce86b8008d84da243d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.623585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2150305f8e240ce86b8008d84da243d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.624931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2150305f8e240ce86b8008d84da243d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.626015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2150305f8e240ce86b8008d84da243d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.639395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2150305f8e240ce86b8008d84da243d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.697187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf43ad0512245edac45cfe98331f9ba', 'request_id': 'req-d9468838-d337-4e9a-a936-2b3192d335f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.712140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3378/6818] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:06 2022] DELETE /identity/v3/users/a2150305f8e240ce86b8008d84da243d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:06.731263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf43ad0512245edac45cfe98331f9ba', 'request_id': 'req-d9468838-d337-4e9a-a936-2b3192d335f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.744785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf43ad0512245edac45cfe98331f9ba', 'request_id': 'req-d9468838-d337-4e9a-a936-2b3192d335f8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.783029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] The token cache is being invalidate because project abf43ad0512245edac45cfe98331f9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:06.783589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.784272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:06.792001 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3441/6819] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:06 2022] DELETE /identity/v3/projects/abf43ad0512245edac45cfe98331f9ba => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:45:06.793880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:06.798678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:06.928541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:07.026245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f348926-e1f0-4573-9274-2a4688a34002 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:07.049284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:07.049966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:07.050318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:07.050552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] PATH_INFO: `/v3/users/951c436269b5474299fa6f753ab1ecdf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:07.058857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] RBAC: Authorizing `identity:delete_user(user_id=951c436269b5474299fa6f753ab1ecdf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:07.060840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:07.117470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:07.118910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:07.262166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951c436269b5474299fa6f753ab1ecdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.279650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468838-d337-4e9a-a936-2b3192d335f8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:07.288733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951c436269b5474299fa6f753ab1ecdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.288975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:07.288975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:07.288975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:07.288975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] PATH_INFO: `/v3/projects/e29c7efb986e4d2daa801a6553cfa8ec` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:07.289816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951c436269b5474299fa6f753ab1ecdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.290566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951c436269b5474299fa6f753ab1ecdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.301896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bda2b32-1c84-46d1-bf6f-d0454708708d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951c436269b5474299fa6f753ab1ecdf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.302114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29c7efb986e4d2daa801a6553cfa8ec)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:07.303250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:07.371104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3379/6820] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:06 2022] DELETE /identity/v3/users/951c436269b5474299fa6f753ab1ecdf => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:07.448821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29c7efb986e4d2daa801a6553cfa8ec', 'request_id': 'req-35c56e65-949b-4933-9115-36295c07cd39'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.464391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29c7efb986e4d2daa801a6553cfa8ec', 'request_id': 'req-35c56e65-949b-4933-9115-36295c07cd39'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.483473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29c7efb986e4d2daa801a6553cfa8ec', 'request_id': 'req-35c56e65-949b-4933-9115-36295c07cd39'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.513843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] The token cache is being invalidate because project e29c7efb986e4d2daa801a6553cfa8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:07.514475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.516115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-35c56e65-949b-4933-9115-36295c07cd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:07.518688 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3442/6821] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:07 2022] DELETE /identity/v3/projects/e29c7efb986e4d2daa801a6553cfa8ec => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:07.523342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:07.523637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:07.523927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:07.561646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:07.563306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:07.703166 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3380/6822] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:07.705273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:07.705551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:07.705829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:07.738654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:07.742966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:07.766397 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3443/6823] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:07.770405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:07.786572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be5afb-dce7-4a01-80da-3703de00c17e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:07.793284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:07.794459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:07.798215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:07.798789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:07.799676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:07.800693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:07.804005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:07.818399 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3381/6824] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:07.822820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:07.837303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af25c5-d150-4388-9f27-9a5812f11cb2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:07.859289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:07.860986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:07.861524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:07.862573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:07.863472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:07.865940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:07.934464 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3444/6825] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:07 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:07.939506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:07.951707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900a24-dd76-4d2a-9f50-7e32e08ff695 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:08.018673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:08.067881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:08.068921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:08.069430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:08.069945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:08.070858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:08.075530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:08.117711 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3382/6826] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:07 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:08.121615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:08.132143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:08.140702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ba2b8-13be-4e41-8f99-2f2df07d5a02 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:08.148539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:08.150756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:08.151433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:08.151938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:08.152993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:08.155282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:08.175060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3445/6827] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:08.178735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:08.206229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2936-6ab9-4f1f-8747-b19c9a217069 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:08.226475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc40c8-b74e-4505-b175-73a7eb268ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:08.227728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc40c8-b74e-4505-b175-73a7eb268ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:08.228258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc40c8-b74e-4505-b175-73a7eb268ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:08.228759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc40c8-b74e-4505-b175-73a7eb268ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:08.229661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc40c8-b74e-4505-b175-73a7eb268ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:08.232233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc40c8-b74e-4505-b175-73a7eb268ca0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:08.255139 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3383/6828] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:08.267507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:08.282642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f8a3a-eae2-49ba-96af-da61fa1adaa9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:08.292070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:08.297668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:08.298419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:08.299476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] PATH_INFO: `/v3/projects/e967fe5cfd9547808ba1b73fcb94942b/users/dab71b397df24ab8b7b42f802b58233b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:08.342271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e967fe5cfd9547808ba1b73fcb94942b, user_id=dab71b397df24ab8b7b42f802b58233b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:08.348637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:08.387867 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3446/6829] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:08 2022] PUT /identity/v3/projects/e967fe5cfd9547808ba1b73fcb94942b/users/dab71b397df24ab8b7b42f802b58233b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:08.395077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:08.396366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:08.396897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:08.485195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] MFA Rules not processed for user `dab71b397df24ab8b7b42f802b58233b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:08.486658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:08.707285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:08.707866 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3384/6830] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:08.949980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8191b-0896-4049-a7e4-ad6d1904cab9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:08.972500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:08.973421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:08.973950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:08.974549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:08.975420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:08.987644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:09.025207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:09.026932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:09.055172 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3447/6831] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:08 2022] POST /identity/v3/projects => generated 373 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:09.059232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:09.070370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d1e7-fe25-4e40-b197-d151eaa4f55d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:09.277696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e5ca-c852-4dc9-9762-dcd6e8e3d499 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:09.303412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:09.304061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.304348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.304633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:09.321574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:09.329980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:09.350944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:09.351641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.354165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.354428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] PATH_INFO: `/v3/projects/fefaa88df2b347c7b7e8eacf84900ebd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:09.358979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefaa88df2b347c7b7e8eacf84900ebd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:09.361051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:09.375687 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3448/6832] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:09 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:09.376622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:09.391007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20e18d-797c-49bd-b45e-7d7842931e76 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:09.396574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:09.397207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.397560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.397751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:09.398426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:09.400816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:09.416963 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3449/6833] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:09.421938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:09.451217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefaa88df2b347c7b7e8eacf84900ebd', 'request_id': 'req-4b6d4397-e78a-4357-a038-df32c3f0597e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:09.454446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:09.467269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefaa88df2b347c7b7e8eacf84900ebd', 'request_id': 'req-4b6d4397-e78a-4357-a038-df32c3f0597e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:09.472710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f063a23-6d7b-4a21-bd4d-ddecca0e6ffe admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:09.486368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefaa88df2b347c7b7e8eacf84900ebd', 'request_id': 'req-4b6d4397-e78a-4357-a038-df32c3f0597e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:09.533306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:09.537766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] The token cache is being invalidate because project fefaa88df2b347c7b7e8eacf84900ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:09.538175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:09.541515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b6d4397-e78a-4357-a038-df32c3f0597e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:09.545879 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3385/6834] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:09 2022] DELETE /identity/v3/projects/fefaa88df2b347c7b7e8eacf84900ebd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:45:09.551985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.552278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.552563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:09.583075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:09.583898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.585018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.585413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] PATH_INFO: `/v3/projects/5cfc13d72d644fa2adc0cb2d074532e4/users/a349013520c048d788d95bd164a9d4d0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:09.608213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc13d72d644fa2adc0cb2d074532e4, user_id=a349013520c048d788d95bd164a9d4d0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:09.613186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:09.644547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:09.651413 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3450/6835] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:09 2022] PUT /identity/v3/projects/5cfc13d72d644fa2adc0cb2d074532e4/users/a349013520c048d788d95bd164a9d4d0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:09.654803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:09.655690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:09.660290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:09.820796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eb1b3-a2f9-404b-a2f9-1f8579a1c72c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:09.837691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a26467-d9ad-4c50-b2d7-6b397a84e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:09.842877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a26467-d9ad-4c50-b2d7-6b397a84e37c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.843480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a26467-d9ad-4c50-b2d7-6b397a84e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.843850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a26467-d9ad-4c50-b2d7-6b397a84e37c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:09.844550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a26467-d9ad-4c50-b2d7-6b397a84e37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:09.846194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a26467-d9ad-4c50-b2d7-6b397a84e37c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:09.872045 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3386/6836] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:09.889616 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3451/6837] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:09.891370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:09.914962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392cc19-ef05-41ff-9672-a1cfc0f0d574 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:09.990371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b57d7-50d7-446c-9d8f-58c2cdcd0fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:09.992507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b57d7-50d7-446c-9d8f-58c2cdcd0fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:09.992808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b57d7-50d7-446c-9d8f-58c2cdcd0fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:09.993095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b57d7-50d7-446c-9d8f-58c2cdcd0fa3 admin admin] PATH_INFO: `/v3/projects/5cfc13d72d644fa2adc0cb2d074532e4/users/a349013520c048d788d95bd164a9d4d0/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.006368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b57d7-50d7-446c-9d8f-58c2cdcd0fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc13d72d644fa2adc0cb2d074532e4, user_id=a349013520c048d788d95bd164a9d4d0, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.009345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b57d7-50d7-446c-9d8f-58c2cdcd0fa3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.022776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.023635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.023932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.056560 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3387/6838] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:09 2022] PUT /identity/v3/projects/5cfc13d72d644fa2adc0cb2d074532e4/users/a349013520c048d788d95bd164a9d4d0/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:10.064983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.066566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.067075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.073148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:10.074881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:10.158632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] MFA Rules not processed for user `a349013520c048d788d95bd164a9d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:10.161781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:10.248601 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3452/6839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:10.253844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.306125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8dc3d-db7a-47c6-9460-e0ab1e0e5316 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.321002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.321644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.321927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.322229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.322892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:10.323200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.324818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.363278 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3388/6840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:10.364366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.376399 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3453/6841] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:10.383894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.386107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0f2bd-967c-4fe6-a3f3-ec020d06f951 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.400416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.401067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.401357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.401634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.402343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.403972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.404470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90bd57-889b-4252-863b-f81d0ed6b462 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.417913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.418721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.419007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.419285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.419917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.425718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.448899 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3389/6842] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/services => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:10.449871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.496913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa9c2-64f0-419c-8382-74bc9f3c871b tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.501875 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3454/6843] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:10.504843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.549414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:10.614275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:10.666981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3828aa-885e-4131-b621-c7f1cdf7ee8a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.714564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.715216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.715504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.715784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.716634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.720907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.721183 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:10.721183 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:45:10.721183 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:45:10.721497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.722756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.723236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.723671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.724480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.726633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.752092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3390/6844] 10.222.0.23 () {60 vars in 1213 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:10.756564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.764550 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3455/6845] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:10.769822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.788891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895b728-dcaa-4fce-bb11-37c88db0aa19 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.795031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.795996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.797141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.797589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.798446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.800637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.801096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073d432-f63e-4973-9661-e1bf649f873e tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.814723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.815368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.815691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.816382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.817110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.819547 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3456/6846] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:10.824491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.825409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.852514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5775-97f3-4426-8440-6cb64084f5f1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.859890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.860834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.861313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.861758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.864640 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3391/6847] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/services => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:10.865532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.866805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.868368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.885969 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3457/6848] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:10.892955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.920363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495988de-2b14-4b4c-b385-32793abe08d9 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.924213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec2126-7ea0-4035-8a41-9b7bc9f54e4e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.934747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.935383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.935725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.936012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.937504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:10.939151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:10.961369 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3392/6849] 10.222.0.23 () {60 vars in 1213 bytes} [Mon Oct 31 05:45:10 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:10.962802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:10.970066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c9dda-bb04-4cce-83cc-d15701b60732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.970790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c9dda-bb04-4cce-83cc-d15701b60732 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.971089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c9dda-bb04-4cce-83cc-d15701b60732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.971349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c9dda-bb04-4cce-83cc-d15701b60732 admin admin] PATH_INFO: `/v3/projects/49dd613fa6ff47f387e251b7ed25177e/users/129030291b0644019ce64d039013f327/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.987938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f75063-d680-4f3a-b5f1-d71dfb7eb8bb tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:10.996452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:10.997093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:10.997378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:10.997919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:10.998578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.001080 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:11.001080 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:45:11.001080 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:45:11.002915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.006335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c9dda-bb04-4cce-83cc-d15701b60732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dd613fa6ff47f387e251b7ed25177e, user_id=129030291b0644019ce64d039013f327, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.009093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c9dda-bb04-4cce-83cc-d15701b60732 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.018228 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3393/6850] 10.222.0.23 () {58 vars in 1191 bytes} [Mon Oct 31 05:45:10 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:11.023089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.050482 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3458/6851] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:10 2022] PUT /identity/v3/projects/49dd613fa6ff47f387e251b7ed25177e/users/129030291b0644019ce64d039013f327/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:11.052212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.053924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.054600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.057013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c80a09-2bf0-479c-b166-a2cc37b69d26 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.096866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:11.098103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:11.183953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.255027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.255027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.255027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.255027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e1527f4b42354c65b5e72209e4fad6e1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.255712 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:11.255712 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:45:11.255712 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:45:11.255712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.255712 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3394/6852] 10.222.0.23 () {58 vars in 1290 bytes} [Mon Oct 31 05:45:11 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1 => generated 332 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:11.255712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.269202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d091d-582c-4967-bcdf-74d846e3d348 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.287879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.288597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.288884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.289166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.289781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e1527f4b42354c65b5e72209e4fad6e1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.291455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.305846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3459/6853] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:11 2022] POST /identity/v3/auth/tokens => generated 3506 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:11.310504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3395/6854] 10.222.0.23 () {58 vars in 1291 bytes} [Mon Oct 31 05:45:11 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:11.316044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.335515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.337395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:11.398289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707cd5-04fc-4d68-855f-3ec43ef748be None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.439035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.439634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.439919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.440201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.440813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e1527f4b42354c65b5e72209e4fad6e1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.441877 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:11.441877 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:45:11.441877 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:45:11.442834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.548368 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3460/6855] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 31 05:45:11 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:11.552607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.566431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b045c6b-575b-4915-9a71-658214a6fda7 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.574390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86ce67-f030-43b1-a66f-cff6750a7fe6 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.587510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.588170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.588464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.589063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.594880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.595340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.595626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.595904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.596592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.597550 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:11.597550 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:45:11.597550 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:45:11.608689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.620703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.630132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.631333 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3461/6856] 10.222.0.23 () {58 vars in 1191 bytes} [Mon Oct 31 05:45:11 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:11.632292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.674095 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3396/6857] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:11 2022] GET /identity/v3/auth/tokens => generated 3506 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:45:11.676338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470954-b5f2-4583-9837-ca61a804cc32 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.692723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.693327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.693611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.693894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.694531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e1527f4b42354c65b5e72209e4fad6e1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.696134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Could not find Endpoint Group: e1527f4b42354c65b5e72209e4fad6e1.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e1527f4b42354c65b5e72209e4fad6e1. Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 31 05:45:11.742179 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 31 05:45:11.742954 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 31 05:45:11.742954 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 31 05:45:11.742954 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 31 05:45:11.742954 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 31 05:45:11.742954 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e1527f4b42354c65b5e72209e4fad6e1. Oct 31 05:45:11.742954 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:45:11.743237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3462/6858] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 31 05:45:11 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e1527f4b42354c65b5e72209e4fad6e1 => generated 120 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:45:11.747296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.767254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea48a89-f9ef-45f7-8c55-65bf8c0bd2ed service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.776460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.777180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.777470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.777753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services/16ee31f4671d41adadf2d2d6cc23c28d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.778718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_service(service_id=16ee31f4671d41adadf2d2d6cc23c28d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.781804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.797927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:11.826547 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3397/6859] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:11 2022] DELETE /identity/v3/services/16ee31f4671d41adadf2d2d6cc23c28d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:11.832003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.843422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cbaa6-aae9-4ffc-aed3-78f91c3c2257 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:11.877539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:11.887433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:11.888318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:11.888736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:11.889154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:11.890624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:11.892978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:11.927043 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3463/6860] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:11 2022] POST /identity/v3/services => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:11.931322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:11.947703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97a82f-4d0e-4d7d-a91e-abdfa7f1b887 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.006289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.006289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.006289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.006658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.006658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.006658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.043192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3398/6861] 10.222.0.23 () {60 vars in 1213 bytes} [Mon Oct 31 05:45:11 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:12.044837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.073315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b9c1a-f163-4bb2-a3ee-d2fb9cac3353 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.089622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.100797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.101164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.101453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.102226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.106596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.137750 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3464/6862] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:12 2022] POST /identity/v3/services => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:12.143105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.156041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ae227-e2ea-4ff3-a0bc-9a1ff86ee185 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.188237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.188910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.189206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.189481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bbde471ef8864545b80dd45118774dfd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.190306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=bbde471ef8864545b80dd45118774dfd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.191530 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:12.191530 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:45:12.191530 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:45:12.193080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.216226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3399/6863] 10.222.0.23 () {60 vars in 1313 bytes} [Mon Oct 31 05:45:12 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/bbde471ef8864545b80dd45118774dfd => generated 336 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:12.220776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.238244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fea83-1e39-418a-a6ef-9200965feecc tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.279205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.280410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.282590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.295550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services/660f4e6a303d4460ab2adb3c9c078810` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.298625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_service(service_id=660f4e6a303d4460ab2adb3c9c078810)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.304949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.372599 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3465/6864] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:12 2022] DELETE /identity/v3/services/660f4e6a303d4460ab2adb3c9c078810 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:12.373801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.387472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5a45-4333-4e89-a818-142024ea4a31 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.429983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.434353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.437480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.438763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bbde471ef8864545b80dd45118774dfd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.439893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=bbde471ef8864545b80dd45118774dfd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.446344 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:12.446344 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:45:12.446344 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:45:12.447699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.476532 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3400/6865] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 31 05:45:12 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/bbde471ef8864545b80dd45118774dfd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:12.477409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.492240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127a62a-f94e-4621-8959-4994d711135a tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.500756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.500947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.501251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.501427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services/5d821118e24b4528bbf6bbee65cc9938` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.501961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5d821118e24b4528bbf6bbee65cc9938)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.503942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.601291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.601816 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3466/6866] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:12 2022] DELETE /identity/v3/services/5d821118e24b4528bbf6bbee65cc9938 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:12.616681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288dca-8fe2-495d-b633-7cbc002375ea tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.658249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.658912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.659352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.659791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8d7609883be64dc588e4b95ea8c6ae99` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.660522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8d7609883be64dc588e4b95ea8c6ae99)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.662348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.695531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.698765 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3401/6867] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 31 05:45:12 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8d7609883be64dc588e4b95ea8c6ae99 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:12.730865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9a92-c1e0-4b33-a0a7-17dca33d9a6f tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:12.771080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aaa77-b3d9-4e56-8b63-af28c0aebef8 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a349013520c048d788d95bd164a9d4d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfc13d72d644fa2adc0cb2d074532e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:12.771802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aaa77-b3d9-4e56-8b63-af28c0aebef8 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:12.772098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aaa77-b3d9-4e56-8b63-af28c0aebef8 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:12.772376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aaa77-b3d9-4e56-8b63-af28c0aebef8 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] PATH_INFO: `/v3/services/3dea0eca88764af3a2d10e10624c117f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:12.772969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8aaa77-b3d9-4e56-8b63-af28c0aebef8 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3dea0eca88764af3a2d10e10624c117f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:12.774624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8aaa77-b3d9-4e56-8b63-af28c0aebef8 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:12.900939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3467/6868] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:12 2022] DELETE /identity/v3/services/3dea0eca88764af3a2d10e10624c117f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:12.905913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:12.961918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ed4e8-44f1-4b89-b5c1-4500d9383657 tempest-EndPointGroupsTest-1219717576 tempest-EndPointGroupsTest-1219717576-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:13.035605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:13.038900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:13.050317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:13.050762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] PATH_INFO: `/v3/users/dab71b397df24ab8b7b42f802b58233b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:13.071335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab71b397df24ab8b7b42f802b58233b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:13.085383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:13.184490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab71b397df24ab8b7b42f802b58233b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:13.207742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab71b397df24ab8b7b42f802b58233b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:13.208708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab71b397df24ab8b7b42f802b58233b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:13.209568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab71b397df24ab8b7b42f802b58233b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:13.220551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab71b397df24ab8b7b42f802b58233b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:13.256923 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3402/6869] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:12 2022] DELETE /identity/v3/users/dab71b397df24ab8b7b42f802b58233b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:13.268163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:13.276114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:13.276583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:13.389363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:13.390990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:13.768178 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3468/6870] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:13.795333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:13.800131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:13.879842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:14.007643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba7f04-183b-43b5-a687-97cdc5c8c856 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:14.020489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:14.021146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:14.021428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:14.021704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:14.068614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:14.070087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:14.094567 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3403/6871] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:45:16.510823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:16.512363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:16.551966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f1406-8f42-4d19-aa83-a1ed69bbe7a2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:16.581719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:16.582413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:16.582853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:16.583402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] PATH_INFO: `/v3/projects/e967fe5cfd9547808ba1b73fcb94942b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:16.591178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e967fe5cfd9547808ba1b73fcb94942b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:16.595244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:16.775143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e967fe5cfd9547808ba1b73fcb94942b', 'request_id': 'req-58f415a2-e62b-41ca-9f92-2ce373532e7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:16.818583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e967fe5cfd9547808ba1b73fcb94942b', 'request_id': 'req-58f415a2-e62b-41ca-9f92-2ce373532e7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:16.835839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:16.841459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e967fe5cfd9547808ba1b73fcb94942b', 'request_id': 'req-58f415a2-e62b-41ca-9f92-2ce373532e7e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:16.874751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] The token cache is being invalidate because project e967fe5cfd9547808ba1b73fcb94942b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:16.875901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:16.879095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:16.882818 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3469/6872] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:16 2022] DELETE /identity/v3/projects/e967fe5cfd9547808ba1b73fcb94942b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:16.886836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:16.902869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43d03-e445-4674-b94e-0978f681f024 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:17.122845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:17.123730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:17.126580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:17.127006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] PATH_INFO: `/v3/users/a349013520c048d788d95bd164a9d4d0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:17.130932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a349013520c048d788d95bd164a9d4d0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:17.133783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:17.266267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a349013520c048d788d95bd164a9d4d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:17.283007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a349013520c048d788d95bd164a9d4d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:17.284210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a349013520c048d788d95bd164a9d4d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:17.286960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a349013520c048d788d95bd164a9d4d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:17.309899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b84249d-b83f-4bfa-8ff5-641f5b615623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a349013520c048d788d95bd164a9d4d0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:17.442728 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3404/6873] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:16 2022] DELETE /identity/v3/users/a349013520c048d788d95bd164a9d4d0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:19.859433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:19.862062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:19.879383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f415a2-e62b-41ca-9f92-2ce373532e7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:20.138738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:20.141083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:20.141380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:20.149135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] PATH_INFO: `/v3/projects/5cfc13d72d644fa2adc0cb2d074532e4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:20.150599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfc13d72d644fa2adc0cb2d074532e4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:20.160663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:20.341979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfc13d72d644fa2adc0cb2d074532e4', 'request_id': 'req-ffb9399b-6eee-4618-be4a-e5392155d5cc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:20.355071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfc13d72d644fa2adc0cb2d074532e4', 'request_id': 'req-ffb9399b-6eee-4618-be4a-e5392155d5cc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:20.367902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfc13d72d644fa2adc0cb2d074532e4', 'request_id': 'req-ffb9399b-6eee-4618-be4a-e5392155d5cc'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:20.396560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] The token cache is being invalidate because project 5cfc13d72d644fa2adc0cb2d074532e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:20.396859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:20.404204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffb9399b-6eee-4618-be4a-e5392155d5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:20.409913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3470/6874] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:19 2022] DELETE /identity/v3/projects/5cfc13d72d644fa2adc0cb2d074532e4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:20.411873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:20.412969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:20.413396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:20.543968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:20.547253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:20.667242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:20.759043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:20.759351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:20.759621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:20.762944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3405/6875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:20.824586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:20.825841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:20.873523 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3471/6876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:20.878671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:20.901676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:20.903296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:20.911064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f3c8-6b0b-4c1a-93c6-ab8427be6bdb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:20.935545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623698c-3143-4706-ba8c-24126ea88f15 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:20.941238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:20.942843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:20.943811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:20.944930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:20.947535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:20.948070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:20.951547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:20.957557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:20.958459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:20.959008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:20.959430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] PATH_INFO: `/v3/users/6a8f3221bcb944dcb4b38194f2cd90ad` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:20.962499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8f3221bcb944dcb4b38194f2cd90ad)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:20.971375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:21.031706 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3406/6877] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:21.036853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:21.039764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:21.080216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b42f-72ce-4f6b-9f54-1e3f5e0cc07f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:21.096080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:21.104343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:21.105519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:21.105998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] PATH_INFO: `/v3/users/589c83708f8d4aeb8f208d02308b6583` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:21.107865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589c83708f8d4aeb8f208d02308b6583)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:21.110942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:21.125896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8f3221bcb944dcb4b38194f2cd90ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.158329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8f3221bcb944dcb4b38194f2cd90ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.161967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8f3221bcb944dcb4b38194f2cd90ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.162866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8f3221bcb944dcb4b38194f2cd90ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.166424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:21.180577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8f3221bcb944dcb4b38194f2cd90ad'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.201729 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3472/6878] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:20 2022] DELETE /identity/v3/users/6a8f3221bcb944dcb4b38194f2cd90ad => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:21.221862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:21.224368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:21.300017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589c83708f8d4aeb8f208d02308b6583'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.331952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589c83708f8d4aeb8f208d02308b6583'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.335254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589c83708f8d4aeb8f208d02308b6583'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.335254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589c83708f8d4aeb8f208d02308b6583'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.367549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbef75fd-2f69-481e-8725-3e72f4558007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589c83708f8d4aeb8f208d02308b6583'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:21.444734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3407/6879] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:21 2022] DELETE /identity/v3/users/589c83708f8d4aeb8f208d02308b6583 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:21.448754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:21.450051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:21.450654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:21.528127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:21.531232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c13a92-3387-44c2-b2a3-272538abe2a1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:21.533079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:21.810494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:21.811159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:21.811443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:21.811779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:21.812541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:21.814581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:21.816716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3408/6880] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:21.853316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:21.854966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:21.938120 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3473/6881] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:21 2022] POST /identity/v3/projects => generated 367 bytes in 736 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:21.940909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:21.943037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:22.042437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:22.072222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007994a3-0c44-41d6-937e-45e184db3af7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.093432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa9ac7-9949-4c69-a276-019a0ae1e218 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.100880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.104002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.104293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.104578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] PATH_INFO: `/v3/projects/163a495a56ed4c8e9835cb35b27de6b3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.120406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163a495a56ed4c8e9835cb35b27de6b3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.128417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:22.196555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:22.218814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.223649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.227843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.228128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.268181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.269665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:22.288901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163a495a56ed4c8e9835cb35b27de6b3', 'request_id': 'req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:22.305209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163a495a56ed4c8e9835cb35b27de6b3', 'request_id': 'req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:22.309219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3409/6882] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:45:22.310734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:22.313934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:22.321416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163a495a56ed4c8e9835cb35b27de6b3', 'request_id': 'req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:22.341724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] The token cache is being invalidate because project 163a495a56ed4c8e9835cb35b27de6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:22.341981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:22.342588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7adcafd0-3ba3-47b0-9ce3-7c2be920d989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:22.354178 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3474/6883] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:21 2022] DELETE /identity/v3/projects/163a495a56ed4c8e9835cb35b27de6b3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:22.355579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e79e42-0b23-4153-a046-c980f29870c8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.355885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e79e42-0b23-4153-a046-c980f29870c8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.356309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e79e42-0b23-4153-a046-c980f29870c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.375681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ea46-801b-4587-b002-5c24edba9758 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.391593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d3e79e42-0b23-4153-a046-c980f29870c8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:22.392846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d3e79e42-0b23-4153-a046-c980f29870c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:22.623168 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3475/6884] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:22.643507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.643869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.644062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.698196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.698845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.699138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.699416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.700059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.702791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:22.707531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:22.709795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:22.760665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3476/6885] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:22.765937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:22.778829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3410/6886] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:22 2022] POST /identity/v3/users => generated 284 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:22.783498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:22.790815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:22.800946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60f79b-c99d-4d41-be6f-86b1f750a4c4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.817732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641b032-e0c1-40b6-8783-3d70cb8f526f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.832592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.833322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.836208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.836208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.836401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.836678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.837236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.839268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.840711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.846974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:22.847146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:22.849385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.862461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:22.880240 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3411/6887] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:22.881995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:22.902945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97b16c-23c9-478b-be77-b18d36ac32e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.919221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.919860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.920148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.920429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.921771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.923433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:22.927962 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3477/6888] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:22.933657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:22.950093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:22.951700 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3412/6889] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:22.952760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:22.976440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c336f-c41d-4fe9-a17e-4c8de2985e18 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:22.989060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:22.989691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:22.989981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:22.990301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:22.990934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:22.993116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:23.024860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071e03b-106a-4f9c-a19e-345ac17dccd8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:23.041818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:23.042974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:23.052422 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3413/6890] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:22 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:23.052422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:23.052935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:23.052935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] PATH_INFO: `/v3/projects/5a82203bc65d41ee8151e16f75aae863` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:23.056870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a82203bc65d41ee8151e16f75aae863)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:23.056870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:23.370720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:23.385182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a82203bc65d41ee8151e16f75aae863', 'request_id': 'req-268ade88-4484-4816-b28c-ff5e01ccd0e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:23.419590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a82203bc65d41ee8151e16f75aae863', 'request_id': 'req-268ade88-4484-4816-b28c-ff5e01ccd0e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:23.444689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaedfc-c72a-4578-865c-1260455b69e6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:23.447410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a82203bc65d41ee8151e16f75aae863', 'request_id': 'req-268ade88-4484-4816-b28c-ff5e01ccd0e3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:23.476498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] The token cache is being invalidate because project 5a82203bc65d41ee8151e16f75aae863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:23.476736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:23.478802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:23.483842 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3478/6891] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:22 2022] DELETE /identity/v3/projects/5a82203bc65d41ee8151e16f75aae863 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:23.488361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:23.497866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:23.548904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:23.596941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401f1c-f875-44c3-86a7-a8ff9611826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:23.597488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401f1c-f875-44c3-86a7-a8ff9611826e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:23.598543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401f1c-f875-44c3-86a7-a8ff9611826e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:23.598857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401f1c-f875-44c3-86a7-a8ff9611826e admin admin] PATH_INFO: `/v3/projects/00b9c60d76c7450f8d933a49fd26340c/users/397c6a29c6934f8fbdcc39bb2bb38ad4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:23.648424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401f1c-f875-44c3-86a7-a8ff9611826e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b9c60d76c7450f8d933a49fd26340c, user_id=397c6a29c6934f8fbdcc39bb2bb38ad4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:23.654697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401f1c-f875-44c3-86a7-a8ff9611826e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:23.703576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3414/6892] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:23 2022] PUT /identity/v3/projects/00b9c60d76c7450f8d933a49fd26340c/users/397c6a29c6934f8fbdcc39bb2bb38ad4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:23.710098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18878675-83e0-404e-aa33-a7c48cc3dc1b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:23.710441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18878675-83e0-404e-aa33-a7c48cc3dc1b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:23.710728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18878675-83e0-404e-aa33-a7c48cc3dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:23.768641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ade88-4484-4816-b28c-ff5e01ccd0e3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:23.774591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-18878675-83e0-404e-aa33-a7c48cc3dc1b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:23.777436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18878675-83e0-404e-aa33-a7c48cc3dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:23.930710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:23.931256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:23.931521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:23.931798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:23.933080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:23.935042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:23.958236 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3415/6893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:23.958236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:23.958236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:23.958236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:23.991335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3479/6894] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:23 2022] POST /identity/v3/users => generated 296 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:24.010784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.026616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49434b9-28cd-4995-8658-7cab53107f8e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:24.034382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] MFA Rules not processed for user `397c6a29c6934f8fbdcc39bb2bb38ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:24.041058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:24.047698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808bf9-ba44-4494-a998-e9e970c7bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:24.048355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808bf9-ba44-4494-a998-e9e970c7bdfd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.048787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808bf9-ba44-4494-a998-e9e970c7bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.048911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808bf9-ba44-4494-a998-e9e970c7bdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.049553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d808bf9-ba44-4494-a998-e9e970c7bdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:24.061174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d808bf9-ba44-4494-a998-e9e970c7bdfd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:24.089709 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3480/6895] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:24.091603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.113557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.114558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.201246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:24.208903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:24.236497 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3481/6896] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:24.240836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.299852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e133503-30af-477c-9290-344f8772c1e2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:24.317788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:24.326585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:24.328316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.328605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.328886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.329552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:24.337740 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3416/6897] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:24.338687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.345498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:24.370731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fb9a6-f6f4-483c-9bc1-b6df500bb390 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:24.384101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:24.384776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.385329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.385329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.386882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:24.386882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:24.388155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3482/6898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:24.389113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.390241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:24.417586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3417/6899] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:24.418955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:24.421922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.447664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889de8-b763-4bcd-b181-da89e7f0abca admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:24.462911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:24.463610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.464833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.465122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] PATH_INFO: `/v3/projects/fd2967117cfd472dba44107665885e6e/users/a8c9035d265e4a93a72db6cc50414707/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.467259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ea2a-b3f6-4b56-851c-d6720d87c623 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:24.500175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2967117cfd472dba44107665885e6e, user_id=a8c9035d265e4a93a72db6cc50414707, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:24.503351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:24.507681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffa2de-59c9-4302-9083-ce91bc593778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:24.508527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa2de-59c9-4302-9083-ce91bc593778 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.508885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa2de-59c9-4302-9083-ce91bc593778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.516514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa2de-59c9-4302-9083-ce91bc593778 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.526045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffa2de-59c9-4302-9083-ce91bc593778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:24.528303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffa2de-59c9-4302-9083-ce91bc593778 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:24.530719 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3418/6900] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:24 2022] PUT /identity/v3/projects/fd2967117cfd472dba44107665885e6e/users/a8c9035d265e4a93a72db6cc50414707/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:24.531746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.649740 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3483/6901] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:24 2022] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:24.652713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:24.652989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:24.653269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:24.725173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:24.727075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:24.785428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abda91-6fbe-4a73-8278-fd37705a24d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:24.907241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:24.943179 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3484/6902] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:24.950714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:24.992550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d7bb-823a-49f0-9b70-22a07b77e8ce None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.007484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.009451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.009895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.010346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.014039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.016414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.030543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.031220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.034993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.035231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.041227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.045776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.088872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3419/6903] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:24 2022] POST /identity/v3/projects => generated 387 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:25.091056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.098683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:25.160407 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3485/6904] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:24 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:25.164261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.212975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febe405-0b97-4580-8296-4b3ee5236a6d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.383642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f5d3b-7fae-4286-9d23-098bd98ef3d0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.399873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.401306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.404059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.404203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.404445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.404717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.408033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.411041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.411525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.412990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.453652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.457951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.461336 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3486/6905] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:25 2022] POST /identity/v3/users => generated 294 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:25.462227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.478426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:25.493458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e630-8843-431d-adf9-19e3740c4fea admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.505537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.506542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.506856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.507126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.511661 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3420/6906] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:45:25.511979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.512354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.516590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.544030 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3487/6907] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:25.544216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4377e31-7b52-4f6a-8103-8531463d6cf6 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.554556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.577623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.580260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ff7f-b944-4e0d-8e71-98f9db320646 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.584228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.584507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.584797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.585485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.588293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.589492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.589978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.590466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] PATH_INFO: `/v3/projects/aac9c2e6ec9542d9ba8c4fe95ad6513d/users/e6f10fd54a334ecc896d3a6b0c82e73e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.605118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.610579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac9c2e6ec9542d9ba8c4fe95ad6513d, user_id=e6f10fd54a334ecc896d3a6b0c82e73e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.614211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.653267 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3488/6908] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:25 2022] PUT /identity/v3/projects/aac9c2e6ec9542d9ba8c4fe95ad6513d/users/e6f10fd54a334ecc896d3a6b0c82e73e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:25.663674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.673127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3421/6909] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:25.677710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:25.705972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455fa4-7cdb-4c7b-a039-e3b9a5ec2bfc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:25.900755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:25.901406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:25.901681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:25.908819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:25.909547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:25.916479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:25.995883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f0fad-87ed-4f42-8050-e9afda5b51b5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:26.002671 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3422/6910] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:26.006537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:26.031293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:26.031944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:26.032232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:26.032513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:26.033172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:26.034885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:26.040382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b228e-ed09-41f9-a907-e863d2c96f94 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:26.060770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ccaa7-9d12-4825-a37e-c6fa8a7e5b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:26.065126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ccaa7-9d12-4825-a37e-c6fa8a7e5b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:26.065414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ccaa7-9d12-4825-a37e-c6fa8a7e5b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:26.069738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ccaa7-9d12-4825-a37e-c6fa8a7e5b22 admin admin] PATH_INFO: `/v3/projects/ea0af30521734a07bc87e6abd7b910ff/users/c40a79fd2f8b4201aa4d34667718331e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:26.094264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3489/6911] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:26.094983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:26.146967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876291-cc6c-40c0-8741-2b3bd0e2f319 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:26.197760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38499e5e-133a-44f9-aba2-9ab6153da05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:26.198356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38499e5e-133a-44f9-aba2-9ab6153da05a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:26.198641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38499e5e-133a-44f9-aba2-9ab6153da05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:26.198926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38499e5e-133a-44f9-aba2-9ab6153da05a admin admin] PATH_INFO: `/v3/projects/aac9c2e6ec9542d9ba8c4fe95ad6513d/users/e6f10fd54a334ecc896d3a6b0c82e73e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:26.219001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38499e5e-133a-44f9-aba2-9ab6153da05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac9c2e6ec9542d9ba8c4fe95ad6513d, user_id=e6f10fd54a334ecc896d3a6b0c82e73e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:26.220645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ccaa7-9d12-4825-a37e-c6fa8a7e5b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0af30521734a07bc87e6abd7b910ff, user_id=c40a79fd2f8b4201aa4d34667718331e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:26.221710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38499e5e-133a-44f9-aba2-9ab6153da05a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:26.247692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ccaa7-9d12-4825-a37e-c6fa8a7e5b22 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:26.276512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3490/6912] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:26 2022] PUT /identity/v3/projects/aac9c2e6ec9542d9ba8c4fe95ad6513d/users/e6f10fd54a334ecc896d3a6b0c82e73e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:26.295941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:26.296203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:26.296483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:26.305529 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3423/6913] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:26 2022] PUT /identity/v3/projects/ea0af30521734a07bc87e6abd7b910ff/users/c40a79fd2f8b4201aa4d34667718331e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:26.333822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:26.335266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:26.335784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:26.422682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] MFA Rules not processed for user `e6f10fd54a334ecc896d3a6b0c82e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:26.423959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:26.450252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:26.542860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] MFA Rules not processed for user `c40a79fd2f8b4201aa4d34667718331e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:26.544125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:26.651495 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3491/6914] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:26.657446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:26.667207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980661e-e170-440c-88af-c4eb42c16851 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:26.681411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:26.682038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:26.682356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:26.682643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:26.684156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:26.685349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:26.781356 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3492/6915] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:26 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:26.785568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:26.814443 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3424/6916] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:26.958402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:26.960063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:27.095887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1053d6e-d6b3-47c7-ac90-f66c29f570b0 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:27.110009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:27.114608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:27.117209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:27.117860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:27.119796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:27.121359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:27.128302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:27.139337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ff9d1-8f59-4ebf-8447-fcb8a701322a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:27.214683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3493/6917] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:26 2022] POST /identity/v3/users => generated 371 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:27.216375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:27.246207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c097d-2c4e-4e5a-864c-93f43dd12d14 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:27.255359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:27.256467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:27.260414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:27.262024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:27.264439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:27.265267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/a4ff907ad2ad407f98f2e40cfab01746` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:27.265525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:27.265634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:27.306788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:get_user(user_id=a4ff907ad2ad407f98f2e40cfab01746)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:27.318273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:27.326485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3494/6918] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:45:27 2022] GET /identity/v3/users/a4ff907ad2ad407f98f2e40cfab01746 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:27.327587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:27.360791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8548cd-c8b3-4b1e-b3a6-860598303c8e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:27.378805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:27.379638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:27.380148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:27.381113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/a4ff907ad2ad407f98f2e40cfab01746` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:27.388743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a4ff907ad2ad407f98f2e40cfab01746)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:27.392743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:27.542794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:27.542794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:27.630627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ff907ad2ad407f98f2e40cfab01746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:27.636496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:27.656153 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3425/6919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:45:27.669393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ff907ad2ad407f98f2e40cfab01746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:27.686555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ff907ad2ad407f98f2e40cfab01746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:27.696903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ff907ad2ad407f98f2e40cfab01746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:27.744012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ff907ad2ad407f98f2e40cfab01746'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:27.798949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3495/6920] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:27 2022] DELETE /identity/v3/users/a4ff907ad2ad407f98f2e40cfab01746 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:27.803741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:27.832195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff892b0-b3d4-461a-b9d7-b2b093844f4b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:28.068901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:28.069568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:28.069845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:28.070118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/f65eb14b1b804af1a686c42d8766b402` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:28.072931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f65eb14b1b804af1a686c42d8766b402)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:28.074066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:28.182182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65eb14b1b804af1a686c42d8766b402', 'request_id': 'req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:28.197639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65eb14b1b804af1a686c42d8766b402', 'request_id': 'req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:28.200622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:28.211375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65eb14b1b804af1a686c42d8766b402', 'request_id': 'req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:28.297843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] The token cache is being invalidate because project f65eb14b1b804af1a686c42d8766b402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:28.298133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:28.300648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:28.308819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:28.311250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:28.313541 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3426/6921] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:27 2022] DELETE /identity/v3/projects/f65eb14b1b804af1a686c42d8766b402 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:28.371103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a6ce-50fe-4c6a-a0c7-42eebf6b6ae9 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:28.586719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:28.587423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:28.587714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:28.588001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:28.588784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:28.590987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:28.709337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:28.710912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:28.720490 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3496/6922] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:28 2022] POST /identity/v3/projects => generated 360 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:28.759924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13fb71-e8c0-4e34-8d98-2585fdee3d65 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:29.161915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:29.161915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.161915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.162742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:29.162742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:29.180199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:29.340099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:29.340798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3427/6923] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:28 2022] POST /identity/v3/users => generated 417 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:29.363797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400b6f-0d4c-41c4-bce0-54430020c977 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:29.396513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:29.397506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.398023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.398547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:29.416833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:29.426113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:29.478968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3497/6924] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:45:29 2022] POST /identity/v3/roles => generated 240 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:29.479708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:29.504606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79afc-eb4e-4462-8ec8-1abf7e27d463 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:29.525881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:29.526864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.527161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.527450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/c3994ec782eb4d5f81986114ab66da9f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:29.586786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:get_user(user_id=c3994ec782eb4d5f81986114ab66da9f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:29.589997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:29.597388 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3428/6925] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:45:29 2022] GET /identity/v3/users/c3994ec782eb4d5f81986114ab66da9f => generated 417 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:29.601720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:29.618890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513ca4-ddab-4927-80f9-ec79af0b540e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:29.626104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:29.627042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.627480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.628606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/roles/caab7904d17340809510bb4804c572e3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:29.630394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:get_role(role_id=caab7904d17340809510bb4804c572e3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:29.631953 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:29.631953 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:45:29.631953 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:45:29.633150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:29.635005 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3498/6926] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:45:29 2022] GET /identity/v3/roles/caab7904d17340809510bb4804c572e3 => generated 240 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:29.638946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:29.649992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29177-64c7-4e31-b9f7-5e3f3ca54cae tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:29.667893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ad5d-7c49-4527-b1e5-89ad7b201689 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:29.668539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ad5d-7c49-4527-b1e5-89ad7b201689 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.668831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ad5d-7c49-4527-b1e5-89ad7b201689 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.669111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ad5d-7c49-4527-b1e5-89ad7b201689 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:29.669767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ad5d-7c49-4527-b1e5-89ad7b201689 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:29.682447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ad5d-7c49-4527-b1e5-89ad7b201689 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:29.783207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3429/6927] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:29 2022] POST /identity/v3/projects => generated 360 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:29.787749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:29.799907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.799907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.802624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec346e2d-2dc0-439e-b783-afa811f9817c tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:29.811225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:29.928510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] MFA Rules not processed for user `129030291b0644019ce64d039013f327`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:29.930341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:29.994240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:29.994865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:29.995157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:29.995438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/7660fc6b3bc743e885581dfd36c6ca72` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:30.001407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:get_project(project_id=7660fc6b3bc743e885581dfd36c6ca72)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:30.008214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:30.018253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3499/6928] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:45:29 2022] GET /identity/v3/projects/7660fc6b3bc743e885581dfd36c6ca72 => generated 360 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:30.022842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:30.065001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181eba6-296c-481f-9166-ceedaa1f80af tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:30.084076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:30.084945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:30.085247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:30.086176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/7660fc6b3bc743e885581dfd36c6ca72/users/c3994ec782eb4d5f81986114ab66da9f/roles/caab7904d17340809510bb4804c572e3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:30.096461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7660fc6b3bc743e885581dfd36c6ca72, user_id=c3994ec782eb4d5f81986114ab66da9f, role_id=caab7904d17340809510bb4804c572e3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:30.099188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:30.157153 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3500/6929] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:30 2022] PUT /identity/v3/projects/7660fc6b3bc743e885581dfd36c6ca72/users/c3994ec782eb4d5f81986114ab66da9f/roles/caab7904d17340809510bb4804c572e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:30.158180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:30.181506 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3430/6930] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:30.182584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:30.185096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:30.265315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:30.304626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:30.393356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da09b-a12e-4486-8f1b-d0cee7dcbeea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:30.414270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:30.414929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:30.415209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:30.415530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:30.420062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:30.424593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:30.427471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa4a72-84ef-476f-9647-2c5607429a3e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:30.562882 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3501/6931] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:30 2022] POST /identity/v3/projects => generated 359 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:30.573890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:30.746668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:30.747314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:30.747599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:30.747932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:30.748546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:30.766673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:30.924821 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3431/6932] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:30 2022] POST /identity/v3/projects => generated 371 bytes in 743 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:30.928134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:30.981978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ac55-3733-4908-a5e6-137b9e398d25 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:31.230942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9142164-af9d-4a8e-86ef-9ff368add36a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:31.248359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:31.250390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:31.250575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:31.250904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:31.251944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:31.254392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:31.312997 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3432/6933] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:30 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:31.313194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:31.314871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:31.314871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:31.314871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/37d0a670d52742f5b8edde23fee6ffbd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:31.315396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:31.323249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:get_project(project_id=37d0a670d52742f5b8edde23fee6ffbd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:31.332833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:31.343289 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3502/6934] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:45:30 2022] GET /identity/v3/projects/37d0a670d52742f5b8edde23fee6ffbd => generated 359 bytes in 776 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:31.345908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:31.353703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4c4e-f4c4-4ead-8b69-27a8c7617598 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:31.379404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:31.384503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:31.384828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:31.386791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:31.389248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:31.393093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21caec7-25b9-48e3-93a8-b78b6b64af16 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:31.397812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:31.407675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:31.408360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:31.413668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:31.415318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/37d0a670d52742f5b8edde23fee6ffbd/users/c3994ec782eb4d5f81986114ab66da9f/roles/caab7904d17340809510bb4804c572e3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:31.424844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_grant(project_id=37d0a670d52742f5b8edde23fee6ffbd, user_id=c3994ec782eb4d5f81986114ab66da9f, role_id=caab7904d17340809510bb4804c572e3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:31.435851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:31.443774 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3433/6935] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:31 2022] GET /identity/v3/roles => generated 1651 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:31.446863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:31.484127 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3503/6936] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:31 2022] PUT /identity/v3/projects/37d0a670d52742f5b8edde23fee6ffbd/users/c3994ec782eb4d5f81986114ab66da9f/roles/caab7904d17340809510bb4804c572e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:31.485103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3aaa5-e363-476e-9b59-aec32856ab2a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:31.487866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:31.617088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:31.646363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:31.699422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:31.706361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:31.706650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:31.706937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] PATH_INFO: `/v3/projects/1c0cc5283ee54a1c927dfbf7a8f94463/users/b934e606eae94a0eafda734f7ed97769/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:31.708083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f5f76-b590-4878-9cfe-f3e5b6b2f965 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:31.726916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:31.728922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:31.729214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:31.729490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/c3994ec782eb4d5f81986114ab66da9f/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:31.734929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=c3994ec782eb4d5f81986114ab66da9f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:31.739069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:31.773588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0cc5283ee54a1c927dfbf7a8f94463, user_id=b934e606eae94a0eafda734f7ed97769, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:31.800035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:31.863465 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3434/6937] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:31 2022] PUT /identity/v3/projects/1c0cc5283ee54a1c927dfbf7a8f94463/users/b934e606eae94a0eafda734f7ed97769/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:31.864555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:31.888322 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3504/6938] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 31 05:45:31 2022] GET /identity/v3/users/c3994ec782eb4d5f81986114ab66da9f/projects => generated 843 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:31.895235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:31.935064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206638fe-650e-412a-9af2-ba924f925154 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:32.128893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:32.129563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:32.129851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:32.130137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/37d0a670d52742f5b8edde23fee6ffbd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:32.133335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37d0a670d52742f5b8edde23fee6ffbd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:32.139842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fbccc-7ead-4960-9dc4-849c061a5347 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:32.144099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:32.166918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:32.170374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:32.170781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:32.171102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:32.171820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:32.179260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:32.284510 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3435/6939] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:31 2022] GET /identity/v3/roles => generated 1651 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:45:32.294947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:32.308146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d0a670d52742f5b8edde23fee6ffbd', 'request_id': 'req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:32.324627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d0a670d52742f5b8edde23fee6ffbd', 'request_id': 'req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:32.355335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d0a670d52742f5b8edde23fee6ffbd', 'request_id': 'req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:32.377711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a9f9f-95db-46b1-9839-8a6b7e74452a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:32.384606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] The token cache is being invalidate because project 37d0a670d52742f5b8edde23fee6ffbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:32.385139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:32.386707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:32.394481 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3505/6940] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:31 2022] DELETE /identity/v3/projects/37d0a670d52742f5b8edde23fee6ffbd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:32.395578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:32.407334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:32.672148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:32.714730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:32.715448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:32.715723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:32.716000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] PATH_INFO: `/v3/projects/1c0cc5283ee54a1c927dfbf7a8f94463/users/b934e606eae94a0eafda734f7ed97769/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:32.721628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0cc5283ee54a1c927dfbf7a8f94463, user_id=b934e606eae94a0eafda734f7ed97769, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:32.736211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:32.747163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c92f1-b1d3-454f-b50d-bbb1ed011ef6 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:32.776807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:32.777915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:32.777915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:32.778105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/7660fc6b3bc743e885581dfd36c6ca72` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:32.779395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7660fc6b3bc743e885581dfd36c6ca72)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:32.782113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:32.790364 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3436/6941] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:32 2022] PUT /identity/v3/projects/1c0cc5283ee54a1c927dfbf7a8f94463/users/b934e606eae94a0eafda734f7ed97769/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:32.962004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7660fc6b3bc743e885581dfd36c6ca72', 'request_id': 'req-ffa978e0-b00e-460c-b866-82f8c6a70ca2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:32.980567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7660fc6b3bc743e885581dfd36c6ca72', 'request_id': 'req-ffa978e0-b00e-460c-b866-82f8c6a70ca2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.002743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7660fc6b3bc743e885581dfd36c6ca72', 'request_id': 'req-ffa978e0-b00e-460c-b866-82f8c6a70ca2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.040707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] The token cache is being invalidate because project 7660fc6b3bc743e885581dfd36c6ca72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:33.041067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.046926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.061984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:33.062593 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3506/6942] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:32 2022] DELETE /identity/v3/projects/7660fc6b3bc743e885581dfd36c6ca72 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:33.065069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:33.299421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:33.315499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac95d2-0aa2-4404-8b23-bd4f35c69dda admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:33.532356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:33.533625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:33.533969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:33.534209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/roles/caab7904d17340809510bb4804c572e3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:33.542362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_role(role_id=caab7904d17340809510bb4804c572e3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:33.544179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:33.624443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invalidating the token cache because role caab7904d17340809510bb4804c572e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:33.624776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.625801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.630830 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3437/6943] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:33 2022] DELETE /identity/v3/roles/caab7904d17340809510bb4804c572e3 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:33.632076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:33.647151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa978e0-b00e-460c-b866-82f8c6a70ca2 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:33.828167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:33.828831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:33.829058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:33.829323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/c3994ec782eb4d5f81986114ab66da9f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:33.830627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c3994ec782eb4d5f81986114ab66da9f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:33.832585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:33.953183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3994ec782eb4d5f81986114ab66da9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.979731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3994ec782eb4d5f81986114ab66da9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.980291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3994ec782eb4d5f81986114ab66da9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:33.980824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3994ec782eb4d5f81986114ab66da9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.009556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3994ec782eb4d5f81986114ab66da9f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.017062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:34.042069 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3507/6944] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:33 2022] DELETE /identity/v3/users/c3994ec782eb4d5f81986114ab66da9f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:45:34.047318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:34.048765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:34.069749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65d659-e411-4dda-92f8-923a2518a1ea tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:34.389324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:34.392099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:34.392806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:34.393094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/60be2515d9ef4b8ba11ebd059f76ed57` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:34.396245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60be2515d9ef4b8ba11ebd059f76ed57)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:34.402086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:34.526249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60be2515d9ef4b8ba11ebd059f76ed57', 'request_id': 'req-33704b2e-e842-49c3-b092-463ff7422d54'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.541670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60be2515d9ef4b8ba11ebd059f76ed57', 'request_id': 'req-33704b2e-e842-49c3-b092-463ff7422d54'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.559742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60be2515d9ef4b8ba11ebd059f76ed57', 'request_id': 'req-33704b2e-e842-49c3-b092-463ff7422d54'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.573816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:34.585582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] The token cache is being invalidate because project 60be2515d9ef4b8ba11ebd059f76ed57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:34.586763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.589562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-33704b2e-e842-49c3-b092-463ff7422d54 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:34.596121 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3438/6945] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:34 2022] DELETE /identity/v3/projects/60be2515d9ef4b8ba11ebd059f76ed57 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:34.601307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:34.603879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:34.694392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c923-8e54-4b07-933d-04e0ac40b95b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:35.116006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:35.127509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:35.127975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:35.128111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:35.145905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:update_user(user_id=397c6a29c6934f8fbdcc39bb2bb38ad4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:35.150748 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:45:35.150748 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:45:35.150748 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:45:35.160020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:35.319775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:35.341450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invalidating the token cache because user 397c6a29c6934f8fbdcc39bb2bb38ad4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:35.342000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:35.343462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:35.346182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3508/6946] 10.222.0.23 () {60 vars in 1243 bytes} [Mon Oct 31 05:45:34 2022] PATCH /identity/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4 => generated 297 bytes in 745 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:35.350244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:35.350542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:35.350833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:35.460888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] MFA Rules not processed for user `397c6a29c6934f8fbdcc39bb2bb38ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:35.465607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:35.474474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3439/6947] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:35 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:45:35.476865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:35.479006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:35.514131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fd960-0bc9-4021-89f3-b9eba8df3c2a tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:35.544391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:35.548493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:35.548783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:35.551346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:35.558586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:update_user(user_id=397c6a29c6934f8fbdcc39bb2bb38ad4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:35.572536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:35.688831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:35.714833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invalidating the token cache because user 397c6a29c6934f8fbdcc39bb2bb38ad4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:35.715312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:35.721561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-22bc7e28-1150-40ec-bbfc-389684f3e6e3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:35.735749 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3509/6948] 10.222.0.23 () {60 vars in 1243 bytes} [Mon Oct 31 05:45:35 2022] PATCH /identity/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:35.736955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:35.757909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8bfed-b420-4a89-a5b3-c905607f0b57 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:35.778589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:35.779190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:35.779474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:35.782892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:35.879442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:update_user(user_id=397c6a29c6934f8fbdcc39bb2bb38ad4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:35.885319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:36.049522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.083516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invalidating the token cache because user 397c6a29c6934f8fbdcc39bb2bb38ad4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:36.084185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.085519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.091060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3440/6949] 10.222.0.23 () {60 vars in 1243 bytes} [Mon Oct 31 05:45:35 2022] PATCH /identity/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4 => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:36.093111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:36.093488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:36.094006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:36.192739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] MFA Rules not processed for user `397c6a29c6934f8fbdcc39bb2bb38ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:36.196571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:36.227310 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3510/6950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:36 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:45:36.228647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:36.230957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:36.263645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccad5f0-912a-47c1-9a50-38698e7af685 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:36.270297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:36.271115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:36.271507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:36.271911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:36.274327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:update_user(user_id=397c6a29c6934f8fbdcc39bb2bb38ad4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:36.276372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:36.360530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.384504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invalidating the token cache because user 397c6a29c6934f8fbdcc39bb2bb38ad4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:36.384816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.387953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.394429 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3441/6951] 10.222.0.23 () {60 vars in 1243 bytes} [Mon Oct 31 05:45:36 2022] PATCH /identity/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:36.401781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:36.443610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b423029-3b68-48f3-a268-87c5e1af8b70 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:36.476884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67177a86-8c98-4e4f-a183-5ebd2845644b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:36.478031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177a86-8c98-4e4f-a183-5ebd2845644b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:36.479462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177a86-8c98-4e4f-a183-5ebd2845644b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:36.481018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177a86-8c98-4e4f-a183-5ebd2845644b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:36.491279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67177a86-8c98-4e4f-a183-5ebd2845644b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:36.525484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67177a86-8c98-4e4f-a183-5ebd2845644b tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:36.647755 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3511/6952] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:45:36 2022] POST /identity/v3/users => generated 262 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:36.648706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:36.650266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:36.700523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5624-4559-458d-b541-c48230b66df3 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:36.721062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:36.721671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:36.721996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:36.722261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/7288ba65174d451f87b6d23b484f1f02/password` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:36.929644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7288ba65174d451f87b6d23b484f1f02'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:36.956800 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3442/6953] 10.222.0.23 () {60 vars in 1269 bytes} [Mon Oct 31 05:45:36 2022] POST /identity/v3/users/7288ba65174d451f87b6d23b484f1f02/password => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:37.961777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:37.962640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:37.963371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:38.040068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] MFA Rules not processed for user `7288ba65174d451f87b6d23b484f1f02`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:38.045284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:38.058188 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3512/6954] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:37 2022] POST /identity/v3/auth/tokens => generated 327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:45:38.060917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:38.087467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a0c4-40a2-43f8-bcf6-6fbc9e5e0960 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:38.113470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f851ef-6b32-48d5-99a4-04ab818aa013 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:38.119514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f851ef-6b32-48d5-99a4-04ab818aa013 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:38.120247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f851ef-6b32-48d5-99a4-04ab818aa013 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:38.123651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f851ef-6b32-48d5-99a4-04ab818aa013 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:38.144270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f851ef-6b32-48d5-99a4-04ab818aa013 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:38.154529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f851ef-6b32-48d5-99a4-04ab818aa013 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:38.172988 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3443/6955] 10.222.0.23 () {56 vars in 1263 bytes} [Mon Oct 31 05:45:38 2022] GET /identity/v3/auth/tokens => generated 327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 05:45:38.177131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:38.207721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4f01-2c1c-4463-b640-0ed5549fce38 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:38.231552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:38.232487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:38.232931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:38.233922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/7288ba65174d451f87b6d23b484f1f02` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:38.239280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7288ba65174d451f87b6d23b484f1f02)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:38.242955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:38.380395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7288ba65174d451f87b6d23b484f1f02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:38.396596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:38.423283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7288ba65174d451f87b6d23b484f1f02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:38.424533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7288ba65174d451f87b6d23b484f1f02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:38.427251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7288ba65174d451f87b6d23b484f1f02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:38.446923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7288ba65174d451f87b6d23b484f1f02'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:38.517222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:38.517729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:38.518171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:38.520690 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3513/6956] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:38 2022] DELETE /identity/v3/users/7288ba65174d451f87b6d23b484f1f02 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:38.527562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:38.529188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:38.563754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:38.567781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:38.727942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:38.729307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede8f66-7733-44de-9a6f-513afc791958 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:38.747897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:38.748564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:38.750331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:38.750646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:38.751475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:38.753387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:38.755736 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3444/6957] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:45:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:38.797852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:38.799499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:38.816237 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3514/6958] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:38 2022] POST /identity/v3/users => generated 364 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:38.817881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:38.843447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71f6f-430d-4be6-bc41-42b8e38bf3bc tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:38.865976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:38.866393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:38.866685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:38.866971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:38.869234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:38.872300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:38.939574 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3515/6959] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:38 2022] POST /identity/v3/projects => generated 360 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:38.943191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:39.016249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9decf-f6d9-4707-a69f-9b692001167c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:39.075023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03bdd4-69cb-464f-893e-dbf4f0f9da79 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:39.087310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:39.088292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:39.088594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:39.089305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/a90b8242a791432e966ef975d4bb62e4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:39.124818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:update_user(user_id=a90b8242a791432e966ef975d4bb62e4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:39.130672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:39.172780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:39.173486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:39.173704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:39.173981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:39.212835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3516/6960] 10.222.0.23 () {60 vars in 1244 bytes} [Mon Oct 31 05:45:38 2022] PATCH /identity/v3/users/a90b8242a791432e966ef975d4bb62e4 => generated 520 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:39.215748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:39.255365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11893e0-8c41-4d52-ba47-0de289dec645 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:39.281981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:39.287781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:39.288396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:39.288689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/a90b8242a791432e966ef975d4bb62e4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:39.325184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=2,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:39.341093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:get_user(user_id=a90b8242a791432e966ef975d4bb62e4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:39.349082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:39.353693 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3517/6961] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:45:39 2022] GET /identity/v3/users/a90b8242a791432e966ef975d4bb62e4 => generated 387 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:39.361262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:39.385143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:39.386820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:39.406683 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3445/6962] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:45:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:45:39.406873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee2b5-f44d-4708-a26e-b68baa3b750e tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:39.421653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:39.422360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:39.422791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:39.423080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/projects/a0aff69fe337493e916ef163b78ec419` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:39.424568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0aff69fe337493e916ef163b78ec419)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:39.437235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:39.608921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0aff69fe337493e916ef163b78ec419', 'request_id': 'req-86a9164d-2987-4d30-b8d6-bf511eb27bcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:39.630784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0aff69fe337493e916ef163b78ec419', 'request_id': 'req-86a9164d-2987-4d30-b8d6-bf511eb27bcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:39.659772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0aff69fe337493e916ef163b78ec419', 'request_id': 'req-86a9164d-2987-4d30-b8d6-bf511eb27bcd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:39.692711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] The token cache is being invalidate because project a0aff69fe337493e916ef163b78ec419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:39.693149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:39.705421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:39.714891 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3518/6963] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:39 2022] DELETE /identity/v3/projects/a0aff69fe337493e916ef163b78ec419 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:39.718398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:39.743853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:39.744423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:39.746508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298ee1e-7aa4-4d77-b318-7bcd7c54158e service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:39.916980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:39.989251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6f10fd54a334ecc896d3a6b0c82e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:39.989978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:39.990313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:39.990602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] PATH_INFO: `/v3/users/a90b8242a791432e966ef975d4bb62e4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:39.994224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a90b8242a791432e966ef975d4bb62e4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:39.996263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:40.023149 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9164d-2987-4d30-b8d6-bf511eb27bcd tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:40.041143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:40.042059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:40.043887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:40.044304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:40.051758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:40.095720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90b8242a791432e966ef975d4bb62e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.099548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:40.104078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:40.129047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3519/6964] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:45:40.136374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90b8242a791432e966ef975d4bb62e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.138472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90b8242a791432e966ef975d4bb62e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.142185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90b8242a791432e966ef975d4bb62e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.164551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-aceab0a4-b0f7-4be4-bd06-28f7cf2e8118 tempest-UsersV3TestJSON-286104764 tempest-UsersV3TestJSON-286104764-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90b8242a791432e966ef975d4bb62e4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.218393 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3446/6965] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:39 2022] DELETE /identity/v3/users/a90b8242a791432e966ef975d4bb62e4 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:40.223614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:40.225408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:40.310169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd2d5a-1614-4c2c-90fb-dccc6bf17e62 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:40.310463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd2d5a-1614-4c2c-90fb-dccc6bf17e62 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:40.310751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd2d5a-1614-4c2c-90fb-dccc6bf17e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:40.431824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e9c2-6a71-4869-9fc3-8efba6dfca63 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:40.440696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b6fd2d5a-1614-4c2c-90fb-dccc6bf17e62 None None] MFA Rules not processed for user `a8c9035d265e4a93a72db6cc50414707`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:40.451275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6fd2d5a-1614-4c2c-90fb-dccc6bf17e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:40.458399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:40.723520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:40.728043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:40.731342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:40.731886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] PATH_INFO: `/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:40.756275 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3447/6966] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:40.768371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:40.768979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:40.769605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:40.780777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397c6a29c6934f8fbdcc39bb2bb38ad4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:40.786997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:40.816660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] MFA Rules not processed for user `a8c9035d265e4a93a72db6cc50414707`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:40.821637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:40.839578 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3448/6967] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:40.853566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:40.855512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:40.958886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:40.972008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.997760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:40.998641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:41.000877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:41.016731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0ecef0ba-4c1b-4a53-934f-243745663220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397c6a29c6934f8fbdcc39bb2bb38ad4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:41.058774 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3520/6968] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:40 2022] DELETE /identity/v3/users/397c6a29c6934f8fbdcc39bb2bb38ad4 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:41.061841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:41.062423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:41.063178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:41.087027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e365-f229-4b35-989c-928ef3900d54 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:41.148146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:41.149453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:41.249923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:41.252747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:41.253156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:41.253450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:41.257850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:41.368797 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3521/6969] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:41.381209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:41.385414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:41.420202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:41.496969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:41.499039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:41.520504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f7bf-0171-44c8-a22a-4fc773871942 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:41.528807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:41.529649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:41.530133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:41.530518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:41.543650 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3449/6970] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:45:41.559630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:41.563693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:41.594894 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3522/6971] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:45:42.259166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:42.263069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:42.284793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137182b-8fa4-4e96-83d6-78a3627342d3 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:42.295175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:42.300423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:42.301111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:42.301654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] PATH_INFO: `/v3/projects/00b9c60d76c7450f8d933a49fd26340c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:42.303194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b9c60d76c7450f8d933a49fd26340c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:42.308068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:42.413792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b9c60d76c7450f8d933a49fd26340c', 'request_id': 'req-c4939cf4-986d-45fa-8116-4726ca4b3ef7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.419758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:42.422603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b9c60d76c7450f8d933a49fd26340c', 'request_id': 'req-c4939cf4-986d-45fa-8116-4726ca4b3ef7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.439962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b9c60d76c7450f8d933a49fd26340c', 'request_id': 'req-c4939cf4-986d-45fa-8116-4726ca4b3ef7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.456539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] The token cache is being invalidate because project 00b9c60d76c7450f8d933a49fd26340c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:42.456836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.457678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.460315 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3450/6972] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:42 2022] DELETE /identity/v3/projects/00b9c60d76c7450f8d933a49fd26340c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:42.464639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:42.484974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d9e67-386d-43fa-b99e-55c7b610e5dc service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:42.612901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:42.613752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:42.614694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:42.614694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] PATH_INFO: `/v3/users/e6f10fd54a334ecc896d3a6b0c82e73e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:42.615892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f10fd54a334ecc896d3a6b0c82e73e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:42.618680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:42.713440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f10fd54a334ecc896d3a6b0c82e73e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.734468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f10fd54a334ecc896d3a6b0c82e73e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.735264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f10fd54a334ecc896d3a6b0c82e73e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.738625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f10fd54a334ecc896d3a6b0c82e73e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.752394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-5ba1ec65-0d1e-4d20-8566-0ce0c678d52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f10fd54a334ecc896d3a6b0c82e73e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:42.785816 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3523/6973] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:42 2022] DELETE /identity/v3/users/e6f10fd54a334ecc896d3a6b0c82e73e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:43.672036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:43.673607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:43.707567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939cf4-986d-45fa-8116-4726ca4b3ef7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:43.875372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:43.876293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:43.876758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:43.877430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] PATH_INFO: `/v3/projects/aac9c2e6ec9542d9ba8c4fe95ad6513d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:43.881218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac9c2e6ec9542d9ba8c4fe95ad6513d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:43.883697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:44.060110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'request_id': 'req-e87a01b4-c547-4e43-b69a-c69f52b4a341'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:44.075166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'request_id': 'req-e87a01b4-c547-4e43-b69a-c69f52b4a341'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:44.104553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac9c2e6ec9542d9ba8c4fe95ad6513d', 'request_id': 'req-e87a01b4-c547-4e43-b69a-c69f52b4a341'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:44.129987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] The token cache is being invalidate because project aac9c2e6ec9542d9ba8c4fe95ad6513d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:44.130561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:44.133902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e87a01b4-c547-4e43-b69a-c69f52b4a341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:44.140720 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3451/6974] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:43 2022] DELETE /identity/v3/projects/aac9c2e6ec9542d9ba8c4fe95ad6513d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:44.145553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:44.146393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:44.146828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:44.207695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:44.216282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:44.345851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:44.436985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3524/6975] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:44.438177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:44.438697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:44.439336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:44.495504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:44.496932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:44.537568 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3452/6976] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:45:44.542564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:44.556010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023840b-6f29-45c3-8462-4301e9a019d0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:44.569867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:44.573418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:44.573775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:44.574069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:44.574820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:44.575137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:44.576839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:44.668177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:44.668677 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3525/6977] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:44.692441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7105557-ed43-4e43-b5bc-c053cc3b88a2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:44.730409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:44.731066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:44.731356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:44.731634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:44.733064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:44.735807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:44.860795 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3453/6978] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:44 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:44.863007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:44.880583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb4c18-3264-444c-a952-047185facbcf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.063757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.064888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.065472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.065935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.067341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.070432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.124794 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3526/6979] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:44 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:45.128809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.140958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182eec5-a4ea-4a6f-917b-df3cdab23d0d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.147290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.147950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.148230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.148510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.149180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.150899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.167053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.178550 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3454/6980] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:45.185392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777aa46-a0b2-40de-bb60-b5ed5ddff9f0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.196359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a00d16-d01c-42bb-a782-0aa365186da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.197160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00d16-d01c-42bb-a782-0aa365186da3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.197450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00d16-d01c-42bb-a782-0aa365186da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.197724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00d16-d01c-42bb-a782-0aa365186da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.198439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a00d16-d01c-42bb-a782-0aa365186da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.200165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a00d16-d01c-42bb-a782-0aa365186da3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.222466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.234004 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3527/6981] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:45.235481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725251a6-9767-4469-9674-6a9284f314a7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.240196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.240893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.241181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.241472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] PATH_INFO: `/v3/projects/b344f7040ae24d85bba7aa309dbf25c9/users/1e478b688225482b8f93dbc36e013c87/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.271641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b344f7040ae24d85bba7aa309dbf25c9, user_id=1e478b688225482b8f93dbc36e013c87, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.274522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.324121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.324566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.324846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.328971 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3455/6982] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:45 2022] PUT /identity/v3/projects/b344f7040ae24d85bba7aa309dbf25c9/users/1e478b688225482b8f93dbc36e013c87/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:45:45.366635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] MFA Rules not processed for user `1e478b688225482b8f93dbc36e013c87`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:45.368212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:45.533528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.547543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3528/6983] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:45.552437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2129a4-0760-4c12-8198-67f2affdb752 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.558847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.559838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.560276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.560784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.562304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:create_application_credential(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.564471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.572629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:45.714033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.725868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d318-4f3a-4140-9ec6-cf4d2608935a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.727455 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3456/6984] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Oct 31 05:45:45 2022] POST /identity/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials => generated 920 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:45.749261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.749966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.750293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.750579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules/5aa7f6972a884805aa525128b9a68386` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.753813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1e478b688225482b8f93dbc36e013c87, access_rule_id=5aa7f6972a884805aa525128b9a68386)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.755730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application session.delete(ref) Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application yield resource Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 05:45:45.836123 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise self.value Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application session.commit() Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.flush() Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 05:45:45.837293 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application compat.raise_( Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._synchronize( Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise AssertionError( Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 31 05:45:45.838246 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:45.839255 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:45.840196 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 31 05:45:45.840196 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 31 05:45:45.840196 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 31 05:45:45.840196 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 31 05:45:45.840196 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 31 05:45:45.840196 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:45:45.848131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.854335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3529/6985] 10.222.0.23 () {58 vars in 1362 bytes} [Mon Oct 31 05:45:45 2022] DELETE /identity/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules/5aa7f6972a884805aa525128b9a68386 => generated 89 bytes in 140 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:45:45.861066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a191d-2ef7-48f0-b563-a25f76d169e0 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:45.878079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:45.878801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:45.879095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:45.879384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials/09914789c4cc4d4d939a3792abf4df68` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:45.916543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1e478b688225482b8f93dbc36e013c87, application_credential_id=09914789c4cc4d4d939a3792abf4df68)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:45.918396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:45.977431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:45.988432 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3457/6986] 10.222.0.23 () {58 vars in 1395 bytes} [Mon Oct 31 05:45:45 2022] DELETE /identity/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials/09914789c4cc4d4d939a3792abf4df68 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:45.992562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053540-f56d-43d2-8662-0620fe295a96 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:46.006920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:46.008992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:46.009299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:46.009584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:46.013017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:list_access_rules(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:46.016632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:46.032389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3530/6987] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 31 05:45:45 2022] GET /identity/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules => generated 369 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:46.051030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:46.069931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48ccf-8961-4afb-abb8-9229e069b861 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:46.095973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:46.100481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:46.101316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:46.103058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules/5aa7f6972a884805aa525128b9a68386` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:46.106737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1e478b688225482b8f93dbc36e013c87, access_rule_id=5aa7f6972a884805aa525128b9a68386)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:46.119567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:46.149079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3458/6988] 10.222.0.23 () {58 vars in 1362 bytes} [Mon Oct 31 05:45:46 2022] DELETE /identity/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules/5aa7f6972a884805aa525128b9a68386 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:46.153401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:46.174434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857be9f-9ab9-429a-ab3c-3a3c9bdb53a8 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:46.200765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:46.201445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:46.201734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:46.202074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:46.238705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:list_access_rules(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:46.247270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:46.279679 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3531/6989] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 31 05:45:46 2022] GET /identity/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules => generated 158 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:46.280824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:46.302960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbac7-ca6f-401a-8015-299f042a8820 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:46.339599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:46.340285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:46.341340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:46.341340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:46.341523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:create_application_credential(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:46.358517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:46.623427 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3459/6990] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Oct 31 05:45:46 2022] POST /identity/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials => generated 921 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:46.627885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:46.636897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:46.644342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4729-8cee-49cb-a994-568621b8723f tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:46.651617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:46.653662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:46.654098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:46.654899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:46.657000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:list_access_rules(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:46.658642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:46.667172 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3532/6991] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 31 05:45:46 2022] GET /identity/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:45:46.673682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:46.689142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5a5d-f41e-4cee-bb74-cc1ff5cd1470 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:46.694995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:46.695842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:46.696257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:46.696785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:46.697693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:create_application_credential(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:46.699095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:46.767991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:46.976586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3460/6992] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Oct 31 05:45:46 2022] POST /identity/v3/users/1e478b688225482b8f93dbc36e013c87/application_credentials => generated 921 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:46.979881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:46.992868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008917-9079-483c-9bdb-9a3c27dd9597 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:47.001882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a14b-878b-48cc-b902-ee0a9908165a tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e478b688225482b8f93dbc36e013c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b344f7040ae24d85bba7aa309dbf25c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:47.002684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a14b-878b-48cc-b902-ee0a9908165a tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:47.002989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a14b-878b-48cc-b902-ee0a9908165a tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:47.003268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a14b-878b-48cc-b902-ee0a9908165a tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules/2a97416301ae49009693cbb4f45a7ce6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:47.005957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a14b-878b-48cc-b902-ee0a9908165a tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorizing `identity:get_access_rule(user_id=1e478b688225482b8f93dbc36e013c87, access_rule_id=2a97416301ae49009693cbb4f45a7ce6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:47.007715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a14b-878b-48cc-b902-ee0a9908165a tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:47.040291 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3533/6993] 10.222.0.23 () {58 vars in 1359 bytes} [Mon Oct 31 05:45:46 2022] GET /identity/v3/users/1e478b688225482b8f93dbc36e013c87/access_rules/2a97416301ae49009693cbb4f45a7ce6 => generated 229 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:47.047557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:47.348855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66649630-23d5-4b85-b870-c523b603d3a7 tempest-AccessRulesV3Test-624245043 tempest-AccessRulesV3Test-624245043-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:47.363433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:47.364390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:47.364780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:47.365166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] PATH_INFO: `/v3/users/1e478b688225482b8f93dbc36e013c87` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:47.367224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e478b688225482b8f93dbc36e013c87)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:47.371432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:47.515855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e478b688225482b8f93dbc36e013c87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:47.534347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e478b688225482b8f93dbc36e013c87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:47.535112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e478b688225482b8f93dbc36e013c87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:47.536248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e478b688225482b8f93dbc36e013c87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:47.574375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e478b688225482b8f93dbc36e013c87'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:47.678884 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3461/6994] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:47 2022] DELETE /identity/v3/users/1e478b688225482b8f93dbc36e013c87 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:47.683325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:47.683763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:47.683836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:47.732619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:47.738322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:47.963223 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3534/6995] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:48.023749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:48.026433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:48.057838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:48.059682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:48.081964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d5bc-4da9-4581-aa04-edcf89a6283c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:48.107113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:48.107786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:48.113280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:48.113489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] PATH_INFO: `/v3/users/d5043f2a72e94da2b1946cfcc1c9d3af` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:48.119431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5043f2a72e94da2b1946cfcc1c9d3af)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:48.123987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:48.135571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:48.227555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e95ca-3de0-471f-bae8-ed208e7568f9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:48.238723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:48.239380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:48.239805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:48.240090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:48.274891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:48.279097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:48.321302 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3535/6996] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:45:48.433193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5043f2a72e94da2b1946cfcc1c9d3af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:48.466100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5043f2a72e94da2b1946cfcc1c9d3af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:48.469250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5043f2a72e94da2b1946cfcc1c9d3af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:48.470415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5043f2a72e94da2b1946cfcc1c9d3af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:48.537478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5043f2a72e94da2b1946cfcc1c9d3af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:48.635055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3462/6997] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:48 2022] DELETE /identity/v3/users/d5043f2a72e94da2b1946cfcc1c9d3af => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:49.573753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:49.576300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:49.608474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dec33e-ac29-4ebd-b195-4c9685e06b39 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:49.690001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:49.691912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:49.863306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:49.868039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:49.871099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:49.871606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] PATH_INFO: `/v3/projects/b344f7040ae24d85bba7aa309dbf25c9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:49.879670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b344f7040ae24d85bba7aa309dbf25c9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:49.902465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:49.965296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec12f-41b4-475a-9617-57043248eb35 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:49.980132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:49.981747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:49.982409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:49.982906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] PATH_INFO: `/v3/projects/ba7e4508ab0f43309271783d8abcf1dd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:49.993686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7e4508ab0f43309271783d8abcf1dd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:49.997037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:50.028188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:50.066772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b344f7040ae24d85bba7aa309dbf25c9', 'request_id': 'req-10bb30f0-78f1-48e0-b30f-df5b1a783674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.083323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b344f7040ae24d85bba7aa309dbf25c9', 'request_id': 'req-10bb30f0-78f1-48e0-b30f-df5b1a783674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.105759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b344f7040ae24d85bba7aa309dbf25c9', 'request_id': 'req-10bb30f0-78f1-48e0-b30f-df5b1a783674'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.151153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] The token cache is being invalidate because project b344f7040ae24d85bba7aa309dbf25c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:50.151581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.152579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-10bb30f0-78f1-48e0-b30f-df5b1a783674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.159025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3536/6998] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:49 2022] DELETE /identity/v3/projects/b344f7040ae24d85bba7aa309dbf25c9 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:50.159832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7e4508ab0f43309271783d8abcf1dd', 'request_id': 'req-04be56f0-e74d-41c8-ad26-79861bbd40fa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.164343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa89e-7af9-45f5-8964-71483f3cf14b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.164598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa89e-7af9-45f5-8964-71483f3cf14b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.165141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa89e-7af9-45f5-8964-71483f3cf14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.181938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7e4508ab0f43309271783d8abcf1dd', 'request_id': 'req-04be56f0-e74d-41c8-ad26-79861bbd40fa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.207588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7e4508ab0f43309271783d8abcf1dd', 'request_id': 'req-04be56f0-e74d-41c8-ad26-79861bbd40fa'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.230094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bf9aa89e-7af9-45f5-8964-71483f3cf14b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:50.232481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] The token cache is being invalidate because project ba7e4508ab0f43309271783d8abcf1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:50.236435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.237435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bf9aa89e-7af9-45f5-8964-71483f3cf14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:50.239331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04be56f0-e74d-41c8-ad26-79861bbd40fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:50.243798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3463/6999] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:49 2022] DELETE /identity/v3/projects/ba7e4508ab0f43309271783d8abcf1dd => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:50.254035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f293296-f19f-4170-8cd3-2697077070d6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.254429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f293296-f19f-4170-8cd3-2697077070d6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.254715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f293296-f19f-4170-8cd3-2697077070d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.328799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f293296-f19f-4170-8cd3-2697077070d6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:50.334380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f293296-f19f-4170-8cd3-2697077070d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:50.361742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:50.521760 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3537/7000] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:50.531432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.531746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.531996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.576454 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3464/7001] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:50.585558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.585855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.586124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.617138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:50.624977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:50.651798 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3538/7002] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:50.656953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:50.677732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:50.685475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:50.704524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0279-7ab8-4114-bb29-043519914835 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:50.720816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3465/7003] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:50.721753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:50.744325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:50.745265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.745718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.746117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.747211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:50.747798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:50.750432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:50.760848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a681f-b908-4309-a996-4fb716ece0f7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:50.780746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:50.781518 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3539/7004] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:50.785827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.786105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:50.788475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.790400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.794127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:50.794494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:50.801863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:50.802097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fddf2-b25e-48a9-8369-a651904cdf0e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:50.808953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:50.809761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:50.810249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:50.810713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:50.825175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:50.831904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:50.852910 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3466/7005] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:50.857045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:50.895635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41cc76-72c6-4c16-925b-2a8266d1b341 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:50.902969 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3540/7006] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/projects => generated 359 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:50.904410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.075918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.077351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.078938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.080124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.082047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.095878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.099027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35078-785e-41f1-ba7c-c69bac7f48ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.119164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.121933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.122282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.122702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.123373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.133267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.151725 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3467/7007] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:51.155816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.203056 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3541/7008] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:50 2022] POST /identity/v3/users => generated 280 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:51.204410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.227621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23908f-8c6c-4ed7-8e1c-440697ed3756 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.262125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:51.287625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e443e-5d93-4ba0-8a3d-443bc72c763f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.321515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.327793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.328140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.332591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.333420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.343027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.446372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3468/7009] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:51 2022] POST /identity/v3/users => generated 287 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:51.450331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.489662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255282c-1920-4ea1-9e63-210d3aa1978e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.516613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.520017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.520616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.521161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.522073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.522350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.523067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.523350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.523714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.524388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.526182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.530987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.540195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:51.568868 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3542/7010] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:51.569586 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3469/7011] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:51.582903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.583347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.611378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02180cb-ea26-4c16-870b-1aee37456e5a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.621365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d283de-ab15-4953-a67c-8dd519f246e3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.625262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.627261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.627762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.628977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.631070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.634968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.656516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.665218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.665218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.669333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.670095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.681658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.723014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3470/7012] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:51.724651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.728022 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3543/7013] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:51.732331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:51.763129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab32a-c13f-40df-b270-b5ffcae7728e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.777704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba587-0b1a-4005-ba0c-7715717f6554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.778875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba587-0b1a-4005-ba0c-7715717f6554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.779274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba587-0b1a-4005-ba0c-7715717f6554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.779662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba587-0b1a-4005-ba0c-7715717f6554 admin admin] PATH_INFO: `/v3/projects/91d65f267c8646a9a5e1d37d1cc8b5f8/users/65994d54af624165911cec009f614daf/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.806586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf08389-e032-4c3c-828c-1f665180c42f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:51.835926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba587-0b1a-4005-ba0c-7715717f6554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d65f267c8646a9a5e1d37d1cc8b5f8, user_id=65994d54af624165911cec009f614daf, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.841717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14ecc-16c9-43f7-850b-17dda23b5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:51.843152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14ecc-16c9-43f7-850b-17dda23b5c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.843445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14ecc-16c9-43f7-850b-17dda23b5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.843770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14ecc-16c9-43f7-850b-17dda23b5c5a admin admin] PATH_INFO: `/v3/projects/1c287a54b4e846a2834ab77d779f6389/users/f51d7cbfe90a4f299ee4913e6ce02f5a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.851201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba587-0b1a-4005-ba0c-7715717f6554 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:51.924007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3471/7014] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:51 2022] PUT /identity/v3/projects/91d65f267c8646a9a5e1d37d1cc8b5f8/users/65994d54af624165911cec009f614daf/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:51.925645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd1ee-5197-49ee-9a07-97af48dbcffa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:51.929028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd1ee-5197-49ee-9a07-97af48dbcffa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:51.929455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd1ee-5197-49ee-9a07-97af48dbcffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:51.941065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e14ecc-16c9-43f7-850b-17dda23b5c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c287a54b4e846a2834ab77d779f6389, user_id=f51d7cbfe90a4f299ee4913e6ce02f5a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:51.954109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e14ecc-16c9-43f7-850b-17dda23b5c5a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:52.000861 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3544/7015] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:51 2022] PUT /identity/v3/projects/1c287a54b4e846a2834ab77d779f6389/users/f51d7cbfe90a4f299ee4913e6ce02f5a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:52.012078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.012388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.012644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.049806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-565dd1ee-5197-49ee-9a07-97af48dbcffa None None] MFA Rules not processed for user `65994d54af624165911cec009f614daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:52.055444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-565dd1ee-5197-49ee-9a07-97af48dbcffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.102135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] MFA Rules not processed for user `f51d7cbfe90a4f299ee4913e6ce02f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:52.104013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.234194 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3545/7016] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 31 05:45:52.244542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:52.251892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.314087 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3472/7017] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:52.325304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f01e05-aa2e-43f2-bfe7-01329b1241dc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.326820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f01e05-aa2e-43f2-bfe7-01329b1241dc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.327668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f01e05-aa2e-43f2-bfe7-01329b1241dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.401077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-08f01e05-aa2e-43f2-bfe7-01329b1241dc None None] MFA Rules not processed for user `65994d54af624165911cec009f614daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:52.406507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-08f01e05-aa2e-43f2-bfe7-01329b1241dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.422187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3473/7018] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:52 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:45:52.428972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.429277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.429905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.504057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] MFA Rules not processed for user `65994d54af624165911cec009f614daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:52.516483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.526137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471ebe6-3c76-4c08-8d0e-42f7adc0b2b4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:52.529557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3474/7019] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:52 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:45:52.531887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:52.534523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:52.535966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.536366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.536812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.549138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:52.553804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5209b5-fd72-4a99-a52e-6b2b05dda25d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:52.559821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:52.561477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:52.565278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:52.566224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.566514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.566792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.587976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3546/7020] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:45:52.598234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorizing `identity:check_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:52.600305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:52.631111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3475/7021] 10.222.0.23 () {56 vars in 1264 bytes} [Mon Oct 31 05:45:52 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 31 05:45:52.633067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:52.648702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c24a-2c41-408e-b78e-d57de700299b service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:52.654425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:52.655826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.656258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.656846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.673240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:52.675969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:52.688425 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3547/7022] 10.222.0.23 () {56 vars in 1263 bytes} [Mon Oct 31 05:45:52 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 05:45:52.688628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:52.706837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cbc97-e658-41b8-a0e2-e5d1d75cea2f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:52.719356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52056d2-02a5-4e2a-a6d8-f960fee3c9ab tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:52.721118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52056d2-02a5-4e2a-a6d8-f960fee3c9ab tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.721407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52056d2-02a5-4e2a-a6d8-f960fee3c9ab tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.721689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52056d2-02a5-4e2a-a6d8-f960fee3c9ab tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.744687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52056d2-02a5-4e2a-a6d8-f960fee3c9ab tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:52.747015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52056d2-02a5-4e2a-a6d8-f960fee3c9ab tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:52.789307 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3476/7023] 10.222.0.23 () {56 vars in 1266 bytes} [Mon Oct 31 05:45:52 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:45:52.793830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:52.810849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa67a0-a4ef-4eb0-8153-40e783269b29 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:52.833997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:52.834928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `HEAD` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.835215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.835493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.837685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 31 05:45:52.861376 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 31 05:45:52.862410 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 31 05:45:52.863399 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:52.863399 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:52.863399 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 31 05:45:52.863399 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 31 05:45:52.863399 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 31 05:45:52.863399 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:45:52.865520 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3548/7024] 10.222.0.23 () {56 vars in 1264 bytes} [Mon Oct 31 05:45:52 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 31 05:45:52.871281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.872019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.872445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:52.927745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] MFA Rules not processed for user `65994d54af624165911cec009f614daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:52.938822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:52.944748 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3477/7025] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:52 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 05:45:52.949771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:52.961508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956ab1-62a1-4a4f-9e3c-a78da7a28e4f tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:52.978626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:52.980074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:52.980074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:52.980383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:53.027656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:53.034052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:53.058900 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3549/7026] 10.222.0.23 () {56 vars in 1263 bytes} [Mon Oct 31 05:45:52 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 05:45:53.064492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:53.094994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb210ca-cc81-419f-917c-1d3ec4fdb7bc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:53.112862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:53.115290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:53.120343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:53.124348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:53.143942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:53.145638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:53.181137 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3478/7027] 10.222.0.23 () {56 vars in 1266 bytes} [Mon Oct 31 05:45:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:45:53.185609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:53.202911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c6c32-c40b-4564-a758-c8683b5d1dd0 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:53.225139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1397d-8fb3-404c-aee4-5e8a6b7c7927 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65994d54af624165911cec009f614daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:53.225953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1397d-8fb3-404c-aee4-5e8a6b7c7927 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:53.226337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1397d-8fb3-404c-aee4-5e8a6b7c7927 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:53.226808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1397d-8fb3-404c-aee4-5e8a6b7c7927 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:53.230871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-96c1397d-8fb3-404c-aee4-5e8a6b7c7927 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-96c1397d-8fb3-404c-aee4-5e8a6b7c7927 tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 31 05:45:53.261896 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 31 05:45:53.262913 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 31 05:45:53.263755 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:45:53.263755 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:45:53.263755 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 31 05:45:53.263755 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 31 05:45:53.263755 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 31 05:45:53.263755 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:45:53.278367 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3550/7028] 10.222.0.23 () {56 vars in 1263 bytes} [Mon Oct 31 05:45:53 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:45:53.280392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:53.354241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:53.412760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331e2c0-0550-4aac-b13f-78b404dfb68c tempest-TokensV3Test-611171061 tempest-TokensV3Test-611171061-project] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:53.430708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:53.431288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:53.431571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:53.443614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] PATH_INFO: `/v3/users/65994d54af624165911cec009f614daf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:53.447598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65994d54af624165911cec009f614daf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:53.452995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:53.572285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65994d54af624165911cec009f614daf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:53.595413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65994d54af624165911cec009f614daf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:53.596360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65994d54af624165911cec009f614daf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:53.597211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65994d54af624165911cec009f614daf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:53.625951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65994d54af624165911cec009f614daf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:53.671576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3479/7029] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:45:53 2022] DELETE /identity/v3/users/65994d54af624165911cec009f614daf => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:53.672517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:53.672983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:53.673057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:53.708929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:53.711770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:53.836290 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3551/7030] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:53.989827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:53.993155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:54.198307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbbbe2-a04a-45e2-a63f-4da1d8396e99 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:54.208722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b2eab-f45d-4a46-bdd2-14d2d206ce5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:54.209489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2eab-f45d-4a46-bdd2-14d2d206ce5f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:54.209896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2eab-f45d-4a46-bdd2-14d2d206ce5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:54.210318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b2eab-f45d-4a46-bdd2-14d2d206ce5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:54.238912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2eab-f45d-4a46-bdd2-14d2d206ce5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:54.240269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b2eab-f45d-4a46-bdd2-14d2d206ce5f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:54.308456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3480/7031] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:45:57.752698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:57.757325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:57.783516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeec34b-2351-4bde-845e-17ca0fcefab9 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:57.792840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:57.793701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:57.797016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:57.798794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] PATH_INFO: `/v3/projects/91d65f267c8646a9a5e1d37d1cc8b5f8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:57.800671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d65f267c8646a9a5e1d37d1cc8b5f8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:57.806886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:58.010013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'request_id': 'req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:58.020166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'request_id': 'req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:58.030296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d65f267c8646a9a5e1d37d1cc8b5f8', 'request_id': 'req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:58.051817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] The token cache is being invalidate because project 91d65f267c8646a9a5e1d37d1cc8b5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:45:58.052130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:58.053778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-be6b4b8f-3e3d-4d85-9d46-38ea0ab5fe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:45:58.055197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3552/7032] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:45:57 2022] DELETE /identity/v3/projects/91d65f267c8646a9a5e1d37d1cc8b5f8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:58.064959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:58.065490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:58.065490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:58.104763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:58.106187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:58.645516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:58.665794 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3481/7033] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:58.673589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:58.674443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:58.674927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:58.746174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:58.746174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:58.765454 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3553/7034] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:58.770128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:58.785030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85bfb-c371-4c71-b521-c4a816f98297 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:58.799695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:58.801150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:58.801433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:58.802846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:58.803532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:45:58.805985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:58.810012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:58.849414 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3482/7035] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:45:58.854367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:58.880503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e2ae-a9d3-46bc-be06-e0e966a2e256 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:58.895603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:58.896629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:58.897261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:58.897654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:58.899206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:58.901264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:58.982674 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3554/7036] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:45:58 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:45:58.999355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:59.020610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eebbe-d5c3-4f52-b35a-52c83fe379c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:59.148544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:59.149205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:59.149445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:59.149607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:59.150308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:59.152209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:59.219636 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3483/7037] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:45:58 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:45:59.219796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:59.236067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:45:59.239960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62248-f0c2-4361-bdd2-458d0305cf04 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:59.258570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:59.259219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:59.259502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:59.259778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:59.260443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:59.262072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:59.282944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3555/7038] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:59.288222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:59.309093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88eb87d-9e1d-4dd8-8141-80bec8589f45 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:59.322932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa0dac-fc0f-421f-b111-b0653482892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:59.324596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa0dac-fc0f-421f-b111-b0653482892b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:59.324876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa0dac-fc0f-421f-b111-b0653482892b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:59.327833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa0dac-fc0f-421f-b111-b0653482892b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:59.328818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa0dac-fc0f-421f-b111-b0653482892b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:59.332635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa0dac-fc0f-421f-b111-b0653482892b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:59.358418 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3484/7039] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:45:59.359895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:59.374183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c040d-aeb3-4365-99ab-17c81b208f63 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:59.385702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:59.386442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:59.386730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:59.387272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] PATH_INFO: `/v3/projects/84635f9d998b4c1192126006ce47e766/users/17a5be9e212e4f9d8c8feedea25c0856/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:59.412367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84635f9d998b4c1192126006ce47e766, user_id=17a5be9e212e4f9d8c8feedea25c0856, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:59.417152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:59.437531 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3556/7040] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:45:59 2022] PUT /identity/v3/projects/84635f9d998b4c1192126006ce47e766/users/17a5be9e212e4f9d8c8feedea25c0856/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:45:59.448117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4f46-287e-497e-bde1-a8fb040e92f0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:59.448396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4f46-287e-497e-bde1-a8fb040e92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:59.448667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4f46-287e-497e-bde1-a8fb040e92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:59.510233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-69fb4f46-287e-497e-bde1-a8fb040e92f0 None None] MFA Rules not processed for user `17a5be9e212e4f9d8c8feedea25c0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:45:59.510233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69fb4f46-287e-497e-bde1-a8fb040e92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:59.650196 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3485/7041] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:45:59.676858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:45:59.679118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:45:59.868975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae61b5-013f-48f7-9e4c-8de52a634ff5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:45:59.878824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:45:59.880118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:45:59.882476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:45:59.882868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:45:59.899694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:45:59.901718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:45:59.916607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3557/7042] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:45:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:00.132311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f2e8-94bc-44ed-b49a-146003bb54d4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:00.132642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f2e8-94bc-44ed-b49a-146003bb54d4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:00.132938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f2e8-94bc-44ed-b49a-146003bb54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:00.155771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8f57f2e8-94bc-44ed-b49a-146003bb54d4 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:00.157785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f57f2e8-94bc-44ed-b49a-146003bb54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:00.255836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:00.274823 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3486/7043] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:00.300841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:00.303194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:00.471267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8997-123a-4e6b-b971-cb544e117432 service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:00.487145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236aae4-fc13-4c5c-9ea8-06d52a898ab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:00.488029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236aae4-fc13-4c5c-9ea8-06d52a898ab9 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:00.488460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236aae4-fc13-4c5c-9ea8-06d52a898ab9 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:00.488882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236aae4-fc13-4c5c-9ea8-06d52a898ab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:00.508671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236aae4-fc13-4c5c-9ea8-06d52a898ab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:00.511258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236aae4-fc13-4c5c-9ea8-06d52a898ab9 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:00.524811 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3558/7044] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:01.087969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:01.088261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:01.088543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:01.274484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] MFA Rules not processed for user `b934e606eae94a0eafda734f7ed97769`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:01.282452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:01.395345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:01.395963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:01.396319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:01.444168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:01.447064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:01.478183 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3559/7045] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:01.488567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:01.524487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56a76-35eb-481e-866e-491535f574d5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:01.529557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3487/7046] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:01.545527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34555ad5-e915-44a9-a30c-41f512fdd4d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:01.547355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34555ad5-e915-44a9-a30c-41f512fdd4d3 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:01.547824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34555ad5-e915-44a9-a30c-41f512fdd4d3 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:01.551534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34555ad5-e915-44a9-a30c-41f512fdd4d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:01.552612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:01.558615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:01.610875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34555ad5-e915-44a9-a30c-41f512fdd4d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:01.613905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34555ad5-e915-44a9-a30c-41f512fdd4d3 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:01.641168 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3560/7047] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:01.808194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81385a-5a84-4e38-a29f-3366f8124430 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:01.834330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:01.835166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:01.835533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:01.836169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:01.840473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:02.111909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:02.118567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:02.162348 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3488/7048] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:02.749291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3cfd-6d65-450f-8b2c-0f3fd4342b45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:02.750527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3cfd-6d65-450f-8b2c-0f3fd4342b45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:02.750970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3cfd-6d65-450f-8b2c-0f3fd4342b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:02.857338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e91d3cfd-6d65-450f-8b2c-0f3fd4342b45 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:02.861492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e91d3cfd-6d65-450f-8b2c-0f3fd4342b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:02.896387 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3561/7049] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:02.909875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:02.931603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b84a-1ded-4af1-a783-8013836bf8ba service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:02.951429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:02.952740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:02.953026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:02.953301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:02.995241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:02.996855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:03.022812 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3489/7050] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:03.375193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514aa93-de97-4216-ad3f-977a37081667 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:03.375816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514aa93-de97-4216-ad3f-977a37081667 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:03.376298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514aa93-de97-4216-ad3f-977a37081667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:03.407339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0514aa93-de97-4216-ad3f-977a37081667 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:03.408998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0514aa93-de97-4216-ad3f-977a37081667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:03.430337 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3562/7051] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:03.437970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:03.459178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110dd2-3524-48e3-9a01-49b27e57fa98 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:03.472253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:03.473573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:03.473860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:03.474137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:03.488554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:03.490521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:03.496264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:03.505540 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3490/7052] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:04.493680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae25c0-261e-4d23-a6cb-a0b096cdab45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:04.494966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae25c0-261e-4d23-a6cb-a0b096cdab45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:04.498534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae25c0-261e-4d23-a6cb-a0b096cdab45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:04.560454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-97ae25c0-261e-4d23-a6cb-a0b096cdab45 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:04.570474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-97ae25c0-261e-4d23-a6cb-a0b096cdab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:04.596212 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3563/7053] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:04.613823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:04.647213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddf22e-692b-422d-9ddb-01002665455a service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:04.668667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:04.669654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:04.671420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:04.674081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:04.686793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:04.693329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:04.718651 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3491/7054] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:05.151000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:05.151300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:05.151577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:05.225287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:05.238770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:05.266772 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3564/7055] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:05.283811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:05.311507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c022-5405-48bb-b930-5601c545b58c service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:05.343820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f06f-c73a-4e7b-a2a3-6e4f53501a11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:05.345780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f06f-c73a-4e7b-a2a3-6e4f53501a11 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:05.346621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f06f-c73a-4e7b-a2a3-6e4f53501a11 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:05.347681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f06f-c73a-4e7b-a2a3-6e4f53501a11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:05.376809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f06f-c73a-4e7b-a2a3-6e4f53501a11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:05.379693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f06f-c73a-4e7b-a2a3-6e4f53501a11 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:05.409990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3492/7056] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:05.680210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:05.702391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:05.907127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d0f09-55e9-4528-875a-46c3fde23105 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:05.916949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:05.917994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:05.923087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:05.927642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] PATH_INFO: `/v3/users/17a5be9e212e4f9d8c8feedea25c0856` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:05.933586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a5be9e212e4f9d8c8feedea25c0856)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:05.936077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:06.054010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a5be9e212e4f9d8c8feedea25c0856'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:06.091113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a5be9e212e4f9d8c8feedea25c0856'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:06.092365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a5be9e212e4f9d8c8feedea25c0856'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:06.093181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a5be9e212e4f9d8c8feedea25c0856'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:06.111460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a5be9e212e4f9d8c8feedea25c0856'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:06.148831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3565/7057] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:05 2022] DELETE /identity/v3/users/17a5be9e212e4f9d8c8feedea25c0856 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:06.150756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:06.151223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:06.151506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:06.197983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:06.207126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:06.490082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3493/7058] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:06.577711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:06.579414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:06.729933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59803d-df21-4640-a01e-21ebbdb91892 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:06.749493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea11fa-734b-4a40-a40f-14c3b3883736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:06.750281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea11fa-734b-4a40-a40f-14c3b3883736 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:06.750575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea11fa-734b-4a40-a40f-14c3b3883736 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:06.750856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea11fa-734b-4a40-a40f-14c3b3883736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:06.786831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea11fa-734b-4a40-a40f-14c3b3883736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:06.788307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea11fa-734b-4a40-a40f-14c3b3883736 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:06.865553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3566/7059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:07.549497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:07.551115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:07.591604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f52ac-7401-420c-a117-e9dcd7dc8fd5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:07.611355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:07.612297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:07.612845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:07.613129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] PATH_INFO: `/v3/projects/84635f9d998b4c1192126006ce47e766` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:07.628811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84635f9d998b4c1192126006ce47e766)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:07.630795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:07.780216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84635f9d998b4c1192126006ce47e766', 'request_id': 'req-18808139-6b53-429d-bdd6-de5aa475037d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:07.790440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84635f9d998b4c1192126006ce47e766', 'request_id': 'req-18808139-6b53-429d-bdd6-de5aa475037d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:07.829363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84635f9d998b4c1192126006ce47e766', 'request_id': 'req-18808139-6b53-429d-bdd6-de5aa475037d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:07.871795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] The token cache is being invalidate because project 84635f9d998b4c1192126006ce47e766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:07.873926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:07.876243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18808139-6b53-429d-bdd6-de5aa475037d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:07.883178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3494/7060] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:07 2022] DELETE /identity/v3/projects/84635f9d998b4c1192126006ce47e766 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:07.888177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d477-9704-4727-9e26-4244d480c606 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:07.888639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d477-9704-4727-9e26-4244d480c606 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:07.888865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d477-9704-4727-9e26-4244d480c606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:07.945472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f302d477-9704-4727-9e26-4244d480c606 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:07.949448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f302d477-9704-4727-9e26-4244d480c606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:08.056116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:08.060179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.060624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.061445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.119501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] MFA Rules not processed for user `129030291b0644019ce64d039013f327`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:08.129042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:08.163527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3567/7061] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:08.172138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.172830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.173126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.279490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:08.284753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:08.318399 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3568/7062] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:08.323806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:08.337525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:08.363719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bebc57-de4a-4616-9764-c547c70c687a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:08.377129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3495/7063] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:08.378445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:08.379293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.380084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.380570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.381708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:08.382493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:08.385649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:08.419408 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3569/7064] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:08.422966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:08.456615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce8d3-e482-49d5-863d-f72583fdc952 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:08.467286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:08.468139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.471054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.471526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.472370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:08.477836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:08.561763 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3496/7065] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:08 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:08.564302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:08.579385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21f581-838d-454d-bcb0-ad1c60ede7ab admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:08.715762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:08.720122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.720520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.720909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.721742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:08.723981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:08.762344 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3570/7066] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:08 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:08.766239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:08.783472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143eb-111a-414f-a334-87d1b5158543 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:08.803337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:08.804426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.804932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.805438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.806675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:08.815908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:08.849913 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3497/7067] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:08.856482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:08.881261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfd18-5282-4118-847e-76ba79cab6cc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:08.890854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861b65-a8b9-4fe2-9ecf-efb2c0c7fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:08.892023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861b65-a8b9-4fe2-9ecf-efb2c0c7fa39 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.892411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861b65-a8b9-4fe2-9ecf-efb2c0c7fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.892810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861b65-a8b9-4fe2-9ecf-efb2c0c7fa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.893579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861b65-a8b9-4fe2-9ecf-efb2c0c7fa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:08.897955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861b65-a8b9-4fe2-9ecf-efb2c0c7fa39 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:08.923779 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3571/7068] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:08.928198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:08.947141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529af94-9bf2-4e8c-8001-9f73441e8ab0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:08.956332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:08.957028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:08.957308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:08.957592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] PATH_INFO: `/v3/projects/7095398e34ba4e789351d86bfd1cf06a/users/8c98d4d0e1af4907afd2244c57ab199b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:08.989591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7095398e34ba4e789351d86bfd1cf06a, user_id=8c98d4d0e1af4907afd2244c57ab199b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:08.992531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:09.039533 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3498/7069] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:08 2022] PUT /identity/v3/projects/7095398e34ba4e789351d86bfd1cf06a/users/8c98d4d0e1af4907afd2244c57ab199b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:09.065104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bebb6-2f6e-409f-862a-b74204ed9ae4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:09.065782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bebb6-2f6e-409f-862a-b74204ed9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:09.066291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bebb6-2f6e-409f-862a-b74204ed9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:09.165631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-932bebb6-2f6e-409f-862a-b74204ed9ae4 None None] MFA Rules not processed for user `8c98d4d0e1af4907afd2244c57ab199b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:09.170970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-932bebb6-2f6e-409f-862a-b74204ed9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:09.450175 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3572/7070] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:09.471523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:09.473309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:09.648316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77aabe-03eb-4f78-97e6-af648ad13543 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:09.663751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:09.664637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:09.665567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:09.666198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:09.680382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:09.683079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:09.697980 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3499/7071] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:10.116634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8c38-ad11-420d-a194-c913d72d8e46 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:10.116634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8c38-ad11-420d-a194-c913d72d8e46 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:10.116634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8c38-ad11-420d-a194-c913d72d8e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:10.176041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-580e8c38-ad11-420d-a194-c913d72d8e46 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:10.180916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-580e8c38-ad11-420d-a194-c913d72d8e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:10.246818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:10.415465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:10.416996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:10.427336 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3573/7072] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:10.610646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001e8c5-4681-47e3-8bf5-f8825b48fdb8 service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:10.623274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:10.624326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:10.624326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:10.624568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:10.660142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:10.661760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:10.696650 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3500/7073] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:46:11.334343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936853b-e1a9-4755-a5a3-49cce145ca83 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:11.334938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936853b-e1a9-4755-a5a3-49cce145ca83 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:11.335055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936853b-e1a9-4755-a5a3-49cce145ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:11.372422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5936853b-e1a9-4755-a5a3-49cce145ca83 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:11.374292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5936853b-e1a9-4755-a5a3-49cce145ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:11.388289 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3574/7074] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:11.400388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:11.417256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b488f8-74a5-4567-b5ef-f1cd555c377c service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:11.428036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:11.429049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:11.429413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:11.429751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:11.442747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:11.444863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:11.473383 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3501/7075] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:12.003058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884797-73a7-4e3b-938e-bb742049da61 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:12.003581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884797-73a7-4e3b-938e-bb742049da61 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:12.004015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884797-73a7-4e3b-938e-bb742049da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:12.051869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e5884797-73a7-4e3b-938e-bb742049da61 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:12.057037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e5884797-73a7-4e3b-938e-bb742049da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:12.088900 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3575/7076] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:12.132496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:12.170986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251de2-cb6f-46dc-b7fd-b836061fbca2 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:12.199632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:12.200362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:12.200647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:12.200928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:12.222531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:12.227752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:12.249868 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3502/7077] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:12.759722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61878a-698b-488c-8f79-cf052831c7a1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:12.760712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61878a-698b-488c-8f79-cf052831c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:12.761168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61878a-698b-488c-8f79-cf052831c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:12.784255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fe61878a-698b-488c-8f79-cf052831c7a1 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:12.785849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fe61878a-698b-488c-8f79-cf052831c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:12.808124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3576/7078] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:12.808943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:12.829449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ce29e-e44f-452f-8380-7e893671cc83 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:12.838311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:12.839320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:12.839826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:12.853471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:12.864517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:12.877318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:12.879516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:12.914792 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3503/7079] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:46:13.564478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8732b7-da81-4faf-a542-162ef0a4d110 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:13.564778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8732b7-da81-4faf-a542-162ef0a4d110 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:13.565064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8732b7-da81-4faf-a542-162ef0a4d110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:13.601379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cc8732b7-da81-4faf-a542-162ef0a4d110 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:13.602653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cc8732b7-da81-4faf-a542-162ef0a4d110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:13.646123 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3577/7080] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:13.660672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:13.680487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12206eae-dd9b-40e9-a764-09f5317b6721 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:13.718444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:13.719133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:13.719425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:13.720284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:13.741402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:13.743044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:13.782109 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3504/7081] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:14.329007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6c96-a239-4cc9-80c3-c4275af7b6fd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:14.329007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6c96-a239-4cc9-80c3-c4275af7b6fd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:14.329007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d6c96-a239-4cc9-80c3-c4275af7b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:14.364383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7c5d6c96-a239-4cc9-80c3-c4275af7b6fd None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:14.365638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c5d6c96-a239-4cc9-80c3-c4275af7b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:14.391021 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3578/7082] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 31 05:46:14.398884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:14.434935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b28d8-111f-4fed-9063-fa06002c46de service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:14.453439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:14.454089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:14.454414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:14.454691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:14.471813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:14.473418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:14.523303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3505/7083] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:17.320974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26950-3889-43a1-aa02-a9344d5df39b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:17.321375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26950-3889-43a1-aa02-a9344d5df39b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:17.321563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26950-3889-43a1-aa02-a9344d5df39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:17.355361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c9b26950-3889-43a1-aa02-a9344d5df39b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:17.356604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9b26950-3889-43a1-aa02-a9344d5df39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:17.377451 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3579/7084] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:17.391966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:17.409192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890edb4-b38c-4f4c-aadc-9eeaa589ad00 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:17.431831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:17.434415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:17.438619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:17.439106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:17.469442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:17.476420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:17.537315 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3506/7085] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:17.790737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff2207-7310-4533-8fa9-6ee0ef2d56e6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:17.791439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff2207-7310-4533-8fa9-6ee0ef2d56e6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:17.791893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff2207-7310-4533-8fa9-6ee0ef2d56e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:17.836418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-06ff2207-7310-4533-8fa9-6ee0ef2d56e6 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:17.839247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-06ff2207-7310-4533-8fa9-6ee0ef2d56e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:17.862284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3580/7086] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:17.878508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:17.906740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488994d3-e55b-42f9-89e1-407c4c46129e service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:17.912737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:17.913638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:17.914164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:17.914663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:17.942798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:17.944751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:17.993293 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3507/7087] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:18.319348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:18.319772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:18.319896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:18.351129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:18.352800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:18.358677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:18.361712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:18.372444 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3581/7088] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:18.390714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:18.426039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a94b14-dc7d-44c1-af0c-7fc1641df886 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:18.443518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099abbe-58a2-47c4-817b-afc74da86cdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:18.444213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099abbe-58a2-47c4-817b-afc74da86cdc service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:18.444670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099abbe-58a2-47c4-817b-afc74da86cdc service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:18.445223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099abbe-58a2-47c4-817b-afc74da86cdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:18.460519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099abbe-58a2-47c4-817b-afc74da86cdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:18.464545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099abbe-58a2-47c4-817b-afc74da86cdc service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:18.481942 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3582/7089] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:46:18.488026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f24c-b870-486c-9daf-fad075081aff service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:18.521471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:18.523689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:18.524715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:18.525697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:18.539234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:18.579280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:18.586066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:18.611944 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3508/7090] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:18.759298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:18.759889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:18.760411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:18.821234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:18.825326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:18.840506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:18.843101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:18.854352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3583/7091] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:18.869253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:18.896722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422775c8-993d-4b48-a157-7b906f55ed7b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:18.915035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ca5c-1a5d-4ec9-adf6-9d32c7992949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:18.927787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ca5c-1a5d-4ec9-adf6-9d32c7992949 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:18.928090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ca5c-1a5d-4ec9-adf6-9d32c7992949 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:18.931543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ca5c-1a5d-4ec9-adf6-9d32c7992949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:18.961089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ca5c-1a5d-4ec9-adf6-9d32c7992949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:18.962884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ca5c-1a5d-4ec9-adf6-9d32c7992949 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:18.973771 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3584/7092] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:46:19.020084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e38a9-beb8-4781-bc86-05c679a4ad03 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:19.025686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:19.026915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:19.027410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:19.028594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] PATH_INFO: `/v3/users/c40a79fd2f8b4201aa4d34667718331e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:19.031923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40a79fd2f8b4201aa4d34667718331e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:19.034608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:19.088833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:19.114799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40a79fd2f8b4201aa4d34667718331e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:19.129180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40a79fd2f8b4201aa4d34667718331e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:19.129180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40a79fd2f8b4201aa4d34667718331e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:19.129180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40a79fd2f8b4201aa4d34667718331e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:19.147526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-529b5255-1ade-414d-9709-9d11086f96f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40a79fd2f8b4201aa4d34667718331e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:19.193475 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3509/7093] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:18 2022] DELETE /identity/v3/users/c40a79fd2f8b4201aa4d34667718331e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:19.198281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:19.198580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:19.198869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:19.243279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:19.245334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:19.287963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:19.288314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:19.288517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:19.331421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:19.332605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:19.406979 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3585/7094] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:19.416880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:19.421577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:19.477520 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3510/7095] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:19.488811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:19.523533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:19.525700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:19.571324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85774af-a3bc-46a2-bf50-6dcaae8e6612 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:19.581198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:19.582054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:19.583835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:19.584485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:19.650308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6def3-c4bd-4f53-b538-eccbeebdbb4e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:19.660130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:19.667073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4f1b2-c5d8-4282-9e24-ca49e264abf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:19.667801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f1b2-c5d8-4282-9e24-ca49e264abf1 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:19.668238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f1b2-c5d8-4282-9e24-ca49e264abf1 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:19.668518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f1b2-c5d8-4282-9e24-ca49e264abf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:19.680828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:19.684302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4f1b2-c5d8-4282-9e24-ca49e264abf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:19.686590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4f1b2-c5d8-4282-9e24-ca49e264abf1 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:19.715898 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3511/7096] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:19.735379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3586/7097] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:20.016524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.016964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.017311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.090203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:20.091330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:20.126077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3512/7098] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:20.138570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:20.165773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a49a-5a7e-47f2-b3af-2de764729387 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:20.187339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea514f-1302-4303-8bca-48003083066a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:20.193106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea514f-1302-4303-8bca-48003083066a service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.193634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea514f-1302-4303-8bca-48003083066a service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.195960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea514f-1302-4303-8bca-48003083066a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.226350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:20.228371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:20.251747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea514f-1302-4303-8bca-48003083066a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:20.269643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea514f-1302-4303-8bca-48003083066a service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:20.298883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6bf3b-2404-4e2f-8443-b4f0dba15002 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:20.312649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:20.313313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.313592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.315022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] PATH_INFO: `/v3/projects/ea0af30521734a07bc87e6abd7b910ff` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.317449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0af30521734a07bc87e6abd7b910ff)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:20.322995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:20.335655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3587/7099] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:46:20.449876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:20.493929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0af30521734a07bc87e6abd7b910ff', 'request_id': 'req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.531463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0af30521734a07bc87e6abd7b910ff', 'request_id': 'req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.554495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0af30521734a07bc87e6abd7b910ff', 'request_id': 'req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.572903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] The token cache is being invalidate because project ea0af30521734a07bc87e6abd7b910ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:20.573883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.576848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.592207 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3513/7100] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:20 2022] DELETE /identity/v3/projects/ea0af30521734a07bc87e6abd7b910ff => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:20.597190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8be38-afe5-4409-91ff-df2b2f67b806 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.597640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8be38-afe5-4409-91ff-df2b2f67b806 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.597750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8be38-afe5-4409-91ff-df2b2f67b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.625659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:20.627771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:20.648621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-daf8be38-afe5-4409-91ff-df2b2f67b806 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:20.652408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-daf8be38-afe5-4409-91ff-df2b2f67b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:20.747477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0da2-177c-4c2a-8f25-fdd34b7e3269 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:20.765954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:20.769041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.769934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.769934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] PATH_INFO: `/v3/users/8c98d4d0e1af4907afd2244c57ab199b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.774428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c98d4d0e1af4907afd2244c57ab199b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:20.778976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:20.835730 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3588/7101] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:20.852344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.853098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.853571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.901549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c98d4d0e1af4907afd2244c57ab199b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.906809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:20.908664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:20.922258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c98d4d0e1af4907afd2244c57ab199b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.922969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c98d4d0e1af4907afd2244c57ab199b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.923778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c98d4d0e1af4907afd2244c57ab199b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.934072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3589/7102] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:20.939793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:20.943467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f1e2edc3-f648-429c-88d8-2d19fe327ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c98d4d0e1af4907afd2244c57ab199b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:20.961498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55801c-4276-449f-ac4a-62e9f396b30b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:20.979399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:20.980593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:20.981139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:20.981733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:20.984222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:20.987687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:20.989778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.000152 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3514/7103] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:20 2022] DELETE /identity/v3/users/8c98d4d0e1af4907afd2244c57ab199b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:21.004965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.005544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.005912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.023880 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3590/7104] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:21.031540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:21.061674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:21.065662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b847007-2a7a-4e71-bc39-9086fd9fe27c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:21.066127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:21.151377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:21.205665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3515/7105] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:21.217956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:21.219313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:21.226853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:21.227947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.230621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.231111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.231962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:21.235918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.320908 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3591/7106] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:21 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:21.329201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:21.361448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bac2e-0eb3-4c85-9fdf-33ca1ffce262 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:21.421587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:21.490985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:21.491532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.491818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.496169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.530780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922982c-8511-4341-9177-06b97ec73dd3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:21.552430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:21.553078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.553361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.553640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.554314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:21.556264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.625028 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3592/7107] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:21 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:21.629371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:21.671585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f55dc-456f-4600-b49e-876009f91d26 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:21.684996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:21.686805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.687783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.688065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.690233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:21.693202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.720208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:21.724133 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3593/7108] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:21.725994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:21.726341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.750214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b48d1-ba66-4259-a9d6-0c3d7c4fb529 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:21.766733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6570dcc-b986-4503-a767-485cff679936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:21.767383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570dcc-b986-4503-a767-485cff679936 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.767660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570dcc-b986-4503-a767-485cff679936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.767942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570dcc-b986-4503-a767-485cff679936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.768600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6570dcc-b986-4503-a767-485cff679936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:21.770247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6570dcc-b986-4503-a767-485cff679936 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.785786 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3516/7109] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:21.825349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3594/7110] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:21.827457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:21.841827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663052b1-acad-437b-a8e7-b2f3e63c3c3f service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:21.862984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:21.862984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.862984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.862984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] PATH_INFO: `/v3/projects/61c529ce392c4a3f8dc8d864fbdf6b41/users/094585e0ff704e6bbb2365911dc642b8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:21.924137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c529ce392c4a3f8dc8d864fbdf6b41, user_id=094585e0ff704e6bbb2365911dc642b8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:21.927486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:21.956724 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3517/7111] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:21 2022] PUT /identity/v3/projects/61c529ce392c4a3f8dc8d864fbdf6b41/users/094585e0ff704e6bbb2365911dc642b8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:21.968535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:21.968829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:21.969141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:22.036871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] MFA Rules not processed for user `094585e0ff704e6bbb2365911dc642b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:22.037809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:22.216676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3595/7112] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:22.244595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:22.247513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:22.311763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:22.409671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6004bc-cb65-49a5-b4e7-231910193adc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:22.420299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc647cdc-03b4-43af-9fd8-440c3396ac99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:22.420947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647cdc-03b4-43af-9fd8-440c3396ac99 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:22.421230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647cdc-03b4-43af-9fd8-440c3396ac99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:22.421521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647cdc-03b4-43af-9fd8-440c3396ac99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:22.426051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:22.427597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:22.443259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc647cdc-03b4-43af-9fd8-440c3396ac99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:22.447263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc647cdc-03b4-43af-9fd8-440c3396ac99 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:22.474923 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3518/7113] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:22.586658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6d049-2cc0-490d-8833-bce25bfc7141 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:22.600709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:22.601558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:22.601840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:22.602115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] PATH_INFO: `/v3/projects/7095398e34ba4e789351d86bfd1cf06a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:22.603323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7095398e34ba4e789351d86bfd1cf06a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:22.605248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:22.739533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:22.772337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7095398e34ba4e789351d86bfd1cf06a', 'request_id': 'req-758af912-ad59-4f94-bda1-3795e45495b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:22.806298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7095398e34ba4e789351d86bfd1cf06a', 'request_id': 'req-758af912-ad59-4f94-bda1-3795e45495b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:22.815718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7095398e34ba4e789351d86bfd1cf06a', 'request_id': 'req-758af912-ad59-4f94-bda1-3795e45495b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:22.849374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] The token cache is being invalidate because project 7095398e34ba4e789351d86bfd1cf06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:22.849669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:22.859010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-758af912-ad59-4f94-bda1-3795e45495b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:22.863865 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3596/7114] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:22 2022] DELETE /identity/v3/projects/7095398e34ba4e789351d86bfd1cf06a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:22.865519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:22.865982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:22.866124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:22.902328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:22.903611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:23.022499 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3519/7115] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:23.036845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.037481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.037965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.083420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:23.084674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:23.114571 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3597/7116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:23.120449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.136390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31a562-6e41-480e-ad6d-100da293c1f8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.146834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.147488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.147886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.148208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.148957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:23.151097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.159044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.181579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3520/7117] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:23.186725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.209288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ccc2-7a2a-4a20-9a4b-cf506d3f418d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.219053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.219705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.220084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.220313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.221148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.223279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.283246 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3598/7118] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:23 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:23.287432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.308994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ccfd3-fa5a-4448-bc54-2f45a0fd98b6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.450699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.452444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.453498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.456396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.457400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.464498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.540106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3521/7119] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:23 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:23.544288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.563045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b31d5-0a76-42fc-9b41-694ebc0b7626 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.596428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.598746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.600050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.601707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.606050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.612531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.705667 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3599/7120] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:23.708176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.723098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26c78-704d-4be5-a2f4-11716189fc90 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.743026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.744579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.746325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.746635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.748925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.757958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.812456 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3522/7121] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:23.814263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.834875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083c2a-a4e9-4df3-af3b-b85b5f34630a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.845020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:23.847040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:23.861536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ad9e8-5028-452d-9fc5-6abc1244c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.862588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ad9e8-5028-452d-9fc5-6abc1244c226 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.863607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ad9e8-5028-452d-9fc5-6abc1244c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.864231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ad9e8-5028-452d-9fc5-6abc1244c226 admin admin] PATH_INFO: `/v3/projects/d177a07580484bed951cb09baf5f4a5a/users/2cf9bcdad425445682dda4558d759563/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.883578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e72f0-3a9a-4311-8a35-b18a6011e6ea admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:23.915771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:23.916437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.916717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.916991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] PATH_INFO: `/v3/users/f51d7cbfe90a4f299ee4913e6ce02f5a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:23.926505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51d7cbfe90a4f299ee4913e6ce02f5a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.933076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ad9e8-5028-452d-9fc5-6abc1244c226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d177a07580484bed951cb09baf5f4a5a, user_id=2cf9bcdad425445682dda4558d759563, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:23.938317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.938857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ad9e8-5028-452d-9fc5-6abc1244c226 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:23.969905 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3600/7122] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:23 2022] PUT /identity/v3/projects/d177a07580484bed951cb09baf5f4a5a/users/2cf9bcdad425445682dda4558d759563/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:23.980950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:23.981597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:23.982205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:24.034577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:24.054114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] MFA Rules not processed for user `2cf9bcdad425445682dda4558d759563`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:24.060601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:24.077393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51d7cbfe90a4f299ee4913e6ce02f5a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:24.095170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51d7cbfe90a4f299ee4913e6ce02f5a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:24.095824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51d7cbfe90a4f299ee4913e6ce02f5a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:24.096655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51d7cbfe90a4f299ee4913e6ce02f5a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:24.111229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9b123ba0-2a36-41ea-9bb1-bf037e0fe347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51d7cbfe90a4f299ee4913e6ce02f5a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:24.180393 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3523/7123] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:23 2022] DELETE /identity/v3/users/f51d7cbfe90a4f299ee4913e6ce02f5a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:24.190983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:24.191281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:24.191560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:24.245914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:24.250866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:24.317702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3601/7124] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:24.322054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:24.327793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:24.453141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3524/7125] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:24.470059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:24.479832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:24.481460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:24.526915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d17f-1bb9-4980-a692-cf7edeecf4b0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:24.541588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:24.542268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:24.545259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:24.545565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:24.547404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:24.557769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:24.620702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b454c-a632-4e6a-a0f8-4c5c0aacacf5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:24.625065 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3602/7126] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:24 2022] POST /identity/v3/projects => generated 369 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:24.629271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:24.637749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:24.638839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:24.639343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:24.639995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:24.662461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:24.664284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:24.686870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3525/7127] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:24.753093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f79cc-fc38-4f3d-8484-f72e5ebc5f11 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:24.777023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:24.777677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:24.777960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:24.780989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:24.781641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:24.799667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:24.889560 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3603/7128] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:24 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:24.891126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:24.905029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77fc18-8444-4a3b-bc58-967ebfd8baf0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:24.911353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:24.912141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:24.912552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:24.912937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:24.913704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:24.915506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:24.976680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:24.993445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc5fb-0b0a-4b87-bdf9-8f70a596e484 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:25.002498 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3526/7129] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:25.018379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4519f5-4acb-4e14-b6a7-1155149ef6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:25.019020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4519f5-4acb-4e14-b6a7-1155149ef6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:25.019358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4519f5-4acb-4e14-b6a7-1155149ef6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:25.019850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4519f5-4acb-4e14-b6a7-1155149ef6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:25.022003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4519f5-4acb-4e14-b6a7-1155149ef6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:25.023671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4519f5-4acb-4e14-b6a7-1155149ef6d4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:25.052458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3604/7130] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:25.053882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:25.078473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24cd1-6066-477c-a3f4-a627474b7f40 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:25.084649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:25.085713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:25.086249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:25.086736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] PATH_INFO: `/v3/projects/ec073198d265473da061b6211bc63438/users/3dd7a7208d6747cb8fc7984794b1e0de/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:25.117474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec073198d265473da061b6211bc63438, user_id=3dd7a7208d6747cb8fc7984794b1e0de, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:25.129892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:25.172981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3527/7131] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:25 2022] PUT /identity/v3/projects/ec073198d265473da061b6211bc63438/users/3dd7a7208d6747cb8fc7984794b1e0de/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:25.285769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:25.286020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:25.286315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:25.324810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] MFA Rules not processed for user `3dd7a7208d6747cb8fc7984794b1e0de`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:25.326880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:25.508197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3605/7132] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:25.518650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:25.520407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:25.544047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:25.649805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd9be6-6c85-447c-8010-e5257dbff389 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:25.656714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ccb96-04ba-4671-9226-4c242d6dc686 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:25.657676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ccb96-04ba-4671-9226-4c242d6dc686 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:25.658287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ccb96-04ba-4671-9226-4c242d6dc686 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:25.658793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ccb96-04ba-4671-9226-4c242d6dc686 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:25.673452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:25.675156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:25.787203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:25.796752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ccb96-04ba-4671-9226-4c242d6dc686 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:25.801338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ccb96-04ba-4671-9226-4c242d6dc686 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:25.827006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3528/7133] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:25.903233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfb078-93ef-4106-bebd-50b047ef6914 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:25.920132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:25.924680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:25.925314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:25.925964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] PATH_INFO: `/v3/projects/1c287a54b4e846a2834ab77d779f6389` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:25.927698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c287a54b4e846a2834ab77d779f6389)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:25.931219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:26.053987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c287a54b4e846a2834ab77d779f6389', 'request_id': 'req-792dda90-ef38-46e2-ab36-47402e721d97'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:26.071692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c287a54b4e846a2834ab77d779f6389', 'request_id': 'req-792dda90-ef38-46e2-ab36-47402e721d97'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:26.090972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c287a54b4e846a2834ab77d779f6389', 'request_id': 'req-792dda90-ef38-46e2-ab36-47402e721d97'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:26.120426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] The token cache is being invalidate because project 1c287a54b4e846a2834ab77d779f6389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:26.120833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:26.122574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:26.128131 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3606/7134] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:25 2022] DELETE /identity/v3/projects/1c287a54b4e846a2834ab77d779f6389 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:26.133337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1430c1-d7a2-4703-a911-69ea93eb4f98 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.133810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1430c1-d7a2-4703-a911-69ea93eb4f98 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.133904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1430c1-d7a2-4703-a911-69ea93eb4f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.177890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:26.179457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:26.189264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1e1430c1-d7a2-4703-a911-69ea93eb4f98 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:26.190638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1e1430c1-d7a2-4703-a911-69ea93eb4f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:26.310064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dda90-ef38-46e2-ab36-47402e721d97 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:26.316871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:26.318021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.319398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.321591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.328210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:26.349965 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3529/7135] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:26.351503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.351796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.352058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.395440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:26.396749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:26.413188 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3530/7136] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:26.419261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:26.440598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60730db-d5af-4c0d-85ee-3324b16c80e5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:26.461732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:26.462381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.462665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.462944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.463603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:26.463907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:26.465515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:26.495635 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3531/7137] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:26.496828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:26.497193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:26.499491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:26.527105 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3607/7138] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:26.529957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e332-dca8-4852-b04c-ce48e25f9b6c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:26.540732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:26.542267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.542453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.542736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.543390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:26.545834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:26.589430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3532/7139] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:26 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:26.590752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:26.619730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091608-b3bc-4a7e-bdf3-4bd389a1aad1 service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:26.657393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:26.745728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:26.746677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.747210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.747673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.751318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:26.766193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:26.813612 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3608/7140] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:26 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:26.815834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:26.827765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245992-06bd-4c2e-bf7a-d62526484030 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:26.859188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:26.860141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.860671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.861255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.862227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:26.864363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:26.900946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:26.915687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27487950-aa90-4620-bf87-6bdd812cdaf3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:26.916391 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3533/7141] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:26.931412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5456304-5977-402a-9ad1-08bc6ae2de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:26.932240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456304-5977-402a-9ad1-08bc6ae2de5d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:26.932757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456304-5977-402a-9ad1-08bc6ae2de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:26.933164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456304-5977-402a-9ad1-08bc6ae2de5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:26.933973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5456304-5977-402a-9ad1-08bc6ae2de5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:26.943634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5456304-5977-402a-9ad1-08bc6ae2de5d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:27.024283 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3609/7142] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:27.026008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:27.046850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c34ce-5d23-4ba8-aa62-c032165b5a66 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:27.096305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:27.097169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:27.099492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:27.099951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] PATH_INFO: `/v3/projects/59e34764895b4c5496be86c326ab01de/users/070ffa06c4494cadb3f104e3e4ac23ed/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:27.139399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:27.153207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e34764895b4c5496be86c326ab01de, user_id=070ffa06c4494cadb3f104e3e4ac23ed, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:27.165145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:27.220984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3534/7143] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:27 2022] PUT /identity/v3/projects/59e34764895b4c5496be86c326ab01de/users/070ffa06c4494cadb3f104e3e4ac23ed/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:27.223636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:27.223800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:27.224085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:27.287102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:27.295443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:27.520700 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3610/7144] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:27.549562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:27.551808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:27.724688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50edf6-3215-435e-8f73-089637b5d1cb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:27.743451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddd9f-e593-43b2-a735-69d088ccc416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:27.745831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddd9f-e593-43b2-a735-69d088ccc416 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:27.746423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddd9f-e593-43b2-a735-69d088ccc416 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:27.747110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddd9f-e593-43b2-a735-69d088ccc416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:27.770823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddd9f-e593-43b2-a735-69d088ccc416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:27.773671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddd9f-e593-43b2-a735-69d088ccc416 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:27.798553 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3535/7145] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:29.298298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:29.299916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:29.329785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc5ac-f342-42d7-8265-d674b8f8cdca None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:29.345553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:29.346271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:29.346558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:29.346830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] PATH_INFO: `/v3/users/2cf9bcdad425445682dda4558d759563` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:29.349361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf9bcdad425445682dda4558d759563)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:29.354374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:29.479967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf9bcdad425445682dda4558d759563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:29.500981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf9bcdad425445682dda4558d759563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:29.501746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf9bcdad425445682dda4558d759563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:29.502942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf9bcdad425445682dda4558d759563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:29.515220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8a10eb9b-b97a-430d-acc8-53704105e908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf9bcdad425445682dda4558d759563'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:29.534824 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3611/7146] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:29 2022] DELETE /identity/v3/users/2cf9bcdad425445682dda4558d759563 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:29.536329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:29.536771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:29.536888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:29.588126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:29.589272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:29.589867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:29.598659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:29.603311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:29.658944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] MFA Rules not processed for user `070ffa06c4494cadb3f104e3e4ac23ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:29.662390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:29.674066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:29.852329 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3536/7147] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:29.865546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:29.867628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:29.944044 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3612/7148] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:29.945289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:29.948222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:29.992161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d23b8e-91c1-46a6-ad79-c00b2170061e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.010930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.011704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.012180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.012692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.014628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.018194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.079360 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3613/7149] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:29 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:30.087535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:30.102537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913cbc-745b-45c7-b0f3-3547b627588d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.245166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:30.266611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.267529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.268020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.268581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.307938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf43e-5a5d-4abd-bfff-cc5de5dec767 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.327470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.328340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.328624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.328898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.331644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.334843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.394071 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3614/7150] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:30 2022] POST /identity/v3/users => generated 296 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:30.395929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:30.419261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005653a3-cfa7-4446-a29c-3bf8bb58df78 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.428758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.433699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.434759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.437286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.437286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.437497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.440799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.445606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.460825 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3537/7151] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:30.470075 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3615/7152] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:30.474298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:30.490341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b445f-d0f2-4089-a98e-fa33e75a14f3 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.508196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.509733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.510521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.510883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] PATH_INFO: `/v3/projects/5ffe7104ba6749a2b980ce4f090341ee/users/c45f4b4dcfc042b1a2104f329f64c8ab/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.549833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffe7104ba6749a2b980ce4f090341ee, user_id=c45f4b4dcfc042b1a2104f329f64c8ab, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.552788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.588010 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3538/7153] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:30 2022] PUT /identity/v3/projects/5ffe7104ba6749a2b980ce4f090341ee/users/c45f4b4dcfc042b1a2104f329f64c8ab/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:30.596339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:30.620370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993324e-a47b-496a-bdb8-be1a630cdeb6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.744951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.748378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.748801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.749181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.749981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.755449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.759433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:30.778337 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3616/7154] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:30.782097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:30.793708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755a309-7d86-4410-ac43-709455f93925 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:30.800267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:30.801593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:30.802062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:30.802625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] PATH_INFO: `/v3/projects/5ffe7104ba6749a2b980ce4f090341ee/users/c45f4b4dcfc042b1a2104f329f64c8ab/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:30.805342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffe7104ba6749a2b980ce4f090341ee, user_id=c45f4b4dcfc042b1a2104f329f64c8ab, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:30.809235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:30.823799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3539/7155] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:30 2022] PUT /identity/v3/projects/5ffe7104ba6749a2b980ce4f090341ee/users/c45f4b4dcfc042b1a2104f329f64c8ab/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:31.174695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:31.177703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:31.348497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49e61c-6f61-4a02-b270-17a23245c1d7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:31.430897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:31.433098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:31.480274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:31.481536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:31.481830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:31.482799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:31.490049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:31.620652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2610-f767-4885-a353-afc0360fff33 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:31.627314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:31.628356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:31.628916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:31.629737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] PATH_INFO: `/v3/projects/d177a07580484bed951cb09baf5f4a5a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:31.631623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d177a07580484bed951cb09baf5f4a5a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:31.642611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:31.657063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:31.658866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:31.681484 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3617/7156] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:31.707595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd177a07580484bed951cb09baf5f4a5a', 'request_id': 'req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:31.715500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd177a07580484bed951cb09baf5f4a5a', 'request_id': 'req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:31.720964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:31.728158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd177a07580484bed951cb09baf5f4a5a', 'request_id': 'req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:31.751201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] The token cache is being invalidate because project d177a07580484bed951cb09baf5f4a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:31.751687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:31.756717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-62ad85f9-1c52-45e0-a547-9cb3462e6f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:31.762314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3540/7157] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:31 2022] DELETE /identity/v3/projects/d177a07580484bed951cb09baf5f4a5a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:31.764268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:31.777022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ede958-6639-420a-b0d8-f863d448a891 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:31.927103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:31.928008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:31.928460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:31.928878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] PATH_INFO: `/v3/users/3dd7a7208d6747cb8fc7984794b1e0de` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:31.930311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd7a7208d6747cb8fc7984794b1e0de)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:31.932397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:31.939700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:32.040186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd7a7208d6747cb8fc7984794b1e0de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:32.091731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd7a7208d6747cb8fc7984794b1e0de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:32.096578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd7a7208d6747cb8fc7984794b1e0de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:32.106778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd7a7208d6747cb8fc7984794b1e0de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:32.119945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd7a7208d6747cb8fc7984794b1e0de'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:32.146676 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3618/7158] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:31 2022] DELETE /identity/v3/users/3dd7a7208d6747cb8fc7984794b1e0de => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:32.862427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f891dc-30c6-4a3b-8e48-b50f3e548ab1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:32.862948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f891dc-30c6-4a3b-8e48-b50f3e548ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:32.865119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f891dc-30c6-4a3b-8e48-b50f3e548ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:32.896567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:32.898280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:32.936537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-73f891dc-30c6-4a3b-8e48-b50f3e548ab1 None None] MFA Rules not processed for user `c45f4b4dcfc042b1a2104f329f64c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:32.938691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-73f891dc-30c6-4a3b-8e48-b50f3e548ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:33.063670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b9bf0-e673-4c13-bb58-70173d6b080f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:33.072032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:33.072867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.073374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.073768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] PATH_INFO: `/v3/projects/ec073198d265473da061b6211bc63438` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.075260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec073198d265473da061b6211bc63438)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:33.077916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:33.084914 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3541/7159] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:33.097735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.098443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.099129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.147250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] MFA Rules not processed for user `070ffa06c4494cadb3f104e3e4ac23ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:33.149399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:33.198426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec073198d265473da061b6211bc63438', 'request_id': 'req-653c60cf-0664-4bd4-9f76-318b96c6811a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:33.221796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec073198d265473da061b6211bc63438', 'request_id': 'req-653c60cf-0664-4bd4-9f76-318b96c6811a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:33.250025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec073198d265473da061b6211bc63438', 'request_id': 'req-653c60cf-0664-4bd4-9f76-318b96c6811a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:33.287214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] The token cache is being invalidate because project ec073198d265473da061b6211bc63438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:33.288439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:33.305462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-653c60cf-0664-4bd4-9f76-318b96c6811a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:33.314038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3619/7160] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:32 2022] DELETE /identity/v3/projects/ec073198d265473da061b6211bc63438 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:33.328490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9c97-4f16-421b-a30a-2dfcafc432f7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.332919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9c97-4f16-421b-a30a-2dfcafc432f7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.336715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb9c97-4f16-421b-a30a-2dfcafc432f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.400137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c8eb9c97-4f16-421b-a30a-2dfcafc432f7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:33.411987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3542/7161] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:33.412127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8eb9c97-4f16-421b-a30a-2dfcafc432f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:33.422811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:33.429703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:33.441517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:33.588842 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3620/7162] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:33.592634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136de1e1-7470-4800-a593-0cda26457703 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.593001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136de1e1-7470-4800-a593-0cda26457703 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.593352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136de1e1-7470-4800-a593-0cda26457703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.638305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db9327-c3f2-405f-adef-203d76fc773f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:33.648266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-136de1e1-7470-4800-a593-0cda26457703 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:33.650111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-136de1e1-7470-4800-a593-0cda26457703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:33.666091 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3621/7163] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:33.669076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136de1e1-7470-4800-a593-0cda26457703 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:33.683835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:33.697871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136de1e1-7470-4800-a593-0cda26457703 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:33.711804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:33.712523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.712847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.713126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.713787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:33.714086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:33.718380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:33.766831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3622/7164] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:33.772553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:33.820140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe5c8-9fe5-4fa2-9db8-125593b01642 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:33.842340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:33.843367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.844495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.847172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.847862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:33.857144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:33.866587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:33.870396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:33.871084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:33.873686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:33.880421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:33.932139 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3623/7165] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:33 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:33.936825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:34.056186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:34.056697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925136f9-1f03-4523-9755-a68dc1092551 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:34.059657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:34.065226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:34.065978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:34.066378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:34.067485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:34.068205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:34.072431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:34.085028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3543/7166] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:34.149241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3624/7167] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:33 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:34.150874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:34.172284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefbaeb-2f37-4988-8a04-a5a7cd6c63be service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:34.186994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:34.187682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:34.188113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:34.188516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:34.189302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:34.191382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:34.219309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:34.220519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3544/7168] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:34.230969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c334e5-51ff-45c4-af60-a46533edab3b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:34.236255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8921-91f7-48db-ac51-c6a19293171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:34.236973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8921-91f7-48db-ac51-c6a19293171a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:34.237327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8921-91f7-48db-ac51-c6a19293171a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:34.237671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8921-91f7-48db-ac51-c6a19293171a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:34.238459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8921-91f7-48db-ac51-c6a19293171a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:34.240161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8921-91f7-48db-ac51-c6a19293171a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:34.258839 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3625/7169] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:34.269736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:34.298298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bf85d-85a2-48c1-88bd-8056b14e94a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:34.315550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:34.316258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:34.316543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:34.316824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] PATH_INFO: `/v3/projects/5f514fd675424ce0bb24fcca2ffff089/users/83907fac290f4b5bb0e82cc1910a70c9/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:34.351014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f514fd675424ce0bb24fcca2ffff089, user_id=83907fac290f4b5bb0e82cc1910a70c9, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:34.353904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:34.382770 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3545/7170] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:34 2022] PUT /identity/v3/projects/5f514fd675424ce0bb24fcca2ffff089/users/83907fac290f4b5bb0e82cc1910a70c9/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:34.396339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:34.396703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:34.397221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:34.503586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] MFA Rules not processed for user `83907fac290f4b5bb0e82cc1910a70c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:34.506643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:34.596582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:34.648586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3626/7171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:34.653476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:34.802829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c741-22b2-4fc0-9566-f7e255d3d1f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:34.819989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:34.821063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:34.821063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:34.821266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:34.821897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:34.823876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:34.884340 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3546/7172] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:34 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:34.888619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:34.909034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d33b4-9215-4f35-b268-fe852b1f65bd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:35.094179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:35.095513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:35.095513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:35.095708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:35.096448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:35.100133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:35.158398 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3627/7173] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:34 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:35.162687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:35.180560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34846df-dd72-45b4-803c-96978ca59d22 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:35.205872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:35.207913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:35.208219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:35.208516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:35.209179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:35.216915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:35.221461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:35.263292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:35.264035 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3547/7174] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:35.297420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32db22-fe31-4ff4-97e4-1a0fc053940c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:35.313565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:35.315942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:35.315942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:35.315942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] PATH_INFO: `/v3/projects/4451b8753dd3414a99b7b26d1d71f702/users/f522202f65434ffc8a95d591af5463db/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:35.399350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4451b8753dd3414a99b7b26d1d71f702, user_id=f522202f65434ffc8a95d591af5463db, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:35.405094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:35.434279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3628/7175] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:35 2022] PUT /identity/v3/projects/4451b8753dd3414a99b7b26d1d71f702/users/f522202f65434ffc8a95d591af5463db/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:35.438865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:35.468233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506ecc-656a-41c3-a133-d0342636434a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:35.595481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bdda7-74e1-447a-9cbb-0bb6d733c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:35.596181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bdda7-74e1-447a-9cbb-0bb6d733c21a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:35.596466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bdda7-74e1-447a-9cbb-0bb6d733c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:35.596741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bdda7-74e1-447a-9cbb-0bb6d733c21a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:35.599975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bdda7-74e1-447a-9cbb-0bb6d733c21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:35.605793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bdda7-74e1-447a-9cbb-0bb6d733c21a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:35.635230 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3548/7176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:35.638531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:35.657595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fb1d5-7dc1-4be2-abb0-294beeb91823 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:35.665624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:35.666693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:35.667232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:35.667717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] PATH_INFO: `/v3/projects/4451b8753dd3414a99b7b26d1d71f702/users/f522202f65434ffc8a95d591af5463db/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:35.671799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4451b8753dd3414a99b7b26d1d71f702, user_id=f522202f65434ffc8a95d591af5463db, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:35.675761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:35.703443 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3629/7177] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:35 2022] PUT /identity/v3/projects/4451b8753dd3414a99b7b26d1d71f702/users/f522202f65434ffc8a95d591af5463db/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:35.707259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:35.707553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:35.707833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:35.759924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] MFA Rules not processed for user `f522202f65434ffc8a95d591af5463db`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:35.762357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:35.946720 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3549/7178] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:36.031489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:36.033265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:36.248831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c619-aaae-418b-af70-d1bf8b6222b2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:36.307014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:36.307660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:36.307942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:36.308221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:36.425538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:36.454816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385bd60-096e-4130-aa6f-3327eabe46e7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:36.466244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:36.467426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:36.469235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:36.469678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:36.475217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:36.522626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:36.575012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:36.575012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:36.607787 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3630/7179] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:36.715426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:36.717009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:36.793430 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3550/7180] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:38.558522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:38.576279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5766b2-8835-43c5-9600-dd54d6fde4f0 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:38.584086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:38.584789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:38.585081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:38.585371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:38.591017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:38.593504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:38.603147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:38.619335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87931b52-3d97-4f5e-8f3a-bce4fb15f234 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:38.630792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:38.633348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:38.634001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:38.634329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:38.634459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:38.634591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:38.637177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:38.671754 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3631/7181] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:38.674239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:38.676203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:38.738106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3551/7182] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:39.614611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:39.617993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:39.811418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74f9c4-199e-4f45-ac84-78335d252bbe service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:39.828628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:39.829914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:39.830397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:39.830859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] PATH_INFO: `/v3/users/a8c9035d265e4a93a72db6cc50414707` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:39.832784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c9035d265e4a93a72db6cc50414707)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:39.835704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:39.932562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c9035d265e4a93a72db6cc50414707'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:39.951672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c9035d265e4a93a72db6cc50414707'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:39.970336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c9035d265e4a93a72db6cc50414707'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:39.970336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c9035d265e4a93a72db6cc50414707'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.000708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5572999-e59e-49e3-a38d-a9a54845a7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c9035d265e4a93a72db6cc50414707'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.041155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3632/7183] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:39 2022] DELETE /identity/v3/users/a8c9035d265e4a93a72db6cc50414707 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:40.211014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:40.212598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:40.227732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21751703-9c4f-4d56-9549-aa2dc75624ad service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:40.335147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:40.336190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:40.336653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:40.337230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] PATH_INFO: `/v3/users/094585e0ff704e6bbb2365911dc642b8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:40.338615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094585e0ff704e6bbb2365911dc642b8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:40.340865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:40.462526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094585e0ff704e6bbb2365911dc642b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.475471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094585e0ff704e6bbb2365911dc642b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.477258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094585e0ff704e6bbb2365911dc642b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.478491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094585e0ff704e6bbb2365911dc642b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.492274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094585e0ff704e6bbb2365911dc642b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.532856 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3552/7184] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:40 2022] DELETE /identity/v3/users/094585e0ff704e6bbb2365911dc642b8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:40.535073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:40.535073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:40.535073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:40.571038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:40.572285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:40.582016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:40.583818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:40.671085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:40.696834 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3633/7185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:40.711228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:40.715160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:40.761610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f017c-fc15-4bdd-af0b-b26658fe1597 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:40.778127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:40.779530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:40.780224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:40.781460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] PATH_INFO: `/v3/projects/fd2967117cfd472dba44107665885e6e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:40.789448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2967117cfd472dba44107665885e6e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:40.789448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:40.829182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:40.933244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416c7d4-12a2-4d8b-b927-be793fabe323 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:40.947199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2967117cfd472dba44107665885e6e', 'request_id': 'req-5224ffd3-f73a-4d2a-a5ae-9690bf877773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.970012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2967117cfd472dba44107665885e6e', 'request_id': 'req-5224ffd3-f73a-4d2a-a5ae-9690bf877773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:40.988545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2967117cfd472dba44107665885e6e', 'request_id': 'req-5224ffd3-f73a-4d2a-a5ae-9690bf877773'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:41.025745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] The token cache is being invalidate because project fd2967117cfd472dba44107665885e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:41.027588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:41.032477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5224ffd3-f73a-4d2a-a5ae-9690bf877773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:41.044052 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3553/7186] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:40 2022] DELETE /identity/v3/projects/fd2967117cfd472dba44107665885e6e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:41.051667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da955c-c66c-4176-bead-8514ea198ce8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.051965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da955c-c66c-4176-bead-8514ea198ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.052250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da955c-c66c-4176-bead-8514ea198ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.133022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e0da955c-c66c-4176-bead-8514ea198ce8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:41.134388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0da955c-c66c-4176-bead-8514ea198ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:41.136979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:41.137995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.138080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.139031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.142598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:41.382648 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3554/7187] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:41.386279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.386572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.386853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.387421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:41.390560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:41.417604 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3634/7188] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:41.435240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:41.436562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:41.470497 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3555/7189] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:41.471505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:41.485983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820551b-9a63-4654-a699-5831f1a55c6c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:41.496950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:41.499108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.501599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.503876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.506175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:41.506554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:41.518678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:41.555080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3635/7190] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:41.557825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:41.572405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabf74-46cb-4b50-8d8e-348ceddccd22 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:41.600780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:41.602715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.603337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.603765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.604597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:41.608438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:41.673153 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3556/7191] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:41 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:41.677829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:41.691868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d8264-522c-4968-b08e-4b8391891dce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:41.772812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:41.792491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:41.794990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.795493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.795832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.796836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:41.798960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:41.856279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3636/7192] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:41 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:41.860451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:41.873316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe461aef-2e98-4dde-b038-6f8051225243 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:41.901450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:41.902020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.902322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.902598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.903249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:41.916413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:41.949201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3557/7193] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:41.950731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:41.967849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95516ba5-a947-4d78-8ad6-99aa0ab18b20 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:41.978441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:41.979174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:41.979474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:41.979893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:41.980658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:41.985854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.014359 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3637/7194] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:42.015508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.029789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b2df6-9200-4631-9de5-bed75b386122 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.056296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.059509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadbaec-c25b-43d8-9875-b538e1b4693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.060209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadbaec-c25b-43d8-9875-b538e1b4693f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.060519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadbaec-c25b-43d8-9875-b538e1b4693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.061622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadbaec-c25b-43d8-9875-b538e1b4693f admin admin] PATH_INFO: `/v3/projects/857ad348ec084b2db5e9c684b99e49bc/users/c54441bd511c4a85bed6d8c8b360ca94/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.063538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:42.098442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a70fc1-c033-4c4e-a1f1-1b689a277459 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.106855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.108114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.108403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.119375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] PATH_INFO: `/v3/projects/61c529ce392c4a3f8dc8d864fbdf6b41` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.120959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c529ce392c4a3f8dc8d864fbdf6b41)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.122964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.127116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadbaec-c25b-43d8-9875-b538e1b4693f admin admin] RBAC: Authorizing `identity:create_grant(project_id=857ad348ec084b2db5e9c684b99e49bc, user_id=c54441bd511c4a85bed6d8c8b360ca94, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.129744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadbaec-c25b-43d8-9875-b538e1b4693f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.160597 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3558/7195] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:42 2022] PUT /identity/v3/projects/857ad348ec084b2db5e9c684b99e49bc/users/c54441bd511c4a85bed6d8c8b360ca94/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:42.166400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.166688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.166964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.226666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:42.227900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:42.288328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c529ce392c4a3f8dc8d864fbdf6b41', 'request_id': 'req-b71c7e4d-a9c9-4369-8460-427296e8baeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:42.312622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c529ce392c4a3f8dc8d864fbdf6b41', 'request_id': 'req-b71c7e4d-a9c9-4369-8460-427296e8baeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:42.325205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c529ce392c4a3f8dc8d864fbdf6b41', 'request_id': 'req-b71c7e4d-a9c9-4369-8460-427296e8baeb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:42.328189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:42.353577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] The token cache is being invalidate because project 61c529ce392c4a3f8dc8d864fbdf6b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:42.353874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:42.354801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b71c7e4d-a9c9-4369-8460-427296e8baeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:42.359736 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3638/7196] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:42 2022] DELETE /identity/v3/projects/61c529ce392c4a3f8dc8d864fbdf6b41 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:42.361456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d289-d99f-4fd7-90af-c2b4bac36191 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.361825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d289-d99f-4fd7-90af-c2b4bac36191 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.363208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d289-d99f-4fd7-90af-c2b4bac36191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.410596 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3559/7197] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:42.411629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bef5d289-d99f-4fd7-90af-c2b4bac36191 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:42.412928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bef5d289-d99f-4fd7-90af-c2b4bac36191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:42.455816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.457992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:42.541171 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3639/7198] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:42.543347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.543794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.544225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.607385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:42.609890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:42.619117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb268-3eef-45c0-9252-0ac464aa3d2c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.620162 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3640/7199] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:42.626226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.640102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf8a4d-942c-4364-ab00-b5662adddefa None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.647723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.648565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.648928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.649282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.650026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:42.650536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.652437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.676453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3641/7200] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:42.678386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.691594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fb0c8-9daf-43ff-b8c5-2310a106ddf7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.707391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.709576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.709868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.710165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.714865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.717290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.742122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.743123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.744376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.744893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.762640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.765850 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3642/7201] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:42 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:42.766014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.769894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.785797 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3560/7202] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:42.789676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:42.873828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351e8fc-a0a4-49d9-aabc-b6c5b8ec5417 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.890427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.891085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.891430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.891660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.892302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.894337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.924553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3643/7203] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:42 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:42.928672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.938808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9969-3374-40f8-9efa-6b456e7d073a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.944493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.945118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.945533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.945813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.946488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.948758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:42.966839 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3561/7204] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:42.968779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:42.979767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f14c1-c814-40e1-ac85-673075cb738e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:42.986955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ac28-8eee-413b-a6b0-7101b5d63ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:42.987581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ac28-8eee-413b-a6b0-7101b5d63ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:42.988340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ac28-8eee-413b-a6b0-7101b5d63ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:42.988645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ac28-8eee-413b-a6b0-7101b5d63ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:42.989472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ac28-8eee-413b-a6b0-7101b5d63ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:42.991182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ac28-8eee-413b-a6b0-7101b5d63ad1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:43.017087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:43.018989 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3644/7205] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:43.032070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898006-3758-4ae7-8e19-e631792d1a2c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:43.045911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:43.046463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:43.046759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:43.047035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] PATH_INFO: `/v3/projects/06c4c68038464fa7ab6f8a89c348bb1f/users/8fc75b5cce0c4b869dace29d57acef7d/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:43.075350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c4c68038464fa7ab6f8a89c348bb1f, user_id=8fc75b5cce0c4b869dace29d57acef7d, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:43.079429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:43.098873 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3562/7206] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:43 2022] PUT /identity/v3/projects/06c4c68038464fa7ab6f8a89c348bb1f/users/8fc75b5cce0c4b869dace29d57acef7d/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:43.112932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:43.113240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:43.113564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:43.157797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] MFA Rules not processed for user `8fc75b5cce0c4b869dace29d57acef7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:43.159109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:43.238340 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3645/7207] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:43.250096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:43.252256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:43.332515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72849d-de47-4b83-8f93-5a9cbc13adfb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:43.336975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d2b56-f1d8-4f02-b199-3b7cb824a2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:43.338041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2b56-f1d8-4f02-b199-3b7cb824a2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:43.338855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2b56-f1d8-4f02-b199-3b7cb824a2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:43.339368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2b56-f1d8-4f02-b199-3b7cb824a2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:43.350753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d2b56-f1d8-4f02-b199-3b7cb824a2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:43.353196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d2b56-f1d8-4f02-b199-3b7cb824a2f1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:43.377679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3563/7208] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:43.960324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:44.103688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec085e-690f-403d-ba51-b0adb9e8b5db None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:44.112002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:44.113477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:44.113913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:44.114363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] PATH_INFO: `/v3/users/8fc75b5cce0c4b869dace29d57acef7d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:44.116251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc75b5cce0c4b869dace29d57acef7d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:44.118992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:44.156978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:44.315763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc75b5cce0c4b869dace29d57acef7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:44.347688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc75b5cce0c4b869dace29d57acef7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:44.349217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc75b5cce0c4b869dace29d57acef7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:44.349877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc75b5cce0c4b869dace29d57acef7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:44.364879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc75b5cce0c4b869dace29d57acef7d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:44.393233 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3646/7209] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:43 2022] DELETE /identity/v3/users/8fc75b5cce0c4b869dace29d57acef7d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:44.399072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:44.399653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:44.399653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:44.420954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:44.447830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:44.449104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:44.650811 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3564/7210] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:44.664899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:44.666737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:44.813444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9af449-7cdd-4c5b-854e-cd3bebeb70a4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:44.825855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16932-e4fc-44da-b193-93767ca88a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:44.826594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16932-e4fc-44da-b193-93767ca88a14 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:44.826888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16932-e4fc-44da-b193-93767ca88a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:44.827253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16932-e4fc-44da-b193-93767ca88a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:44.854477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16932-e4fc-44da-b193-93767ca88a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:44.855933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16932-e4fc-44da-b193-93767ca88a14 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:44.876363 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3647/7211] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:47.502554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:47.504254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:47.527007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d37b-bd5d-4ce0-9101-c8869b8d7527 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:47.539125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:47.539803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:47.540086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:47.540363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] PATH_INFO: `/v3/projects/06c4c68038464fa7ab6f8a89c348bb1f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:47.549295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c4c68038464fa7ab6f8a89c348bb1f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:47.551933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:47.738204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c4c68038464fa7ab6f8a89c348bb1f', 'request_id': 'req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:47.753433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c4c68038464fa7ab6f8a89c348bb1f', 'request_id': 'req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:47.775204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c4c68038464fa7ab6f8a89c348bb1f', 'request_id': 'req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:47.803527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] The token cache is being invalidate because project 06c4c68038464fa7ab6f8a89c348bb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:47.803874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:47.806755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b7e12f4-0a92-4d82-a8d4-3f7ccb2a3111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:47.815344 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3565/7212] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:47 2022] DELETE /identity/v3/projects/06c4c68038464fa7ab6f8a89c348bb1f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:47.817292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:47.818942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:47.821489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:47.873781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:47.875244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:48.036147 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3648/7213] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:48.039178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.039687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.040178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.082270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:48.088248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:48.114532 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3566/7214] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:48.115466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:48.130180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077f129-0eff-4231-ae9a-c5e2c97a0858 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:48.153285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:48.154041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.154910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.155204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.157124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:48.157438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:48.159117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:48.197164 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3649/7215] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:48.201660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:48.224044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b949a-53c1-41d2-ac11-e54d6458a0dc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:48.250426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:48.254012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.254393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.254851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.268405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:48.282059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:48.344175 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3567/7216] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:48 2022] POST /identity/v3/projects => generated 355 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:48.348124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:48.366579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927fa10-57a3-4fef-ac55-eb1799285cee admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:48.418027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:48.524333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:48.525236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.525673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.526099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.526953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:48.529639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:48.578467 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3650/7217] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:48 2022] POST /identity/v3/users => generated 278 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:48.579656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:48.600789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd6df5-0847-45f8-8cbf-b316d45fc075 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:48.621737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:48.622460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.623330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.623748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.624410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:48.626091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:48.672994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3568/7218] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:48.674138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:48.691203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf1cd-b6df-4f85-8288-03c501155142 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:48.707103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a68f59-2d94-436c-a483-6a26d4bcc2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:48.708229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a68f59-2d94-436c-a483-6a26d4bcc2ab admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.708749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a68f59-2d94-436c-a483-6a26d4bcc2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.709352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a68f59-2d94-436c-a483-6a26d4bcc2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.710598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a68f59-2d94-436c-a483-6a26d4bcc2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:48.713379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a68f59-2d94-436c-a483-6a26d4bcc2ab admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:48.735929 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3651/7219] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:48.739950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:48.760591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7b9f-2cfa-4361-abf1-7135fa303ee0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:48.776240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:48.776871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.777154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.777443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] PATH_INFO: `/v3/projects/a013b1309d74481facf24d647dcb4045/users/99c8d239e8f0461d95ae77ecc4589e6b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.843170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a013b1309d74481facf24d647dcb4045, user_id=99c8d239e8f0461d95ae77ecc4589e6b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:48.845981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:48.886371 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3569/7220] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:48 2022] PUT /identity/v3/projects/a013b1309d74481facf24d647dcb4045/users/99c8d239e8f0461d95ae77ecc4589e6b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:48.898714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:48.899303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:48.900203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:48.978070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] MFA Rules not processed for user `99c8d239e8f0461d95ae77ecc4589e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:48.979923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:49.221875 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3652/7221] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:49.221988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:49.304524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:49.305841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:49.364034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:49.479048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550abb-f77b-4bec-ba1f-5b002b32a7ab admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:49.493088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:49.493755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:49.494041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:49.494339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:49.494998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:49.500046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:49.540027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf000-49ee-432f-891d-9a6cca9a7ed8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:49.567818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:49.568508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:49.568792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:49.569068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] PATH_INFO: `/v3/users/bd693c76b1694649a3223facbb823ce4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:49.573324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd693c76b1694649a3223facbb823ce4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:49.579191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:49.601099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3570/7222] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:49 2022] POST /identity/v3/projects => generated 353 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:49.602081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:49.714515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:49.750038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd693c76b1694649a3223facbb823ce4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:49.760227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507e66d-1cb4-4ec9-8f33-2faa76909fdc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:49.775698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:49.776812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:49.777618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:49.778050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:49.778971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:49.783784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:49.790625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd693c76b1694649a3223facbb823ce4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:49.794023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd693c76b1694649a3223facbb823ce4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:49.795524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd693c76b1694649a3223facbb823ce4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:49.812013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-878913b1-a68f-4fba-965a-e092b3092e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd693c76b1694649a3223facbb823ce4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:49.850294 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3653/7223] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:49 2022] DELETE /identity/v3/users/bd693c76b1694649a3223facbb823ce4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:49.853000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:49.853388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:49.860905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:49.865304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3571/7224] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:49 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:49.869800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:49.875334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:49.907079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3577613-5aa7-481c-81df-bc602cca768e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:49.929545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:49.937728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:50.021768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:50.023783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:50.023783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:50.024332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:50.025097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:50.026973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:50.067969 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3572/7225] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:50.072315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:50.097498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1a4d-4686-49ca-8cc4-3e0bcba6b38a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:50.111133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:50.112198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:50.112711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:50.113191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] PATH_INFO: `/v3/projects/747a66f1cba44610aca1e577ebf11ad9/users/4f5a0615021c49c890d18ef59ae23371/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:50.121208 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3654/7226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:50.147021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a66f1cba44610aca1e577ebf11ad9, user_id=4f5a0615021c49c890d18ef59ae23371, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:50.151180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:50.158366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:50.160033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:50.183511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3573/7227] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:50 2022] PUT /identity/v3/projects/747a66f1cba44610aca1e577ebf11ad9/users/4f5a0615021c49c890d18ef59ae23371/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:50.188011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:50.223573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:50.366434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b2b37-4f96-4e6a-9d60-8612207c799d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:50.414290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85443c-401c-4fa0-87b6-42c3ab4d83cf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:50.427932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:50.428577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:50.428866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:50.429146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:50.430447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:50.432096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:50.466477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:50.467671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:50.468946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:50.469439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:50.473716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3574/7228] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:46:50.476187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:50.484526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:50.486343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:50.503198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55556f49-9bec-40b0-a12d-3f1e6c562b59 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:50.509149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3194bd5-d549-4fae-883c-23a33ea56d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:50.509846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3194bd5-d549-4fae-883c-23a33ea56d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:50.510133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3194bd5-d549-4fae-883c-23a33ea56d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:50.510544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3194bd5-d549-4fae-883c-23a33ea56d86 admin admin] PATH_INFO: `/v3/projects/747a66f1cba44610aca1e577ebf11ad9/users/4f5a0615021c49c890d18ef59ae23371/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:50.512556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3194bd5-d549-4fae-883c-23a33ea56d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a66f1cba44610aca1e577ebf11ad9, user_id=4f5a0615021c49c890d18ef59ae23371, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:50.516427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3194bd5-d549-4fae-883c-23a33ea56d86 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:50.532078 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3575/7229] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:50 2022] PUT /identity/v3/projects/747a66f1cba44610aca1e577ebf11ad9/users/4f5a0615021c49c890d18ef59ae23371/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:50.542418 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3655/7230] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:50.542752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:50.543007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:50.543385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:50.639400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] MFA Rules not processed for user `4f5a0615021c49c890d18ef59ae23371`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:50.643773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:50.877523 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3576/7231] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:50.890808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:50.893030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:50.938259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:51.091111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4248e-b5b9-49f1-adff-c7de44804a4d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:51.327140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:51.327785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:51.328075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:51.328348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:51.355272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:51.357493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:51.372389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3656/7232] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:51.478816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:51.496493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b59b7-a394-4ce4-a0ab-40015de863f5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:51.503555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:51.504210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:51.504519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:51.504764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:51.511144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:51.636883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:51.638550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a43af-e67f-4eb0-a6ba-9f834ce20430 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:51.664840 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3577/7233] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:46:51.748488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:51.749963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:51.892403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f7255-5406-4783-b541-569e1ada9178 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:51.902635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:51.905712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:51.908361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:51.908666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] PATH_INFO: `/v3/projects/72d96b1acb624949b603a8df2acef085` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:51.914270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d96b1acb624949b603a8df2acef085)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:51.920123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:52.068692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d96b1acb624949b603a8df2acef085', 'request_id': 'req-dc2177cb-6891-4c61-a3e9-21c78106cc67'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:52.093134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d96b1acb624949b603a8df2acef085', 'request_id': 'req-dc2177cb-6891-4c61-a3e9-21c78106cc67'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:52.116216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d96b1acb624949b603a8df2acef085', 'request_id': 'req-dc2177cb-6891-4c61-a3e9-21c78106cc67'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:52.144379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:52.168347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] The token cache is being invalidate because project 72d96b1acb624949b603a8df2acef085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:52.169086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:52.170934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dc2177cb-6891-4c61-a3e9-21c78106cc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:52.176512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3657/7234] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:51 2022] DELETE /identity/v3/projects/72d96b1acb624949b603a8df2acef085 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:52.178587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:52.179018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:52.179395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:52.222758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:52.224167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:52.245864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:52.410297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3578/7235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:52.411853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:52.412329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:52.412878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:52.464865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:52.466531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:52.485022 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3658/7236] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:52.489549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:52.503675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaceac-99af-474f-9e4f-2a96a45979eb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:52.519615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:52.520273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:52.520563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:52.520841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:52.521636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:52.521949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:52.526823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:52.556831 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3579/7237] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:46:52.561792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:52.573154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e14a-0835-419b-aee9-887bed23ba66 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:52.590216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:52.590973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:52.591259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:52.591690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:52.592309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:52.594259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:52.693568 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3659/7238] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:52 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:52.697708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:52.721660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87347-18e3-4d34-bfcc-2b020444322d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:52.870634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:52.871270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:52.871555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:52.871833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:52.872485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:52.885272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:52.944787 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3580/7239] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:52 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:52.948676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:52.963541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09730b4-ed85-4264-b513-053fc7c9ed4d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:52.979593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:52.980637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:52.981073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:52.981764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:52.983051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:52.985208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:53.006297 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3660/7240] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:53.010961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:53.031200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caad95-4e5a-4c0a-a730-c9b8667f57c8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:53.044877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275f8a1-bb35-4642-8673-bed39b46e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:53.045540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275f8a1-bb35-4642-8673-bed39b46e7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:53.045989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275f8a1-bb35-4642-8673-bed39b46e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:53.046426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275f8a1-bb35-4642-8673-bed39b46e7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:53.047241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275f8a1-bb35-4642-8673-bed39b46e7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:53.049000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275f8a1-bb35-4642-8673-bed39b46e7a6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:53.140935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3581/7241] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:53.146347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:53.171448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bad99-f7ef-4103-9401-178fed826da3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:53.210107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:53.210831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:53.211116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:53.211396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] PATH_INFO: `/v3/projects/499fb32e0504474c819ead46ede4e9ea/users/803367ce98434160ac150fa23cec5996/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:53.284020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499fb32e0504474c819ead46ede4e9ea, user_id=803367ce98434160ac150fa23cec5996, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:53.286757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:53.323734 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3661/7242] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:53 2022] PUT /identity/v3/projects/499fb32e0504474c819ead46ede4e9ea/users/803367ce98434160ac150fa23cec5996/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:46:53.330513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f797c3-a579-4ae2-bde5-ded603cd056c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:53.330513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f797c3-a579-4ae2-bde5-ded603cd056c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:53.330513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f797c3-a579-4ae2-bde5-ded603cd056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:53.401569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c0f797c3-a579-4ae2-bde5-ded603cd056c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:53.403899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c0f797c3-a579-4ae2-bde5-ded603cd056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:53.618203 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3582/7243] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:53.659295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:53.662294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:53.762774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031d08d-b4b0-4456-a287-063079f46b17 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:53.772860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b9b4-f89b-4a08-8d7d-0d5b0043d56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:53.773755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b9b4-f89b-4a08-8d7d-0d5b0043d56d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:53.774046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b9b4-f89b-4a08-8d7d-0d5b0043d56d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:53.774359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b9b4-f89b-4a08-8d7d-0d5b0043d56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:53.796474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b9b4-f89b-4a08-8d7d-0d5b0043d56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:53.797948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b9b4-f89b-4a08-8d7d-0d5b0043d56d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:53.811802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3662/7244] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:54.485927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:54.486429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:54.486569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:54.613300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] MFA Rules not processed for user `c54441bd511c4a85bed6d8c8b360ca94`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:54.624685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:54.667471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:54.831219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3583/7245] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:54.837596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:54.838586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:54.839010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:54.872919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] MFA Rules not processed for user `c54441bd511c4a85bed6d8c8b360ca94`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:54.876291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:54.899949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3663/7246] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:54.908080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:54.912372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:55.028459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba716bd-8656-4b4e-a769-3ac3678bc0b5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:55.063245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef450d9-97c4-410c-8fa0-f4bea6c19c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:55.065298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef450d9-97c4-410c-8fa0-f4bea6c19c1b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:55.065626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef450d9-97c4-410c-8fa0-f4bea6c19c1b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:55.065917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef450d9-97c4-410c-8fa0-f4bea6c19c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:55.088407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef450d9-97c4-410c-8fa0-f4bea6c19c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:55.092927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef450d9-97c4-410c-8fa0-f4bea6c19c1b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:55.114927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3584/7247] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:55.818125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:55.819741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:55.865413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4bb91-49ae-444f-bb91-177c4390e7cc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:55.877162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:55.878127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:55.878591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:55.879016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] PATH_INFO: `/v3/users/83907fac290f4b5bb0e82cc1910a70c9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:55.880433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83907fac290f4b5bb0e82cc1910a70c9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:55.882922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:55.987197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83907fac290f4b5bb0e82cc1910a70c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:56.014027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83907fac290f4b5bb0e82cc1910a70c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:56.015116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83907fac290f4b5bb0e82cc1910a70c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:56.015879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83907fac290f4b5bb0e82cc1910a70c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:56.030675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83907fac290f4b5bb0e82cc1910a70c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:56.090018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:56.091217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:56.091555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:56.094240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3664/7248] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:55 2022] DELETE /identity/v3/users/83907fac290f4b5bb0e82cc1910a70c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:56.128891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:56.132435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:56.310690 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3585/7249] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:56.323881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:56.326336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:56.354799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:56.485290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613727f-67a7-496f-9a2c-b13153edbf1d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:56.490814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:56.491695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:56.491929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:56.492204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:56.506181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:56.507430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:56.532905 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3665/7250] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:46:56.873910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:56.883110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:56.971944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3eb7a-32d9-40c6-8246-2459d2fe7b55 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:57.014953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:57.015645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:57.015934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:57.016295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] PATH_INFO: `/v3/projects/5f514fd675424ce0bb24fcca2ffff089` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:57.019029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f514fd675424ce0bb24fcca2ffff089)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:57.030275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:57.162396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:57.217376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f514fd675424ce0bb24fcca2ffff089', 'request_id': 'req-0004f86d-86fd-4830-879b-9edcb5b92b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.257832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f514fd675424ce0bb24fcca2ffff089', 'request_id': 'req-0004f86d-86fd-4830-879b-9edcb5b92b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.279708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f514fd675424ce0bb24fcca2ffff089', 'request_id': 'req-0004f86d-86fd-4830-879b-9edcb5b92b89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.334908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] The token cache is being invalidate because project 5f514fd675424ce0bb24fcca2ffff089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:57.335477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.337205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.343470 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3586/7251] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:56 2022] DELETE /identity/v3/projects/5f514fd675424ce0bb24fcca2ffff089 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:57.344704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:57.358353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b93aaf-8c6b-42a9-aea2-1d04a6e4baa1 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:57.467782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:57.469001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:57.469436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:57.469900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] PATH_INFO: `/v3/users/f522202f65434ffc8a95d591af5463db` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:57.471371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f522202f65434ffc8a95d591af5463db)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:57.473549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:57.588796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f522202f65434ffc8a95d591af5463db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.617858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f522202f65434ffc8a95d591af5463db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.619220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f522202f65434ffc8a95d591af5463db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.620821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f522202f65434ffc8a95d591af5463db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.636886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e30e1da9-5858-4800-b74c-b4b62608c4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f522202f65434ffc8a95d591af5463db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:57.663352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3666/7252] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:46:57 2022] DELETE /identity/v3/users/f522202f65434ffc8a95d591af5463db => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:58.147647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:58.150996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:58.178240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004f86d-86fd-4830-879b-9edcb5b92b89 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:58.334426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:58.335183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:58.335732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:58.336259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] PATH_INFO: `/v3/projects/4451b8753dd3414a99b7b26d1d71f702` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:58.340071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4451b8753dd3414a99b7b26d1d71f702)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:58.345026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:58.509892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4451b8753dd3414a99b7b26d1d71f702', 'request_id': 'req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:58.527566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4451b8753dd3414a99b7b26d1d71f702', 'request_id': 'req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:58.551187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4451b8753dd3414a99b7b26d1d71f702', 'request_id': 'req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:58.580155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] The token cache is being invalidate because project 4451b8753dd3414a99b7b26d1d71f702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:46:58.580796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:58.581662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e20b3ab-d951-4bb5-89e9-a573e27f2c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:46:58.583361 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3587/7253] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:46:58 2022] DELETE /identity/v3/projects/4451b8753dd3414a99b7b26d1d71f702 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:58.588451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:58.588935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:58.589082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:58.643836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:58.645086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:58.709530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:58.832001 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3667/7254] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:46:58.839691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:58.839976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:58.840250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:58.899310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:58.901151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:46:58.920832 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3588/7255] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:46:58.921567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:58.938502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec720a50-dce7-48f7-8963-eaf659bc94ea None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:58.956504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:58.957553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:58.958211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:58.958647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:58.959662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:46:58.960276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:58.962391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:59.002588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3668/7256] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:46:59.007303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:59.020613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4dc84-f81d-49ce-8df3-0bddc7260a83 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:59.041082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:59.041927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:59.042264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:59.042546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:59.043211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:59.045508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:59.121043 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3589/7257] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:46:59 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:46:59.126159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:59.145944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d6a6-41ed-4851-b70b-e078a98320aa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:59.327863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:59.328579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:59.328941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:59.329293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:59.330356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:59.358713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:59.425972 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3669/7258] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:46:59 2022] POST /identity/v3/users => generated 305 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:46:59.429810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:59.447076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8008cf-d2c2-45dd-a8f0-6db97c3f2c06 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:59.458823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:59.461266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:59.462935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:59.463453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:59.464365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:59.466275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:59.494504 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3590/7259] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:59.496785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:59.522619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd78da-8ef7-4801-b62b-2ed6ebf2905d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:59.541419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdfc4e-545b-4633-977e-32c6984b3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:59.548754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdfc4e-545b-4633-977e-32c6984b3543 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:59.549046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdfc4e-545b-4633-977e-32c6984b3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:59.549442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdfc4e-545b-4633-977e-32c6984b3543 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:59.550359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdfc4e-545b-4633-977e-32c6984b3543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:59.554304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdfc4e-545b-4633-977e-32c6984b3543 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:59.590459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3670/7260] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:46:59.593624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:46:59.614748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6a98-2b52-498b-9d54-446b205066e5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:46:59.647061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:46:59.648412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:59.649651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:59.650225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] PATH_INFO: `/v3/projects/4b71091eaef94b8cb078af49c850e26c/users/10c566350bef4d759708fd96628b686f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:59.664999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:46:59.693280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b71091eaef94b8cb078af49c850e26c, user_id=10c566350bef4d759708fd96628b686f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:46:59.696519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:46:59.727371 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3591/7261] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:46:59 2022] PUT /identity/v3/projects/4b71091eaef94b8cb078af49c850e26c/users/10c566350bef4d759708fd96628b686f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:46:59.739545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:46:59.739902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:46:59.740190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:46:59.840332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] MFA Rules not processed for user `10c566350bef4d759708fd96628b686f`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:46:59.842384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:00.012192 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3671/7262] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:00.017331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:00.235846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b5ad2-dbb6-42b7-bc81-b4b965784972 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:00.277256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:00.278181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:00.279163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:00.279688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:00.280554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:00.283362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:00.365910 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3592/7263] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:00 2022] POST /identity/v3/projects => generated 409 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:00.370267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:00.393297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c4f24-4c8a-4c60-a790-e58d8973a0f1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:00.482198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:00.593795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:00.594489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:00.594778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:00.595015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:00.595667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:00.597656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:00.671985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3672/7264] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:00 2022] POST /identity/v3/users => generated 311 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:00.677377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:00.692807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f4d2-d23b-4096-9c0f-92861eb06a0d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:00.722903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:00.723921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:00.724475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:00.724963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:00.726816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:00.732586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:00.784392 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3593/7265] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:00.787006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:00.805665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ca448-f3cb-4921-8ec3-60093c83b57a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:00.857366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:00.858292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:00.858586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:00.858913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] PATH_INFO: `/v3/projects/078bdb0dc69e4e71bbfc85a0d8455cde/users/60db72f6ac314a26ac90b09fefb75f88/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:00.936300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=078bdb0dc69e4e71bbfc85a0d8455cde, user_id=60db72f6ac314a26ac90b09fefb75f88, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:00.939320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:00.968989 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3673/7266] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:00 2022] PUT /identity/v3/projects/078bdb0dc69e4e71bbfc85a0d8455cde/users/60db72f6ac314a26ac90b09fefb75f88/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:00.973140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:00.990591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd8d76-0e85-453b-8344-a134d703e377 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:01.195958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336cdf1-2241-40d0-9c88-b750aaeef9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:01.196525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336cdf1-2241-40d0-9c88-b750aaeef9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:01.196814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336cdf1-2241-40d0-9c88-b750aaeef9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:01.197090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336cdf1-2241-40d0-9c88-b750aaeef9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:01.197751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336cdf1-2241-40d0-9c88-b750aaeef9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:01.199713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336cdf1-2241-40d0-9c88-b750aaeef9f9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:01.226487 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3594/7267] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:01.236247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:01.255727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff1c4-37c9-48da-a818-6c5fd3387d1f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:01.294756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:01.295537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:01.296018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:01.296452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] PATH_INFO: `/v3/projects/078bdb0dc69e4e71bbfc85a0d8455cde/users/60db72f6ac314a26ac90b09fefb75f88/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:01.301801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078bdb0dc69e4e71bbfc85a0d8455cde, user_id=60db72f6ac314a26ac90b09fefb75f88, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:01.305630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:01.335540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3674/7268] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:01 2022] PUT /identity/v3/projects/078bdb0dc69e4e71bbfc85a0d8455cde/users/60db72f6ac314a26ac90b09fefb75f88/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:47:01.348769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892251c-ac48-4926-919d-d575c8335760 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:01.349321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892251c-ac48-4926-919d-d575c8335760 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:01.349830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892251c-ac48-4926-919d-d575c8335760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:01.404638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f892251c-ac48-4926-919d-d575c8335760 None None] MFA Rules not processed for user `60db72f6ac314a26ac90b09fefb75f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:01.406260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f892251c-ac48-4926-919d-d575c8335760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:01.532582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:01.585222 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3595/7269] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:01.620655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:01.624382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:01.812115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ab25-eadf-43ea-9b1c-ef657ad469e1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:01.822616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:01.823265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:01.824681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:01.827115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:01.853679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:01.855834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:01.894918 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3675/7270] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:09.594768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:09.595180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:09.595330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:09.662893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] MFA Rules not processed for user `803367ce98434160ac150fa23cec5996`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:09.664052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:09.878550 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3596/7271] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:09.883314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:09.885194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:10.045978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c6250-8d2d-49c6-8e6f-5c602b08a0ad service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.053299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.055356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.055356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.055356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.055356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.057625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.108723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3676/7272] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:09 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:10.109496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.121095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bddb7-8077-4df6-a232-2a4f0153db8c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.245212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.245971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.246388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.246745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.247684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.249975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.322941 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3597/7273] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:10 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:10.328239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.341732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:10.356883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232182-4d93-4e64-a9ed-5d9df6758e75 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.363156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.364058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.364353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.364634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.365294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.367004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.393200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3677/7274] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:47:10.396282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.408048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c100-a680-4832-84b3-6ee3867462bc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.413984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.414831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.415894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.415894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] PATH_INFO: `/v3/projects/e18f5d074e3f4c2fac8195d269b29d85/users/bdcd6ffef69f45989bcbaaa5366b8976/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.448289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18f5d074e3f4c2fac8195d269b29d85, user_id=bdcd6ffef69f45989bcbaaa5366b8976, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.453059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.478764 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3598/7275] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:10 2022] PUT /identity/v3/projects/e18f5d074e3f4c2fac8195d269b29d85/users/bdcd6ffef69f45989bcbaaa5366b8976/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:10.480430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.495643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2f1b2-cc51-47a4-990b-e04fa89b91d3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.569534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.606188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.608763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.609065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.609495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.610653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.612628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.622082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:10.629354 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3678/7276] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:10.634345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.651106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6971e-f47c-43d8-bb3e-e4d39aacdf8e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.658377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5aac4-682f-4cbd-b6f2-2aae99a50e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.659368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5aac4-682f-4cbd-b6f2-2aae99a50e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.659636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5aac4-682f-4cbd-b6f2-2aae99a50e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.659908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5aac4-682f-4cbd-b6f2-2aae99a50e7c admin admin] PATH_INFO: `/v3/projects/e18f5d074e3f4c2fac8195d269b29d85/users/bdcd6ffef69f45989bcbaaa5366b8976/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.661923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5aac4-682f-4cbd-b6f2-2aae99a50e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18f5d074e3f4c2fac8195d269b29d85, user_id=bdcd6ffef69f45989bcbaaa5366b8976, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.663098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e50d2-2fe1-4168-af13-4e7ccd57ae6c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:10.664729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5aac4-682f-4cbd-b6f2-2aae99a50e7c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.671163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:10.672199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.673018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.673428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] PATH_INFO: `/v3/users/10c566350bef4d759708fd96628b686f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.675397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c566350bef4d759708fd96628b686f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:10.677431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:10.678532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3679/7277] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:10 2022] PUT /identity/v3/projects/e18f5d074e3f4c2fac8195d269b29d85/users/bdcd6ffef69f45989bcbaaa5366b8976/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:10.757613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c566350bef4d759708fd96628b686f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:10.769845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c566350bef4d759708fd96628b686f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:10.771671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c566350bef4d759708fd96628b686f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:10.773228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c566350bef4d759708fd96628b686f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:10.788696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c566350bef4d759708fd96628b686f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:10.821941 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3599/7278] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:10 2022] DELETE /identity/v3/users/10c566350bef4d759708fd96628b686f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:47:10.823379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:10.823717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:10.824002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:10.848033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:10.850036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:10.951782 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3680/7279] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:47:10.961737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:10.963976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:11.077974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df06cd6-a6b1-4f3a-aa12-242f13bfb030 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:11.083832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:11.084720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:11.086376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:11.086663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:11.097857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:11.099800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:11.119232 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3600/7280] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:11.751740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:11.753422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:11.791120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb972b-423f-4e55-bc65-b77497c8189c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:11.798282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:11.799654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:11.800126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:11.800699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] PATH_INFO: `/v3/projects/4b71091eaef94b8cb078af49c850e26c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:11.802601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b71091eaef94b8cb078af49c850e26c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:11.805013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:11.906791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b71091eaef94b8cb078af49c850e26c', 'request_id': 'req-2284721b-7086-4afe-8718-e56528e61013'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:11.917505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b71091eaef94b8cb078af49c850e26c', 'request_id': 'req-2284721b-7086-4afe-8718-e56528e61013'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:11.927447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b71091eaef94b8cb078af49c850e26c', 'request_id': 'req-2284721b-7086-4afe-8718-e56528e61013'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:11.944714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:11.954049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] The token cache is being invalidate because project 4b71091eaef94b8cb078af49c850e26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:11.954617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:11.961781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:11.974050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:11.974542 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3681/7281] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:11 2022] DELETE /identity/v3/projects/4b71091eaef94b8cb078af49c850e26c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:11.990753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d673065-7910-4527-a31c-f9349c6338ee service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:12.312558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:12.313713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:12.314866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:12.315153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] PATH_INFO: `/v3/users/60db72f6ac314a26ac90b09fefb75f88` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:12.318723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60db72f6ac314a26ac90b09fefb75f88)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:12.323854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:12.324883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:12.416485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60db72f6ac314a26ac90b09fefb75f88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:12.430543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60db72f6ac314a26ac90b09fefb75f88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:12.440331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60db72f6ac314a26ac90b09fefb75f88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:12.442460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60db72f6ac314a26ac90b09fefb75f88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:12.466573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6bae9e4-0d76-4982-b799-557a0c01083a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60db72f6ac314a26ac90b09fefb75f88'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:12.536105 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3601/7282] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:11 2022] DELETE /identity/v3/users/60db72f6ac314a26ac90b09fefb75f88 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:13.954764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:13.957972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:13.988178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284721b-7086-4afe-8718-e56528e61013 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:14.160502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:14.163820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:14.164160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:14.164499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] PATH_INFO: `/v3/projects/078bdb0dc69e4e71bbfc85a0d8455cde` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:14.185383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078bdb0dc69e4e71bbfc85a0d8455cde)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:14.187622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:14.308502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078bdb0dc69e4e71bbfc85a0d8455cde', 'request_id': 'req-d491553b-d7a6-4642-9443-5eed76733626'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:14.326260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078bdb0dc69e4e71bbfc85a0d8455cde', 'request_id': 'req-d491553b-d7a6-4642-9443-5eed76733626'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:14.348323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078bdb0dc69e4e71bbfc85a0d8455cde', 'request_id': 'req-d491553b-d7a6-4642-9443-5eed76733626'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:14.400540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] The token cache is being invalidate because project 078bdb0dc69e4e71bbfc85a0d8455cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:14.400845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:14.403055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d491553b-d7a6-4642-9443-5eed76733626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:14.422844 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3682/7283] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:13 2022] DELETE /identity/v3/projects/078bdb0dc69e4e71bbfc85a0d8455cde => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:14.428509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:14.428966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:14.429076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:14.473347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:14.474707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:14.680858 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3602/7284] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:14.692931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:14.693140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:14.693367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:14.751431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:14.755252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:14.780485 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3683/7285] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:14.780692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:14.790582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9529f-d907-4e1d-9587-e2158437cd1e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:14.799567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:14.800436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:14.803320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:14.803609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:14.804300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:47:14.804625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:14.808815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:14.835200 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3603/7286] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:47:14.840080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:14.861039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861bcb-4186-4b91-a9e9-cf1de8288e33 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:14.866365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:14.867347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:14.867477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:14.867663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:14.868307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:14.874669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:14.934291 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3684/7287] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:14 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:14.938821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:14.954847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03daf8-14a3-4366-8227-949b4ef6adc4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:15.200431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:15.201886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:15.202208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:15.202493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:15.203818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:15.206572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:15.228662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:15.255863 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3604/7288] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:14 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:15.259653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:15.275791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64ec9-df94-492d-881a-1234ab44e24a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:15.288753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:15.289321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:15.289602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:15.289877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:15.290563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:15.292375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:15.321076 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3685/7289] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:15.325075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:15.339010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2a048-960f-4ede-bd04-f414354742f4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:15.356538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca878fa-1b51-47bb-82d6-bcb72cc63de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:15.357566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca878fa-1b51-47bb-82d6-bcb72cc63de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:15.358170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca878fa-1b51-47bb-82d6-bcb72cc63de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:15.358639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca878fa-1b51-47bb-82d6-bcb72cc63de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:15.360406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca878fa-1b51-47bb-82d6-bcb72cc63de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:15.362313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca878fa-1b51-47bb-82d6-bcb72cc63de7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:15.385621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3605/7290] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:15.390174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:15.404211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff40d-b9dd-4d7d-8c14-1b35febef8bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:15.423812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:15.424514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:15.424800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:15.425075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] PATH_INFO: `/v3/projects/913ecd43942f4e1d98499527f61e6e44/users/7e00660ea99e45c981389bb0c26dbe00/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:15.453555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=913ecd43942f4e1d98499527f61e6e44, user_id=7e00660ea99e45c981389bb0c26dbe00, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:15.456833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:15.477365 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3686/7291] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:15 2022] PUT /identity/v3/projects/913ecd43942f4e1d98499527f61e6e44/users/7e00660ea99e45c981389bb0c26dbe00/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:15.489291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:15.489761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:15.489866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:15.548725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] MFA Rules not processed for user `7e00660ea99e45c981389bb0c26dbe00`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:15.550163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:15.701567 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3606/7292] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:47:15.748322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:15.750478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:15.827781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:15.894471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19079-c6dc-4c45-a5f1-92fd229f93cc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:15.899720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:15.900931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:15.901185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:15.901840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:15.915838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:15.917146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:15.929666 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3687/7293] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:19.346966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:19.350364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:19.548725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd24a-a747-4984-ae70-26810dc80296 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:19.567062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:19.567744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:19.568023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:19.568291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] PATH_INFO: `/v3/users/070ffa06c4494cadb3f104e3e4ac23ed` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:19.569549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070ffa06c4494cadb3f104e3e4ac23ed)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:19.571565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:19.672640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070ffa06c4494cadb3f104e3e4ac23ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:19.687808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070ffa06c4494cadb3f104e3e4ac23ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:19.688542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070ffa06c4494cadb3f104e3e4ac23ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:19.689353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070ffa06c4494cadb3f104e3e4ac23ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:19.700048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070ffa06c4494cadb3f104e3e4ac23ed'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:19.716745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:19.730527 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3607/7294] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:19 2022] DELETE /identity/v3/users/070ffa06c4494cadb3f104e3e4ac23ed => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:20.102532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:20.139186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7a5c-becb-4f8b-bca9-4b075f3a5082 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:20.283037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:20.283759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:20.284467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:20.284467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] PATH_INFO: `/v3/projects/59e34764895b4c5496be86c326ab01de` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:20.291066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e34764895b4c5496be86c326ab01de)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:20.294640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:20.389005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e34764895b4c5496be86c326ab01de', 'request_id': 'req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.397529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e34764895b4c5496be86c326ab01de', 'request_id': 'req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.405672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e34764895b4c5496be86c326ab01de', 'request_id': 'req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.423223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] The token cache is being invalidate because project 59e34764895b4c5496be86c326ab01de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:20.423554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.424376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.426480 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3688/7295] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:20 2022] DELETE /identity/v3/projects/59e34764895b4c5496be86c326ab01de => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:47:20.430686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:20.432277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:20.449200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0bc73-ff56-416b-90a3-590246e81de9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:20.547405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:20.553507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:20.553792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:20.554065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] PATH_INFO: `/v3/users/c45f4b4dcfc042b1a2104f329f64c8ab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:20.555439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45f4b4dcfc042b1a2104f329f64c8ab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:20.559880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:20.715784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45f4b4dcfc042b1a2104f329f64c8ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.739953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45f4b4dcfc042b1a2104f329f64c8ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.740954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45f4b4dcfc042b1a2104f329f64c8ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.742096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45f4b4dcfc042b1a2104f329f64c8ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.769218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0e7f9c6-8702-4b3e-8013-de316af7983e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45f4b4dcfc042b1a2104f329f64c8ab'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:20.824579 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3608/7296] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:20 2022] DELETE /identity/v3/users/c45f4b4dcfc042b1a2104f329f64c8ab => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:21.324225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:21.326346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:21.355773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bccde0-cfbf-4ee1-85bc-f39f31db3262 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:21.470991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:21.479848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:21.481706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:21.482433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:21.482950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] PATH_INFO: `/v3/projects/5ffe7104ba6749a2b980ce4f090341ee` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:21.485359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffe7104ba6749a2b980ce4f090341ee)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:21.488008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:21.574204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffe7104ba6749a2b980ce4f090341ee', 'request_id': 'req-e212ebca-ad34-4add-9959-b9bde380fa85'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:21.589042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffe7104ba6749a2b980ce4f090341ee', 'request_id': 'req-e212ebca-ad34-4add-9959-b9bde380fa85'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:21.596660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffe7104ba6749a2b980ce4f090341ee', 'request_id': 'req-e212ebca-ad34-4add-9959-b9bde380fa85'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:21.615806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] The token cache is being invalidate because project 5ffe7104ba6749a2b980ce4f090341ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:21.616154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:21.616909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e212ebca-ad34-4add-9959-b9bde380fa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:21.619894 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3689/7297] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:21 2022] DELETE /identity/v3/projects/5ffe7104ba6749a2b980ce4f090341ee => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:23.070217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:23.070818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:23.070818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:23.105663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] MFA Rules not processed for user `c54441bd511c4a85bed6d8c8b360ca94`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:23.109199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:23.237227 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3609/7298] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:23.677463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:23.678320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:23.678759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:23.756402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] MFA Rules not processed for user `bdcd6ffef69f45989bcbaaa5366b8976`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:23.757644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:23.909845 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3690/7299] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:23.930934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:23.933123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:24.004226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:24.161017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a7da-6b0c-4619-873b-9b4934712b2b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:24.167411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:24.168059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:24.168345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:24.168627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:24.182034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:24.184370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:24.201300 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3610/7300] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:24.788868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:24.791486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:24.967224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65836a39-e8cb-4588-9ed0-c087346ad725 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:24.977744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:24.978691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:24.979886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:24.982643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:24.988907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:25.033246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:25.036107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:25.071080 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3691/7301] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:25.828497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:25.829944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:25.891205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269058b9-58a6-46f2-805a-a5f99e5ddd07 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:25.917927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:25.919948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:25.921458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:25.921611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:25.925390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:25.926986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:25.930676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:25.933189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:25.994029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:26.002788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eac28f-2e6c-455c-9599-e0477f5b282b service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:26.046342 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3611/7302] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:26.220488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268752c-2c9a-4418-bb37-8f4b053c7084 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:26.225938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:26.227050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:26.227050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:26.227275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] PATH_INFO: `/v3/users/99c8d239e8f0461d95ae77ecc4589e6b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:26.229664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c8d239e8f0461d95ae77ecc4589e6b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:26.232185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:26.392863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c8d239e8f0461d95ae77ecc4589e6b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:26.435075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c8d239e8f0461d95ae77ecc4589e6b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:26.436145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c8d239e8f0461d95ae77ecc4589e6b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:26.437357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c8d239e8f0461d95ae77ecc4589e6b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:26.464293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c8d239e8f0461d95ae77ecc4589e6b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:26.500624 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3692/7303] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:25 2022] DELETE /identity/v3/users/99c8d239e8f0461d95ae77ecc4589e6b => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:26.504474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:26.505157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:26.505581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:26.559340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:26.562317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:26.711870 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3612/7304] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:26.779031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:26.781125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:26.922402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4bc25-f424-4f87-9059-207511a1dd7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:26.932827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:26.933473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:26.933737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:26.934015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:26.965692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:26.968773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:27.004781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3693/7305] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:29.392086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:29.395206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:29.413278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fbfe-f27e-44f8-a726-68b85daef8c5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:29.423737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:29.425607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:29.427505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:29.427867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] PATH_INFO: `/v3/projects/a013b1309d74481facf24d647dcb4045` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:29.429776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a013b1309d74481facf24d647dcb4045)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:29.432213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:29.535508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a013b1309d74481facf24d647dcb4045', 'request_id': 'req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.543489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a013b1309d74481facf24d647dcb4045', 'request_id': 'req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.564785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a013b1309d74481facf24d647dcb4045', 'request_id': 'req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.602980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] The token cache is being invalidate because project a013b1309d74481facf24d647dcb4045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:29.604239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.605129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.608758 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3613/7306] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:29 2022] DELETE /identity/v3/projects/a013b1309d74481facf24d647dcb4045 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:29.613563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:29.639769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ab4f-0816-4fd0-b5e8-df9618a5879d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:29.686186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:29.809102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:29.809887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:29.810225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:29.810529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] PATH_INFO: `/v3/users/4f5a0615021c49c890d18ef59ae23371` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:29.814599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5a0615021c49c890d18ef59ae23371)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:29.817167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:29.913102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5a0615021c49c890d18ef59ae23371'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.933708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5a0615021c49c890d18ef59ae23371'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.934562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5a0615021c49c890d18ef59ae23371'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.935716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5a0615021c49c890d18ef59ae23371'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.947110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bf3ef6b4-e711-4996-aaeb-b1ec296099ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5a0615021c49c890d18ef59ae23371'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:29.986664 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3694/7307] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:29 2022] DELETE /identity/v3/users/4f5a0615021c49c890d18ef59ae23371 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:32.269668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:32.276548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:32.325477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ea46-8500-4e37-a5b6-0bf5a4fc03ac admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:32.382696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:32.532886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:32.533721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:32.534114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:32.534561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] PATH_INFO: `/v3/projects/747a66f1cba44610aca1e577ebf11ad9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:32.536105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747a66f1cba44610aca1e577ebf11ad9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:32.539588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:32.658447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747a66f1cba44610aca1e577ebf11ad9', 'request_id': 'req-e730cbbb-223a-4c86-8aa0-1a447faa83f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:32.677808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747a66f1cba44610aca1e577ebf11ad9', 'request_id': 'req-e730cbbb-223a-4c86-8aa0-1a447faa83f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:32.699145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747a66f1cba44610aca1e577ebf11ad9', 'request_id': 'req-e730cbbb-223a-4c86-8aa0-1a447faa83f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:32.720059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] The token cache is being invalidate because project 747a66f1cba44610aca1e577ebf11ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:32.720383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:32.721104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e730cbbb-223a-4c86-8aa0-1a447faa83f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:32.724027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3614/7308] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:32 2022] DELETE /identity/v3/projects/747a66f1cba44610aca1e577ebf11ad9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:32.729556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:32.730211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:32.730211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:32.756006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:32.757247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:32.840559 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3695/7309] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:32.850627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:32.851143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:32.851593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:32.884189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:32.885797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:32.900528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:32.912253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9dab-4825-4baa-96b1-933b5b0c5ae6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:32.914457 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3615/7310] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:32.924878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:32.925747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:32.926031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:32.926464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:32.927195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:47:32.927505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:32.929327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:32.959618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:32.959965 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3696/7311] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:47:32.972697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1bc1-47ae-4884-9eb9-c39e17d47690 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:32.992184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:32.992874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:32.993320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:32.993703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:32.994266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:32.996200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:33.058196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:33.060215 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3616/7312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:32 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:47:33.078766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb00e5-7aea-4250-a2a8-afb2099132ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:33.129597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:33.198686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:33.199328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:33.199854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:33.200746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:33.201862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:33.204312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:33.262230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3697/7313] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:33 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:33.265392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:33.291315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f6569-c54c-47ad-a50c-6a83a9731939 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:33.300558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:33.301387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:33.301836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:33.302226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:33.303200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:33.305960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:33.338966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3617/7314] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:33.343765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:33.357205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0262f-523c-4d97-9cdf-ceafe8045fb4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:33.401121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3921f2b-24ad-42ec-92be-b62c66722141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:33.402553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3921f2b-24ad-42ec-92be-b62c66722141 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:33.403043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3921f2b-24ad-42ec-92be-b62c66722141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:33.404332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3921f2b-24ad-42ec-92be-b62c66722141 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:33.406372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3921f2b-24ad-42ec-92be-b62c66722141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:33.408417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3921f2b-24ad-42ec-92be-b62c66722141 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:33.422457 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3698/7315] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:33.426353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:33.443409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e29c2-1042-4c2a-845f-f7121f8b3b25 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:33.448939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:33.449687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:33.450305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:33.451400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] PATH_INFO: `/v3/projects/13ebde067f1c4fca861d9223ca15a3c0/users/5d1345869e7f4358a3a15c026f3c1c26/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:33.475085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ebde067f1c4fca861d9223ca15a3c0, user_id=5d1345869e7f4358a3a15c026f3c1c26, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:33.478327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:33.506970 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3618/7316] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:33 2022] PUT /identity/v3/projects/13ebde067f1c4fca861d9223ca15a3c0/users/5d1345869e7f4358a3a15c026f3c1c26/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:33.519408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:33.519694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:33.519930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:33.571738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] MFA Rules not processed for user `5d1345869e7f4358a3a15c026f3c1c26`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:33.572989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:33.674050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3699/7317] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:33.674817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:33.771333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:33.795773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821cd69-e8f5-428d-9a8b-b3fd97c0bc36 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:33.802464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:33.803209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:33.803595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:33.808467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:33.810091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:33.815531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:33.892912 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3619/7318] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:33 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:47:33.894762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:33.909960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e1027-60c5-442b-b41b-fa010bdf3380 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:34.021913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:34.022684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:34.022978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:34.023314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:34.024109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:34.029774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:34.065574 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3700/7319] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:33 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:34.068317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:34.122574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4d423-f582-42e4-b524-20e3bb845946 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:34.138443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:34.139499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:34.140050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:34.140522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:34.143851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:34.148037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:34.183191 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3620/7320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:34.187499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:34.227142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3330a-2afa-4640-a11c-07e4ce94ec1d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:34.255002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:34.256021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:34.256519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:34.268871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] PATH_INFO: `/v3/projects/0e079d67af9945b8b63f36ba5a248f81/users/fb2f67b174d1424cba0b5d5c0b536764/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:34.302000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e079d67af9945b8b63f36ba5a248f81, user_id=fb2f67b174d1424cba0b5d5c0b536764, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:34.315554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:34.368125 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3701/7321] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:34 2022] PUT /identity/v3/projects/0e079d67af9945b8b63f36ba5a248f81/users/fb2f67b174d1424cba0b5d5c0b536764/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:34.372557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:34.401430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531b13-e460-4198-87c7-56dad1ecea65 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:34.549935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e1d24-5eb1-4efb-a83a-e6bb416c3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:34.551276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e1d24-5eb1-4efb-a83a-e6bb416c3842 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:34.551721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e1d24-5eb1-4efb-a83a-e6bb416c3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:34.552150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e1d24-5eb1-4efb-a83a-e6bb416c3842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:34.552969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e1d24-5eb1-4efb-a83a-e6bb416c3842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:34.566594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e1d24-5eb1-4efb-a83a-e6bb416c3842 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:34.588806 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3621/7322] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:34.590874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:34.609918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:34.632594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0df58-a8c1-4357-8e32-41dcdf3e9b11 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:34.632594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:34.635125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:34.635125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:34.635363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] PATH_INFO: `/v3/projects/0e079d67af9945b8b63f36ba5a248f81/users/fb2f67b174d1424cba0b5d5c0b536764/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:34.640118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e079d67af9945b8b63f36ba5a248f81, user_id=fb2f67b174d1424cba0b5d5c0b536764, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:34.642848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:34.668282 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3702/7323] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:34 2022] PUT /identity/v3/projects/0e079d67af9945b8b63f36ba5a248f81/users/fb2f67b174d1424cba0b5d5c0b536764/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:34.669785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336f37-234c-425c-b450-989deb292c07 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:34.670170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336f37-234c-425c-b450-989deb292c07 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:34.670462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336f37-234c-425c-b450-989deb292c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:34.756609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e8336f37-234c-425c-b450-989deb292c07 None None] MFA Rules not processed for user `fb2f67b174d1424cba0b5d5c0b536764`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:34.758701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e8336f37-234c-425c-b450-989deb292c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:34.886381 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3622/7324] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:34.901929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:34.904492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:34.992713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf834879-d37c-42d8-93ef-638165303bc4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:34.999400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:35.001310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:35.001800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:35.002277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:35.095517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:35.097775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:35.111454 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3703/7325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:37.873362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8336f37-234c-425c-b450-989deb292c07 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:37.890806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8336f37-234c-425c-b450-989deb292c07 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:37.897236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:37.897984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:37.898683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:37.899173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:37.923698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:37.925891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:37.947546 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3623/7326] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:38.759218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:38.761658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:38.808901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:38.812063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:38.895014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:39.012386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac8fb3-869a-4d06-af88-c78ee3b581d1 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:39.031606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c895d70-0006-4504-9cbc-761f39a0745e service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:39.032320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:39.032969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:39.033250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:39.033533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:39.038696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:39.044740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:39.048094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:39.050368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:39.052203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:39.056381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:39.058104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:39.061350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:39.078716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3624/7327] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:47:39.091526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:39.094295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:39.115607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3704/7328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:41.448095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:41.455362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:41.475999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e29d06-4000-4d88-a273-a9cc418a3590 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:41.487055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:41.487927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:41.488950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:41.489407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:41.500149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:41.517212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:41.518832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:41.546604 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3625/7329] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:43.733866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:43.736392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:43.833311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:43.862421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc63e0-7f81-4721-9c93-8d9a6d74aa0d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:43.868107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:43.869473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:43.869863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:43.870297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] PATH_INFO: `/v3/users/803367ce98434160ac150fa23cec5996` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:43.871588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803367ce98434160ac150fa23cec5996)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:43.873817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:43.931361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803367ce98434160ac150fa23cec5996'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:43.948992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803367ce98434160ac150fa23cec5996'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:43.949836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803367ce98434160ac150fa23cec5996'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:43.951189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803367ce98434160ac150fa23cec5996'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:43.959621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803367ce98434160ac150fa23cec5996'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:43.977370 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3705/7330] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:43 2022] DELETE /identity/v3/users/803367ce98434160ac150fa23cec5996 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:44.410988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:44.430227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a89ce5-9d53-478a-bd34-276b720aea82 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:44.507955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:44.509687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:44.510422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:44.511052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] PATH_INFO: `/v3/projects/499fb32e0504474c819ead46ede4e9ea` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:44.513089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=499fb32e0504474c819ead46ede4e9ea)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:44.515249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:44.607402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499fb32e0504474c819ead46ede4e9ea', 'request_id': 'req-6e4291ab-aa07-47df-9785-a5e32c9415fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:44.616031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499fb32e0504474c819ead46ede4e9ea', 'request_id': 'req-6e4291ab-aa07-47df-9785-a5e32c9415fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:44.624748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499fb32e0504474c819ead46ede4e9ea', 'request_id': 'req-6e4291ab-aa07-47df-9785-a5e32c9415fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:44.640382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] The token cache is being invalidate because project 499fb32e0504474c819ead46ede4e9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:44.641065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:44.641517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:44.644795 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3626/7331] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:44 2022] DELETE /identity/v3/projects/499fb32e0504474c819ead46ede4e9ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:44.648743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:44.650193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:44.672784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303319e-0015-4c9d-ba53-c81c07ead5b9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:44.787541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:44.788951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:44.789392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:44.789816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] PATH_INFO: `/v3/users/bdcd6ffef69f45989bcbaaa5366b8976` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:44.791551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcd6ffef69f45989bcbaaa5366b8976)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:44.795822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:44.961868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcd6ffef69f45989bcbaaa5366b8976'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.004663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcd6ffef69f45989bcbaaa5366b8976'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.005652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcd6ffef69f45989bcbaaa5366b8976'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.008621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcd6ffef69f45989bcbaaa5366b8976'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.022589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:45.040640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-71deafda-b8c1-4f79-b1e4-8228da7c7c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcd6ffef69f45989bcbaaa5366b8976'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.109954 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3706/7332] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:44 2022] DELETE /identity/v3/users/bdcd6ffef69f45989bcbaaa5366b8976 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:45.608201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:45.610117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:45.650050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4291ab-aa07-47df-9785-a5e32c9415fb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:45.699241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:45.764738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:45.765356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:45.765965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:45.766431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] PATH_INFO: `/v3/projects/e18f5d074e3f4c2fac8195d269b29d85` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:45.768514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18f5d074e3f4c2fac8195d269b29d85)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:45.770832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:45.824334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18f5d074e3f4c2fac8195d269b29d85', 'request_id': 'req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.834599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18f5d074e3f4c2fac8195d269b29d85', 'request_id': 'req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.854887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18f5d074e3f4c2fac8195d269b29d85', 'request_id': 'req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.869394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] The token cache is being invalidate because project e18f5d074e3f4c2fac8195d269b29d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:45.869690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.871139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4e1d13a-f0af-406e-8f36-97e2fcc8bfd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:45.879048 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3627/7333] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:45 2022] DELETE /identity/v3/projects/e18f5d074e3f4c2fac8195d269b29d85 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:45.881528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:45.882009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:45.882092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:45.929704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:45.931093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:46.011313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3707/7334] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:46.020129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.020447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.020748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.043804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:46.045316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:46.054320 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3628/7335] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:46.058854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.070388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596bcc2-6131-462e-bf5d-877f60c50249 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.075969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.076622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.076904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.077183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.077861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:47:46.078210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.079929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.104954 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3708/7336] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:47:46.110228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.120602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635daf9-2a73-40c9-8dad-7c73c0a08bff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.126986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.127616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.127898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.128171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.128870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.130912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.174581 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3629/7337] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:46 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:47:46.176561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.189191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f2c3c-308d-4cac-a9c3-c2d4ac7d534c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.282635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.283584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.284049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.289874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.290960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.293184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.338611 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3709/7338] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:46 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:46.344203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.357829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ee13e-7b61-4b85-a633-8ef38b0be448 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.366842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.367490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.367775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.368055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.368777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.370367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.396761 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3630/7339] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:46.398523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.415505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489352e-8180-4559-a414-3240c9dfc75e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.421754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85705bb-2a6e-47f8-928e-dd6708f07196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.422536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85705bb-2a6e-47f8-928e-dd6708f07196 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.422931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85705bb-2a6e-47f8-928e-dd6708f07196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.423311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85705bb-2a6e-47f8-928e-dd6708f07196 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.424077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85705bb-2a6e-47f8-928e-dd6708f07196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.426067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85705bb-2a6e-47f8-928e-dd6708f07196 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.441192 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3710/7340] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:46.445301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.463126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c853-cc97-4dbd-8495-9817e1cc718d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.469073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.469821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.470106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.470435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] PATH_INFO: `/v3/projects/767ac163e9fe4d51a864ae5083c5475a/users/db14c5e21a6e4120b57ae91ad77cb834/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.490478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] RBAC: Authorizing `identity:create_grant(project_id=767ac163e9fe4d51a864ae5083c5475a, user_id=db14c5e21a6e4120b57ae91ad77cb834, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.493265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.511184 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3631/7341] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:46 2022] PUT /identity/v3/projects/767ac163e9fe4d51a864ae5083c5475a/users/db14c5e21a6e4120b57ae91ad77cb834/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:46.521644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.522220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.522686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.545347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:46.546757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:46.598802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:46.615815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3711/7342] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:46.626184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:46.628986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:46.720608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9db8-6933-4729-ad86-38eab27d064a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:46.725706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:46.726854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:46.727064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:46.727399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:46.737296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:46.742441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:46.744173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:46.768763 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3632/7343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:48.425332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:48.427840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:48.606323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91022-90ff-43b1-ac1c-291523c28399 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:48.618125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:48.618807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:48.619093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:48.619377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:48.624095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:48.657104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:48.658862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71e9ca-17e8-480f-8bb5-1e56ef042c70 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:48.696756 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3712/7344] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:50.384974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:50.386639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:50.409160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5022df-67b1-48a0-8adc-f70cf10d97f4 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:50.427405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:50.428657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:50.429721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:50.430308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] PATH_INFO: `/v3/users/5d1345869e7f4358a3a15c026f3c1c26` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:50.447915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1345869e7f4358a3a15c026f3c1c26)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:50.454614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:50.608400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1345869e7f4358a3a15c026f3c1c26'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:50.627164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1345869e7f4358a3a15c026f3c1c26'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:50.628013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1345869e7f4358a3a15c026f3c1c26'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:50.628658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1345869e7f4358a3a15c026f3c1c26'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:50.641364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1345869e7f4358a3a15c026f3c1c26'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:50.686862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3633/7345] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:50 2022] DELETE /identity/v3/users/5d1345869e7f4358a3a15c026f3c1c26 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:50.690528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:50.691196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:50.691196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:50.729762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:50.731687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:50.892923 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3713/7346] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:50.973875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:50.975367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:51.111932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f49f7a-a632-41d3-a739-f30a1499cdd7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:51.124735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:51.125613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:51.126050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:51.126505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:51.167312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:51.169656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:51.217243 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3634/7347] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:53.029170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:53.031184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:53.044644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3db27-244f-42cc-bf61-e3d2b436c3ef None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:53.050368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:53.051201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:53.051649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:53.052071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] PATH_INFO: `/v3/projects/13ebde067f1c4fca861d9223ca15a3c0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:53.053440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ebde067f1c4fca861d9223ca15a3c0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:53.055601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:53.151986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ebde067f1c4fca861d9223ca15a3c0', 'request_id': 'req-2fa47890-38ef-43a5-b288-51fb582f50e0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.167981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ebde067f1c4fca861d9223ca15a3c0', 'request_id': 'req-2fa47890-38ef-43a5-b288-51fb582f50e0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.183616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ebde067f1c4fca861d9223ca15a3c0', 'request_id': 'req-2fa47890-38ef-43a5-b288-51fb582f50e0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.207301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] The token cache is being invalidate because project 13ebde067f1c4fca861d9223ca15a3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:53.207774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.208565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.213323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3714/7348] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:53 2022] DELETE /identity/v3/projects/13ebde067f1c4fca861d9223ca15a3c0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:53.214789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:53.226106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c0a7-21e5-4a81-87bc-8e5bc478d649 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:53.338168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:53.339142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:53.339587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:53.340014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] PATH_INFO: `/v3/users/fb2f67b174d1424cba0b5d5c0b536764` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:53.342446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2f67b174d1424cba0b5d5c0b536764)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:53.344681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:53.357384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:53.419164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2f67b174d1424cba0b5d5c0b536764'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.436083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2f67b174d1424cba0b5d5c0b536764'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.437098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2f67b174d1424cba0b5d5c0b536764'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.438054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2f67b174d1424cba0b5d5c0b536764'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.454533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cf06123f-72d3-4cb5-b339-115ba9c2d235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2f67b174d1424cba0b5d5c0b536764'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:53.507917 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3635/7349] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:53 2022] DELETE /identity/v3/users/fb2f67b174d1424cba0b5d5c0b536764 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:54.948326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:54.953728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:54.969033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:54.988973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa47890-38ef-43a5-b288-51fb582f50e0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:55.148790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:55.150388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:55.150931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:55.151507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] PATH_INFO: `/v3/projects/0e079d67af9945b8b63f36ba5a248f81` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:55.153946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e079d67af9945b8b63f36ba5a248f81)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:55.157356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:55.273785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e079d67af9945b8b63f36ba5a248f81', 'request_id': 'req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:55.287723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e079d67af9945b8b63f36ba5a248f81', 'request_id': 'req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:55.312673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e079d67af9945b8b63f36ba5a248f81', 'request_id': 'req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:55.360950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] The token cache is being invalidate because project 0e079d67af9945b8b63f36ba5a248f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:55.361239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:55.363681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f2631c44-0f81-4d96-97e5-b10d0ad4e7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:55.366177 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3715/7350] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:54 2022] DELETE /identity/v3/projects/0e079d67af9945b8b63f36ba5a248f81 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:55.371447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:55.372561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:55.372645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:55.406279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:55.407454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:55.565541 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3636/7351] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:55.568142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:55.568438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:55.568747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:55.610709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:55.614441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:55.630374 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3716/7352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:55.632326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:55.646580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b2db-32c4-4910-8e1b-38c9b194802b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:55.653229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:55.654247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:55.654640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:55.655021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:55.655855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:47:55.656346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:55.658934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:55.681844 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3637/7353] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:47:55.683275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:55.701404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcbdc9-4026-440d-95ee-d35690844676 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:55.719156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:55.720582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:55.720582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:55.720861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:55.721797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:55.724317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:55.770631 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3717/7354] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:55 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:47:55.772223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:55.784371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bcc0a-3a3c-406b-b805-441c8f2043f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:55.952044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:55.952846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:55.953235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:55.954441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:55.954441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:55.956581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.005324 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3638/7355] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:55 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:56.006940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.034029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7621d6-c5c8-47f3-b433-f2dfe9e267dd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.047217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.049118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.050242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.051610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.052391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.055631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.082932 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3718/7356] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:56.086976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.102258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:56.112153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214c20b-b76b-47ba-96b5-04af5ae61481 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.126875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57e0e7-7b65-4583-a267-ca669518b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.127631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e0e7-7b65-4583-a267-ca669518b6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.129132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e0e7-7b65-4583-a267-ca669518b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.140112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57e0e7-7b65-4583-a267-ca669518b6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.141911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57e0e7-7b65-4583-a267-ca669518b6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.149094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57e0e7-7b65-4583-a267-ca669518b6b8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.167871 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3639/7357] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:56.171948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.184570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54e307-ee92-4a47-8b61-16ae1e3e2fba admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.189504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.190218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.190508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.190789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] PATH_INFO: `/v3/projects/acf516ccfb1c460fbc3b950a300c09bb/users/66c47dd9d76f4fcaa427cda4e0acfc3b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.210958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf516ccfb1c460fbc3b950a300c09bb, user_id=66c47dd9d76f4fcaa427cda4e0acfc3b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.217683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.253675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21916-fc89-49c5-8251-8437720a996d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.254073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21916-fc89-49c5-8251-8437720a996d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.254627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21916-fc89-49c5-8251-8437720a996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.264118 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3719/7358] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:56 2022] PUT /identity/v3/projects/acf516ccfb1c460fbc3b950a300c09bb/users/66c47dd9d76f4fcaa427cda4e0acfc3b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:56.296639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-eff21916-fc89-49c5-8251-8437720a996d None None] MFA Rules not processed for user `66c47dd9d76f4fcaa427cda4e0acfc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:56.298031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eff21916-fc89-49c5-8251-8437720a996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:56.476908 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3640/7359] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:56.481916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.567729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:56.612964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43555aa-f811-481d-a337-1856dd10464d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.618331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.618962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.619413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.619694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.620341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.624633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.668958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff21916-fc89-49c5-8251-8437720a996d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.671606 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3720/7360] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:56 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:56.681480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff21916-fc89-49c5-8251-8437720a996d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.785789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.786442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.786725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.786994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.787626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.789704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.834136 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3641/7361] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:56 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:56.835465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.855021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810df7-a75b-425e-802f-ca75bb8601f9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.863528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.864647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.865136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.865953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.866900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.869456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.882273 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3721/7362] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:47:56.886831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.901458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061df2e5-6fb4-4248-a91e-0264abcdab79 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:56.914285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:56.914818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:56.915044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:56.915613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] PATH_INFO: `/v3/projects/bd78e61d00194f039b66f63012a31d77/users/668641362143469a849143500c3ab4d8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:56.935727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd78e61d00194f039b66f63012a31d77, user_id=668641362143469a849143500c3ab4d8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:56.938440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:56.962999 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3642/7363] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:56 2022] PUT /identity/v3/projects/bd78e61d00194f039b66f63012a31d77/users/668641362143469a849143500c3ab4d8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:47:56.964840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:56.981962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538543c-d187-4a29-950e-92b3af798a2b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:57.074311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b5b88-6482-4c97-8cd4-f3d7c22ad4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:57.076661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b5b88-6482-4c97-8cd4-f3d7c22ad4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:57.077112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b5b88-6482-4c97-8cd4-f3d7c22ad4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:57.077695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b5b88-6482-4c97-8cd4-f3d7c22ad4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:57.078535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b5b88-6482-4c97-8cd4-f3d7c22ad4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:57.080955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b5b88-6482-4c97-8cd4-f3d7c22ad4a9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:57.100723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3722/7364] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:47:57.104435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:57.130587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcf78f-27ca-4b39-835a-74d8a838e2ac admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:57.165713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:57.166698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:57.167138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:57.169700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] PATH_INFO: `/v3/projects/bd78e61d00194f039b66f63012a31d77/users/668641362143469a849143500c3ab4d8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:57.188709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd78e61d00194f039b66f63012a31d77, user_id=668641362143469a849143500c3ab4d8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:57.207554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:57.253173 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3643/7365] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:47:57 2022] PUT /identity/v3/projects/bd78e61d00194f039b66f63012a31d77/users/668641362143469a849143500c3ab4d8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:57.269689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:57.270868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:57.271359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:57.400763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] MFA Rules not processed for user `668641362143469a849143500c3ab4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:57.402360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:57.702536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3723/7366] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:57.724029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:57.727662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:57.879664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:57.945426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa9260-1164-4197-b36d-f5e9be432b6b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:57.958299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:57.958960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:57.959245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:57.959519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:57.977991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:57.979507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:58.009631 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3644/7367] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:58.295384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:58.320588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:58.323870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af70bd-05d4-4a11-87b8-d8f77ead8375 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:58.324114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:58.338497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:58.339146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:58.339447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:58.339708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:58.389751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:58.475054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:58.484228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:58.516704 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3724/7368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:58.527226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:58.530061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:58.565517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ed04-9730-4d86-820d-5ca6f82addca service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:58.577116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:58.579432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:58.581814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:58.582277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:58.589568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:58.614124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:58.616431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:58.656753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3645/7369] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:47:58.693511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f699d-ab0a-4fc0-acd7-d43d80d072bf service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:58.712195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:58.712793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:58.713121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:58.713344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] PATH_INFO: `/v3/users/c54441bd511c4a85bed6d8c8b360ca94` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:58.718195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54441bd511c4a85bed6d8c8b360ca94)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:58.720203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:58.873575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54441bd511c4a85bed6d8c8b360ca94'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:58.907617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54441bd511c4a85bed6d8c8b360ca94'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:58.909179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54441bd511c4a85bed6d8c8b360ca94'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:58.910001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54441bd511c4a85bed6d8c8b360ca94'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:58.936893 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54441bd511c4a85bed6d8c8b360ca94'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:58.966257 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3725/7370] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:58 2022] DELETE /identity/v3/users/c54441bd511c4a85bed6d8c8b360ca94 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:58.995206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:59.020115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305343-71c6-4d83-8e8a-bc8e1bc02332 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:59.129304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:59.131069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.133261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.133980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] PATH_INFO: `/v3/users/66c47dd9d76f4fcaa427cda4e0acfc3b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.136765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c47dd9d76f4fcaa427cda4e0acfc3b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:59.142814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:59.235366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c47dd9d76f4fcaa427cda4e0acfc3b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.269507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c47dd9d76f4fcaa427cda4e0acfc3b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.270924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c47dd9d76f4fcaa427cda4e0acfc3b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.271592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c47dd9d76f4fcaa427cda4e0acfc3b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.281261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fcdf6cbb-e886-46f9-98a7-9e6167bbfa11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c47dd9d76f4fcaa427cda4e0acfc3b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.295956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:59.296988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:59.313040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:59.337969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6344f-7a9e-4940-8f49-082db36020a2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:59.363176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:59.364668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.364903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.365184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] PATH_INFO: `/v3/projects/857ad348ec084b2db5e9c684b99e49bc` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.368788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857ad348ec084b2db5e9c684b99e49bc)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:59.371139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:59.377681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3646/7371] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:47:58 2022] DELETE /identity/v3/users/66c47dd9d76f4fcaa427cda4e0acfc3b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:59.384353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.384642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.384919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.421740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:59.423031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:59.493845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:47:59.509052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857ad348ec084b2db5e9c684b99e49bc', 'request_id': 'req-bcc1ece0-136c-4ccb-afc2-d9e06d342820'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.519985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857ad348ec084b2db5e9c684b99e49bc', 'request_id': 'req-bcc1ece0-136c-4ccb-afc2-d9e06d342820'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.538095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857ad348ec084b2db5e9c684b99e49bc', 'request_id': 'req-bcc1ece0-136c-4ccb-afc2-d9e06d342820'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.559723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] The token cache is being invalidate because project 857ad348ec084b2db5e9c684b99e49bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:47:59.560028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.566514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bcc1ece0-136c-4ccb-afc2-d9e06d342820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:47:59.571406 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3726/7372] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:47:59 2022] DELETE /identity/v3/projects/857ad348ec084b2db5e9c684b99e49bc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:47:59.577090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e91f62-15a7-42dc-abba-a5e2cfa311f7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.577388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e91f62-15a7-42dc-abba-a5e2cfa311f7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.577671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e91f62-15a7-42dc-abba-a5e2cfa311f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.579989 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3647/7373] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:59.590996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:59.594466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:59.636034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-92e91f62-15a7-42dc-abba-a5e2cfa311f7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:59.639316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-92e91f62-15a7-42dc-abba-a5e2cfa311f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:59.706649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e65d0-8aec-4bf9-a991-9326f255ca3f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:59.735085 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3727/7374] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:59.744730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.745464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.745464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.775099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:59.775880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.776177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.776463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.777147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:47:59.779730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:47:59.788612 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3728/7375] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:47:59.791474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:59.792821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:59.792955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:59.805098 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3648/7376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:47:59.805361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332f5e-ca2a-48c9-a7e9-355c2b93c4ac None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:59.811745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:59.812581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.813033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.814336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.815106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:47:59.815540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:59.817850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:59.837163 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3729/7377] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:47:59.837812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:59.849987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f2fe-cfdf-4542-b938-633a13512df9 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:59.856512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:59.857191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.857909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.857909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.858485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:59.860439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:47:59.897288 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3649/7378] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:47:59 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:47:59.899557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:47:59.911488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464d559-16fe-45b1-af99-d8c64870e1c0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:47:59.983978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:47:59.984774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:47:59.985159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:47:59.985533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:47:59.986340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:47:59.988456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:00.012764 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3730/7379] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:47:59 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:00.016769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.028887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df339-dd53-40f4-a98c-5b0ea5bb3c72 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:00.039009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:00.039930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.040748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.040748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.041615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:00.045324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:00.057898 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3650/7380] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:00.062932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.074114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526484-5fd7-4cb1-b120-0b4f08460bb2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:00.081365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606422a-0aae-4249-97af-11e7ed8dc9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:00.082137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606422a-0aae-4249-97af-11e7ed8dc9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.082556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606422a-0aae-4249-97af-11e7ed8dc9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.082967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606422a-0aae-4249-97af-11e7ed8dc9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.084184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606422a-0aae-4249-97af-11e7ed8dc9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:00.085476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606422a-0aae-4249-97af-11e7ed8dc9c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:00.260682 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3731/7381] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:00.265786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.307086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f625e5-76c3-4a86-9737-3724b97c2e31 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:00.314225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d863-2b89-4493-88cc-71d897207e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:00.315460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d863-2b89-4493-88cc-71d897207e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.315896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d863-2b89-4493-88cc-71d897207e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.316518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d863-2b89-4493-88cc-71d897207e02 admin admin] PATH_INFO: `/v3/projects/f2e7268e63a348d8ad8751e77a5d31b6/users/43ec96c2e59d401bb0ae461214371470/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.327762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d102008-3d94-4997-b361-43b52744d77e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.328302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d102008-3d94-4997-b361-43b52744d77e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.328302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d102008-3d94-4997-b361-43b52744d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.363308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:00.375833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d863-2b89-4493-88cc-71d897207e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e7268e63a348d8ad8751e77a5d31b6, user_id=43ec96c2e59d401bb0ae461214371470, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:00.378443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4d102008-3d94-4997-b361-43b52744d77e None None] MFA Rules not processed for user `db14c5e21a6e4120b57ae91ad77cb834`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:00.379693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d102008-3d94-4997-b361-43b52744d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:00.380219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d863-2b89-4493-88cc-71d897207e02 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:00.404749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:00.405874 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3651/7382] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:00 2022] PUT /identity/v3/projects/f2e7268e63a348d8ad8751e77a5d31b6/users/43ec96c2e59d401bb0ae461214371470/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:00.415940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.416482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.417002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.471576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] MFA Rules not processed for user `43ec96c2e59d401bb0ae461214371470`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:00.472848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:00.531749 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3732/7383] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:00.532851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d102008-3d94-4997-b361-43b52744d77e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.536159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4d102008-3d94-4997-b361-43b52744d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:00.572608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d102008-3d94-4997-b361-43b52744d77e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:00.604141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3652/7384] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:00.606217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.610999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:00.717318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:00.717992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.718300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.718583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] PATH_INFO: `/v3/projects/acf516ccfb1c460fbc3b950a300c09bb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.724588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf516ccfb1c460fbc3b950a300c09bb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:00.726562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:00.749856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c97ade-18f3-4bd0-8de1-4c9dd8bb3897 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:00.766073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:00.767001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:00.767283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:00.767571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:00.768348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:00.770405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:00.816271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf516ccfb1c460fbc3b950a300c09bb', 'request_id': 'req-1e1d901a-00a8-4204-9b9a-db2e48145db7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:00.826481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf516ccfb1c460fbc3b950a300c09bb', 'request_id': 'req-1e1d901a-00a8-4204-9b9a-db2e48145db7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:00.833955 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3653/7385] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:00 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:00.833955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.839104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:00.844296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf516ccfb1c460fbc3b950a300c09bb', 'request_id': 'req-1e1d901a-00a8-4204-9b9a-db2e48145db7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:00.867323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] The token cache is being invalidate because project acf516ccfb1c460fbc3b950a300c09bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:00.867574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:00.868542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:00.872725 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3733/7386] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:00 2022] DELETE /identity/v3/projects/acf516ccfb1c460fbc3b950a300c09bb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:00.877246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:00.878961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:00.965014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:00.969170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:00.991374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7fe2-85ac-41ea-9c8e-180e2c1e2035 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.008090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d901a-00a8-4204-9b9a-db2e48145db7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.010668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.011327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.011810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.012104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.015737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:01.095414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.096111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.096312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.096466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.096911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.097205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.098559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.099516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.111149 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3654/7387] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:01.112137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:01.113576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:01.133308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bdef-2811-4e9b-bfc0-bf08639aa49c service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.140989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.141894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.142365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.142854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] PATH_INFO: `/v3/users/668641362143469a849143500c3ab4d8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.144632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] RBAC: Authorizing `identity:delete_user(user_id=668641362143469a849143500c3ab4d8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.147218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.158830 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3734/7388] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:00 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:01.162919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:01.190997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca485fe4-5795-4ea9-989f-6949dcd9ea21 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.198389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.205997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.206741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.207042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.210533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.217260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.232898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668641362143469a849143500c3ab4d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:01.244283 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3735/7389] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:01.245781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:01.250512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668641362143469a849143500c3ab4d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:01.251324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668641362143469a849143500c3ab4d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:01.252749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668641362143469a849143500c3ab4d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:01.263377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c19ae-25ea-4348-b5fa-6e7da1556773 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.273158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668641362143469a849143500c3ab4d8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:01.277613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.279083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.280028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.280318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] PATH_INFO: `/v3/projects/cd2312eba5694e52984f33961ced6337/users/6a20858f323a4dd6aca31a561b2b5376/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.306421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2312eba5694e52984f33961ced6337, user_id=6a20858f323a4dd6aca31a561b2b5376, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.312426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.320058 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3655/7390] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:01 2022] DELETE /identity/v3/users/668641362143469a849143500c3ab4d8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:01.341208 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3736/7391] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:01 2022] PUT /identity/v3/projects/cd2312eba5694e52984f33961ced6337/users/6a20858f323a4dd6aca31a561b2b5376/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:01.346393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:01.348698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:01.528010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9215-ccc0-408b-8c1a-057af376bdba admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.557615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:01.673427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88937acc-223b-46c0-8020-d6f3f8882ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.674789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88937acc-223b-46c0-8020-d6f3f8882ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.675630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88937acc-223b-46c0-8020-d6f3f8882ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.676273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88937acc-223b-46c0-8020-d6f3f8882ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.678169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88937acc-223b-46c0-8020-d6f3f8882ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.682636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88937acc-223b-46c0-8020-d6f3f8882ae0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.716996 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3656/7392] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:01.721633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:01.738822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0bb0-f20d-48a9-b37b-3df8c621f753 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:01.752536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:01.753181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.753534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.753941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] PATH_INFO: `/v3/projects/cd2312eba5694e52984f33961ced6337/users/6a20858f323a4dd6aca31a561b2b5376/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.757579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2312eba5694e52984f33961ced6337, user_id=6a20858f323a4dd6aca31a561b2b5376, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:01.765395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:01.798087 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3737/7393] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:01 2022] PUT /identity/v3/projects/cd2312eba5694e52984f33961ced6337/users/6a20858f323a4dd6aca31a561b2b5376/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:01.872451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6007fa-3a82-44cf-a79b-44af030e5cac None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:01.873462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6007fa-3a82-44cf-a79b-44af030e5cac None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:01.873816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6007fa-3a82-44cf-a79b-44af030e5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:01.935646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7b6007fa-3a82-44cf-a79b-44af030e5cac None None] MFA Rules not processed for user `0005cf1c5e004b919cb8579e7067d506`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:01.937080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b6007fa-3a82-44cf-a79b-44af030e5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:02.077424 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3657/7394] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:02.244681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:02.249024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:02.424274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498ccf0-a19c-48bb-9361-cade4ba045fa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:02.446272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:02.446944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:02.447292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:02.447672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] PATH_INFO: `/v3/projects/bd78e61d00194f039b66f63012a31d77` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:02.449318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd78e61d00194f039b66f63012a31d77)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:02.460266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:02.541024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:02.582473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd78e61d00194f039b66f63012a31d77', 'request_id': 'req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:02.599127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd78e61d00194f039b66f63012a31d77', 'request_id': 'req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:02.612534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd78e61d00194f039b66f63012a31d77', 'request_id': 'req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:02.636094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] The token cache is being invalidate because project bd78e61d00194f039b66f63012a31d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:02.638230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:02.641367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad8ad657-0fac-441f-b17b-56dd9a23d9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:02.646591 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3738/7395] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:02 2022] DELETE /identity/v3/projects/bd78e61d00194f039b66f63012a31d77 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:02.652413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:02.653074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:02.653074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:02.700862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:02.702595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:02.843447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3658/7396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:02.858840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:02.859174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:02.859460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:02.913682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:02.918141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:02.933252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3739/7397] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:02.934702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:02.952105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83687c-c40a-49f9-b578-803b4307481f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:02.964115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:02.964849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:02.964991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:02.965550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:02.966337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:02.966971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:02.969170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.001942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.013419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94e2fe-d387-4bce-bd47-bdf79e05dd7b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.014503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3659/7398] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:03.020417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.021069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.021528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.021804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.022515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.024599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.081328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.088924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3740/7399] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:03 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:03.095350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993017-9a49-4109-a384-b5de32c64437 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.196468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:03.233139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.233910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.234287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.234783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.235572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.237929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.285094 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3660/7400] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:03 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:03.289431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.312503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd44451-1db8-4bc8-927f-4917dc57c5ed admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.337039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.339682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.340120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.341189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.341918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.343816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.367050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3741/7401] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:03.367834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.382855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3d86-667b-42ea-8c83-b464e38ca38a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.390243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19042f15-a709-4b90-8005-4891dd590692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.391752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19042f15-a709-4b90-8005-4891dd590692 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.392247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19042f15-a709-4b90-8005-4891dd590692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.392754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19042f15-a709-4b90-8005-4891dd590692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.394411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19042f15-a709-4b90-8005-4891dd590692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.396262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19042f15-a709-4b90-8005-4891dd590692 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.422963 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3661/7402] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:03.424399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.438775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74f906-d210-43be-801f-039cd7ef9a16 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.445263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.446206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.446625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.447164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] PATH_INFO: `/v3/projects/75fcd852c2704b6aaf046aad885a7789/users/dfd14ee035e14a4f9bfcb3c7d27f5139/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.472779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fcd852c2704b6aaf046aad885a7789, user_id=dfd14ee035e14a4f9bfcb3c7d27f5139, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.476870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.494891 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3742/7403] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:03 2022] PUT /identity/v3/projects/75fcd852c2704b6aaf046aad885a7789/users/dfd14ee035e14a4f9bfcb3c7d27f5139/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:03.507340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.507892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.508370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.565006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] MFA Rules not processed for user `dfd14ee035e14a4f9bfcb3c7d27f5139`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:03.570665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:03.719290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.721698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:03.754295 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3662/7404] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:03.766020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:03.770905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:03.916205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ad1b-fb7b-4974-95e9-73f4fb236451 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.930460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401686f-cbdf-45d5-a505-67b5f90b49f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:03.939868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.940151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:03.940911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.941298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.941701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.942379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:03.942839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:03.943267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:03.948127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:03.956627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.958382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.969920 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3663/7405] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:03.977226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:03.979403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f968-3dd4-4c0b-93f0-e581e63b376f service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:03.997515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:04.009199 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3743/7406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:04.079398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:04.120075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e758d-018d-40e1-a9d0-4c7dbca1b0b6 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:04.134619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:04.135286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:04.135871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:04.148889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] PATH_INFO: `/v3/users/dfd14ee035e14a4f9bfcb3c7d27f5139` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:04.152639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd14ee035e14a4f9bfcb3c7d27f5139)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:04.156419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:04.260342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd14ee035e14a4f9bfcb3c7d27f5139'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:04.300604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd14ee035e14a4f9bfcb3c7d27f5139'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:04.301480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd14ee035e14a4f9bfcb3c7d27f5139'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:04.302347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd14ee035e14a4f9bfcb3c7d27f5139'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:04.315601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd14ee035e14a4f9bfcb3c7d27f5139'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:04.381048 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3664/7407] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:03 2022] DELETE /identity/v3/users/dfd14ee035e14a4f9bfcb3c7d27f5139 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:04.386442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:04.386862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:04.387842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:04.429759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:04.442647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:04.546431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:04.597323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3744/7408] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:04.670831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:04.672453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:04.828161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc05f9-8aae-46ac-a024-4884c403fd7b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:04.842137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14e275-82c3-4f45-8162-f4d4c4aba7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:04.843197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e275-82c3-4f45-8162-f4d4c4aba7fc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:04.843648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e275-82c3-4f45-8162-f4d4c4aba7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:04.843924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e275-82c3-4f45-8162-f4d4c4aba7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:04.867942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14e275-82c3-4f45-8162-f4d4c4aba7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:04.869500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14e275-82c3-4f45-8162-f4d4c4aba7fc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:04.896557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3665/7409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:48:05.843291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:05.846035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:05.878117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4823b-e4ac-42a4-aa96-31652bfeb18e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:05.883874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:05.884900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:05.885351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:05.885937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] PATH_INFO: `/v3/projects/75fcd852c2704b6aaf046aad885a7789` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:05.889425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fcd852c2704b6aaf046aad885a7789)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:05.907663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.009045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fcd852c2704b6aaf046aad885a7789', 'request_id': 'req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:06.017393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fcd852c2704b6aaf046aad885a7789', 'request_id': 'req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:06.024289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fcd852c2704b6aaf046aad885a7789', 'request_id': 'req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:06.044305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] The token cache is being invalidate because project 75fcd852c2704b6aaf046aad885a7789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:06.044655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:06.045332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9d5e798e-dde4-4bda-b9e3-5a44a8f6b75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:06.047789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3745/7410] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:05 2022] DELETE /identity/v3/projects/75fcd852c2704b6aaf046aad885a7789 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:06.053499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.054381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.054837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.087980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:06.090089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:06.214321 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3666/7411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:06.215035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.215671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.216097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.248335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:06.250906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:06.274784 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3746/7412] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:06.278939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:06.296615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f65fb-c345-4d2e-8897-3930771eb328 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:06.301823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:06.302672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.303155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.303585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.304418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:06.304879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:06.306744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.332272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:06.336403 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3667/7413] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:06.341354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:06.360134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a597-6223-4394-afd6-b874c008bdd5 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:06.367816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:06.368555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.368936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.369295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.369994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:06.372817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.437502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3747/7414] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:06 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:06.441276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:06.471003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6ab4-228c-47e5-ab63-74ae2c98c423 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:06.577569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:06.578377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.579332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.579621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.580299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:06.582987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.638380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3668/7415] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:06 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:06.642278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:06.657512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db4a6-2bd7-450d-8bac-f4d5e59fb213 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:06.670002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:06.671272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.672879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.673279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.674082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:06.678088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.708102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3748/7416] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:06.709372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:06.721269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aea28-6f0d-4c0b-a4cc-fc630a7359be admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:06.739129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf3810-8c43-4998-a011-f54341c6304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:06.739305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf3810-8c43-4998-a011-f54341c6304e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.740810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf3810-8c43-4998-a011-f54341c6304e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.741106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf3810-8c43-4998-a011-f54341c6304e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.743753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf3810-8c43-4998-a011-f54341c6304e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:06.747739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf3810-8c43-4998-a011-f54341c6304e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.780094 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3669/7417] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:06.781307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:06.797538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eaf2e-909b-4525-a578-9259581b23e4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:06.810383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:06.811063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.811355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.811636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] PATH_INFO: `/v3/projects/8bec805502f8416e9cc447f35dc13188/users/f8815d26e29c4f6b989c98f8143796df/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.847055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bec805502f8416e9cc447f35dc13188, user_id=f8815d26e29c4f6b989c98f8143796df, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:06.850013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:06.890293 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3749/7418] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:06 2022] PUT /identity/v3/projects/8bec805502f8416e9cc447f35dc13188/users/f8815d26e29c4f6b989c98f8143796df/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:06.891833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:06.895090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:06.895090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:06.952463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] MFA Rules not processed for user `f8815d26e29c4f6b989c98f8143796df`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:06.953784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:07.112474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3670/7419] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:07.120883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:07.123527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:07.208045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbabbc-bba4-4b28-a31a-c647c6ab00b7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:07.213570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc47009-621c-40c4-a54c-a715432041bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:07.214422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc47009-621c-40c4-a54c-a715432041bb service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:07.214860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc47009-621c-40c4-a54c-a715432041bb service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:07.215812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc47009-621c-40c4-a54c-a715432041bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:07.226899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc47009-621c-40c4-a54c-a715432041bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:07.230391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc47009-621c-40c4-a54c-a715432041bb service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:07.243060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3750/7420] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:07.943360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:07.946061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:08.092500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e906-ccf2-4d61-9063-b015352aaa69 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:08.123912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:08.127749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:08.130311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:08.132557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] PATH_INFO: `/v3/users/43ec96c2e59d401bb0ae461214371470` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:08.137546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ec96c2e59d401bb0ae461214371470)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:08.145935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:08.188295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:08.270057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ec96c2e59d401bb0ae461214371470'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:08.289818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ec96c2e59d401bb0ae461214371470'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:08.290774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ec96c2e59d401bb0ae461214371470'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:08.291612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ec96c2e59d401bb0ae461214371470'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:08.301193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ec96c2e59d401bb0ae461214371470'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:08.345089 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3671/7421] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:07 2022] DELETE /identity/v3/users/43ec96c2e59d401bb0ae461214371470 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:08.350906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:08.352336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:08.354163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:08.384612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:08.386874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:08.395356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:08.570723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:08.572336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:08.572579 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3751/7422] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:08.707478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cd4bc-753f-4fbb-a438-8ebf8bb874d2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:08.716310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:08.716987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:08.717281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:08.717558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:08.744530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:08.745997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:08.770490 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3672/7423] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:09.896013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:09.899574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:09.919517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:09.921648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:09.927406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13840d-08b8-4b70-974f-2dacb4e839bc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:09.947080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598568-5095-4b74-ac9d-121afc4feb01 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:09.961678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:09.962462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:09.967447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:09.967868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:09.971575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:09.993047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:10.003076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.003377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.003639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] PATH_INFO: `/v3/projects/f2e7268e63a348d8ad8751e77a5d31b6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.007465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:10.010702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfa912-31a2-48d7-b63e-75c685f05dfa service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:10.015914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e7268e63a348d8ad8751e77a5d31b6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:10.024174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:10.041604 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3673/7424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:48:10.159228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e7268e63a348d8ad8751e77a5d31b6', 'request_id': 'req-e1c3abb0-fc33-4d25-8125-42e60548d81b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:10.173115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e7268e63a348d8ad8751e77a5d31b6', 'request_id': 'req-e1c3abb0-fc33-4d25-8125-42e60548d81b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:10.185722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e7268e63a348d8ad8751e77a5d31b6', 'request_id': 'req-e1c3abb0-fc33-4d25-8125-42e60548d81b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:10.231832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] The token cache is being invalidate because project f2e7268e63a348d8ad8751e77a5d31b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:10.232044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:10.233589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e1c3abb0-fc33-4d25-8125-42e60548d81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:10.238104 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3752/7425] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:09 2022] DELETE /identity/v3/projects/f2e7268e63a348d8ad8751e77a5d31b6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:10.244601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.245006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.245459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.297892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:10.299432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:10.495590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.495820 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3674/7426] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:10.495925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.496075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.543680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:10.544837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:10.567263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3753/7427] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:10.571998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:10.594175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0e7e6-592a-4999-9469-be76b8ad32a2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:10.605368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:10.606215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.606616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.607005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.607799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:10.608221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:10.609990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:10.656083 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3675/7428] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:10.657478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:10.670807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6755d1-400e-4c4c-b373-f09fca69ef78 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:10.682500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:10.683419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.683696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.684329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.685037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:10.691225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:10.750732 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3754/7429] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:10 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:10.752094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:10.764821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:10.785997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d01d-d356-448c-87e3-84be02b5e86a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:10.862673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:10.863567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.864234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.864752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.865612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:10.868080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:10.911054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:10.916861 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3676/7430] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:10 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:10.924867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c57217-6d8a-4e17-9cf4-926ad3d5cace admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:10.939760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:10.942761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:10.943270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:10.944098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:10.945932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:10.951592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:10.979467 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3755/7431] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:10.983859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:10.998008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f08b41-985e-47d1-b0b7-ff83a056b963 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:11.012744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e9043-c6a2-4013-9fe2-b043a8895a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:11.013754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e9043-c6a2-4013-9fe2-b043a8895a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.014049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e9043-c6a2-4013-9fe2-b043a8895a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.014371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e9043-c6a2-4013-9fe2-b043a8895a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.015173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e9043-c6a2-4013-9fe2-b043a8895a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:11.016795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e9043-c6a2-4013-9fe2-b043a8895a82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:11.042104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:11.050027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3677/7432] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:11.055190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8f5ec-56a0-48d9-bd6f-a23ec1434caa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:11.062047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:11.063030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.063944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.064801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] PATH_INFO: `/v3/projects/22bfeb01cbcb4836b25da8771de2ad8b/users/34540bc5d78b4a8e87ebfed8dabf0064/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.085193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bfeb01cbcb4836b25da8771de2ad8b, user_id=34540bc5d78b4a8e87ebfed8dabf0064, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:11.087902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:11.123039 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3756/7433] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:11 2022] PUT /identity/v3/projects/22bfeb01cbcb4836b25da8771de2ad8b/users/34540bc5d78b4a8e87ebfed8dabf0064/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:11.126573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.127090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.128321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.169931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] MFA Rules not processed for user `34540bc5d78b4a8e87ebfed8dabf0064`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:11.171657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:11.281638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3678/7434] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:11.284803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:11.376212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:11.449126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6199-b651-4e63-b071-9adb92a5567c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:11.467706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:11.468356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.468765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.469063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.469794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:11.472538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:11.522134 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3757/7435] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:11 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:11.523389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:11.541772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8cef-cf39-47e5-819e-b4d08c049fb4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:11.645172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:11.645942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.646417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.646889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.648167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:11.657488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:11.694181 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3679/7436] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:11 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:11.700145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:11.721921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70122ee-11cf-46bf-9f46-245060a816fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:11.757044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:11.758182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.759597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.760342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.761543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:11.763800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:11.841193 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3758/7437] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:11.845928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:11.857371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:11.876278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1fb2-4b2c-466c-947e-791841ad4369 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:11.884385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:11.885375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:11.886119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:11.886673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] PATH_INFO: `/v3/projects/37315c9e6ac449baafad7b4472c380cf/users/5f78f9fa6fce4cc9be19462fb21ded21/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:11.922758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37315c9e6ac449baafad7b4472c380cf, user_id=5f78f9fa6fce4cc9be19462fb21ded21, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:11.949060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:11.984658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3680/7438] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:11 2022] PUT /identity/v3/projects/37315c9e6ac449baafad7b4472c380cf/users/5f78f9fa6fce4cc9be19462fb21ded21/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:11.988539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:12.003042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29f4d-d0bf-4342-9dba-a83b37b1b819 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:12.195070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:12.195914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:12.196371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:12.196798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:12.197595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:12.200059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:12.242128 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3759/7439] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:12.243892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:12.279109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:12.281284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:12.298184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc24b9-eb8f-47a3-85f6-ec471896ff38 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:12.308784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7057868-6e01-4751-baa7-6a9f386e4ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:12.309993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7057868-6e01-4751-baa7-6a9f386e4ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:12.309993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7057868-6e01-4751-baa7-6a9f386e4ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:12.310493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7057868-6e01-4751-baa7-6a9f386e4ff9 admin admin] PATH_INFO: `/v3/projects/37315c9e6ac449baafad7b4472c380cf/users/5f78f9fa6fce4cc9be19462fb21ded21/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:12.316793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7057868-6e01-4751-baa7-6a9f386e4ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37315c9e6ac449baafad7b4472c380cf, user_id=5f78f9fa6fce4cc9be19462fb21ded21, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:12.323380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7057868-6e01-4751-baa7-6a9f386e4ff9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:12.367717 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3681/7440] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:12 2022] PUT /identity/v3/projects/37315c9e6ac449baafad7b4472c380cf/users/5f78f9fa6fce4cc9be19462fb21ded21/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:12.381151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:12.381439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:12.381719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:12.491122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] MFA Rules not processed for user `5f78f9fa6fce4cc9be19462fb21ded21`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:12.492718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:12.509497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd3b89-40ce-4deb-8aa4-ddf515de301d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:12.630074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:12.665050 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3682/7441] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:12.669710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:12.688818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99828511-8024-4585-bbe5-d76b93e2d197 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:12.703639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:12.704323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:12.704613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:12.704896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:12.705597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:12.707305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:12.734915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:12.736130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:12.736411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:12.736690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:12.741990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:12.765659 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3683/7442] 10.222.0.23 () {60 vars in 1150 bytes} [Mon Oct 31 05:48:12 2022] POST /identity/v3/domains => generated 277 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:12.771522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:12.795520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:12.797106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:12.838025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3760/7443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:48:12.970164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96034b2-d3ad-4b4a-820a-bcb9bd0762e6 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:12.982293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:12.982805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:12.983094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:12.983479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:12.986032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:12.987764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:13.033197 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3684/7444] 10.222.0.23 () {60 vars in 1150 bytes} [Mon Oct 31 05:48:12 2022] POST /identity/v3/domains => generated 276 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:13.035239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:13.055449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95231747-3f3b-40b2-b973-8411985ddeb5 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:13.228596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:13.229233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:13.229517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:13.229790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:13.230490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:13.232755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:13.279462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:13.279883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3761/7445] 10.222.0.23 () {60 vars in 1150 bytes} [Mon Oct 31 05:48:13 2022] POST /identity/v3/domains => generated 276 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:13.294807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea82d-a090-4c1d-b7d6-03e201e5efd4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:13.386835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:13.468649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:13.469301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:13.469591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:13.469870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:13.470672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:13.472297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:13.506915 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3685/7446] 10.222.0.23 () {60 vars in 1150 bytes} [Mon Oct 31 05:48:13 2022] POST /identity/v3/domains => generated 278 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:13.511612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:13.539329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1aad-eafd-40b7-b51c-fc4841af4f41 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:13.670189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:13.670961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:13.671151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:13.671478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/a9e5f9495d7249b18ece1a4384003ad2` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:13.686739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a9e5f9495d7249b18ece1a4384003ad2)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:13.688430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:13.742797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.752794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.847349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:13.872783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2', 'request_id': 'req-d1e52d4e-daf2-4b71-9cf3-bd580816483c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.885220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2', 'request_id': 'req-d1e52d4e-daf2-4b71-9cf3-bd580816483c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.898286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2', 'request_id': 'req-d1e52d4e-daf2-4b71-9cf3-bd580816483c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.923112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project a9e5f9495d7249b18ece1a4384003ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:13.923413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.924145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.948681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2', 'request_id': 'req-d1e52d4e-daf2-4b71-9cf3-bd580816483c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.968521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2', 'request_id': 'req-d1e52d4e-daf2-4b71-9cf3-bd580816483c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.971031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a9e5f9495d7249b18ece1a4384003ad2', 'request_id': 'req-d1e52d4e-daf2-4b71-9cf3-bd580816483c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:13.978326 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3762/7447] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:13 2022] DELETE /identity/v3/domains/a9e5f9495d7249b18ece1a4384003ad2 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:13.985635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:13.988126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:14.016397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc8d4-32cc-444b-8f57-53d4a321cb25 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:14.164434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:14.165374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:14.165484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:14.165866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:14.166694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:14.168928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:14.212570 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3686/7448] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:48:13 2022] POST /identity/v3/domains => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:14.216714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:14.236100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52d4e-daf2-4b71-9cf3-bd580816483c tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:14.377876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:14.378758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:14.379143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:14.379519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/12ca4f2427c240da84f7722550baef2a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:14.394075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=12ca4f2427c240da84f7722550baef2a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:14.395843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:14.423942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '12ca4f2427c240da84f7722550baef2a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.424746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '12ca4f2427c240da84f7722550baef2a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.467941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '12ca4f2427c240da84f7722550baef2a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.468858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '12ca4f2427c240da84f7722550baef2a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.474764 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3763/7449] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:14 2022] PATCH /identity/v3/domains/12ca4f2427c240da84f7722550baef2a => generated 248 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:14.478500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:14.483248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:14.506993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c8bb8-a087-4438-b45a-2beaf9049833 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:14.657521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:14.658323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:14.658670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:14.658966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/12ca4f2427c240da84f7722550baef2a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:14.693103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=12ca4f2427c240da84f7722550baef2a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:14.695650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:14.748846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '12ca4f2427c240da84f7722550baef2a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.777478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '12ca4f2427c240da84f7722550baef2a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.836704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:14.870756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ca4f2427c240da84f7722550baef2a', 'request_id': 'req-ceadfb01-1b4e-43d9-8492-4e54a9aea574'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.893217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ca4f2427c240da84f7722550baef2a', 'request_id': 'req-ceadfb01-1b4e-43d9-8492-4e54a9aea574'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.905869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ca4f2427c240da84f7722550baef2a', 'request_id': 'req-ceadfb01-1b4e-43d9-8492-4e54a9aea574'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.920483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project 12ca4f2427c240da84f7722550baef2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:14.920715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.924565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.936157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '12ca4f2427c240da84f7722550baef2a', 'request_id': 'req-ceadfb01-1b4e-43d9-8492-4e54a9aea574'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.937288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '12ca4f2427c240da84f7722550baef2a', 'request_id': 'req-ceadfb01-1b4e-43d9-8492-4e54a9aea574'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.938215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '12ca4f2427c240da84f7722550baef2a', 'request_id': 'req-ceadfb01-1b4e-43d9-8492-4e54a9aea574'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:14.951552 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3687/7450] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:14 2022] DELETE /identity/v3/domains/12ca4f2427c240da84f7722550baef2a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:14.958740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:14.979958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd7b74-f26f-4d8e-b991-b90092112558 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:15.100023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:15.125786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:15.127170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:15.128104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:15.129365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:15.131635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:15.134061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:15.171032 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3764/7451] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:48:14 2022] POST /identity/v3/domains => generated 279 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:15.171350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:15.172807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:15.194073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadfb01-1b4e-43d9-8492-4e54a9aea574 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:15.322911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:15.324041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:15.324758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:15.325879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:15.373186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8b6c626b496841ecbd4e6eb1af7d5a89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:15.404302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:15.482403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.483952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.537345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.538085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.542750 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3688/7452] 10.222.0.23 () {60 vars in 1250 bytes} [Mon Oct 31 05:48:15 2022] PATCH /identity/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89 => generated 277 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:15.547023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:15.549105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:15.576561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116a081-e023-4bed-9d63-bdfa8f368e1b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:15.700618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:15.701379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:15.701675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:15.701956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:15.716910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=8b6c626b496841ecbd4e6eb1af7d5a89)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:15.719090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:15.724415 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3765/7453] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:48:15 2022] GET /identity/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89 => generated 277 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:15.725266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:15.742812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30457729-e47b-441c-84d1-82576927a163 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:15.763621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:15.764826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:15.765330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:15.765811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:15.768238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8b6c626b496841ecbd4e6eb1af7d5a89)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:15.770893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:15.803315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:15.805254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:15.820285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.833797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.882411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:15.941677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89', 'request_id': 'req-f9effb61-5ebc-4533-8175-167b8505572b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.955077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89', 'request_id': 'req-f9effb61-5ebc-4533-8175-167b8505572b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:15.980347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89', 'request_id': 'req-f9effb61-5ebc-4533-8175-167b8505572b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.015123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ede37-ead9-40bd-a251-29910990d3c9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:16.017152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project 8b6c626b496841ecbd4e6eb1af7d5a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:16.017462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.019866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.041973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89', 'request_id': 'req-f9effb61-5ebc-4533-8175-167b8505572b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.045217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89', 'request_id': 'req-f9effb61-5ebc-4533-8175-167b8505572b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.047847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8b6c626b496841ecbd4e6eb1af7d5a89', 'request_id': 'req-f9effb61-5ebc-4533-8175-167b8505572b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.070250 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3689/7454] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:15 2022] DELETE /identity/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:16.079154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:16.082704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:16.165747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:16.166675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.167171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.167722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] PATH_INFO: `/v3/users/f8815d26e29c4f6b989c98f8143796df` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.169431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8815d26e29c4f6b989c98f8143796df)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:16.171861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:16.221863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:16.280205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8815d26e29c4f6b989c98f8143796df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.317535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8815d26e29c4f6b989c98f8143796df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.319063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8815d26e29c4f6b989c98f8143796df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.323496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8815d26e29c4f6b989c98f8143796df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.326906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9effb61-5ebc-4533-8175-167b8505572b tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:16.340948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91526f9-f31c-403e-985c-52c3ebbb8f0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:16.342409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91526f9-f31c-403e-985c-52c3ebbb8f0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.344620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91526f9-f31c-403e-985c-52c3ebbb8f0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.344920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91526f9-f31c-403e-985c-52c3ebbb8f0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.345587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91526f9-f31c-403e-985c-52c3ebbb8f0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:16.346693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-aa1c425e-ac65-4609-869d-b37f10b2f52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8815d26e29c4f6b989c98f8143796df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:16.353230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91526f9-f31c-403e-985c-52c3ebbb8f0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:16.377823 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3766/7455] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:15 2022] DELETE /identity/v3/users/f8815d26e29c4f6b989c98f8143796df => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:16.381283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.382289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.384237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.398440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3690/7456] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 31 05:48:16 2022] GET /identity/v3/domains => generated 1347 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:16.400152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.400635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.401068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.436684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] MFA Rules not processed for user `6a20858f323a4dd6aca31a561b2b5376`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:16.438118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:16.439249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:16.456789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:16.565325 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3767/7457] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:16.573862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:16.576267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:16.619657 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3691/7458] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:16.620597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:16.622003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:16.685258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:16.728799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cee3-f63f-4882-ab69-b8e6f1726fb8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:16.738544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:16.739673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.739972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.740254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.765511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find domain: 8b6c626b496841ecbd4e6eb1af7d5a89.: keystone.exception.DomainNotFound: Could not find domain: 8b6c626b496841ecbd4e6eb1af7d5a89. Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8b6c626b496841ecbd4e6eb1af7d5a89. Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:16.771649 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:16.772771 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8b6c626b496841ecbd4e6eb1af7d5a89. Oct 31 05:48:16.773792 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:16.774852 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3768/7459] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:16 2022] PATCH /identity/v3/domains/8b6c626b496841ecbd4e6eb1af7d5a89 => generated 112 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:16.780768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:16.788067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:16.788635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a494770-c51f-4b88-b8d7-236deb36abf7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:16.806268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:16.806919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.807211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.807803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.826316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:16.828068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:16.845847 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3692/7460] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:16.846863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:16.860620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6fdd8-af0e-421e-bb67-140d4c1e3421 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:16.866359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:16.867134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:16.867524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:16.867928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:16.868870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:16.871210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:16.881362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:16.924771 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3693/7461] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:48:16 2022] POST /identity/v3/domains => generated 276 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:16.929160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:16.935695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed9e0e-64b8-4e5a-8636-b6fa018da241 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:17.037624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8996f6c-b93c-4a02-a9f1-7a7558f844f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:17.038631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8996f6c-b93c-4a02-a9f1-7a7558f844f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:17.039250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8996f6c-b93c-4a02-a9f1-7a7558f844f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:17.039668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8996f6c-b93c-4a02-a9f1-7a7558f844f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:17.083445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50681e4-ea79-40e5-bc77-168f20151c79 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:17.089876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:17.092701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:17.092941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:17.093223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:17.094526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:17.096429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:17.138341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8996f6c-b93c-4a02-a9f1-7a7558f844f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:17.140474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8996f6c-b93c-4a02-a9f1-7a7558f844f0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:17.156371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3769/7462] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:17.159731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:17.160018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:17.160630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:17.172077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3694/7463] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:16 2022] POST /identity/v3/users => generated 348 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:17.172713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:17.185856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] MFA Rules not processed for user `db14c5e21a6e4120b57ae91ad77cb834`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:17.188343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:17.193004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36eded-5f72-4f99-bda5-069b72df3937 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:17.206068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:17.206738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:17.207025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:17.207301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:17.207954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:17.209883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:17.242680 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3695/7464] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 31 05:48:17 2022] POST /identity/v3/groups => generated 323 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:17.247470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:17.265199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd677d-d8b5-4bf8-85fe-0aaf08b8daec tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:17.271404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:17.272152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:17.272511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:17.272936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/695a13799e1344c7ac505f130911c88f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:17.274332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=695a13799e1344c7ac505f130911c88f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:17.276081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:17.291044 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3770/7465] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:17.329282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '695a13799e1344c7ac505f130911c88f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.330731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '695a13799e1344c7ac505f130911c88f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.415987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '695a13799e1344c7ac505f130911c88f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.418077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '695a13799e1344c7ac505f130911c88f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.427395 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3696/7466] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:17 2022] PATCH /identity/v3/domains/695a13799e1344c7ac505f130911c88f => generated 277 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:17.428700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:17.461153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf680dc9-8430-4dea-88db-120a0bdc0282 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:17.570626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:17.612358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:17.613188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:17.613320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:17.613568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/695a13799e1344c7ac505f130911c88f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:17.635303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=695a13799e1344c7ac505f130911c88f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:17.636995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:17.699000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '695a13799e1344c7ac505f130911c88f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.719221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '695a13799e1344c7ac505f130911c88f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.935680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55e858a830247a48cfb75f714ce7758'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.962907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55e858a830247a48cfb75f714ce7758'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.963947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55e858a830247a48cfb75f714ce7758'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.967269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55e858a830247a48cfb75f714ce7758'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:17.981196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55e858a830247a48cfb75f714ce7758'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.047971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:18.073288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695a13799e1344c7ac505f130911c88f', 'request_id': 'req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.086185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695a13799e1344c7ac505f130911c88f', 'request_id': 'req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.097270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695a13799e1344c7ac505f130911c88f', 'request_id': 'req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.117264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project 695a13799e1344c7ac505f130911c88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:18.118517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.119544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.134279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '695a13799e1344c7ac505f130911c88f', 'request_id': 'req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.151201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '695a13799e1344c7ac505f130911c88f', 'request_id': 'req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.153365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '695a13799e1344c7ac505f130911c88f', 'request_id': 'req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.170895 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3771/7467] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:17 2022] DELETE /identity/v3/domains/695a13799e1344c7ac505f130911c88f => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:18.175301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.178166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:18.185999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.187931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:18.196798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1aac3-1190-43a6-a3fa-812beb17250a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.261293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:18.344941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.346697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.346964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.347255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/695a13799e1344c7ac505f130911c88f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.354597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f656-c30d-42ba-ba5d-e3365d3bc9df tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.365000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.365663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.365989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.366300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] PATH_INFO: `/v3/projects/8bec805502f8416e9cc447f35dc13188` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.367499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bec805502f8416e9cc447f35dc13188)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.368142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=695a13799e1344c7ac505f130911c88f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.370689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.375722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find domain: 695a13799e1344c7ac505f130911c88f.: keystone.exception.DomainNotFound: Could not find domain: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:18.390766 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:18.392087 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:18.393268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.397556 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3697/7468] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:48:18 2022] GET /identity/v3/domains/695a13799e1344c7ac505f130911c88f => generated 112 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:18.401668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.406279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:18.420877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28488f0-4489-4749-8952-b6f14c0d3227 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.460953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.463783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.466020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.466616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/users/a55e858a830247a48cfb75f714ce7758` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.487877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:get_user(user_id=a55e858a830247a48cfb75f714ce7758)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.491008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bec805502f8416e9cc447f35dc13188', 'request_id': 'req-06db390b-8aed-4e8a-824e-f916d32160c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.491468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.512285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bec805502f8416e9cc447f35dc13188', 'request_id': 'req-06db390b-8aed-4e8a-824e-f916d32160c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find user: a55e858a830247a48cfb75f714ce7758.: keystone.exception.UserNotFound: Could not find user: a55e858a830247a48cfb75f714ce7758. Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 05:48:18.518858 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:18.520009 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a55e858a830247a48cfb75f714ce7758. Oct 31 05:48:18.521352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.525059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bec805502f8416e9cc447f35dc13188', 'request_id': 'req-06db390b-8aed-4e8a-824e-f916d32160c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.528869 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3698/7469] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 31 05:48:18 2022] GET /identity/v3/users/a55e858a830247a48cfb75f714ce7758 => generated 110 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:18.529992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.545338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] The token cache is being invalidate because project 8bec805502f8416e9cc447f35dc13188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:18.546127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.547848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06db390b-8aed-4e8a-824e-f916d32160c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:18.548719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160575-6976-449d-aea5-5928c18fe0c3 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.554943 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3772/7470] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:18 2022] DELETE /identity/v3/projects/8bec805502f8416e9cc447f35dc13188 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:18.557291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e6c3-cfd8-4364-b875-3462203b8caf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.557853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e6c3-cfd8-4364-b875-3462203b8caf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.558395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e6c3-cfd8-4364-b875-3462203b8caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.586666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8d38e6c3-cfd8-4364-b875-3462203b8caf None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:18.588379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d38e6c3-cfd8-4364-b875-3462203b8caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:18.688339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:18.701795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.702582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.702874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.704386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/groups/f6fd52a967e944bab36b028307a8c0d7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.710042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:get_group(group_id=f6fd52a967e944bab36b028307a8c0d7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.712518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find group: f6fd52a967e944bab36b028307a8c0d7.: keystone.exception.GroupNotFound: Could not find group: f6fd52a967e944bab36b028307a8c0d7. Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 31 05:48:18.747427 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:18.748462 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: f6fd52a967e944bab36b028307a8c0d7. Oct 31 05:48:18.749402 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.750958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3699/7471] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:18 2022] GET /identity/v3/groups/f6fd52a967e944bab36b028307a8c0d7 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:18.755366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.757183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:18.759972 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3773/7472] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:18.770636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.771024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.771401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.771921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fdd9-79fd-4acb-9e50-d37f93193df4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.776952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.777564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.777888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.778188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/groups/f6fd52a967e944bab36b028307a8c0d7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.789277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find group: f6fd52a967e944bab36b028307a8c0d7.: keystone.exception.GroupNotFound: Could not find group: f6fd52a967e944bab36b028307a8c0d7. Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 31 05:48:18.795952 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:18.797088 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: f6fd52a967e944bab36b028307a8c0d7. Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.798345 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3700/7473] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:48:18 2022] DELETE /identity/v3/groups/f6fd52a967e944bab36b028307a8c0d7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:18.800036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:18.801615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.801761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:18.812708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080b2d7-f2ca-49f9-87dd-59f1fccfe3c4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.816114 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3774/7474] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:18.817052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.819828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.820766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.821102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.821388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/users/a55e858a830247a48cfb75f714ce7758` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.830297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b7c0-1018-4ace-8a72-e23f21ec0192 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.836220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.836587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a55e858a830247a48cfb75f714ce7758)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.837159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.837504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.837877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.838744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:18.838878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.839186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.841849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.869244 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3775/7475] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find user: a55e858a830247a48cfb75f714ce7758.: keystone.exception.UserNotFound: Could not find user: a55e858a830247a48cfb75f714ce7758. Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 31 05:48:18.873522 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:18.874711 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a55e858a830247a48cfb75f714ce7758. Oct 31 05:48:18.875769 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.876792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.877074 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3701/7476] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:18 2022] DELETE /identity/v3/users/a55e858a830247a48cfb75f714ce7758 => generated 110 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:18.890333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.894448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0e7c-284c-428f-b0b1-2b081cbeb459 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.902295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b04cba-12d8-4266-bac5-a3908b1393ff tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:18.902751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41638-7912-4e51-933f-65955613928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.903766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41638-7912-4e51-933f-65955613928e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.904156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41638-7912-4e51-933f-65955613928e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.904738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41638-7912-4e51-933f-65955613928e admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.905816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c41638-7912-4e51-933f-65955613928e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:18.908391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c41638-7912-4e51-933f-65955613928e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:18.923827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:18.925798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:18.926246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:18.927276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/695a13799e1344c7ac505f130911c88f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:18.947814 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3776/7477] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:18 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:18.949163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41638-7912-4e51-933f-65955613928e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.951025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find domain: 695a13799e1344c7ac505f130911c88f.: keystone.exception.DomainNotFound: Could not find domain: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:18.961907 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:18.963268 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:18.964370 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:18.972006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3702/7478] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:18 2022] PATCH /identity/v3/domains/695a13799e1344c7ac505f130911c88f => generated 112 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:18.973042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:18.999266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bfefb-3df2-4653-998a-dd4c3ffb352e tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.040512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41638-7912-4e51-933f-65955613928e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.052459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.053224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.054068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.054446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.055099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.057054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.090729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.091991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.092596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.093254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.094225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.097257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.099238 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3777/7479] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:18 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:19.104933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.123215 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3703/7480] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 31 05:48:18 2022] GET /identity/v3/domains => generated 1347 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:19.127885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31281960-eca3-4a7d-a27b-965229115e11 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.129691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.140278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:19.145653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.147382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.147652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.147911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.150729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.157055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.157360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b60d-ccab-48ae-9511-2349120c0e4a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.168836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.169949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.169949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.170281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.170947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:19.171240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.172637 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3778/7481] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:19.175900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.176374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.205803 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3704/7482] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:19 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:19.206006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991cd1c-7212-42bb-bdfd-1d9af4de175d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.206740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.217634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.218991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd83-27b3-44ee-99f0-53b4e345edab tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.222811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.223387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.224081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.225237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.227328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.240596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.241292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.241581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.241859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.242542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1417263826) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:19.242845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.244477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.246230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3779/7483] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:19.253410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.273929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d3da0-0125-449e-875a-cac9f3988177 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.281810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.284049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.284459 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3705/7484] 10.222.0.23 () {58 vars in 1199 bytes} [Mon Oct 31 05:48:19 2022] GET /identity/v3/domains?name=tempest-test_domain-1417263826 => generated 409 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:19.284599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.285082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] PATH_INFO: `/v3/projects/98a26125acbf480287b9d4d30909cda7/users/ae6dedfb15fe43bf86a7d7269ac5de2c/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.292282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.311713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a26125acbf480287b9d4d30909cda7, user_id=ae6dedfb15fe43bf86a7d7269ac5de2c, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.315020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.315276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ceb99-4e40-440f-9f0e-157e7bad5966 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.329219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1a83c-bc0d-4458-8bfd-6fb184133178 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.329887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1a83c-bc0d-4458-8bfd-6fb184133178 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.330460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1a83c-bc0d-4458-8bfd-6fb184133178 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.330460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1a83c-bc0d-4458-8bfd-6fb184133178 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/695a13799e1344c7ac505f130911c88f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.339722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1a83c-bc0d-4458-8bfd-6fb184133178 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 05:48:19.347405 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3780/7485] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:19 2022] PUT /identity/v3/projects/98a26125acbf480287b9d4d30909cda7/users/ae6dedfb15fe43bf86a7d7269ac5de2c/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-93f1a83c-bc0d-4458-8bfd-6fb184133178 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Could not find domain: 695a13799e1344c7ac505f130911c88f.: keystone.exception.DomainNotFound: Could not find domain: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:19.352782 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:19.354224 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 695a13799e1344c7ac505f130911c88f. Oct 31 05:48:19.355134 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:19.357792 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3706/7486] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:19 2022] PATCH /identity/v3/domains/695a13799e1344c7ac505f130911c88f => generated 112 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:19.362305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.363861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.364155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.364437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.452081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] MFA Rules not processed for user `ae6dedfb15fe43bf86a7d7269ac5de2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:19.453606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:19.482819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:19.569981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de985a-aced-40f3-abb2-1d57a3f4c2ca admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.578744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.579650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.581142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.581382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/57026999a118481a880fbb0ca5671629` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.581491 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3707/7487] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:19.595056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.597050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:19.603865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=57026999a118481a880fbb0ca5671629)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.608176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.665618 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3781/7488] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:19 2022] PATCH /identity/v3/domains/57026999a118481a880fbb0ca5671629 => generated 276 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:19.680576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:19.710351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f5a7-123f-4ae3-9c6f-03d68d7ae4d9 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.726018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.727021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.727461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.727972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/57026999a118481a880fbb0ca5671629` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.754098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bea6fe-c623-48ef-9dca-6cb0ba80183d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:19.757450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=57026999a118481a880fbb0ca5671629)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.760043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.766331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:19.767192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:19.768157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:19.768491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:19.795787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:19.798538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '57026999a118481a880fbb0ca5671629'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:19.799989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:19.804828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '57026999a118481a880fbb0ca5671629'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:19.829593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3708/7489] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:48:19.936374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57026999a118481a880fbb0ca5671629', 'request_id': 'req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:19.943872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57026999a118481a880fbb0ca5671629', 'request_id': 'req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:19.961265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57026999a118481a880fbb0ca5671629', 'request_id': 'req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:19.995702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project 57026999a118481a880fbb0ca5671629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:19.996012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:19.998319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.015988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '57026999a118481a880fbb0ca5671629', 'request_id': 'req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.023868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '57026999a118481a880fbb0ca5671629', 'request_id': 'req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.025237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '57026999a118481a880fbb0ca5671629', 'request_id': 'req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.038513 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3782/7490] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:19 2022] DELETE /identity/v3/domains/57026999a118481a880fbb0ca5671629 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:20.042269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:20.054769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f7c5-3204-40fe-8e4b-29b95ee704da service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:20.194756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:20.195590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:20.196395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:20.196395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/bcd630767a974d5a89575cd3de78c994` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:20.201378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:20.215900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bcd630767a974d5a89575cd3de78c994)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:20.217925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:20.264139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bcd630767a974d5a89575cd3de78c994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.265810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bcd630767a974d5a89575cd3de78c994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.358077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bcd630767a974d5a89575cd3de78c994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.365059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bcd630767a974d5a89575cd3de78c994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.368099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3709/7491] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:20 2022] PATCH /identity/v3/domains/bcd630767a974d5a89575cd3de78c994 => generated 277 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:20.372103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:20.373646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:20.397549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d019f6-eea3-4a5c-9964-8b32759fcbf4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:20.446793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:20.533435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:20.534413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:20.534749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:20.535167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/bcd630767a974d5a89575cd3de78c994` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:20.549369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bcd630767a974d5a89575cd3de78c994)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:20.551819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:20.586390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bcd630767a974d5a89575cd3de78c994'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.591892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bcd630767a974d5a89575cd3de78c994'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.786019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd630767a974d5a89575cd3de78c994', 'request_id': 'req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.798642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd630767a974d5a89575cd3de78c994', 'request_id': 'req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.816218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd630767a974d5a89575cd3de78c994', 'request_id': 'req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.848966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project bcd630767a974d5a89575cd3de78c994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:20.850664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.852938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.875241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bcd630767a974d5a89575cd3de78c994', 'request_id': 'req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.879260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bcd630767a974d5a89575cd3de78c994', 'request_id': 'req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.881786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bcd630767a974d5a89575cd3de78c994', 'request_id': 'req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:20.903790 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3783/7492] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:20 2022] DELETE /identity/v3/domains/bcd630767a974d5a89575cd3de78c994 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:20.906360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:20.908040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:20.931071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21a26-849d-4caa-90a2-a88e753c36a4 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:21.028947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:21.029913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:21.030441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:21.031234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/c8e8ec0effd64c62876a9c9dfea14dc3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:21.045356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c8e8ec0effd64c62876a9c9dfea14dc3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:21.047276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:21.073445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.074864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.132545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.133474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.136271 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3710/7493] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 31 05:48:20 2022] PATCH /identity/v3/domains/c8e8ec0effd64c62876a9c9dfea14dc3 => generated 278 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:21.141701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:21.144095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:21.181373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8bbc8-a302-40f0-8978-44a06fcb2d0a tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:21.291833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:21.312285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f78f9fa6fce4cc9be19462fb21ded21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37315c9e6ac449baafad7b4472c380cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:21.313170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:21.313452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:21.313729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] PATH_INFO: `/v3/domains/c8e8ec0effd64c62876a9c9dfea14dc3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:21.342287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c8e8ec0effd64c62876a9c9dfea14dc3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:21.351172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:21.420897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.428103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.567145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3', 'request_id': 'req-cd6c77cc-6240-4629-8ab8-a60615f11d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.591956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3', 'request_id': 'req-cd6c77cc-6240-4629-8ab8-a60615f11d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.619920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3', 'request_id': 'req-cd6c77cc-6240-4629-8ab8-a60615f11d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.661495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] The token cache is being invalidate because project c8e8ec0effd64c62876a9c9dfea14dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:21.661916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.663839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.684174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3', 'request_id': 'req-cd6c77cc-6240-4629-8ab8-a60615f11d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.695101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3', 'request_id': 'req-cd6c77cc-6240-4629-8ab8-a60615f11d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.696492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd6c77cc-6240-4629-8ab8-a60615f11d43 tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c8e8ec0effd64c62876a9c9dfea14dc3', 'request_id': 'req-cd6c77cc-6240-4629-8ab8-a60615f11d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:21.709371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3784/7494] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:21 2022] DELETE /identity/v3/domains/c8e8ec0effd64c62876a9c9dfea14dc3 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:21.713208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:21.716522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:21.859798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63a28-8f7e-4ca4-b255-d6028682b5ae tempest-DomainsTestJSON-143530887 tempest-DomainsTestJSON-143530887-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:21.885389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:21.991405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:21.992179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:21.992469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:21.993906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] PATH_INFO: `/v3/users/34540bc5d78b4a8e87ebfed8dabf0064` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:21.996943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=34540bc5d78b4a8e87ebfed8dabf0064)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:22.010636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:22.130715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34540bc5d78b4a8e87ebfed8dabf0064'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:22.151349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34540bc5d78b4a8e87ebfed8dabf0064'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:22.153521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34540bc5d78b4a8e87ebfed8dabf0064'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:22.154616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34540bc5d78b4a8e87ebfed8dabf0064'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:22.176490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34540bc5d78b4a8e87ebfed8dabf0064'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:22.205482 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3711/7495] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:21 2022] DELETE /identity/v3/users/34540bc5d78b4a8e87ebfed8dabf0064 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:22.210996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:22.212157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:22.216038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:22.262724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:22.265167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:22.385605 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3785/7496] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:22.447919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:22.450916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:22.573507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fd44-7050-4584-8ba6-dc021feaa2ba admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:22.578098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:22.579082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:22.579201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:22.579455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:22.592425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:22.594088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:22.614270 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3712/7497] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:23.718130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:23.723827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:23.744444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9157d-e034-4f37-a12a-3b9fb1176a2c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:23.751899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:23.752662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:23.753229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:23.753648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] PATH_INFO: `/v3/projects/22bfeb01cbcb4836b25da8771de2ad8b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:23.755300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bfeb01cbcb4836b25da8771de2ad8b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:23.757880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:23.826814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:23.847883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bfeb01cbcb4836b25da8771de2ad8b', 'request_id': 'req-524b7c78-681e-44e2-a049-5ad5747648e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:23.856353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bfeb01cbcb4836b25da8771de2ad8b', 'request_id': 'req-524b7c78-681e-44e2-a049-5ad5747648e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:23.882317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bfeb01cbcb4836b25da8771de2ad8b', 'request_id': 'req-524b7c78-681e-44e2-a049-5ad5747648e8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:23.916562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] The token cache is being invalidate because project 22bfeb01cbcb4836b25da8771de2ad8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:23.917148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:23.918983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:23.922916 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3786/7498] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:23 2022] DELETE /identity/v3/projects/22bfeb01cbcb4836b25da8771de2ad8b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:23.927378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:23.945501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1825-6710-4cf0-99b0-e7497825c7e8 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:24.059677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:24.099532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:24.100385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:24.100686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:24.100965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] PATH_INFO: `/v3/users/5f78f9fa6fce4cc9be19462fb21ded21` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:24.103398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f78f9fa6fce4cc9be19462fb21ded21)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:24.108226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:24.228257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f78f9fa6fce4cc9be19462fb21ded21'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.242924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f78f9fa6fce4cc9be19462fb21ded21'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.243681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f78f9fa6fce4cc9be19462fb21ded21'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.244362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f78f9fa6fce4cc9be19462fb21ded21'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.257364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4355b6f3-ebde-4035-8496-71425a0e1b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f78f9fa6fce4cc9be19462fb21ded21'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.318990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3713/7499] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:23 2022] DELETE /identity/v3/users/5f78f9fa6fce4cc9be19462fb21ded21 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:24.719488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:24.721106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:24.754892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7c78-681e-44e2-a049-5ad5747648e8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:24.841920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:24.842253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:24.842623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:24.843011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] PATH_INFO: `/v3/projects/37315c9e6ac449baafad7b4472c380cf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:24.844189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37315c9e6ac449baafad7b4472c380cf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:24.846713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:24.908346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37315c9e6ac449baafad7b4472c380cf', 'request_id': 'req-3d613b0a-cc31-4599-8bd4-912404f9ca03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.914983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37315c9e6ac449baafad7b4472c380cf', 'request_id': 'req-3d613b0a-cc31-4599-8bd4-912404f9ca03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.923312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37315c9e6ac449baafad7b4472c380cf', 'request_id': 'req-3d613b0a-cc31-4599-8bd4-912404f9ca03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.937707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] The token cache is being invalidate because project 37315c9e6ac449baafad7b4472c380cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:24.937994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.938656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-3d613b0a-cc31-4599-8bd4-912404f9ca03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:24.940162 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3787/7500] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:24 2022] DELETE /identity/v3/projects/37315c9e6ac449baafad7b4472c380cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:24.949985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:24.951339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:24.952000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:24.980312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:24.981896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:25.068065 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3714/7501] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:25.070383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.070710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.070995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.096000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:25.107120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:25.157061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3788/7502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:25.161836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.178648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8da84-7a85-4349-88fc-827562c1f64e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.193240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.194027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.194634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.195373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.196560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:25.198960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.201392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.225986 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3715/7503] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:25.229741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.242056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e92d0-6a28-4591-b4ae-51aab7e4dc5a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.248631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.249696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.250312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.250666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.251385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.253429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.318196 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3789/7504] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:25 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:25.321496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.334522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e764-88d4-4fa7-986f-a6b4f66ba1d7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.414418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:25.435019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.438819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.439141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.439424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.440123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.442230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.472067 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3716/7505] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:25 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:25.476159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.488631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eec2a-3ef2-4aa0-91df-2f1b978ce50b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.499092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.499991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.500469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.500806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.501679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.503684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.517456 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3790/7506] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:25.521622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.536081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cdd1f-2a97-43d1-9dc7-fb5c05b49ea7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.544266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d30b-a48c-4d58-a05c-a5ab890be822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.544965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d30b-a48c-4d58-a05c-a5ab890be822 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.545257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d30b-a48c-4d58-a05c-a5ab890be822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.545588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d30b-a48c-4d58-a05c-a5ab890be822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.546306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d30b-a48c-4d58-a05c-a5ab890be822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.548206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d30b-a48c-4d58-a05c-a5ab890be822 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.560911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3717/7507] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:25.564973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.580270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc57a9-93c3-4828-b702-908d7a1b79d3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.593007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.593007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.593562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.593984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] PATH_INFO: `/v3/projects/cd2dba1118a94a39a8bdc5c7f3094562/users/40f781beb6bb4afea3bfa4cf40d94a62/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.600513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:25.613849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2dba1118a94a39a8bdc5c7f3094562, user_id=40f781beb6bb4afea3bfa4cf40d94a62, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.616951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.643321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3791/7508] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:25 2022] PUT /identity/v3/projects/cd2dba1118a94a39a8bdc5c7f3094562/users/40f781beb6bb4afea3bfa4cf40d94a62/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:25.653932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.654913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.655216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.687686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] MFA Rules not processed for user `40f781beb6bb4afea3bfa4cf40d94a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:25.690910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:25.805086 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3718/7509] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:25.809766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:25.919842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a072de2-bbaf-43de-bea3-60eff790e3b1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:25.926639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:25.927713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:25.928142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:25.928766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:25.929535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:25.932120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:25.978361 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3792/7510] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:25 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:25.982602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.000893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4492a8-75c4-4a40-a8a0-fc022d18b88c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.080814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.081908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.083450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.083922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.085378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.088498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.127632 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3719/7511] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:25 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:26.132001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.144726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae9f48-96cf-426d-8381-dbf5c02b4980 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.149742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.150480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.150774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.151052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.151709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.154342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.166455 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3793/7512] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:26.172801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.185407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a12a4-c46d-43a2-b9e1-8d9aacf01eaa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.194643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.195402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.196293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.196583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] PATH_INFO: `/v3/projects/a505bcdea1884b8e9fba58384fc6d0bb/users/68c2b5ed38a1489592aca5b34001cac5/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.228163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a505bcdea1884b8e9fba58384fc6d0bb, user_id=68c2b5ed38a1489592aca5b34001cac5, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.237183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.269408 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3720/7513] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:26 2022] PUT /identity/v3/projects/a505bcdea1884b8e9fba58384fc6d0bb/users/68c2b5ed38a1489592aca5b34001cac5/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:26.270701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.286389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf76fa-0fbb-4c55-86c7-a448f68e970e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.398602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816b5d2-a890-49a4-8753-0f97f2ba9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.399234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b5d2-a890-49a4-8753-0f97f2ba9408 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.399546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b5d2-a890-49a4-8753-0f97f2ba9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.399832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816b5d2-a890-49a4-8753-0f97f2ba9408 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.402203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b5d2-a890-49a4-8753-0f97f2ba9408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.403184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816b5d2-a890-49a4-8753-0f97f2ba9408 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.415896 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3794/7514] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:26.420541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.434812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f71c-5805-43d2-894d-1ed3c7befdc3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.447453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.448158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.450379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.450671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] PATH_INFO: `/v3/projects/a505bcdea1884b8e9fba58384fc6d0bb/users/68c2b5ed38a1489592aca5b34001cac5/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.453396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a505bcdea1884b8e9fba58384fc6d0bb, user_id=68c2b5ed38a1489592aca5b34001cac5, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.457586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.514241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3721/7515] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:26 2022] PUT /identity/v3/projects/a505bcdea1884b8e9fba58384fc6d0bb/users/68c2b5ed38a1489592aca5b34001cac5/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:26.525934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.526404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.526975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.587908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] MFA Rules not processed for user `68c2b5ed38a1489592aca5b34001cac5`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:26.589836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:26.695089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:26.794614 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3795/7516] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:26.800512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.819688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470371-1e17-4f4e-ba25-562867ca79b4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.828296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.829490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.830023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.830779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.831667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.833754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.839329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:26.875643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3722/7517] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:26 2022] POST /identity/v3/services => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:26.880466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.894328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aee33-e80e-4ff1-a1af-fcfff8e53a5a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.920396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.921047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.923670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.923971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.926344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.928964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: On instance['enabled']: Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: On instance['enabled']: Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: 'False' Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise error Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application 'False' Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.942455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:48:26.944099 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application 'False' Oct 31 05:48:26.946499 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:26.950723 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3796/7518] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:48:26 2022] POST /identity/v3/endpoints => generated 283 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:48:26.951654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:26.963126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b17c3-3407-4c7c-afaa-3ff416941653 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:26.968819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:26.969458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:26.969746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:26.970026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:26.970968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:26.972907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: On instance['enabled']: Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: On instance['enabled']: Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: 'True' Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise error Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application 'True' Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.980232 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:48:26.982295 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application 'True' Oct 31 05:48:26.986749 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:26.987803 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3723/7519] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:48:26 2022] POST /identity/v3/endpoints => generated 281 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 31 05:48:26.990965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.010888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5b7b1-262f-435f-b6cf-37db837082df tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.017358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.017876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.018064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.018384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.020576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.022409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.064388 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1985371949. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:48:27.064388 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:48:27.064388 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:48:27.120135 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3797/7520] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:48:26 2022] POST /identity/v3/endpoints => generated 360 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:27.125893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.143146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b88a90-58a8-440b-bd47-f2e5a9861e22 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.181003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.182355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.182749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.183128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/regions/tempest-region-1985371949` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.184142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1985371949)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.185453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.189127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3724/7521] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:48:27 2022] GET /identity/v3/regions/tempest-region-1985371949 => generated 180 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:27.192164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.208694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bc437-5104-4d6e-b5ba-582f0299a37e tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.220248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.221011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.221956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.222400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints/1c0ee219ad8a43d0ac6b51f7d3fb54ac` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.234914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=1c0ee219ad8a43d0ac6b51f7d3fb54ac)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.236274 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:48:27.236274 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:48:27.236274 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:48:27.238993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: On instance['enabled']: Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: On instance['enabled']: Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: 'False' Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise error Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application 'False' Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.249948 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:48:27.251728 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application 'False' Oct 31 05:48:27.252923 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:27.254308 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3798/7522] 10.222.0.23 () {60 vars in 1255 bytes} [Mon Oct 31 05:48:27 2022] PATCH /identity/v3/endpoints/1c0ee219ad8a43d0ac6b51f7d3fb54ac => generated 283 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:48:27.256299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.270624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c24cae-40cf-4d4f-88fc-7a17d5d0e6ef tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.278306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.279306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.280706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.281119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints/1c0ee219ad8a43d0ac6b51f7d3fb54ac` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.282609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=1c0ee219ad8a43d0ac6b51f7d3fb54ac)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.284964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.295320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '1c0ee219ad8a43d0ac6b51f7d3fb54ac', 'request_id': 'req-0dc48bdf-c835-4f88-83ba-532449142f75'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:27.309744 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3725/7523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:48:27 2022] DELETE /identity/v3/endpoints/1c0ee219ad8a43d0ac6b51f7d3fb54ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:27.313567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.328153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbdd73-0580-4ceb-9dff-343f7960bdd3 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.346044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.346802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.347158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.347498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/regions/tempest-region-1985371949` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.348158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1985371949)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.349829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.377566 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3799/7524] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 31 05:48:27 2022] DELETE /identity/v3/regions/tempest-region-1985371949 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:27.394190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.395325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc48bdf-c835-4f88-83ba-532449142f75 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.411723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.412348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.412630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.412906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.413577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.415237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.433103 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2056933070. To ensure interoperability, identifiers should be a valid uuid. Oct 31 05:48:27.433103 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 05:48:27.433103 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:48:27.465119 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3726/7525] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 31 05:48:27 2022] POST /identity/v3/endpoints => generated 360 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:27.469346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.482499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db490f0-e9e8-4d51-bb60-b9c0c558dc41 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.504723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.505388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.505669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.505944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/regions/tempest-region-2056933070` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.506582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2056933070)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.507868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.510112 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3800/7526] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 31 05:48:27 2022] GET /identity/v3/regions/tempest-region-2056933070 => generated 180 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:27.514690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.533116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b89d3-af0a-4d40-9ef6-8e7f7a917815 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.559227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.559972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.560210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.560487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints/69b5247ce63a4f118b887feaf743bb5c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.576480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=69b5247ce63a4f118b887feaf743bb5c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.578621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: On instance['enabled']: Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: On instance['enabled']: Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: 'True' Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise error Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application 'True' Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.587205 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:48:27.588556 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application 'True' Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:27.589511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3727/7527] 10.222.0.23 () {60 vars in 1255 bytes} [Mon Oct 31 05:48:27 2022] PATCH /identity/v3/endpoints/69b5247ce63a4f118b887feaf743bb5c => generated 281 bytes in 74 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:48:27.593213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.605703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d33d6-e60f-44c3-aa75-9d22d8f68bf2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.611014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.611779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.612692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.613035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/endpoints/69b5247ce63a4f118b887feaf743bb5c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.614565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=69b5247ce63a4f118b887feaf743bb5c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.616595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.629364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '69b5247ce63a4f118b887feaf743bb5c', 'request_id': 'req-7c4202d6-b5a3-494c-8cc5-5daf9a498204'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:27.646853 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3801/7528] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 31 05:48:27 2022] DELETE /identity/v3/endpoints/69b5247ce63a4f118b887feaf743bb5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:27.647933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.664781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d391-c3b9-455b-8e63-c942ce3d1967 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.684975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.685631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.685915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.686216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/regions/tempest-region-2056933070` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.686822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2056933070)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.688432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.719181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.719618 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3728/7529] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 31 05:48:27 2022] DELETE /identity/v3/regions/tempest-region-2056933070 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:27.735011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4202d6-b5a3-494c-8cc5-5daf9a498204 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.755981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30420b2-f33e-4692-836a-47f6d28897e5 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68c2b5ed38a1489592aca5b34001cac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a505bcdea1884b8e9fba58384fc6d0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.756844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30420b2-f33e-4692-836a-47f6d28897e5 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.757132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30420b2-f33e-4692-836a-47f6d28897e5 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.757405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30420b2-f33e-4692-836a-47f6d28897e5 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] PATH_INFO: `/v3/services/833b00512b6043e185dbb26e3877565f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.758009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30420b2-f33e-4692-836a-47f6d28897e5 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorizing `identity:delete_service(service_id=833b00512b6043e185dbb26e3877565f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.760821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30420b2-f33e-4692-836a-47f6d28897e5 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.797081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:27.798224 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3802/7530] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:27 2022] DELETE /identity/v3/services/833b00512b6043e185dbb26e3877565f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:27.921118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45bc4-0758-4d23-baec-5dcad98875e2 tempest-EndpointsNegativeTestJSON-1030865594 tempest-EndpointsNegativeTestJSON-1030865594-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:27.947480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:27.948136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:27.948424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:27.948713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] PATH_INFO: `/v3/users/40f781beb6bb4afea3bfa4cf40d94a62` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:27.951963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f781beb6bb4afea3bfa4cf40d94a62)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:27.955139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:27.984616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:28.020029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f781beb6bb4afea3bfa4cf40d94a62'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.029009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f781beb6bb4afea3bfa4cf40d94a62'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.029798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f781beb6bb4afea3bfa4cf40d94a62'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.030693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f781beb6bb4afea3bfa4cf40d94a62'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.040420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f781beb6bb4afea3bfa4cf40d94a62'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.066936 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3729/7531] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:27 2022] DELETE /identity/v3/users/40f781beb6bb4afea3bfa4cf40d94a62 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:28.072890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:28.073415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:28.073509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:28.098002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:28.099508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:28.162991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:28.191532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3803/7532] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:28.202137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:28.203604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:28.326977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2935-b8bd-400b-9416-d45b696dca04 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:28.334170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:28.335276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:28.335625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:28.335928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:28.350523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:28.351972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:28.364199 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3730/7533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:28.713557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:28.715462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:28.730058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a433-12d0-4ce4-a8c4-ea68335753da None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:28.738049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:28.738878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:28.739259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:28.739612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] PATH_INFO: `/v3/projects/cd2dba1118a94a39a8bdc5c7f3094562` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:28.740973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2dba1118a94a39a8bdc5c7f3094562)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:28.743162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:28.829637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2dba1118a94a39a8bdc5c7f3094562', 'request_id': 'req-989fb2df-6db0-4932-9300-f3a63d148125'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.838834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2dba1118a94a39a8bdc5c7f3094562', 'request_id': 'req-989fb2df-6db0-4932-9300-f3a63d148125'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.849361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2dba1118a94a39a8bdc5c7f3094562', 'request_id': 'req-989fb2df-6db0-4932-9300-f3a63d148125'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.883029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] The token cache is being invalidate because project cd2dba1118a94a39a8bdc5c7f3094562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:28.883249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.884476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:28.886394 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3804/7534] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:28 2022] DELETE /identity/v3/projects/cd2dba1118a94a39a8bdc5c7f3094562 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:28.890524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:28.902273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78878ac8-e6b6-43fa-9c88-d2b86e96fa0c service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:28.997505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:28.998922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:28.999314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:29.001311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] PATH_INFO: `/v3/users/68c2b5ed38a1489592aca5b34001cac5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:29.005222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c2b5ed38a1489592aca5b34001cac5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:29.010651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:29.085681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:29.104254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c2b5ed38a1489592aca5b34001cac5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:29.120730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c2b5ed38a1489592aca5b34001cac5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:29.122072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c2b5ed38a1489592aca5b34001cac5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:29.122893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c2b5ed38a1489592aca5b34001cac5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:29.135817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c2b5ed38a1489592aca5b34001cac5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:29.166092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3731/7535] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:28 2022] DELETE /identity/v3/users/68c2b5ed38a1489592aca5b34001cac5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:29.792524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:29.794117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:29.829802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb2df-6db0-4932-9300-f3a63d148125 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:29.845429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:29.846924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:29.917557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:29.918760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:29.919114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:29.919342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] PATH_INFO: `/v3/projects/a505bcdea1884b8e9fba58384fc6d0bb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:29.920486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a505bcdea1884b8e9fba58384fc6d0bb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:29.923229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:29.947499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335f9d-c39e-4b26-a470-a8e7002d45ec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:29.952626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:29.953254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:29.953534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:29.953807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:29.955688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:30.004686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a505bcdea1884b8e9fba58384fc6d0bb', 'request_id': 'req-ab1579e4-43d8-4199-b227-f6ee9921a3c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:30.024191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a505bcdea1884b8e9fba58384fc6d0bb', 'request_id': 'req-ab1579e4-43d8-4199-b227-f6ee9921a3c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:30.031389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a505bcdea1884b8e9fba58384fc6d0bb', 'request_id': 'req-ab1579e4-43d8-4199-b227-f6ee9921a3c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:30.036138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:30.053626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] The token cache is being invalidate because project a505bcdea1884b8e9fba58384fc6d0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:30.054667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:30.057005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ab1579e4-43d8-4199-b227-f6ee9921a3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:30.060808 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3805/7536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:29 2022] DELETE /identity/v3/projects/a505bcdea1884b8e9fba58384fc6d0bb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:30.066110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.066483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.066709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.075082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.079196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c433d-600a-483a-a19b-9619477c65f9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.093766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:30.095034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:30.105338 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3732/7537] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:30.183380 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3806/7538] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:30.193392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.194475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.194830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.222261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:30.224435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:30.235281 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3733/7539] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:30.239719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:30.257858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d0dfc-1065-40a9-bf8c-24017b211a75 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:30.273280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:30.274501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.275043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.275332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.276263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:30.276863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.281100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.302550 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3807/7540] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:30.307412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:30.319723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384bd9b-d09e-4bad-9264-73fe571cba2d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:30.324799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:30.325585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.325874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.326970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.326970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.329190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.363654 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3734/7541] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:30 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:30.367804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:30.380863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1018f3-1292-4d1f-bdc0-164c680de9c9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:30.456408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:30.457459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.458094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.458886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.459882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.462076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.494262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3808/7542] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:30 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:30.497639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:30.510876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3a90a-7a00-4a5c-85de-c4125681bda5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:30.522224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:30.541082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.543597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.544102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.547052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.551388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.578737 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3735/7543] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:30.583606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:30.596978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20653f53-108d-4f11-98d8-0ca4ac07d32e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:30.606367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333701-ccf6-433b-88d6-2ca567b3b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:30.617393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333701-ccf6-433b-88d6-2ca567b3b444 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.619159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333701-ccf6-433b-88d6-2ca567b3b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.619449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333701-ccf6-433b-88d6-2ca567b3b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.622216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333701-ccf6-433b-88d6-2ca567b3b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.622735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333701-ccf6-433b-88d6-2ca567b3b444 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.654541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3809/7544] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:30.659179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:30.676620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597929e8-9fd9-4658-a091-793fea59b2df admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:30.683189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:30.684415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.684723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.685004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] PATH_INFO: `/v3/projects/c866aa8408994a72acb3a2bb9eb343e6/users/963cde2c116841a19a579bfd3dba15d9/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.696054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:30.705423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c866aa8408994a72acb3a2bb9eb343e6, user_id=963cde2c116841a19a579bfd3dba15d9, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:30.709200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:30.739872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3736/7545] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:30 2022] PUT /identity/v3/projects/c866aa8408994a72acb3a2bb9eb343e6/users/963cde2c116841a19a579bfd3dba15d9/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:30.751930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:30.752217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:30.752489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:30.793732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] MFA Rules not processed for user `963cde2c116841a19a579bfd3dba15d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:30.795225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:30.938938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:30.993539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3810/7546] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:30.997414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.080194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0980c-1d7b-4881-a78a-59ee6a4a9ddc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.085425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.086075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.086474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.086753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.088415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.091470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.138172 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3737/7547] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:30 2022] POST /identity/v3/projects => generated 395 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:31.142689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.157985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9406c-c1b5-44f7-838f-c27dae16c2bd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.250672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.251221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.251502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.251782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.252441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.254408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.284358 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3811/7548] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:31 2022] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:31.288745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.302841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef22408-4903-4a15-8b50-bdc741546082 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.309499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.313849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.314671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.314671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.316102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.317604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.334185 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3738/7549] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:31.338189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.354074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e316e-e816-4ec6-b283-d243125f14de admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.360879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.361659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.362024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.362425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] PATH_INFO: `/v3/projects/f67a9bebfacf44f9a03dbe7e5d271e00/users/4524ff8c8faa488291ea52c2cd545e6e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.386054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67a9bebfacf44f9a03dbe7e5d271e00, user_id=4524ff8c8faa488291ea52c2cd545e6e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.390618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.429428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3812/7550] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:31 2022] PUT /identity/v3/projects/f67a9bebfacf44f9a03dbe7e5d271e00/users/4524ff8c8faa488291ea52c2cd545e6e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:31.433592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.458410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ed527-6b69-4af6-a674-9c2eda84e550 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.544606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c7e1a-b744-4beb-9da4-56d6f7cfab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.545371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c7e1a-b744-4beb-9da4-56d6f7cfab80 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.546462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c7e1a-b744-4beb-9da4-56d6f7cfab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.547413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c7e1a-b744-4beb-9da4-56d6f7cfab80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.548912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c7e1a-b744-4beb-9da4-56d6f7cfab80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.551403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c7e1a-b744-4beb-9da4-56d6f7cfab80 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.567907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3739/7551] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:31.571991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.588327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b938841-def0-4760-9085-643ac1c8ae8c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.596492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.597474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.597803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.598088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] PATH_INFO: `/v3/projects/f67a9bebfacf44f9a03dbe7e5d271e00/users/4524ff8c8faa488291ea52c2cd545e6e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.601071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67a9bebfacf44f9a03dbe7e5d271e00, user_id=4524ff8c8faa488291ea52c2cd545e6e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.603242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.631271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3813/7552] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:31 2022] PUT /identity/v3/projects/f67a9bebfacf44f9a03dbe7e5d271e00/users/4524ff8c8faa488291ea52c2cd545e6e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:31.631742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.632034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.632314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.672443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] MFA Rules not processed for user `4524ff8c8faa488291ea52c2cd545e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:31.673680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:31.766161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:31.820380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3740/7553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:31.825660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.927692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561b693-6c23-4e2b-b31c-f1e56640c134 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.934886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963cde2c116841a19a579bfd3dba15d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c866aa8408994a72acb3a2bb9eb343e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.935689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.935974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.936255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.937166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 31 05:48:31.945386 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 31 05:48:31.946347 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:31.946825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3814/7554] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:31 2022] POST /identity/v3/projects => generated 136 bytes in 122 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:31.952621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:31.962283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8648fc-ec85-4f47-814b-03f1eefe5713 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:31.972099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4524ff8c8faa488291ea52c2cd545e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:31.973148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:31.973532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:31.973917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:31.974907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:31.976896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invalid input for field 'name': '' is too short Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: On instance['name']: Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: On instance['name']: Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: '' Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise error Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application '' Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.983913 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:48:31.985352 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application '' Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:31.986357 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3741/7555] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:31 2022] POST /identity/v3/projects => generated 283 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:48:31.990388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.004316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e3d8-3b1f-46ac-9ac4-2fa6ea9c85a6 tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.010183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4524ff8c8faa488291ea52c2cd545e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.010554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.010851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.011136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.014548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.016269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: On instance['name']: Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: On instance['name']: Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise error Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:48:32.024427 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:32.025550 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application On instance['name']: Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 05:48:32.026604 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.031321 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3815/7556] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:31 2022] POST /identity/v3/projects => generated 412 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:48:32.031500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.047543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f17bb-52ed-4f2a-a022-bdf61e406e4f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.056624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4524ff8c8faa488291ea52c2cd545e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.057289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.057572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.057850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] PATH_INFO: `/v3/projects/b56f42f634f246738076e0f6daa13e60` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.068032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b56f42f634f246738076e0f6daa13e60)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.070520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-e2003170-76ce-469c-a9ce-e4c920700054 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Could not find project: b56f42f634f246738076e0f6daa13e60.: keystone.exception.ProjectNotFound: Could not find project: b56f42f634f246738076e0f6daa13e60. Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 31 05:48:32.088079 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b56f42f634f246738076e0f6daa13e60. Oct 31 05:48:32.089713 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:32.097191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.108094 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3742/7557] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:32 2022] DELETE /identity/v3/projects/b56f42f634f246738076e0f6daa13e60 => generated 113 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:32.109783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbb09e-22c2-4b96-9cc9-020693460b56 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.116177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963cde2c116841a19a579bfd3dba15d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c866aa8408994a72acb3a2bb9eb343e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.117141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.117437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.117717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.118484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.125324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.126872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.127449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 31 05:48:32.144705 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._list_projects() Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 31 05:48:32.145684 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.154586 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3816/7558] 10.222.0.23 () {58 vars in 1131 bytes} [Mon Oct 31 05:48:32 2022] GET /identity/v3/projects => generated 135 bytes in 58 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:32.156116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.169925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] MFA Rules not processed for user `db14c5e21a6e4120b57ae91ad77cb834`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:32.171222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:32.175082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae0039-ac0b-4fe9-a86b-95dda775880b tempest-ProjectsNegativeStaticTestJSON-1167405678 tempest-ProjectsNegativeStaticTestJSON-1167405678-project] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.181471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4524ff8c8faa488291ea52c2cd545e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.182826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.183351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.183904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.184986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.187635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:32.252474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3817/7559] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:32 2022] POST /identity/v3/projects => generated 359 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:32.255610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.301942 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3743/7560] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:32.305904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:32.368541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaaa9b-4ae7-4336-b694-eda4d465eb9f tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.374565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4524ff8c8faa488291ea52c2cd545e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.375141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.375660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.376745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.376919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.379868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:32.410024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.sql.core [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1074601496' for key 'project.ixu_project_name_domain_id'") Oct 31 05:48:32.410024 n-d-862355-5 devstack@keystone.service[82000]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 05:48:32.410024 n-d-862355-5 devstack@keystone.service[82000]: [parameters: {'id': 'bd72c8d0460b4793bc538d806bd79fb7', 'name': 'tempest-project-dup-1074601496', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 05:48:32.410024 n-d-862355-5 devstack@keystone.service[82000]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82000) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1074601496, project id bd72c8d0460b4793bc538d806bd79fb7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1074601496, project id bd72c8d0460b4793bc538d806bd79fb7. Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 05:48:32.422239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1074601496' for key 'project.ixu_project_name_domain_id'") Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 05:48:32.423145 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application yield resource Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application next(self.gen) Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise self.value Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 05:48:32.424455 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application session.commit() Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.session.flush() Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application compat.raise_( Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 05:48:32.425706 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 05:48:32.426928 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application conn.query(q) Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application result.read() Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 05:48:32.428077 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1074601496' for key 'project.ixu_project_name_domain_id'") Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [parameters: {'id': 'bd72c8d0460b4793bc538d806bd79fb7', 'name': 'tempest-project-dup-1074601496', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.429159 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1074601496 at domain ID default. Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:32.430239 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1074601496, project id bd72c8d0460b4793bc538d806bd79fb7. Oct 31 05:48:32.431412 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:32.434584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3818/7561] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:32 2022] POST /identity/v3/projects => generated 285 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 05:48:32.437210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.451774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ea25-2a8c-4129-a830-8f094ad7c95f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.456908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4524ff8c8faa488291ea52c2cd545e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.457584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.458175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.458474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] PATH_INFO: `/v3/projects/4dd181c6d80341e0b6f1913db535f6ba` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.459653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4dd181c6d80341e0b6f1913db535f6ba)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.461857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:32.556212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd181c6d80341e0b6f1913db535f6ba', 'request_id': 'req-20d4a13f-0db4-40c1-9a40-28d8646ccf35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:32.565023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd181c6d80341e0b6f1913db535f6ba', 'request_id': 'req-20d4a13f-0db4-40c1-9a40-28d8646ccf35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:32.578941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd181c6d80341e0b6f1913db535f6ba', 'request_id': 'req-20d4a13f-0db4-40c1-9a40-28d8646ccf35'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:32.607276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] The token cache is being invalidate because project 4dd181c6d80341e0b6f1913db535f6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:32.607664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:32.609924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-20d4a13f-0db4-40c1-9a40-28d8646ccf35 tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:32.614109 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3744/7562] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:32 2022] DELETE /identity/v3/projects/4dd181c6d80341e0b6f1913db535f6ba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:32.619529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:32.623022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:32.813515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26cbcb-994b-4a57-9133-6572daf958ab tempest-ProjectsNegativeStaticTestJSON-260384400 tempest-ProjectsNegativeStaticTestJSON-260384400-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:32.928213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:32.929831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:32.930292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:32.930591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] PATH_INFO: `/v3/users/963cde2c116841a19a579bfd3dba15d9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:32.932018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963cde2c116841a19a579bfd3dba15d9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:32.935212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:33.025960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963cde2c116841a19a579bfd3dba15d9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:33.041143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:33.053102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963cde2c116841a19a579bfd3dba15d9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:33.057648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963cde2c116841a19a579bfd3dba15d9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:33.057648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963cde2c116841a19a579bfd3dba15d9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:33.077303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963cde2c116841a19a579bfd3dba15d9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:33.110800 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3819/7563] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:32 2022] DELETE /identity/v3/users/963cde2c116841a19a579bfd3dba15d9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:33.116917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:33.116917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:33.117573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:33.164122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:33.164828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:33.265964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:33.304557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3745/7564] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:33.355026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:33.359187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:33.500071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de91bf1-326e-4a3f-be73-dd5ba64e1267 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:33.511477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:33.512215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:33.512480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:33.512753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:33.534399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:33.537262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:33.552373 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3820/7565] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:34.912463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:34.919803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:34.948802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbe042-292f-4258-a07e-371966b5e9a9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:34.965873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:34.968434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:34.968725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:34.971620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] PATH_INFO: `/v3/projects/c866aa8408994a72acb3a2bb9eb343e6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:34.975467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c866aa8408994a72acb3a2bb9eb343e6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:34.977788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:35.211758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c866aa8408994a72acb3a2bb9eb343e6', 'request_id': 'req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.260494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c866aa8408994a72acb3a2bb9eb343e6', 'request_id': 'req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.298409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c866aa8408994a72acb3a2bb9eb343e6', 'request_id': 'req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.348392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] The token cache is being invalidate because project c866aa8408994a72acb3a2bb9eb343e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:35.349409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.350835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.376582 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3746/7566] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:34 2022] DELETE /identity/v3/projects/c866aa8408994a72acb3a2bb9eb343e6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:35.377946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:35.396039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8344d-1d66-48c7-850e-6580e3c58b9d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:35.636277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:35.637429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:35.637786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:35.638181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] PATH_INFO: `/v3/users/4524ff8c8faa488291ea52c2cd545e6e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:35.639812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4524ff8c8faa488291ea52c2cd545e6e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:35.645331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:35.735803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4524ff8c8faa488291ea52c2cd545e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.770980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4524ff8c8faa488291ea52c2cd545e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.771799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4524ff8c8faa488291ea52c2cd545e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.772435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4524ff8c8faa488291ea52c2cd545e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.781441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-14633e93-b2b6-477f-a092-e66445e843b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4524ff8c8faa488291ea52c2cd545e6e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:35.797332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:35.808057 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3821/7567] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:35 2022] DELETE /identity/v3/users/4524ff8c8faa488291ea52c2cd545e6e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:37.140228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:37.141758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:37.161377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd9c5f-f681-49a1-b694-3bbf7bf1acd3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:37.300765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:37.301490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:37.301779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:37.302070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] PATH_INFO: `/v3/projects/f67a9bebfacf44f9a03dbe7e5d271e00` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:37.303256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67a9bebfacf44f9a03dbe7e5d271e00)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:37.306133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:37.391330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'request_id': 'req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:37.418623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'request_id': 'req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:37.444565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67a9bebfacf44f9a03dbe7e5d271e00', 'request_id': 'req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:37.466557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:37.486635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] The token cache is being invalidate because project f67a9bebfacf44f9a03dbe7e5d271e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:37.487949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:37.490629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eb1a6078-f030-4db6-96e2-ab6b9cb33e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:37.494002 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3747/7568] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:37 2022] DELETE /identity/v3/projects/f67a9bebfacf44f9a03dbe7e5d271e00 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:37.500633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:37.501173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:37.501356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:37.555369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:37.560790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:37.718949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3822/7569] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:37.726957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:37.727245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:37.727527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:37.774416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:37.776326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:37.797689 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3748/7570] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:37.802201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:37.813991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7fe93-57a6-4b88-8412-eec2d2834a45 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:37.823013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:37.823741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:37.824580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:37.824580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:37.825817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:37.826129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:37.829650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:37.847664 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3823/7571] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:37.851707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:37.876612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916eacd-2da0-4cc8-a933-21d507632bfd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:37.892769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:37.893759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:37.894115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:37.895827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:37.896566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:37.899957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:37.972798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3749/7572] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:37 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:37.976423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:37.989453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8629f2-4c9d-4dd7-81aa-5357d661f961 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.064794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.065456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.065876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.066177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.067268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.069628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.107966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.108391 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3824/7573] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:37 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:38.118869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af836f-4fbb-4634-a8b3-1aeb5ee8cc30 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.124673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.125311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.125598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.125925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.126639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.128323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.141120 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3750/7574] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:38.145643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.172377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9d47-4d87-492d-992a-d0aa60202af9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.180558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719351de-9c94-4998-ae77-786a6bacc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.181243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719351de-9c94-4998-ae77-786a6bacc608 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.181536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719351de-9c94-4998-ae77-786a6bacc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.181942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719351de-9c94-4998-ae77-786a6bacc608 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.182973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719351de-9c94-4998-ae77-786a6bacc608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.184685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719351de-9c94-4998-ae77-786a6bacc608 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.198637 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3825/7575] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:38.203429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.216935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ea46-d4aa-4e5f-9591-a68298e3e046 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.223082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.224139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.224386 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.224769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] PATH_INFO: `/v3/projects/e785ad66947244c0b8c0284c71c2abbe/users/c1c9e82efcc34f17b9a49c3cbb1f6268/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.253482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e785ad66947244c0b8c0284c71c2abbe, user_id=c1c9e82efcc34f17b9a49c3cbb1f6268, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.257051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.289946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3751/7576] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:38 2022] PUT /identity/v3/projects/e785ad66947244c0b8c0284c71c2abbe/users/c1c9e82efcc34f17b9a49c3cbb1f6268/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:38.302530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.303015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.303296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.340453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] MFA Rules not processed for user `c1c9e82efcc34f17b9a49c3cbb1f6268`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:38.342796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:38.421478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:38.440241 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3826/7577] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:38.441320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.515669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc847ea-2a28-4d6d-b55d-b3440f51821e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.522307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.522940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.523511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.523800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.524448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.526424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.562768 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3752/7578] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:38 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:38.564004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.575817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27592427-8ae1-42f6-92ab-293a03585a79 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.640772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.641466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.642226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.642226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.643065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.645279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.675665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3827/7579] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:38 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:38.677244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.689390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14ba0b-c73c-46c9-9b07-009ca55c80bc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.694693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.695329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.695615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.695899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.696558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.698201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.710365 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3753/7580] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:38.715484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.727466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b6e9-9932-4683-89f5-53aad2a16033 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.733979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.734853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.735134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.735409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] PATH_INFO: `/v3/projects/76b156a5cee345ef9299275d5b7f5a16/users/80989a6ae38a48cfbd1d56942bdd6f8c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.757178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b156a5cee345ef9299275d5b7f5a16, user_id=80989a6ae38a48cfbd1d56942bdd6f8c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.761842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.780460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3828/7581] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:38 2022] PUT /identity/v3/projects/76b156a5cee345ef9299275d5b7f5a16/users/80989a6ae38a48cfbd1d56942bdd6f8c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:38.784202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.796194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c515520-fc70-4130-b6d2-9b6461e49dc6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.871964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcd9b9-2d3f-4e39-9e31-59bf2817ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.872655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcd9b9-2d3f-4e39-9e31-59bf2817ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.872919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcd9b9-2d3f-4e39-9e31-59bf2817ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.873199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcd9b9-2d3f-4e39-9e31-59bf2817ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.873868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcd9b9-2d3f-4e39-9e31-59bf2817ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.876179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcd9b9-2d3f-4e39-9e31-59bf2817ac08 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.901918 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3754/7582] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:38.903740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:38.915782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bf5d-3966-49c6-91c0-b54cb95f3337 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:38.921369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:38.922255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.923191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.924049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] PATH_INFO: `/v3/projects/76b156a5cee345ef9299275d5b7f5a16/users/80989a6ae38a48cfbd1d56942bdd6f8c/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.926351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b156a5cee345ef9299275d5b7f5a16, user_id=80989a6ae38a48cfbd1d56942bdd6f8c, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:38.930822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:38.959866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:38.960288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:38.960612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:38.963438 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3829/7583] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:38 2022] PUT /identity/v3/projects/76b156a5cee345ef9299275d5b7f5a16/users/80989a6ae38a48cfbd1d56942bdd6f8c/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:38.972438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:39.002572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] MFA Rules not processed for user `80989a6ae38a48cfbd1d56942bdd6f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:39.003913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:39.114125 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3755/7584] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:39.119388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.132144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23d43d-8d9e-47a6-b4ca-d3a2a67a6036 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.138770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.139393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.139682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.139964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.140649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.142094 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:48:39.142094 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:48:39.142094 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:48:39.143384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.170126 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3830/7585] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:48:39 2022] POST /identity/v3/regions => generated 223 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:39.171623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.183320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c470-f03c-44e8-a1d9-e583e78c0c6a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.204378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.205280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.205762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.206217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.207081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.208296 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:48:39.208296 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:48:39.208296 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:48:39.209537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.240129 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3756/7586] 10.222.0.23 () {60 vars in 1149 bytes} [Mon Oct 31 05:48:39 2022] POST /identity/v3/regions => generated 224 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:39.241238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.255171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e455c-302f-47a6-8b0d-e80961cacf7e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.284511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.287629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.289706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.290195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/bc39dc02-f5ec-449b-97bb-a2c440209945` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.291142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:create_region(region_id=bc39dc02-f5ec-449b-97bb-a2c440209945)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.293645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.319791 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3831/7587] 10.222.0.23 () {60 vars in 1259 bytes} [Mon Oct 31 05:48:39 2022] PUT /identity/v3/regions/bc39dc02-f5ec-449b-97bb-a2c440209945 => generated 232 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:39.323965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.336032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083989-4697-4b46-b9a4-2e821774f7ef tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.354644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.356122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.356492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.356866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/bc39dc02-f5ec-449b-97bb-a2c440209945` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.357615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=bc39dc02-f5ec-449b-97bb-a2c440209945)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.359379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.397272 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3757/7588] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 31 05:48:39 2022] DELETE /identity/v3/regions/bc39dc02-f5ec-449b-97bb-a2c440209945 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:39.405193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.422564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd674f-7edf-458a-abfc-0f76322f4192 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.441997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.443233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.443541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.443824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.444692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.446126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.473760 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3832/7589] 10.222.0.23 () {60 vars in 1150 bytes} [Mon Oct 31 05:48:39 2022] POST /identity/v3/regions => generated 253 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:39.476054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.488960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751b385-c0c5-4825-9f35-0e63d555446f tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.512745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.513863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.514294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.514650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.515501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:update_region(region_id=a0cd0f1782ae4d43aab1c436b8f34bfd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.516679 n-d-862355-5 devstack@keystone.service[81999]: WARNING py.warnings [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:48:39.516679 n-d-862355-5 devstack@keystone.service[81999]: warnings.warn(msg) Oct 31 05:48:39.516679 n-d-862355-5 devstack@keystone.service[81999]: Oct 31 05:48:39.518646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.584163 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3758/7590] 10.222.0.23 () {60 vars in 1250 bytes} [Mon Oct 31 05:48:39 2022] PATCH /identity/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd => generated 253 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:39.587886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.602950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0a8c2-43eb-45a4-9f6a-5ceb7ec419b7 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.632263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.633154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.633865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.634766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.635656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:get_region(region_id=a0cd0f1782ae4d43aab1c436b8f34bfd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.637441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.645790 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3833/7591] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:48:39 2022] GET /identity/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd => generated 253 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:39.649833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.663488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6629-aa0e-460c-a3fc-36018ec82a93 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.669654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.670525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.670879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.671266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.671969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a0cd0f1782ae4d43aab1c436b8f34bfd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.673822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.702867 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3759/7592] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:39 2022] DELETE /identity/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:39.706840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.719822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36eef1-0eea-468c-a45a-ffae77618cc5 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.740794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.741600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.742193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.745282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.745282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.745282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.747738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:39.757975 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3834/7593] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 31 05:48:39 2022] GET /identity/v3/regions => generated 669 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:39.759531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.772693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c40f3-496f-4d8c-bfa3-644996ace0c6 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.778209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.778597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.778887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.779168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.779786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a0cd0f1782ae4d43aab1c436b8f34bfd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.781415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Could not find region: a0cd0f1782ae4d43aab1c436b8f34bfd.: keystone.exception.RegionNotFound: Could not find region: a0cd0f1782ae4d43aab1c436b8f34bfd. Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a0cd0f1782ae4d43aab1c436b8f34bfd. Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:39.798990 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a0cd0f1782ae4d43aab1c436b8f34bfd. Oct 31 05:48:39.800715 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:39.805305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.810286 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3760/7594] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:39 2022] DELETE /identity/v3/regions/a0cd0f1782ae4d43aab1c436b8f34bfd => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:39.817837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2382-2627-4243-b94e-e0b88ece0b76 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.823169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.824918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.824918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.824918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.825247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.826249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.835451 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3835/7595] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 31 05:48:39 2022] GET /identity/v3/regions => generated 669 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:39.841238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.854792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2061-013e-450c-8ff1-7a46bb3b353b tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.862189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.862375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.862643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.862915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.863819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.865318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.893694 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3761/7596] 10.222.0.23 () {60 vars in 1150 bytes} [Mon Oct 31 05:48:39 2022] POST /identity/v3/regions => generated 253 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:39.897654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.912770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efd911-5ee0-43bc-a4f2-9dc58fe6c88e tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.931471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.932105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.932633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.933153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.933999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Adding query filter params (parent_region_id=5122bfc7e8204d12a0ed04803453d8b2) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:39.934584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.936033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.946048 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3836/7597] 10.222.0.23 () {58 vars in 1227 bytes} [Mon Oct 31 05:48:39 2022] GET /identity/v3/regions?parent_region_id=5122bfc7e8204d12a0ed04803453d8b2 => generated 399 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:39.947946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:39.961776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e616-0677-4b49-9985-a3c7d9b878a2 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:39.967483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:39.968094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:39.968390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:39.968666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/53e8cd6057f541c68f8e90843f95bc46` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:39.969363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=53e8cd6057f541c68f8e90843f95bc46)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:39.972300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:39.978775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:40.006511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3762/7598] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:39 2022] DELETE /identity/v3/regions/53e8cd6057f541c68f8e90843f95bc46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:40.013117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:40.029001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9c227-d055-47bc-a3b7-6cff682f1cba tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:40.050401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:40.051984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:40.052533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:40.053070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/4d571f3ee5f8434ab1c3310331a267d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:40.053909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4d571f3ee5f8434ab1c3310331a267d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:40.056180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:40.081882 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3837/7599] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:40 2022] DELETE /identity/v3/regions/4d571f3ee5f8434ab1c3310331a267d1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:40.086753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:40.099138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232345-ae98-4ae9-91f8-1027de5f84e9 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:40.117552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91d2bf-e2f9-4a91-8c9e-018de63a1c94 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80989a6ae38a48cfbd1d56942bdd6f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b156a5cee345ef9299275d5b7f5a16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:40.118401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d2bf-e2f9-4a91-8c9e-018de63a1c94 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:40.118693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d2bf-e2f9-4a91-8c9e-018de63a1c94 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:40.119234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91d2bf-e2f9-4a91-8c9e-018de63a1c94 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] PATH_INFO: `/v3/regions/5122bfc7e8204d12a0ed04803453d8b2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:40.119569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91d2bf-e2f9-4a91-8c9e-018de63a1c94 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5122bfc7e8204d12a0ed04803453d8b2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:40.121784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91d2bf-e2f9-4a91-8c9e-018de63a1c94 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:40.146100 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3763/7600] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 31 05:48:40 2022] DELETE /identity/v3/regions/5122bfc7e8204d12a0ed04803453d8b2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:40.150882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:40.258084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06badbc-bbf4-4b66-9555-2fafbd19c895 tempest-RegionsTestJSON-1906095008 tempest-RegionsTestJSON-1906095008-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:40.284137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:40.286532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:40.286532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:40.286532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] PATH_INFO: `/v3/users/c1c9e82efcc34f17b9a49c3cbb1f6268` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:40.286867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c9e82efcc34f17b9a49c3cbb1f6268)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:40.289155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:40.359420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c9e82efcc34f17b9a49c3cbb1f6268'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:40.374654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c9e82efcc34f17b9a49c3cbb1f6268'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:40.376190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c9e82efcc34f17b9a49c3cbb1f6268'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:40.376991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c9e82efcc34f17b9a49c3cbb1f6268'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:40.386461 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c9e82efcc34f17b9a49c3cbb1f6268'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:40.402928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3838/7601] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:40 2022] DELETE /identity/v3/users/c1c9e82efcc34f17b9a49c3cbb1f6268 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:40.407782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:40.409891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:40.409891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:40.435206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:40.436717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:40.515842 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3764/7602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:40.527076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:40.529782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:40.536517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:40.613660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a92e2b-daff-489b-ace8-e8724b61d48b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:40.618583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:40.619355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:40.619791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:40.620295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:40.638625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:40.641758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:40.662453 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3839/7603] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:41.107716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:41.109346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:41.124791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da0729-18a1-4664-ace3-069a1f0fa538 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:41.131297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:41.131946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:41.132236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:41.132521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] PATH_INFO: `/v3/projects/e785ad66947244c0b8c0284c71c2abbe` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:41.134793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e785ad66947244c0b8c0284c71c2abbe)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:41.138784 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:41.197979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e785ad66947244c0b8c0284c71c2abbe', 'request_id': 'req-d203899c-85c5-44c3-b8bb-d19edc85e6f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.205866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e785ad66947244c0b8c0284c71c2abbe', 'request_id': 'req-d203899c-85c5-44c3-b8bb-d19edc85e6f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.214289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e785ad66947244c0b8c0284c71c2abbe', 'request_id': 'req-d203899c-85c5-44c3-b8bb-d19edc85e6f7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.226669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] The token cache is being invalidate because project e785ad66947244c0b8c0284c71c2abbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:41.227102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.227775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.229513 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3765/7604] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:41 2022] DELETE /identity/v3/projects/e785ad66947244c0b8c0284c71c2abbe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:41.234023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:41.245963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecb086-66a3-44d4-9026-871e6edb350f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:41.321602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:41.322277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:41.322562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:41.322840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] PATH_INFO: `/v3/users/80989a6ae38a48cfbd1d56942bdd6f8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:41.323989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80989a6ae38a48cfbd1d56942bdd6f8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:41.326488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:41.383535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80989a6ae38a48cfbd1d56942bdd6f8c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.398202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80989a6ae38a48cfbd1d56942bdd6f8c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.398957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80989a6ae38a48cfbd1d56942bdd6f8c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.399741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80989a6ae38a48cfbd1d56942bdd6f8c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.409469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fc7c9c0d-7efe-4f7c-8b62-686eed472882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80989a6ae38a48cfbd1d56942bdd6f8c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:41.429989 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3840/7605] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:41 2022] DELETE /identity/v3/users/80989a6ae38a48cfbd1d56942bdd6f8c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:42.385290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:42.387694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:42.410363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203899c-85c5-44c3-b8bb-d19edc85e6f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:42.477296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:42.499145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:42.500116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:42.500565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:42.501006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] PATH_INFO: `/v3/projects/76b156a5cee345ef9299275d5b7f5a16` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:42.503629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b156a5cee345ef9299275d5b7f5a16)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:42.507231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:42.606824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b156a5cee345ef9299275d5b7f5a16', 'request_id': 'req-57d32ac3-3e47-4e2c-b371-54e961d632cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:42.616051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b156a5cee345ef9299275d5b7f5a16', 'request_id': 'req-57d32ac3-3e47-4e2c-b371-54e961d632cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:42.628156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b156a5cee345ef9299275d5b7f5a16', 'request_id': 'req-57d32ac3-3e47-4e2c-b371-54e961d632cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:42.650678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] The token cache is being invalidate because project 76b156a5cee345ef9299275d5b7f5a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:42.651067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:42.653338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-57d32ac3-3e47-4e2c-b371-54e961d632cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:42.659595 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3766/7606] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:42 2022] DELETE /identity/v3/projects/76b156a5cee345ef9299275d5b7f5a16 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:42.661225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:42.661697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:42.661781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:42.701974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:42.701974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:42.720696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:42.796157 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3841/7607] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:42.803953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:42.804316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:42.804663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:42.853327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:42.853327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:42.865466 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3767/7608] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:42.870232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:42.881941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224f84-27f7-4992-911d-c59ce459df8c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:42.895555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:42.897442 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:42.897827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:42.898269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:42.899230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:42.899637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:42.903617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:42.932150 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3842/7609] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:42.936926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:42.951787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79669da-189a-42f9-83b2-40877f5b8621 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:42.957196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:42.958121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:42.958442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:42.958720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:42.959364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:42.962033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:42.997090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3768/7610] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:42 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:43.001360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.014326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33f63-0039-46dd-9cf6-51a1ba4ba8d0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.127931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.129245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.129525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.129804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.130652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.133544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.170664 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3843/7611] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:43 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:43.171419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.185812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316308e0-c3d4-4cf0-8c9d-561a9131bd8f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.193876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.194456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.194749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.195019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.196718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.199646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.214118 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3769/7612] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:43.219692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.244986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091dac9-e056-479d-94fb-2aa16bb87eef admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.255297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26d020-6d18-4904-8f47-a73818265b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.256124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d020-6d18-4904-8f47-a73818265b98 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.258956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d020-6d18-4904-8f47-a73818265b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.259790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26d020-6d18-4904-8f47-a73818265b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.261095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26d020-6d18-4904-8f47-a73818265b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.264794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26d020-6d18-4904-8f47-a73818265b98 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.291124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3844/7613] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:43.292014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.306716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5079-73a1-476c-93c6-9cc0afce0a1f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.335722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.336901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.337392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.337906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] PATH_INFO: `/v3/projects/cb1c76858828469f9082a9990cf33d96/users/e80f8fa8ca6c40ca82dfe398c850bfa0/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.385998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1c76858828469f9082a9990cf33d96, user_id=e80f8fa8ca6c40ca82dfe398c850bfa0, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.391289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.413203 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3770/7614] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:43 2022] PUT /identity/v3/projects/cb1c76858828469f9082a9990cf33d96/users/e80f8fa8ca6c40ca82dfe398c850bfa0/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:43.424687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.424987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.425244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.467269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] MFA Rules not processed for user `e80f8fa8ca6c40ca82dfe398c850bfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:43.468666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:43.579056 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3845/7615] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:43.583803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.690222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcff47-b0b5-4f61-bc76-cfccf41e6d41 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.696275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.696922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.697209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.697489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.698544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.702238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.721864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:43.745209 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3771/7616] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:43 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:43.751285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.775284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946845a-2299-40f0-8341-d9b7a4ddb6f0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.788101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:43.861628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.863292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.863511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.863794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.864812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.867195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.894999 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3846/7617] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:43 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:43.898922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.912390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399a08f-cb2c-417b-b486-8b65609ee9e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.918062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.919607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.919889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.920166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.920946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.922648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:43.936194 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3772/7618] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:43.940681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:43.952228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135d29-a1d1-4857-a275-ae9742cdb31e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:43.958179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:43.958894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:43.959172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:43.959444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] PATH_INFO: `/v3/projects/be0a359c536041d0b90fdb0a6c60f030/users/8374d451a82d4f1ab28b9192f813a1c9/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:43.977934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0a359c536041d0b90fdb0a6c60f030, user_id=8374d451a82d4f1ab28b9192f813a1c9, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:43.981973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.001156 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3847/7619] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:43 2022] PUT /identity/v3/projects/be0a359c536041d0b90fdb0a6c60f030/users/8374d451a82d4f1ab28b9192f813a1c9/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:44.004888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.017454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb14eb-8061-4cf2-9062-d67361cfb0ee admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.092562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48879e-3acb-4b37-91cd-320b3a4a5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.093562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48879e-3acb-4b37-91cd-320b3a4a5637 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.096370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48879e-3acb-4b37-91cd-320b3a4a5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.096820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48879e-3acb-4b37-91cd-320b3a4a5637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.097910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48879e-3acb-4b37-91cd-320b3a4a5637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.099091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48879e-3acb-4b37-91cd-320b3a4a5637 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.117117 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3773/7620] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:44.118354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.131355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d261d-d617-4bf7-adeb-fbcf26119555 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.137187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.138021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.138334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.138611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] PATH_INFO: `/v3/projects/be0a359c536041d0b90fdb0a6c60f030/users/8374d451a82d4f1ab28b9192f813a1c9/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.140796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0a359c536041d0b90fdb0a6c60f030, user_id=8374d451a82d4f1ab28b9192f813a1c9, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.143760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.159391 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3848/7621] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:44 2022] PUT /identity/v3/projects/be0a359c536041d0b90fdb0a6c60f030/users/8374d451a82d4f1ab28b9192f813a1c9/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:44.249255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.249600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.249819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.280953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] MFA Rules not processed for user `8374d451a82d4f1ab28b9192f813a1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:44.282247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:44.367639 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3774/7622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:44.372229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.383595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe039b-27e2-4c98-a3c3-7f0fc2855a9d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.389408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.390000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.390415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.390818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.391542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.393556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.424530 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3849/7623] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:44 2022] POST /identity/v3/projects => generated 328 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:44.428606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.438966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1321dba-b1eb-4828-a679-1f629d0cd358 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.510262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.512389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.512795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.513151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.513914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.516073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.530927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:44.543919 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3775/7624] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:44 2022] POST /identity/v3/users => generated 416 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:44.547709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.558180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3e29a-5a4c-4a7b-a2d4-c1863ddc1558 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.563754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.564364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.564650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.565445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.565604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.567253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.588472 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3850/7625] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:44 2022] POST /identity/v3/roles => generated 244 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:44.593483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.625422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121ca81-d0dd-4807-ba30-716647b99832 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.633839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.634937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.635379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.635815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.638493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.641256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.667046 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3776/7626] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:44 2022] POST /identity/v3/roles => generated 246 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:44.671056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.687624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fd371-0b18-499e-bbd3-b70c62103486 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.703142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.704178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.704619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.704965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/a9404acf44154e19bfe7dcea54415ec1/users/8b3e5ebb5af546eca54082f7262a6a6c/roles/60d776058bd8459b8750713379f9d763` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.738107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9404acf44154e19bfe7dcea54415ec1, user_id=8b3e5ebb5af546eca54082f7262a6a6c, role_id=60d776058bd8459b8750713379f9d763)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.747329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.769746 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3851/7627] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:44 2022] PUT /identity/v3/projects/a9404acf44154e19bfe7dcea54415ec1/users/8b3e5ebb5af546eca54082f7262a6a6c/roles/60d776058bd8459b8750713379f9d763 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:44.774503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.787697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f1e1-a27f-42fe-a5da-68b21ddd8a4a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:44.901014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ca043-c593-4afd-93be-c1191df9b837 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:44.902236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ca043-c593-4afd-93be-c1191df9b837 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:44.902643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ca043-c593-4afd-93be-c1191df9b837 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:44.903027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ca043-c593-4afd-93be-c1191df9b837 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/a9404acf44154e19bfe7dcea54415ec1/users/8b3e5ebb5af546eca54082f7262a6a6c/roles/5fca6c4ce85c4108a5fcb2c01e325d40` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:44.906629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ca043-c593-4afd-93be-c1191df9b837 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9404acf44154e19bfe7dcea54415ec1, user_id=8b3e5ebb5af546eca54082f7262a6a6c, role_id=5fca6c4ce85c4108a5fcb2c01e325d40)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:44.919611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ca043-c593-4afd-93be-c1191df9b837 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:44.966205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3777/7628] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:44 2022] PUT /identity/v3/projects/a9404acf44154e19bfe7dcea54415ec1/users/8b3e5ebb5af546eca54082f7262a6a6c/roles/5fca6c4ce85c4108a5fcb2c01e325d40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:44.975693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:44.992012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87598cf-cfdf-4cee-957a-64c1cde3cc3b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.065830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12b552-1a98-45b2-8e3a-e7fd7ef50cb5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.066627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12b552-1a98-45b2-8e3a-e7fd7ef50cb5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.067132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12b552-1a98-45b2-8e3a-e7fd7ef50cb5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.067496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12b552-1a98-45b2-8e3a-e7fd7ef50cb5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.068228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12b552-1a98-45b2-8e3a-e7fd7ef50cb5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.070203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12b552-1a98-45b2-8e3a-e7fd7ef50cb5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.087523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:45.110262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3852/7629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:44 2022] GET /identity/v3/users => generated 8329 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:45.111979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.112356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.112646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.159265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] MFA Rules not processed for user `8b3e5ebb5af546eca54082f7262a6a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:45.160608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.249486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3778/7630] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:45 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:45.251427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.251787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.252131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.281250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] MFA Rules not processed for user `8b3e5ebb5af546eca54082f7262a6a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:45.282756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.302701 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3853/7631] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:45 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:45.307552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.317585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df416-00b3-4f0c-8ccf-e522d4a8bbb6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.321918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b3e5ebb5af546eca54082f7262a6a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9404acf44154e19bfe7dcea54415ec1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-169449632', 'tempest-DelegatedRole-1459159075'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.322595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.322883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.323171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.324934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: Authorizing `identity:create_trust()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.326121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.403215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:45.427473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3779/7632] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 31 05:48:45 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:45.431680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.445433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0afb00-7ae3-4bd3-9725-227f06130c21 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.450798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.451428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.451717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.451998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.452641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.454581 n-d-862355-5 devstack@keystone.service[82000]: WARNING py.warnings [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 05:48:45.454581 n-d-862355-5 devstack@keystone.service[82000]: warnings.warn(msg) Oct 31 05:48:45.454581 n-d-862355-5 devstack@keystone.service[82000]: Oct 31 05:48:45.455514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.463525 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3854/7633] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 31 05:48:45 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:45.468051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.478214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0dfbe-bbf9-4c5d-b20c-4a4a95d99dcc tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.485763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b3e5ebb5af546eca54082f7262a6a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9404acf44154e19bfe7dcea54415ec1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-169449632', 'tempest-DelegatedRole-1459159075'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.486704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.486953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.487305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] PATH_INFO: `/v3/OS-TRUST/trusts/1a15f4a15f5a46da8db49d1dd6ad0a5d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.497827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: Authorizing `identity:delete_trust(trust_id=1a15f4a15f5a46da8db49d1dd6ad0a5d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.499341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.523124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1a15f4a15f5a46da8db49d1dd6ad0a5d', 'request_id': 'req-3f9114e2-07cc-465a-aed6-1761fc54ab79'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.524186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1a15f4a15f5a46da8db49d1dd6ad0a5d', 'request_id': 'req-3f9114e2-07cc-465a-aed6-1761fc54ab79'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.525601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1a15f4a15f5a46da8db49d1dd6ad0a5d', 'request_id': 'req-3f9114e2-07cc-465a-aed6-1761fc54ab79'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.543938 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3780/7634] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:48:45 2022] DELETE /identity/v3/OS-TRUST/trusts/1a15f4a15f5a46da8db49d1dd6ad0a5d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:45.548504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.550960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.567021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5538ca-fc5f-41f8-a1ca-71f2b10e9e99 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.571676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b3e5ebb5af546eca54082f7262a6a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9404acf44154e19bfe7dcea54415ec1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-169449632', 'tempest-DelegatedRole-1459159075'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.572501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.572764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.573109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] PATH_INFO: `/v3/OS-TRUST/trusts/1a15f4a15f5a46da8db49d1dd6ad0a5d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Could not find trust: 1a15f4a15f5a46da8db49d1dd6ad0a5d.: keystone.exception.TrustNotFound: Could not find trust: 1a15f4a15f5a46da8db49d1dd6ad0a5d. Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 05:48:45.607414 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1a15f4a15f5a46da8db49d1dd6ad0a5d. Oct 31 05:48:45.608647 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:45.610522 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3855/7635] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:45 2022] GET /identity/v3/OS-TRUST/trusts/1a15f4a15f5a46da8db49d1dd6ad0a5d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:45.613153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.614763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.630214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9114e2-07cc-465a-aed6-1761fc54ab79 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.635460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.636200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.636679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.638341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/5fca6c4ce85c4108a5fcb2c01e325d40` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.639570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5fca6c4ce85c4108a5fcb2c01e325d40)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.641292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.694246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.699742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 5fca6c4ce85c4108a5fcb2c01e325d40 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:45.700595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.700690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.701359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.706226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3781/7636] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:45 2022] DELETE /identity/v3/roles/5fca6c4ce85c4108a5fcb2c01e325d40 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:45.707808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.709403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.786237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b9cae-45fa-4955-a46b-1cadc6fc6c53 tempest-TrustsV3TestJSON-239590900 tempest-user-1932995204] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.788847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722127-e7c7-4282-ace7-543f428d7a07 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.801373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.802160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.802545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.802902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/60d776058bd8459b8750713379f9d763` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.806042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=60d776058bd8459b8750713379f9d763)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.809575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.850855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:45.851497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.851844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.852176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] PATH_INFO: `/v3/users/7e00660ea99e45c981389bb0c26dbe00` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.853326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e00660ea99e45c981389bb0c26dbe00)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:45.855821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:45.860332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 60d776058bd8459b8750713379f9d763 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:45.861024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.862731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.864882 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3782/7637] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:45 2022] DELETE /identity/v3/roles/60d776058bd8459b8750713379f9d763 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:45.868985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:45.870568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:45.908441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e00660ea99e45c981389bb0c26dbe00'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.914711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:45.923250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e00660ea99e45c981389bb0c26dbe00'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.924072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e00660ea99e45c981389bb0c26dbe00'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.925208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e00660ea99e45c981389bb0c26dbe00'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.934999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2aae27ca-6863-4a05-ab5d-dda95acb4d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e00660ea99e45c981389bb0c26dbe00'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:45.951641 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3856/7638] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:45 2022] DELETE /identity/v3/users/7e00660ea99e45c981389bb0c26dbe00 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:45.953564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1aea8-1439-4de4-8158-3a279fa7f7ce tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:45.955965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:45.956272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:45.956556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:45.964787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:45.987341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:45.989212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.038504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.039488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.040005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.042475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users/8b3e5ebb5af546eca54082f7262a6a6c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.042475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8b3e5ebb5af546eca54082f7262a6a6c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.046331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.090702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3857/7639] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:46.096825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.098674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.112904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3e5ebb5af546eca54082f7262a6a6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.125145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3e5ebb5af546eca54082f7262a6a6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.126236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3e5ebb5af546eca54082f7262a6a6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.127071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3e5ebb5af546eca54082f7262a6a6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.142296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3e5ebb5af546eca54082f7262a6a6c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.183312 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3783/7640] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:45 2022] DELETE /identity/v3/users/8b3e5ebb5af546eca54082f7262a6a6c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:46.188181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.189752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.193608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5b096-0fff-43de-b156-5427d9847ca8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.247971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.248613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.248906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.249188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.251232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.270217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3693c-720d-42d5-97f9-09b256cd6098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.276276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.279269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.279872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.280360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/a9404acf44154e19bfe7dcea54415ec1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.281913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9404acf44154e19bfe7dcea54415ec1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.294930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.297203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:46.341020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.343150 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.357389 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3858/7641] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:48:46.369175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9404acf44154e19bfe7dcea54415ec1', 'request_id': 'req-f5ad3bc3-9695-4582-b3ac-d5142db919ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.376644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9404acf44154e19bfe7dcea54415ec1', 'request_id': 'req-f5ad3bc3-9695-4582-b3ac-d5142db919ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.386059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9404acf44154e19bfe7dcea54415ec1', 'request_id': 'req-f5ad3bc3-9695-4582-b3ac-d5142db919ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.404913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] The token cache is being invalidate because project a9404acf44154e19bfe7dcea54415ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:46.405224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.405910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.407954 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3784/7642] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:46 2022] DELETE /identity/v3/projects/a9404acf44154e19bfe7dcea54415ec1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:46.416289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.432155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7893a9-47d1-4b8d-a0bc-17461dee8546 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.439058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:46.530550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.531295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.531581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.531898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.533115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.535074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.568203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.568718 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3859/7643] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:46 2022] POST /identity/v3/projects => generated 329 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:46.572445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.573444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.579325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.661645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad3bc3-9695-4582-b3ac-d5142db919ac tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.662058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed348ac-90b3-43ed-a993-cf5f4b466572 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.667661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.668431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.668738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.669005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.669817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.671843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.702911 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3860/7644] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:46 2022] POST /identity/v3/users => generated 410 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:46.704513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.716439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7bf70-79f1-415c-9009-633cf2913cae tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.721731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.722372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.722654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.722930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.723623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.725228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.732573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.733477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.733759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.734036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] PATH_INFO: `/v3/projects/913ecd43942f4e1d98499527f61e6e44` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.735353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913ecd43942f4e1d98499527f61e6e44)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.737206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.749843 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3861/7645] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:46 2022] POST /identity/v3/roles => generated 244 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:46.751630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.764800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945242-70f0-4dc0-a1a1-d458e6c3fd69 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.773629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.774431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.774870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.775178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.775981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.778752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.787809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:46.798460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3862/7646] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:46 2022] POST /identity/v3/roles => generated 246 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:46.801687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913ecd43942f4e1d98499527f61e6e44', 'request_id': 'req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.802562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.809634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913ecd43942f4e1d98499527f61e6e44', 'request_id': 'req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.815069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09719-8aa6-4454-80d1-c24184cbadb4 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:46.820088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913ecd43942f4e1d98499527f61e6e44', 'request_id': 'req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.833578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] The token cache is being invalidate because project 913ecd43942f4e1d98499527f61e6e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:46.834029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.834834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8e69eeb-83ec-4710-bc50-ffca1c5c4ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:46.838223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3785/7647] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:46 2022] DELETE /identity/v3/projects/913ecd43942f4e1d98499527f61e6e44 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:46.841799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1185a9-615a-4d18-b5ac-c4ef9760500e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.842316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1185a9-615a-4d18-b5ac-c4ef9760500e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.843649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1185a9-615a-4d18-b5ac-c4ef9760500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.869021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dc1185a9-615a-4d18-b5ac-c4ef9760500e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:46.870342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc1185a9-615a-4d18-b5ac-c4ef9760500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.874744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:46.885918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:46.885918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.885918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.886318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/7d6e5cd0cf4e482590481bf5f8c4e578/users/a7bf0d520e394811a74890c5024c7938/roles/414340e586074094bcfe5df78d17389b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.901549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d6e5cd0cf4e482590481bf5f8c4e578, user_id=a7bf0d520e394811a74890c5024c7938, role_id=414340e586074094bcfe5df78d17389b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:46.905882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:46.922583 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3863/7648] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:46 2022] PUT /identity/v3/projects/7d6e5cd0cf4e482590481bf5f8c4e578/users/a7bf0d520e394811a74890c5024c7938/roles/414340e586074094bcfe5df78d17389b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:46.927370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:46.930536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:46.951896 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3786/7649] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:46.961019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:46.961244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:46.962574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:46.984268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:46.985479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.019603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ce66-b6ae-44c3-901a-83ffed74460c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.076865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.077617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.077915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.078204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/7d6e5cd0cf4e482590481bf5f8c4e578/users/a7bf0d520e394811a74890c5024c7938/roles/9c9692bc5f364365b8ee38d9251fcabf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.081763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d6e5cd0cf4e482590481bf5f8c4e578, user_id=a7bf0d520e394811a74890c5024c7938, role_id=9c9692bc5f364365b8ee38d9251fcabf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.086585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.110200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3864/7650] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:46 2022] PUT /identity/v3/projects/7d6e5cd0cf4e482590481bf5f8c4e578/users/a7bf0d520e394811a74890c5024c7938/roles/9c9692bc5f364365b8ee38d9251fcabf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:47.112447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.131363 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3787/7651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:47.135407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.148040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529965cd-1eca-42d1-92fb-ee114096b8cb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.193768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b964-e898-4b1a-8686-bdd05682abfb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.201071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.201699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.201988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.202292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.203420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.205869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.221576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.222305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.222589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.222861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.223526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:48:47.223830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.225494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b90f8-acb0-4b2e-b2cc-f4981bbd9d3d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.236630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:47.245207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3865/7652] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/users => generated 8045 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:47.245674 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3788/7653] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:47.247213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.251959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bf956-7cb7-43f3-bf2d-3faa49ff54f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.252254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bf956-7cb7-43f3-bf2d-3faa49ff54f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.252524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bf956-7cb7-43f3-bf2d-3faa49ff54f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.275066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b646b25-da46-4674-b26f-62e4492b26c9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.282508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.283289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.283574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.283846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.284488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.286459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.312157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-860bf956-7cb7-43f3-bf2d-3faa49ff54f9 None None] MFA Rules not processed for user `a7bf0d520e394811a74890c5024c7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:47.313360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-860bf956-7cb7-43f3-bf2d-3faa49ff54f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.326263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3866/7654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:48:47 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:47.330627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.393343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:47.415725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a664b-3835-458b-97dc-dd85485bf39d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.426185 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3789/7655] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:47.431696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.432024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.432328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.437835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.438606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.439105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.439387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.440037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.442650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.467050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] MFA Rules not processed for user `a7bf0d520e394811a74890c5024c7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:47.469297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.488252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3867/7656] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:47 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:47.489163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.514204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853818f4-384a-441a-9564-a3c56e408833 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.519482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.520113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.520486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.520767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.521529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.523284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.542129 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3868/7657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/roles => generated 1892 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:47.544234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.558191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fdf87-d595-4b2a-82d7-594221feaf41 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.565860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.566499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.566788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.567067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.568261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.569697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.579883 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3790/7658] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:47.584598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.589341 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3869/7659] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/roles => generated 1892 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:47.593969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.601069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32506a8-0be0-4c12-b530-848afc603aa0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.608037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bf0d520e394811a74890c5024c7938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6e5cd0cf4e482590481bf5f8c4e578', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-590312397', 'tempest-DelegatedRole-1677791182'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.608955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.609105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abdc55-dc1b-4ca4-a12d-0f47c27b8e03 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.609573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.610042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.611271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: Authorizing `identity:create_trust()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.612656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.615621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d7391-493d-4d0a-ac4d-19bcd61d4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.616460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7391-493d-4d0a-ac4d-19bcd61d4d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.616801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7391-493d-4d0a-ac4d-19bcd61d4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.617262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7391-493d-4d0a-ac4d-19bcd61d4d7c admin admin] PATH_INFO: `/v3/projects/f2b06b0297364e1b8908ee0a48cf621a/users/29167802f249485280914e02306751ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.655519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d7391-493d-4d0a-ac4d-19bcd61d4d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b06b0297364e1b8908ee0a48cf621a, user_id=29167802f249485280914e02306751ae, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.658437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d7391-493d-4d0a-ac4d-19bcd61d4d7c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.680191 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3870/7660] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:47 2022] PUT /identity/v3/projects/f2b06b0297364e1b8908ee0a48cf621a/users/29167802f249485280914e02306751ae/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:47.692592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.692883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.693190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.726669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] MFA Rules not processed for user `29167802f249485280914e02306751ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:47.727962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.752987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3791/7661] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 31 05:48:47 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:47.756823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.771990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ee08-6e09-40f6-ba90-f48e6bfefc1f tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.791195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:47.826431 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3871/7662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:47.833080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.835311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.851221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bf0d520e394811a74890c5024c7938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6e5cd0cf4e482590481bf5f8c4e578', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-590312397', 'tempest-DelegatedRole-1677791182'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.852167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.852458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.852746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.853408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.855050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.864763 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3792/7663] 10.222.0.23 () {58 vars in 1252 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=a7bf0d520e394811a74890c5024c7938 => generated 611 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:47.869980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.882893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe923c7-6eee-469d-9a4a-c6eb11446af4 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.889765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bf0d520e394811a74890c5024c7938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6e5cd0cf4e482590481bf5f8c4e578', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-590312397', 'tempest-DelegatedRole-1677791182'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.890632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.891083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.891593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] PATH_INFO: `/v3/OS-TRUST/trusts/c0f48ba5c659439cad3acee183ccff13` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.898404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: Authorizing `identity:delete_trust(trust_id=c0f48ba5c659439cad3acee183ccff13)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.899833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.920192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c0f48ba5c659439cad3acee183ccff13', 'request_id': 'req-bdc00871-5074-4cfa-936e-d3dba17de2c1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:47.921176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c0f48ba5c659439cad3acee183ccff13', 'request_id': 'req-bdc00871-5074-4cfa-936e-d3dba17de2c1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:47.921806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c0f48ba5c659439cad3acee183ccff13', 'request_id': 'req-bdc00871-5074-4cfa-936e-d3dba17de2c1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:47.922901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160bee1-7021-42ee-bbf2-cf6261eac1f7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.927028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.927750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.927962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.928215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.930595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.942567 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3793/7664] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:48:47 2022] DELETE /identity/v3/OS-TRUST/trusts/c0f48ba5c659439cad3acee183ccff13 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:47.946571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:47.947633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:47.948854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:47.951349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:47.960876 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3872/7665] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:48:47.973793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc00871-5074-4cfa-936e-d3dba17de2c1 tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:47.978895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bf0d520e394811a74890c5024c7938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6e5cd0cf4e482590481bf5f8c4e578', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-590312397', 'tempest-DelegatedRole-1677791182'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:47.979763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:47.980256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:47.980776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] PATH_INFO: `/v3/OS-TRUST/trusts/c0f48ba5c659439cad3acee183ccff13` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Could not find trust: c0f48ba5c659439cad3acee183ccff13.: keystone.exception.TrustNotFound: Could not find trust: c0f48ba5c659439cad3acee183ccff13. Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 05:48:47.995710 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c0f48ba5c659439cad3acee183ccff13. Oct 31 05:48:47.996843 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:47.999800 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3794/7666] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:47 2022] GET /identity/v3/OS-TRUST/trusts/c0f48ba5c659439cad3acee183ccff13 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 05:48:48.006137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:48.007748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:48.047052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:48.115874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f3f63-d834-4dea-b83c-1200365ce6f9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:48.124556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:48.125233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:48.125523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:48.128060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/9c9692bc5f364365b8ee38d9251fcabf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:48.130647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9c9692bc5f364365b8ee38d9251fcabf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:48.132548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:48.191688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 9c9692bc5f364365b8ee38d9251fcabf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:48.192356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.194930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.197654 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3873/7667] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:48 2022] DELETE /identity/v3/roles/9c9692bc5f364365b8ee38d9251fcabf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:48.202524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:48.205560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:48.236821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcfae2-7639-4def-81ac-0aa96be03dfe tempest-TrustsV3TestJSON-1209607962 tempest-user-27333992] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:48.334526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:48.335289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:48.335641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:48.335992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/414340e586074094bcfe5df78d17389b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:48.337481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=414340e586074094bcfe5df78d17389b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:48.339218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:48.386845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 414340e586074094bcfe5df78d17389b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:48.387237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.387925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.389894 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3795/7668] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:48 2022] DELETE /identity/v3/roles/414340e586074094bcfe5df78d17389b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:48.394052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:48.405882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ce38-dcf0-4389-a335-ae11fa7d71a9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:48.472964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:48.473619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:48.473903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:48.474279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users/a7bf0d520e394811a74890c5024c7938` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:48.475580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a7bf0d520e394811a74890c5024c7938)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:48.477584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:48.565834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bf0d520e394811a74890c5024c7938'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.598846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bf0d520e394811a74890c5024c7938'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.600275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bf0d520e394811a74890c5024c7938'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.600574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bf0d520e394811a74890c5024c7938'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.611747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bf0d520e394811a74890c5024c7938'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.635663 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3874/7669] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:48 2022] DELETE /identity/v3/users/a7bf0d520e394811a74890c5024c7938 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:48.646506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:48.648116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:48.670018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f43407-38d0-4a02-8dea-bbdbdea68b7f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:48.728480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:48.759609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:48.760560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:48.761002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:48.761149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/7d6e5cd0cf4e482590481bf5f8c4e578` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:48.762888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d6e5cd0cf4e482590481bf5f8c4e578)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:48.764802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:48.826756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6e5cd0cf4e482590481bf5f8c4e578', 'request_id': 'req-c39501b4-6652-4694-85e3-104c0b7dc711'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.832690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6e5cd0cf4e482590481bf5f8c4e578', 'request_id': 'req-c39501b4-6652-4694-85e3-104c0b7dc711'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.840586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6e5cd0cf4e482590481bf5f8c4e578', 'request_id': 'req-c39501b4-6652-4694-85e3-104c0b7dc711'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.857133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] The token cache is being invalidate because project 7d6e5cd0cf4e482590481bf5f8c4e578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:48.857973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.858792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:48.860952 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3796/7670] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:48 2022] DELETE /identity/v3/projects/7d6e5cd0cf4e482590481bf5f8c4e578 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:48.867536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:48.869118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:48.885512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2e693-5f2e-44ca-9175-0170c66847f3 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:48.893285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:48.969340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:48.970434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:48.970799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:48.972118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:48.972924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:48.975114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.017546 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3875/7671] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:48 2022] POST /identity/v3/projects => generated 328 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:49.022686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.024485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:49.044284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39501b4-6652-4694-85e3-104c0b7dc711 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.111095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.111731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.112020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.112303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.112968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.115104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.144599 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3797/7672] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:49 2022] POST /identity/v3/users => generated 413 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:49.149140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.162130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf4981-d7c0-4176-a8d8-63b2c1da224a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.166916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.167731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.168207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.168569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.169443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.171310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.192961 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3876/7673] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:49 2022] POST /identity/v3/roles => generated 244 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:49.194326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.207437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b7197-deed-43fa-9212-62a7bf417098 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.213380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.213898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.214319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.215222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.216603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.217776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.234195 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3798/7674] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:49 2022] POST /identity/v3/roles => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:49.239350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.252861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d3d9-c2e6-47ad-81c8-4e4761c0c05d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.265944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.266682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.266969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.267248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/eabdf4a9beab48099f6ac486ad4a3efd/users/2c108d1fcc424ce49dc7098dc8cfbe0b/roles/ee7a1e1e804f41f1854df12cf0904872` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.285005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eabdf4a9beab48099f6ac486ad4a3efd, user_id=2c108d1fcc424ce49dc7098dc8cfbe0b, role_id=ee7a1e1e804f41f1854df12cf0904872)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.295066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.326247 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3877/7675] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:49 2022] PUT /identity/v3/projects/eabdf4a9beab48099f6ac486ad4a3efd/users/2c108d1fcc424ce49dc7098dc8cfbe0b/roles/ee7a1e1e804f41f1854df12cf0904872 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:49.330933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.349637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb8334-df9b-428c-8e9e-6133aa197884 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.399065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:49.433295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0adab7-2b47-4132-98cc-10a7c34c58c5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.433678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0adab7-2b47-4132-98cc-10a7c34c58c5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.434812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0adab7-2b47-4132-98cc-10a7c34c58c5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.435190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0adab7-2b47-4132-98cc-10a7c34c58c5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/eabdf4a9beab48099f6ac486ad4a3efd/users/2c108d1fcc424ce49dc7098dc8cfbe0b/roles/a6df45649ec04becbb0b967fb7deb1f5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.438871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0adab7-2b47-4132-98cc-10a7c34c58c5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eabdf4a9beab48099f6ac486ad4a3efd, user_id=2c108d1fcc424ce49dc7098dc8cfbe0b, role_id=a6df45649ec04becbb0b967fb7deb1f5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.444120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0adab7-2b47-4132-98cc-10a7c34c58c5 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.466361 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3799/7676] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:49 2022] PUT /identity/v3/projects/eabdf4a9beab48099f6ac486ad4a3efd/users/2c108d1fcc424ce49dc7098dc8cfbe0b/roles/a6df45649ec04becbb0b967fb7deb1f5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:49.470541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.483730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd51de2-1e56-457e-9902-57a6f8a6c6d9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.560568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad6cdc-5ce7-4727-978a-5142cd3423ef tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.561496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6cdc-5ce7-4727-978a-5142cd3423ef tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.561937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6cdc-5ce7-4727-978a-5142cd3423ef tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.562407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6cdc-5ce7-4727-978a-5142cd3423ef tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.563269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6cdc-5ce7-4727-978a-5142cd3423ef tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.565704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6cdc-5ce7-4727-978a-5142cd3423ef tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:49.618207 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3878/7677] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:49 2022] GET /identity/v3/users => generated 8326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:49.623800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.624561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.625271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.675892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] MFA Rules not processed for user `2c108d1fcc424ce49dc7098dc8cfbe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:49.677338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:49.777298 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3800/7678] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:49.778910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.779203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.779482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.843987 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] MFA Rules not processed for user `2c108d1fcc424ce49dc7098dc8cfbe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:49.846730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:49.866121 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3879/7679] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:49.870661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:49.881370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63625da0-daf1-420b-bfa7-6fc34cca2e92 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:49.888143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:49.888889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:49.890006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:49.890006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:49.890449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:create_trust()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:49.891701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.054855 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3801/7680] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 31 05:48:49 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:50.056182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.070816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225d43-8ff0-46ab-8741-8a0745907ea8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.084329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.088304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.090438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.090988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.120050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:get_trust(trust_id=509d7ba000b0494588cc176620da4f64)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.122673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.136957 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3880/7681] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:50 2022] GET /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64 => generated 859 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:50.138372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.154503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504087-6228-416a-af3e-124162e34fa9 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.172162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.172968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.175350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.175350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.187111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=509d7ba000b0494588cc176620da4f64)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.191445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.240158 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3802/7682] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 31 05:48:50 2022] GET /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles => generated 371 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:50.242280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.279052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ea17c-4438-408c-9e31-ed5d6b60ffc6 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.314727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.315486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.315850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.316136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/ee7a1e1e804f41f1854df12cf0904872` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.343872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:get_role_for_trust(trust_id=509d7ba000b0494588cc176620da4f64, role_id=ee7a1e1e804f41f1854df12cf0904872)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.346667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.365120 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3881/7683] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:48:50 2022] GET /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/ee7a1e1e804f41f1854df12cf0904872 => generated 244 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:50.368729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.387108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177416d3-dba6-40b4-ae42-6c6e98ddf465 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.392867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.393549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.393836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.394186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/ee7a1e1e804f41f1854df12cf0904872` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.411006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:get_role_for_trust(trust_id=509d7ba000b0494588cc176620da4f64, role_id=ee7a1e1e804f41f1854df12cf0904872)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.412592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.439041 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3803/7684] 10.222.0.23 () {58 vars in 1369 bytes} [Mon Oct 31 05:48:50 2022] HEAD /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/ee7a1e1e804f41f1854df12cf0904872 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 31 05:48:50.440237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.461989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ee6d-2a90-4044-b70e-d553d0043d08 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.475845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.477220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.477734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.478289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/a6df45649ec04becbb0b967fb7deb1f5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.492979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:50.502334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:get_role_for_trust(trust_id=509d7ba000b0494588cc176620da4f64, role_id=a6df45649ec04becbb0b967fb7deb1f5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.504091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Could not find role: a6df45649ec04becbb0b967fb7deb1f5.: keystone.exception.RoleNotFound: Could not find role: a6df45649ec04becbb0b967fb7deb1f5. Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:48:50.515719 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a6df45649ec04becbb0b967fb7deb1f5. Oct 31 05:48:50.516960 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:50.521402 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3882/7685] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:48:50 2022] GET /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/a6df45649ec04becbb0b967fb7deb1f5 => generated 110 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:50.522623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.533642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185df6c-1201-46ae-9927-d940b9560304 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.539414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.540372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.540885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.541381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/a6df45649ec04becbb0b967fb7deb1f5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.551849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:get_role_for_trust(trust_id=509d7ba000b0494588cc176620da4f64, role_id=a6df45649ec04becbb0b967fb7deb1f5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.556687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.559194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Could not find role: a6df45649ec04becbb0b967fb7deb1f5.: keystone.exception.RoleNotFound: Could not find role: a6df45649ec04becbb0b967fb7deb1f5. Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:48:50.574653 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a6df45649ec04becbb0b967fb7deb1f5. Oct 31 05:48:50.575734 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:50.578076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3804/7686] 10.222.0.23 () {58 vars in 1369 bytes} [Mon Oct 31 05:48:50 2022] HEAD /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64/roles/a6df45649ec04becbb0b967fb7deb1f5 => generated 0 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 31 05:48:50.583616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.598371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580847c2-2051-42e9-8732-43ea1dabd9fe tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.604413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.605224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.606229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.607523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.614324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorizing `identity:delete_trust(trust_id=509d7ba000b0494588cc176620da4f64)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.616016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.648571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '509d7ba000b0494588cc176620da4f64', 'request_id': 'req-0a0cafb4-44a8-46c1-9cf1-895de024d499'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:50.649460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '509d7ba000b0494588cc176620da4f64', 'request_id': 'req-0a0cafb4-44a8-46c1-9cf1-895de024d499'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:50.662508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '509d7ba000b0494588cc176620da4f64', 'request_id': 'req-0a0cafb4-44a8-46c1-9cf1-895de024d499'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:50.674134 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3883/7687] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:48:50 2022] DELETE /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:50.678523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.682242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:50.700223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcb5f9-b34d-4157-b480-2ad3b9b7ad53 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.704711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c108d1fcc424ce49dc7098dc8cfbe0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabdf4a9beab48099f6ac486ad4a3efd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-929286704', 'tempest-DelegatedRole-1517323282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.705396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.705900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.706283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] PATH_INFO: `/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Could not find trust: 509d7ba000b0494588cc176620da4f64.: keystone.exception.TrustNotFound: Could not find trust: 509d7ba000b0494588cc176620da4f64. Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 05:48:50.718799 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 509d7ba000b0494588cc176620da4f64. Oct 31 05:48:50.720007 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:50.722276 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3805/7688] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:50 2022] GET /identity/v3/OS-TRUST/trusts/509d7ba000b0494588cc176620da4f64 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:50.726401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.727878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:50.746526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cafb4-44a8-46c1-9cf1-895de024d499 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.752879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.753686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.753901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.754135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/a6df45649ec04becbb0b967fb7deb1f5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.768343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a6df45649ec04becbb0b967fb7deb1f5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.770652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:50.815604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role a6df45649ec04becbb0b967fb7deb1f5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:50.816168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:50.819446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:50.823240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3884/7689] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:50 2022] DELETE /identity/v3/roles/a6df45649ec04becbb0b967fb7deb1f5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:50.831074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:50.834765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:50.859645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec7c5-b3fc-4ad9-b206-a05a661c77a8 tempest-TrustsV3TestJSON-694272698 tempest-user-124663506] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:50.975545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:50.979619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:50.980745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:50.981321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/ee7a1e1e804f41f1854df12cf0904872` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:50.985652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ee7a1e1e804f41f1854df12cf0904872)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:50.989967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:51.094872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role ee7a1e1e804f41f1854df12cf0904872 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:51.097255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.100178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.103029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3806/7690] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:50 2022] DELETE /identity/v3/roles/ee7a1e1e804f41f1854df12cf0904872 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:51.111562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:51.150720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85627d63-07f8-45da-a79d-7cf059b7d485 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:51.228390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:51.229391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:51.229892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:51.230866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users/2c108d1fcc424ce49dc7098dc8cfbe0b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:51.232504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2c108d1fcc424ce49dc7098dc8cfbe0b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:51.234522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:51.310698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c108d1fcc424ce49dc7098dc8cfbe0b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.338931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c108d1fcc424ce49dc7098dc8cfbe0b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.341316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c108d1fcc424ce49dc7098dc8cfbe0b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.342252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c108d1fcc424ce49dc7098dc8cfbe0b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.361683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c108d1fcc424ce49dc7098dc8cfbe0b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.365896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=13 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:51.398545 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3885/7691] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:51 2022] DELETE /identity/v3/users/2c108d1fcc424ce49dc7098dc8cfbe0b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:51.403527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:51.407648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:51.426553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401528-9e37-44e4-bf1f-ffe8722b2fb6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:51.525780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:51.526497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:51.526785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:51.527082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/eabdf4a9beab48099f6ac486ad4a3efd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:51.528431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eabdf4a9beab48099f6ac486ad4a3efd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:51.530747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:51.605071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eabdf4a9beab48099f6ac486ad4a3efd', 'request_id': 'req-7ce4c444-4aa0-4f11-99d8-54477a5094d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.611507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:51.617717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eabdf4a9beab48099f6ac486ad4a3efd', 'request_id': 'req-7ce4c444-4aa0-4f11-99d8-54477a5094d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.641262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eabdf4a9beab48099f6ac486ad4a3efd', 'request_id': 'req-7ce4c444-4aa0-4f11-99d8-54477a5094d6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.679238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] The token cache is being invalidate because project eabdf4a9beab48099f6ac486ad4a3efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:51.680876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.684508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:51.699163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:51.702610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:51.705266 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3807/7692] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:51 2022] DELETE /identity/v3/projects/eabdf4a9beab48099f6ac486ad4a3efd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:51.738847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd129449-0322-46f6-9003-ed3b1668161a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:51.918953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:51.919410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:51.919668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:51.919956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:51.921001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:51.923163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.036735 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3886/7693] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:51 2022] POST /identity/v3/projects => generated 328 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:52.041301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:52.044051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:52.089034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4c444-4aa0-4f11-99d8-54477a5094d6 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:52.243265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:52.244273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.244564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.244846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.245513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:52.248667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.285878 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3808/7694] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:52 2022] POST /identity/v3/users => generated 413 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:52.289961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:52.304701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc534a6-4257-400c-b3ec-85d5ada74191 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:52.311009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:52.311787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.312173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.312748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.313329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:52.315114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.337391 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3887/7695] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:52 2022] POST /identity/v3/roles => generated 243 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:52.346548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:52.364490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b98fe-79ad-4e23-b424-b5fd48f01623 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:52.379226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:52.380417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.381120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.381842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.383353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:52.387649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.418409 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3809/7696] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:52 2022] POST /identity/v3/roles => generated 247 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:52.426851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:52.441254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9139a7d-928c-46fb-802c-8234e496cc62 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:52.448727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:52.449518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.449948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.450582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/505d33b4198a47a2b65810ec45646ddc/users/e771bf8ce0424e62becceb84c2f439b6/roles/b55268549cef4a66ab084174000e28ed` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.478508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=505d33b4198a47a2b65810ec45646ddc, user_id=e771bf8ce0424e62becceb84c2f439b6, role_id=b55268549cef4a66ab084174000e28ed)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:52.494185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.507866 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3888/7697] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:52 2022] PUT /identity/v3/projects/505d33b4198a47a2b65810ec45646ddc/users/e771bf8ce0424e62becceb84c2f439b6/roles/b55268549cef4a66ab084174000e28ed => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:52.516517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:52.530861 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ac971-4ddb-4660-90b0-3ef968f33f59 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:52.621381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577198-6dbc-417d-9fc2-eb9a06cbcf6f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:52.622357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577198-6dbc-417d-9fc2-eb9a06cbcf6f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.622564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577198-6dbc-417d-9fc2-eb9a06cbcf6f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.622951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577198-6dbc-417d-9fc2-eb9a06cbcf6f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/505d33b4198a47a2b65810ec45646ddc/users/e771bf8ce0424e62becceb84c2f439b6/roles/97b7e3395f2b42c894d3305b9c77569d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.625574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577198-6dbc-417d-9fc2-eb9a06cbcf6f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=505d33b4198a47a2b65810ec45646ddc, user_id=e771bf8ce0424e62becceb84c2f439b6, role_id=97b7e3395f2b42c894d3305b9c77569d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:52.628747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577198-6dbc-417d-9fc2-eb9a06cbcf6f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.655826 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3810/7698] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:52 2022] PUT /identity/v3/projects/505d33b4198a47a2b65810ec45646ddc/users/e771bf8ce0424e62becceb84c2f439b6/roles/97b7e3395f2b42c894d3305b9c77569d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:52.662186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:52.681574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acb8d6-6d98-4411-84b3-f42e0f110b1f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:52.797293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf90b8-a6dc-47e8-80a1-e5d50e1c9696 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:52.798672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf90b8-a6dc-47e8-80a1-e5d50e1c9696 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.799768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf90b8-a6dc-47e8-80a1-e5d50e1c9696 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.800148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf90b8-a6dc-47e8-80a1-e5d50e1c9696 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.800931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf90b8-a6dc-47e8-80a1-e5d50e1c9696 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:52.803342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf90b8-a6dc-47e8-80a1-e5d50e1c9696 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:52.847086 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3889/7699] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:52 2022] GET /identity/v3/users => generated 8326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:52.855049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:52.855885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:52.856213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:52.910915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] MFA Rules not processed for user `e771bf8ce0424e62becceb84c2f439b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:52.912368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:52.989269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:53.097918 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3811/7700] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:53.100634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:53.102427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:53.103103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:53.139786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] MFA Rules not processed for user `e771bf8ce0424e62becceb84c2f439b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:53.141251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:53.155119 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3890/7701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:53.170769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:53.199278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf7f2-6768-4eb5-bcd9-de8c73a93177 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:53.216610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e771bf8ce0424e62becceb84c2f439b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505d33b4198a47a2b65810ec45646ddc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-940991614', 'tempest-NotDelegatedRole-1039157351'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:53.217648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:53.218714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:53.219273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:53.220407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] RBAC: Authorizing `identity:create_trust()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:53.223465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 31 05:48:53.432896 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 31 05:48:53.438428 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 31 05:48:53.440039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 31 05:48:53.440039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 31 05:48:53.440039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 31 05:48:53.440039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 31 05:48:53.440039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 31 05:48:53.440039 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:53.441005 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3812/7702] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 31 05:48:53 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 276 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 05:48:53.447369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:53.470552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e6acc-3898-4037-a9c7-40ffbbff3867 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:53.482926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:53.484017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:53.485046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:53.485280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/97b7e3395f2b42c894d3305b9c77569d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:53.486857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=97b7e3395f2b42c894d3305b9c77569d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:53.489177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:53.556119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:53.627267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 97b7e3395f2b42c894d3305b9c77569d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:53.627267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:53.628274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:53.635827 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3891/7703] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:53 2022] DELETE /identity/v3/roles/97b7e3395f2b42c894d3305b9c77569d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:53.641542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:53.643809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:53.692883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf5cef-f39d-4073-8363-abe22ccd2791 tempest-TrustsV3TestJSON-692517575 tempest-user-969883447] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:53.807028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:53.807719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:53.808062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:53.808426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/b55268549cef4a66ab084174000e28ed` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:53.810868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b55268549cef4a66ab084174000e28ed)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:53.812668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:53.913480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role b55268549cef4a66ab084174000e28ed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:53.915852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:53.916787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:53.923496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3813/7704] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:53 2022] DELETE /identity/v3/roles/b55268549cef4a66ab084174000e28ed => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:53.928878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:53.944006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6cf6-e8a8-45fc-970e-39252ca48aee tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.058004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.058715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.059369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.059369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users/e771bf8ce0424e62becceb84c2f439b6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.060667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e771bf8ce0424e62becceb84c2f439b6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.062865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:54.143510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e771bf8ce0424e62becceb84c2f439b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.165219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e771bf8ce0424e62becceb84c2f439b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.166209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e771bf8ce0424e62becceb84c2f439b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.166980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e771bf8ce0424e62becceb84c2f439b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.181006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e771bf8ce0424e62becceb84c2f439b6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.198835 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3892/7705] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:53 2022] DELETE /identity/v3/users/e771bf8ce0424e62becceb84c2f439b6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:54.204860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:54.206649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:54.227860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207bee4-fb1d-48b9-86e2-0c72f0db5709 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.288945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:54.325098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.325894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.326207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.327216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/505d33b4198a47a2b65810ec45646ddc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.328247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=505d33b4198a47a2b65810ec45646ddc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.330200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:54.417202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505d33b4198a47a2b65810ec45646ddc', 'request_id': 'req-ce022fff-eff4-43ce-b752-b06fe77926d7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.425187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505d33b4198a47a2b65810ec45646ddc', 'request_id': 'req-ce022fff-eff4-43ce-b752-b06fe77926d7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.436797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505d33b4198a47a2b65810ec45646ddc', 'request_id': 'req-ce022fff-eff4-43ce-b752-b06fe77926d7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.460546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] The token cache is being invalidate because project 505d33b4198a47a2b65810ec45646ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:54.460785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.461598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:54.463695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3814/7706] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:54 2022] DELETE /identity/v3/projects/505d33b4198a47a2b65810ec45646ddc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:54.470632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:54.472487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:54.492948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44151da3-2721-47d3-8c78-f646583303e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.596366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.597366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.597871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.598432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.599699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.604651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:54.625009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:54.654422 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3893/7707] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:54 2022] POST /identity/v3/projects => generated 329 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:54.658803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:54.661459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:54.683970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022fff-eff4-43ce-b752-b06fe77926d7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.787686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.788952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.789398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.790354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.792831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.798935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:54.836593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3815/7708] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:54 2022] POST /identity/v3/users => generated 413 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:54.838181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:54.853467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc08f3-f933-4626-90ce-56ac743e1ccd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.860366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.861120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.861639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.862012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.862930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.864607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:54.886929 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3894/7709] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:54 2022] POST /identity/v3/roles => generated 244 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:54.892645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:54.906990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46d93e-fd14-43e3-8884-9ee08f6900fd tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.912254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.912892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.913176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.913465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.914194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.915860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:54.935438 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3816/7710] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:54 2022] POST /identity/v3/roles => generated 246 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:54.939985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:54.953775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e336e6-d422-476f-8f3c-a6415e3c61bb tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:54.961380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:54.962629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:54.962922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:54.963227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/4fb02304355f4d9482412b11aad351fb/users/288f6fb0591946d8800ff72ce54b68d8/roles/bb2db8b333334df3aa0e276a9d14807b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:54.984393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4fb02304355f4d9482412b11aad351fb, user_id=288f6fb0591946d8800ff72ce54b68d8, role_id=bb2db8b333334df3aa0e276a9d14807b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:54.987723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:55.004531 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3895/7711] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:54 2022] PUT /identity/v3/projects/4fb02304355f4d9482412b11aad351fb/users/288f6fb0591946d8800ff72ce54b68d8/roles/bb2db8b333334df3aa0e276a9d14807b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:55.008657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:55.035519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e414-3901-48af-a28e-288f2332bb92 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:55.104452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:55.133126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f44ae-7b26-45c7-9d1e-585cabf4d28f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:55.133670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f44ae-7b26-45c7-9d1e-585cabf4d28f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.134419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f44ae-7b26-45c7-9d1e-585cabf4d28f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.135163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f44ae-7b26-45c7-9d1e-585cabf4d28f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/4fb02304355f4d9482412b11aad351fb/users/288f6fb0591946d8800ff72ce54b68d8/roles/4b883a136b29494099ebf944929102d9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.141480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f44ae-7b26-45c7-9d1e-585cabf4d28f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4fb02304355f4d9482412b11aad351fb, user_id=288f6fb0591946d8800ff72ce54b68d8, role_id=4b883a136b29494099ebf944929102d9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:55.146508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f44ae-7b26-45c7-9d1e-585cabf4d28f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:55.181386 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3817/7712] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:55 2022] PUT /identity/v3/projects/4fb02304355f4d9482412b11aad351fb/users/288f6fb0591946d8800ff72ce54b68d8/roles/4b883a136b29494099ebf944929102d9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:55.182726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:55.204037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d32af-4f72-498f-85f0-0b9b26a23379 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:55.305359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a5d1-6381-4f58-a249-4db2f2684050 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:55.306239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a5d1-6381-4f58-a249-4db2f2684050 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.306524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a5d1-6381-4f58-a249-4db2f2684050 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.306935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a5d1-6381-4f58-a249-4db2f2684050 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.307545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a5d1-6381-4f58-a249-4db2f2684050 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:55.310547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a5d1-6381-4f58-a249-4db2f2684050 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:55.345175 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3896/7713] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:55 2022] GET /identity/v3/users => generated 8326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:48:55.349896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.350534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.351003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.409343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] MFA Rules not processed for user `288f6fb0591946d8800ff72ce54b68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:55.410698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:55.508234 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3818/7714] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:55 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:55.521564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.522128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.522128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.568998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] MFA Rules not processed for user `288f6fb0591946d8800ff72ce54b68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:55.570859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:55.594805 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3897/7715] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:55 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:55.596293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:55.610850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896922d-14d2-4f9b-8aa5-4abaa70acb74 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:55.614427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:55.615096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.618724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.618724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.618724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:create_trust()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:55.618724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:55.798838 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3819/7716] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 31 05:48:55 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:55.804044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:55.825351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d802486-148c-40be-b84f-e6372c11a351 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:55.831745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:55.836051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.836737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.837567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.854538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:get_trust(trust_id=502053b99d6a4d6eb328d17baacb2924)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:55.860138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:55.903368 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3898/7717] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:55 2022] GET /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924 => generated 834 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:55.904197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:55.917240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae30507-9035-4a32-9d76-8ce14b15aef5 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:55.932392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:55.933097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:55.934334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:55.934618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:55.946967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=502053b99d6a4d6eb328d17baacb2924)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:55.949766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:55.966043 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3820/7718] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 31 05:48:55 2022] GET /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles => generated 371 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:55.970982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:55.984103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366613b-2f0f-4589-b8b9-cfd87c7e13d0 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.009611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.011048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.012291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.012586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/bb2db8b333334df3aa0e276a9d14807b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.029793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:get_role_for_trust(trust_id=502053b99d6a4d6eb328d17baacb2924, role_id=bb2db8b333334df3aa0e276a9d14807b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.034182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.052859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.065900 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3899/7719] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:48:55 2022] GET /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/bb2db8b333334df3aa0e276a9d14807b => generated 244 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:56.069882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc77cb-38a3-4e5a-a9c2-e6a05e618aa1 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.076189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.076928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.077555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.077867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/bb2db8b333334df3aa0e276a9d14807b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.087508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:get_role_for_trust(trust_id=502053b99d6a4d6eb328d17baacb2924, role_id=bb2db8b333334df3aa0e276a9d14807b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.089062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.099401 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3821/7720] 10.222.0.23 () {58 vars in 1369 bytes} [Mon Oct 31 05:48:56 2022] HEAD /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/bb2db8b333334df3aa0e276a9d14807b => generated 0 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 31 05:48:56.104624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.116316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715324-4042-4086-b3ae-df093eb4fb25 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.121531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.122600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.123067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.123411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/4b883a136b29494099ebf944929102d9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.132081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:get_role_for_trust(trust_id=502053b99d6a4d6eb328d17baacb2924, role_id=4b883a136b29494099ebf944929102d9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.135497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Could not find role: 4b883a136b29494099ebf944929102d9.: keystone.exception.RoleNotFound: Could not find role: 4b883a136b29494099ebf944929102d9. Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:48:56.160294 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4b883a136b29494099ebf944929102d9. Oct 31 05:48:56.161478 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:56.161932 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3900/7721] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:48:56 2022] GET /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/4b883a136b29494099ebf944929102d9 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:56.166430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.181221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bc94d-0f8e-4193-89a6-eb3674155a4c tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.188323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.189532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.190050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.190670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/4b883a136b29494099ebf944929102d9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.200692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:get_role_for_trust(trust_id=502053b99d6a4d6eb328d17baacb2924, role_id=4b883a136b29494099ebf944929102d9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.205958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.218011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Could not find role: 4b883a136b29494099ebf944929102d9.: keystone.exception.RoleNotFound: Could not find role: 4b883a136b29494099ebf944929102d9. Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:48:56.226075 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4b883a136b29494099ebf944929102d9. Oct 31 05:48:56.227502 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:56.232580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.233337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3822/7722] 10.222.0.23 () {58 vars in 1369 bytes} [Mon Oct 31 05:48:56 2022] HEAD /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924/roles/4b883a136b29494099ebf944929102d9 => generated 0 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 31 05:48:56.254268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a6e2-bd12-4004-b857-8272de762324 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.271523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.272541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.273530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.274076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.299431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorizing `identity:delete_trust(trust_id=502053b99d6a4d6eb328d17baacb2924)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.303699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.372759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '502053b99d6a4d6eb328d17baacb2924', 'request_id': 'req-ec8e3764-c518-469d-8a1d-887b4dbc3197'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.374110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '502053b99d6a4d6eb328d17baacb2924', 'request_id': 'req-ec8e3764-c518-469d-8a1d-887b4dbc3197'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.387866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '502053b99d6a4d6eb328d17baacb2924', 'request_id': 'req-ec8e3764-c518-469d-8a1d-887b4dbc3197'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.400725 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3901/7723] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:48:56 2022] DELETE /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:56.404961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.408034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:56.432694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d19bb-2d76-41e6-97be-cc9fe086e76a tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.441604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288f6fb0591946d8800ff72ce54b68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb02304355f4d9482412b11aad351fb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1080730685', 'tempest-NotDelegatedRole-516210475'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.443669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.443669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.443669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] PATH_INFO: `/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Could not find trust: 502053b99d6a4d6eb328d17baacb2924.: keystone.exception.TrustNotFound: Could not find trust: 502053b99d6a4d6eb328d17baacb2924. Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 05:48:56.457353 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 502053b99d6a4d6eb328d17baacb2924. Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:56.459029 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3823/7724] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:56 2022] GET /identity/v3/OS-TRUST/trusts/502053b99d6a4d6eb328d17baacb2924 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:56.463001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.465121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:56.509424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3764-c518-469d-8a1d-887b4dbc3197 tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.520198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.521309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.521755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.522386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/4b883a136b29494099ebf944929102d9` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.525854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4b883a136b29494099ebf944929102d9)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.532625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.542500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:56.635761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 4b883a136b29494099ebf944929102d9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:56.636181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.637686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.640758 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3902/7725] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:56 2022] DELETE /identity/v3/roles/4b883a136b29494099ebf944929102d9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:56.645140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.647033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:56.671623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06b47-c765-4dbc-8bcc-6bf12a10b53f tempest-TrustsV3TestJSON-2009639574 tempest-user-570326779] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.810264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.810776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.811395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.811395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/bb2db8b333334df3aa0e276a9d14807b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.813601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb2db8b333334df3aa0e276a9d14807b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.815979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:56.871925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role bb2db8b333334df3aa0e276a9d14807b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:56.872262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.873030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:56.875248 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3824/7726] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:56 2022] DELETE /identity/v3/roles/bb2db8b333334df3aa0e276a9d14807b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:56.879434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:56.897395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4235-baa4-4372-afb6-c1f7989cc37a tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:56.986473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:56.987287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:56.987583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:56.987957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users/288f6fb0591946d8800ff72ce54b68d8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:56.989257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=288f6fb0591946d8800ff72ce54b68d8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:56.991910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:57.076609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288f6fb0591946d8800ff72ce54b68d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.094193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288f6fb0591946d8800ff72ce54b68d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.095726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288f6fb0591946d8800ff72ce54b68d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.097156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288f6fb0591946d8800ff72ce54b68d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.113441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288f6fb0591946d8800ff72ce54b68d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.151796 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3903/7727] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:56 2022] DELETE /identity/v3/users/288f6fb0591946d8800ff72ce54b68d8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:57.156266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:57.158271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:57.185975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40f38-aa98-4668-9792-45ae3109d6e9 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:57.289008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:57.289912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:57.290388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:57.290818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/4fb02304355f4d9482412b11aad351fb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:57.292154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4fb02304355f4d9482412b11aad351fb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:57.298106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:57.384002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb02304355f4d9482412b11aad351fb', 'request_id': 'req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.391497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb02304355f4d9482412b11aad351fb', 'request_id': 'req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.399733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:UPDATE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:57.419382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb02304355f4d9482412b11aad351fb', 'request_id': 'req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.444090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] The token cache is being invalidate because project 4fb02304355f4d9482412b11aad351fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:57.444660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.445544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:57.453489 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3825/7728] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:48:57 2022] DELETE /identity/v3/projects/4fb02304355f4d9482412b11aad351fb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:57.453590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:57.454980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:57.480330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc83390-7fea-4d6e-acea-8a5255950735 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:57.586729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:57.605662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:57.606626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:57.607009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:57.607351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:57.608081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:57.610182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:57.655762 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3904/7729] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Oct 31 05:48:57 2022] POST /identity/v3/projects => generated 329 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:48:57.660125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:57.661834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:57.677264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0ba1-75e2-4a50-b793-538b3b6f5ee7 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:57.778179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:57.787012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:57.787305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:57.787589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:57.788820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:57.790841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:57.827987 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3826/7730] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:48:57 2022] POST /identity/v3/users => generated 413 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:57.833929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:57.848993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d280-4b49-49cb-b999-173d55245923 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:57.854280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:57.855035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:57.856751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:57.857466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:57.859736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:57.861900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:57.890243 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3905/7731] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:57 2022] POST /identity/v3/roles => generated 244 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:57.893898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:57.906850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b2118-eb9a-407b-814a-258942eb4701 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:57.912833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:57.913818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:57.914399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:57.914852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:57.915732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:57.918547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:57.956613 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3827/7732] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Oct 31 05:48:57 2022] POST /identity/v3/roles => generated 247 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:57.961571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:57.985181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31fc64-fdc9-4e98-b2be-cc4905ec8c52 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:57.991007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:57.992058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:57.993995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:57.995399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/b82f9dde17334fec87f7a624db09e6b2/users/17592c35df84413a850cdcb554a18b69/roles/717b639087c749578718f9775ce196c7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.029184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b82f9dde17334fec87f7a624db09e6b2, user_id=17592c35df84413a850cdcb554a18b69, role_id=717b639087c749578718f9775ce196c7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.032963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.056072 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3906/7733] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:57 2022] PUT /identity/v3/projects/b82f9dde17334fec87f7a624db09e6b2/users/17592c35df84413a850cdcb554a18b69/roles/717b639087c749578718f9775ce196c7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:58.062361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:58.081136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e7e5-3217-4d38-b0ac-ea95546ba758 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:58.191218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f0e81-c85b-43fb-8a9c-2a05e184e75b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:58.192098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f0e81-c85b-43fb-8a9c-2a05e184e75b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.192479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f0e81-c85b-43fb-8a9c-2a05e184e75b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.192770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f0e81-c85b-43fb-8a9c-2a05e184e75b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/b82f9dde17334fec87f7a624db09e6b2/users/17592c35df84413a850cdcb554a18b69/roles/b065322ed2f64e899d574ee28286cf1e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.197296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f0e81-c85b-43fb-8a9c-2a05e184e75b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b82f9dde17334fec87f7a624db09e6b2, user_id=17592c35df84413a850cdcb554a18b69, role_id=b065322ed2f64e899d574ee28286cf1e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.201913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f0e81-c85b-43fb-8a9c-2a05e184e75b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.235467 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3828/7734] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:48:58 2022] PUT /identity/v3/projects/b82f9dde17334fec87f7a624db09e6b2/users/17592c35df84413a850cdcb554a18b69/roles/b065322ed2f64e899d574ee28286cf1e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:58.236792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:58.251666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f236e6-ba42-4da1-8c2d-34ad1cb25980 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:58.334343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdd493-a922-4bff-8713-be14dc891a9b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:58.335132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdd493-a922-4bff-8713-be14dc891a9b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.335525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdd493-a922-4bff-8713-be14dc891a9b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.335910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdd493-a922-4bff-8713-be14dc891a9b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.336714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdd493-a922-4bff-8713-be14dc891a9b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.339373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdd493-a922-4bff-8713-be14dc891a9b tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.382357 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3907/7735] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:48:58 2022] GET /identity/v3/users => generated 8326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:48:58.384751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.385536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.385946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.445893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] MFA Rules not processed for user `17592c35df84413a850cdcb554a18b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:58.447761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:58.516889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:58.564074 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3829/7736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:48:58.576027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.576794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.577346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.607175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] MFA Rules not processed for user `17592c35df84413a850cdcb554a18b69`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:48:58.608929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:58.628880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:58.633535 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3908/7737] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:48:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:48:58.645706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa548d0-0e0d-4fce-b58c-36cea08a8192 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:58.654498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:58.655266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.656904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.657412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.659498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:create_trust()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.660738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.827073 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3830/7738] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 31 05:48:58 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:48:58.829003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:58.842207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7457a8-d078-4fbd-b13a-f57703ec72bf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:58.862255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:58.863559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.864299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.869056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.877553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:get_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.881053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.895280 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3909/7739] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:58 2022] GET /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6 => generated 835 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:58.896495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:58.908015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f58f-f49d-444a-a72d-abb16e7804e3 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:58.914288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:58.915129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.915415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.915702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.922609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.924165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.934301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3831/7740] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 31 05:48:58 2022] GET /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:48:58.939446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:58.959050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544566f-2e26-4cba-b880-f5da202cf165 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:58.964767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:58.965720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:58.966080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:58.966549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/717b639087c749578718f9775ce196c7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:58.976101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6, role_id=717b639087c749578718f9775ce196c7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:58.976587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:58.986362 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3910/7741] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:48:58 2022] GET /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/717b639087c749578718f9775ce196c7 => generated 244 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:48:58.991141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.005986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfbd91-740f-4dab-a0fc-c32f0506dcf4 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.018607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.019446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.019877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.020261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/717b639087c749578718f9775ce196c7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.034303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6, role_id=717b639087c749578718f9775ce196c7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.036951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:59.047261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3832/7742] 10.222.0.23 () {58 vars in 1369 bytes} [Mon Oct 31 05:48:58 2022] HEAD /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/717b639087c749578718f9775ce196c7 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 31 05:48:59.051959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.066783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958850a-a897-4fbc-81da-0aba92463b55 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.073705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.075853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.076541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.077040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/b065322ed2f64e899d574ee28286cf1e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.085923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6, role_id=b065322ed2f64e899d574ee28286cf1e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.088587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Could not find role: b065322ed2f64e899d574ee28286cf1e.: keystone.exception.RoleNotFound: Could not find role: b065322ed2f64e899d574ee28286cf1e. Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:48:59.111630 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b065322ed2f64e899d574ee28286cf1e. Oct 31 05:48:59.112608 n-d-862355-5 devstack@keystone.service[82000]: ERROR keystone.server.flask.application Oct 31 05:48:59.113184 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3911/7743] 10.222.0.23 () {58 vars in 1368 bytes} [Mon Oct 31 05:48:59 2022] GET /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/b065322ed2f64e899d574ee28286cf1e => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:59.118029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.133596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd60fc-6b0f-4640-8b93-4696fd6a73ec tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.148324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.149018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `HEAD` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.149819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.150114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/b065322ed2f64e899d574ee28286cf1e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.178353 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6, role_id=b065322ed2f64e899d574ee28286cf1e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.179980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Could not find role: b065322ed2f64e899d574ee28286cf1e.: keystone.exception.RoleNotFound: Could not find role: b065322ed2f64e899d574ee28286cf1e. Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 05:48:59.192410 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b065322ed2f64e899d574ee28286cf1e. Oct 31 05:48:59.194733 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:59.194733 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3833/7744] 10.222.0.23 () {58 vars in 1369 bytes} [Mon Oct 31 05:48:59 2022] HEAD /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6/roles/b065322ed2f64e899d574ee28286cf1e => generated 0 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 31 05:48:59.200753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.233960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebe86-138b-4233-be09-532496b6d9a5 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.238769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.239890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.240278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.240760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.248912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorizing `identity:delete_trust(trust_id=fde2c548472f40088ddb76e4f8eee9b6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.250832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:59.285085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fde2c548472f40088ddb76e4f8eee9b6', 'request_id': 'req-b4e18cca-c982-412f-a61d-16877adba407'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.291705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'fde2c548472f40088ddb76e4f8eee9b6', 'request_id': 'req-b4e18cca-c982-412f-a61d-16877adba407'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.310401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:59.321333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fde2c548472f40088ddb76e4f8eee9b6', 'request_id': 'req-b4e18cca-c982-412f-a61d-16877adba407'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.338655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3912/7745] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 31 05:48:59 2022] DELETE /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:59.343886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.345582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:59.378673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbb9cf-7725-4168-964c-efabeac70d90 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.390259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17592c35df84413a850cdcb554a18b69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82f9dde17334fec87f7a624db09e6b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1772154975', 'tempest-DelegatedRole-1906425804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.390939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.391221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.391501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] PATH_INFO: `/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Could not find trust: fde2c548472f40088ddb76e4f8eee9b6.: keystone.exception.TrustNotFound: Could not find trust: fde2c548472f40088ddb76e4f8eee9b6. Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 05:48:59.411950 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: fde2c548472f40088ddb76e4f8eee9b6. Oct 31 05:48:59.413211 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:48:59.413986 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3834/7746] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 31 05:48:59 2022] GET /identity/v3/OS-TRUST/trusts/fde2c548472f40088ddb76e4f8eee9b6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:48:59.417445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.419764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:59.450518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e18cca-c982-412f-a61d-16877adba407 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.457946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.458918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.459427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.460366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/b065322ed2f64e899d574ee28286cf1e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.462063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b065322ed2f64e899d574ee28286cf1e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.464196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:59.544646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role b065322ed2f64e899d574ee28286cf1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:59.545198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.546665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.554392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3913/7747] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:59 2022] DELETE /identity/v3/roles/b065322ed2f64e899d574ee28286cf1e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:48:59.555704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.557649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:48:59.597427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022b612-72c1-4d2d-9715-8ebda6d2fe81 tempest-TrustsV3TestJSON-1724286355 tempest-user-325849320] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.717317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.719055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.719055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.719055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/roles/717b639087c749578718f9775ce196c7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.720521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_role(role_id=717b639087c749578718f9775ce196c7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.722707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:48:59.736867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:48:59.797585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invalidating the token cache because role 717b639087c749578718f9775ce196c7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:48:59.799374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.800454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:48:59.807258 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3835/7748] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:59 2022] DELETE /identity/v3/roles/717b639087c749578718f9775ce196c7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:48:59.812312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:48:59.833141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0828-588e-40bb-a80f-04ae3839f885 tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:48:59.967837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:48:59.968878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:48:59.969425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:48:59.969925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/users/17592c35df84413a850cdcb554a18b69` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:48:59.971991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_user(user_id=17592c35df84413a850cdcb554a18b69)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:48:59.974774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:00.041325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17592c35df84413a850cdcb554a18b69'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.075739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17592c35df84413a850cdcb554a18b69'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.077146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17592c35df84413a850cdcb554a18b69'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.077805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17592c35df84413a850cdcb554a18b69'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.106647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17592c35df84413a850cdcb554a18b69'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.134665 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3914/7749] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:48:59 2022] DELETE /identity/v3/users/17592c35df84413a850cdcb554a18b69 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:00.139771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:00.141808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:00.158899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d25c8-4b48-4827-8117-873c621fcf7c tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:00.310088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8374d451a82d4f1ab28b9192f813a1c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0a359c536041d0b90fdb0a6c60f030', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:00.312003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:00.312443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:00.312895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] PATH_INFO: `/v3/projects/b82f9dde17334fec87f7a624db09e6b2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:00.314284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b82f9dde17334fec87f7a624db09e6b2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:00.316449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:00.383364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:00.385782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:00.407306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82f9dde17334fec87f7a624db09e6b2', 'request_id': 'req-eedf6fac-af24-48d6-982a-fe6105605c2d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.416717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82f9dde17334fec87f7a624db09e6b2', 'request_id': 'req-eedf6fac-af24-48d6-982a-fe6105605c2d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.428371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82f9dde17334fec87f7a624db09e6b2', 'request_id': 'req-eedf6fac-af24-48d6-982a-fe6105605c2d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.443658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] The token cache is being invalidate because project b82f9dde17334fec87f7a624db09e6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:00.444101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.445143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.447378 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3836/7750] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:00 2022] DELETE /identity/v3/projects/b82f9dde17334fec87f7a624db09e6b2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:00.455905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:00.461141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:00.492167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:00.568311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c24e9-81dd-49b6-be71-67adc58d387f tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:00.595868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6fac-af24-48d6-982a-fe6105605c2d tempest-TrustsV3TestJSON-866735943 tempest-TrustsV3TestJSON-866735943-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:00.604904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:00.606067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:00.606443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:00.606750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] PATH_INFO: `/v3/users/e80f8fa8ca6c40ca82dfe398c850bfa0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:00.614053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80f8fa8ca6c40ca82dfe398c850bfa0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:00.616216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:00.618410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:00.675630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:00.678777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:00.679153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:00.679544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] PATH_INFO: `/v3/users/29167802f249485280914e02306751ae` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:00.681285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29167802f249485280914e02306751ae)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:00.686000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:00.702468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80f8fa8ca6c40ca82dfe398c850bfa0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.718226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80f8fa8ca6c40ca82dfe398c850bfa0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.719184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80f8fa8ca6c40ca82dfe398c850bfa0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.719998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80f8fa8ca6c40ca82dfe398c850bfa0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.734068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ae52fac8-8455-4b1e-98c5-85b897df2fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80f8fa8ca6c40ca82dfe398c850bfa0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.767030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29167802f249485280914e02306751ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.784131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29167802f249485280914e02306751ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.784968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29167802f249485280914e02306751ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.785595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29167802f249485280914e02306751ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.788066 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3837/7751] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:00 2022] DELETE /identity/v3/users/e80f8fa8ca6c40ca82dfe398c850bfa0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:00.793095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:00.793505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:00.794060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:00.802995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e4c96bc1-0b9a-46cc-852e-d703f7a2267c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29167802f249485280914e02306751ae'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:00.822865 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3915/7752] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:00 2022] DELETE /identity/v3/users/29167802f249485280914e02306751ae => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:00.829534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:00.830095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:00.830579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:00.847577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:00.848965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:00.857623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:00.859058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:00.937457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:00.954228 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3916/7753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:00.963484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:00.967059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:00.975026 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3838/7754] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:00.986916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:00.988870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:01.100856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213b1ba-af11-488d-a9b3-bcc56a216e44 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:01.106946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:01.108109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:01.108710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:01.109198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:01.127311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de8a1-9a17-4622-9921-09f3677da9ad None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:01.134073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93e745-299d-482a-9b1d-08cc0aeca959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:01.136166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93e745-299d-482a-9b1d-08cc0aeca959 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:01.136724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:01.137276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93e745-299d-482a-9b1d-08cc0aeca959 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:01.137881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93e745-299d-482a-9b1d-08cc0aeca959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:01.142740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:01.152398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93e745-299d-482a-9b1d-08cc0aeca959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:01.155494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93e745-299d-482a-9b1d-08cc0aeca959 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:01.174489 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3839/7755] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:49:01.195151 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3917/7756] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:49:01.715528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:01.717297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:01.758785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84427d5-dc66-407c-9816-f930bed53e14 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:01.765457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:01.766531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:01.766809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:01.767100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] PATH_INFO: `/v3/projects/f2b06b0297364e1b8908ee0a48cf621a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:01.768453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b06b0297364e1b8908ee0a48cf621a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:01.770985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:01.797993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:01.848334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b06b0297364e1b8908ee0a48cf621a', 'request_id': 'req-8faa93c5-3253-4e8a-8c28-e0a104934002'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:01.857295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b06b0297364e1b8908ee0a48cf621a', 'request_id': 'req-8faa93c5-3253-4e8a-8c28-e0a104934002'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:01.868588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b06b0297364e1b8908ee0a48cf621a', 'request_id': 'req-8faa93c5-3253-4e8a-8c28-e0a104934002'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:01.882226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] The token cache is being invalidate because project f2b06b0297364e1b8908ee0a48cf621a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:01.882545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:01.883229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8faa93c5-3253-4e8a-8c28-e0a104934002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:01.889060 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3840/7757] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:01 2022] DELETE /identity/v3/projects/f2b06b0297364e1b8908ee0a48cf621a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:01.891736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:01.892221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:01.892316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:01.929919 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:01.931424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:02.033651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3918/7758] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:02.035515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.036054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.036444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.061313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:02.062785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:02.073130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3841/7759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:02.078331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.090230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff41b-54d7-4cf0-b1a5-fc3e7e1d6ad6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.096216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.096913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.097351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.097643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.098649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:02.098948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.100648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.115630 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3919/7760] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:02.120147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.131912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68c15-d2ea-47e4-8945-6d45f2809898 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.139234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.139876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.140153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.140426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.141129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.143213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.179495 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3842/7761] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:02 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:02.184841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.198534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89eb2a-c5c9-4528-8578-7bbbfe6f1c94 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.263961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.264604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.264922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.266355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.267261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.269353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.297820 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3920/7762] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:02 2022] POST /identity/v3/users => generated 279 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:02.302069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.314102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80eab-20ab-4da4-ac27-dc7b4929b6c0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.319227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.319841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.320126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.320431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.321086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.322710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.334903 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3843/7763] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:02.340100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.352455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda83d9-bd3e-4f45-aa93-9cec08131323 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.357314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.357941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.358244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.358666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.359340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.361083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.379806 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3921/7764] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:02.379970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.380570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:02.380960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.405424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7f94-6124-4d79-8384-070264543373 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.406507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf9b31-1784-4256-b433-94dbeb2a89b9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.411216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae6ce6-9c54-41fd-908e-daa0939f8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.411933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6ce6-9c54-41fd-908e-daa0939f8735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.412158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6ce6-9c54-41fd-908e-daa0939f8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.412445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6ce6-9c54-41fd-908e-daa0939f8735 admin admin] PATH_INFO: `/v3/projects/2253698f76054151861015cee1581d1f/users/3884912e30674c76a7361b94cc7dd5b6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.413087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.413999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.414203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.414477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] PATH_INFO: `/v3/projects/cb1c76858828469f9082a9990cf33d96` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.415025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:02.419030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1c76858828469f9082a9990cf33d96)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.422537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.441570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae6ce6-9c54-41fd-908e-daa0939f8735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2253698f76054151861015cee1581d1f, user_id=3884912e30674c76a7361b94cc7dd5b6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.444503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae6ce6-9c54-41fd-908e-daa0939f8735 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.488811 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3922/7765] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:02 2022] PUT /identity/v3/projects/2253698f76054151861015cee1581d1f/users/3884912e30674c76a7361b94cc7dd5b6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:02.497067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.497423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.497707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.543936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1c76858828469f9082a9990cf33d96', 'request_id': 'req-d2d80c61-064e-43a6-8750-9fcaa61a1ede'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:02.556578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1c76858828469f9082a9990cf33d96', 'request_id': 'req-d2d80c61-064e-43a6-8750-9fcaa61a1ede'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:02.577287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1c76858828469f9082a9990cf33d96', 'request_id': 'req-d2d80c61-064e-43a6-8750-9fcaa61a1ede'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:02.579716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] MFA Rules not processed for user `3884912e30674c76a7361b94cc7dd5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:02.581114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:02.594360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] The token cache is being invalidate because project cb1c76858828469f9082a9990cf33d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:02.594755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:02.595538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:02.601055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3844/7766] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:02 2022] DELETE /identity/v3/projects/cb1c76858828469f9082a9990cf33d96 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:02.602081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.618640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:02.757913 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3923/7767] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:02.766570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:02.771963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:02.789114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:02.837610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d80c61-064e-43a6-8750-9fcaa61a1ede admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.852869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.853684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.854760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.856573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] PATH_INFO: `/v3/users/8374d451a82d4f1ab28b9192f813a1c9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.858874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8374d451a82d4f1ab28b9192f813a1c9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.865009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.884944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595764c2-8443-4be2-a774-f5752c0d41eb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:02.889882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:02.890656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:02.891042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:02.893805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:02.913762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:02.917246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:02.932480 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3924/7768] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:02.988641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8374d451a82d4f1ab28b9192f813a1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.000440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8374d451a82d4f1ab28b9192f813a1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.001550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8374d451a82d4f1ab28b9192f813a1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.003072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8374d451a82d4f1ab28b9192f813a1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.023015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68e1814e-930a-4822-adcc-4dff0c5cba2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8374d451a82d4f1ab28b9192f813a1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.071019 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3845/7769] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:02 2022] DELETE /identity/v3/users/8374d451a82d4f1ab28b9192f813a1c9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:03.571271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:03.593775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9156f-eed5-42b6-a104-d93369c2dfec service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:03.700166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:03.700742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:03.701090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:03.701717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] PATH_INFO: `/v3/projects/be0a359c536041d0b90fdb0a6c60f030` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:03.702748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0a359c536041d0b90fdb0a6c60f030)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:03.705361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:03.731319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:03.798327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0a359c536041d0b90fdb0a6c60f030', 'request_id': 'req-1bcec17f-7938-4a50-af6c-d1df651d8b2c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.815419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0a359c536041d0b90fdb0a6c60f030', 'request_id': 'req-1bcec17f-7938-4a50-af6c-d1df651d8b2c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.832834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0a359c536041d0b90fdb0a6c60f030', 'request_id': 'req-1bcec17f-7938-4a50-af6c-d1df651d8b2c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.853602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] The token cache is being invalidate because project be0a359c536041d0b90fdb0a6c60f030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:03.854412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.855580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1bcec17f-7938-4a50-af6c-d1df651d8b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:03.864506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:03.865444 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3925/7770] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:03 2022] DELETE /identity/v3/projects/be0a359c536041d0b90fdb0a6c60f030 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:03.865989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:03.866339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:03.919473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:03.921060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:04.038935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.040603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.041111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.047143 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3846/7771] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:04.069143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:04.070683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:04.083836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.084709 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3926/7772] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:04.098635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7e2e8-f503-4bb8-836e-fce796c7e59a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.104012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.104998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.105527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.106017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.106957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:04.108129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.110500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.132845 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3847/7773] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:04.138252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.150918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb0a8-e941-404c-b47c-236d2b630268 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.162556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.163196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.163481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.163757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.164418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.166463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.220394 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3927/7774] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:04 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:04.224257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.241989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f4356-2b6b-447c-93b0-4bd255717c79 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.329073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:04.347015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.347918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.348833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.350182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.351879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.354193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.385281 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3848/7775] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:04 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:04.386639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.403143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d61de-b478-4bbc-be11-6081625d9e80 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.409880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.410958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.410958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.411266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.411861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.413664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.429090 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3928/7776] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:04.430054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.441215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a852-2e92-4db0-a6d2-4106bbfb8971 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.457251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c0fba-0755-4836-8c56-3a850347b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.457896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c0fba-0755-4836-8c56-3a850347b7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.458206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c0fba-0755-4836-8c56-3a850347b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.458495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c0fba-0755-4836-8c56-3a850347b7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.459198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c0fba-0755-4836-8c56-3a850347b7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.461455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c0fba-0755-4836-8c56-3a850347b7a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.477459 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3849/7777] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:04.483260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.498353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5780-84ff-4a82-be2f-eac804d31081 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.507596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.508345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.508627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.508904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] PATH_INFO: `/v3/projects/e3c0ca7e0e25444189bff46d728d045a/users/afd95e2f78214cf5b0ea2e406245414f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.529176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c0ca7e0e25444189bff46d728d045a, user_id=afd95e2f78214cf5b0ea2e406245414f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.534321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.566980 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3929/7778] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:04 2022] PUT /identity/v3/projects/e3c0ca7e0e25444189bff46d728d045a/users/afd95e2f78214cf5b0ea2e406245414f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:04.572314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.572592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.572809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.607717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] MFA Rules not processed for user `afd95e2f78214cf5b0ea2e406245414f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:04.608595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:04.761716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.762471 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3850/7779] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:04.781151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a12018-f672-4568-a78f-91eb6ca58658 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.785477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a00878-1a04-49d7-a354-76f9c643fd7e tempest-IdentityCatalogTest-140919806 tempest-IdentityCatalogTest-140919806-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afd95e2f78214cf5b0ea2e406245414f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3c0ca7e0e25444189bff46d728d045a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.786111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a00878-1a04-49d7-a354-76f9c643fd7e tempest-IdentityCatalogTest-140919806 tempest-IdentityCatalogTest-140919806-project] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.786425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a00878-1a04-49d7-a354-76f9c643fd7e tempest-IdentityCatalogTest-140919806 tempest-IdentityCatalogTest-140919806-project] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.786702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a00878-1a04-49d7-a354-76f9c643fd7e tempest-IdentityCatalogTest-140919806 tempest-IdentityCatalogTest-140919806-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.787288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a00878-1a04-49d7-a354-76f9c643fd7e tempest-IdentityCatalogTest-140919806 tempest-IdentityCatalogTest-140919806-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.788377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a00878-1a04-49d7-a354-76f9c643fd7e tempest-IdentityCatalogTest-140919806 tempest-IdentityCatalogTest-140919806-project] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:04.790371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3930/7780] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 31 05:49:04 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:04.796005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:04.944131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc076-b9bd-4c2b-9e02-04014ad27ac2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:04.950767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:04.951922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:04.952316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:04.952732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] PATH_INFO: `/v3/users/afd95e2f78214cf5b0ea2e406245414f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:04.957556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd95e2f78214cf5b0ea2e406245414f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:04.959931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:05.130593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd95e2f78214cf5b0ea2e406245414f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:05.146668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd95e2f78214cf5b0ea2e406245414f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:05.150231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd95e2f78214cf5b0ea2e406245414f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:05.152546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd95e2f78214cf5b0ea2e406245414f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:05.169356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd95e2f78214cf5b0ea2e406245414f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:05.171890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:05.200283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3851/7781] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:04 2022] DELETE /identity/v3/users/afd95e2f78214cf5b0ea2e406245414f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:05.204740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:05.205222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:05.205377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:05.239687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:05.241713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:05.362501 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3931/7782] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:05.371886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:05.375473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:05.473902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba3d55-ff83-4626-a3a8-3c2e4cf65d1a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:05.479235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d2a36-8a1c-4624-9c47-b6afe18f0131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:05.480382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2a36-8a1c-4624-9c47-b6afe18f0131 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:05.480694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2a36-8a1c-4624-9c47-b6afe18f0131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:05.481231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2a36-8a1c-4624-9c47-b6afe18f0131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:05.493488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d2a36-8a1c-4624-9c47-b6afe18f0131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:05.495211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d2a36-8a1c-4624-9c47-b6afe18f0131 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:05.508205 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3852/7783] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:49:06.595144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:06.598596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:06.626553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34817311-b2de-4fbe-a8cd-6da68b15bd00 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:06.632825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:06.633490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:06.633954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:06.634702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] PATH_INFO: `/v3/projects/e3c0ca7e0e25444189bff46d728d045a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:06.638798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c0ca7e0e25444189bff46d728d045a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:06.641213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:06.693993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:06.716405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c0ca7e0e25444189bff46d728d045a', 'request_id': 'req-fbd0a43c-6857-476e-af27-af78ad0e4bc2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:06.724340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c0ca7e0e25444189bff46d728d045a', 'request_id': 'req-fbd0a43c-6857-476e-af27-af78ad0e4bc2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:06.731719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c0ca7e0e25444189bff46d728d045a', 'request_id': 'req-fbd0a43c-6857-476e-af27-af78ad0e4bc2'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:06.750656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] The token cache is being invalidate because project e3c0ca7e0e25444189bff46d728d045a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:06.751247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:06.752085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fbd0a43c-6857-476e-af27-af78ad0e4bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:06.754875 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3932/7784] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:06 2022] DELETE /identity/v3/projects/e3c0ca7e0e25444189bff46d728d045a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:06.759757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:06.760285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:06.760385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:06.788880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:06.790301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:06.930121 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3853/7785] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:06.939824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:06.940534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:06.940870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.017206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:07.018557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:07.043506 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3933/7786] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:07.045568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.071408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd9610-4a68-457e-b517-be75571c7af8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.092270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.093022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.093656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.094040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.094873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:07.096025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.097806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.131375 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3854/7787] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:07.135690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.151478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010102b-7222-4450-976d-66fb9e244a81 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.163363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.166322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.166949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.167400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.169797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.175122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.241089 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3934/7788] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:07 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:07.245107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.258952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067d288-b609-474e-ab6b-c4f096914b3a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.432063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.432843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.433163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.433445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.434098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.436240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.468753 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3855/7789] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:07 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:07.470035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.492684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0c31-ef76-4e77-9947-5c4215c9597b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.521454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.522664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.523202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.523734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.524677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.526825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.553734 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3935/7790] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:07.557991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.564872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:07.577241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639551b9-8fe3-4293-972f-2ba6cd08cda3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.590672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.591952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.594574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.594938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] PATH_INFO: `/v3/projects/e224f65eb908460b866ec9f5b7f9c4d0/users/389ecd205fd741dbb3cd3acfba48f8fb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.644694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=e224f65eb908460b866ec9f5b7f9c4d0, user_id=389ecd205fd741dbb3cd3acfba48f8fb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.648629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.682322 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3856/7791] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:07 2022] PUT /identity/v3/projects/e224f65eb908460b866ec9f5b7f9c4d0/users/389ecd205fd741dbb3cd3acfba48f8fb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:07.683871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.702881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7cad6-725a-4b39-a7b7-295b714a9b2a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.827817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372ed58-9bac-40c0-88b6-c30139447011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.828476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ed58-9bac-40c0-88b6-c30139447011 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.828799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ed58-9bac-40c0-88b6-c30139447011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.829223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ed58-9bac-40c0-88b6-c30139447011 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.829823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372ed58-9bac-40c0-88b6-c30139447011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.831494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372ed58-9bac-40c0-88b6-c30139447011 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.859626 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3936/7792] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:07.863517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:07.883855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17285d26-da54-4f2b-a849-2869c8726dde admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:07.900201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:07.901020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.901363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.901647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] PATH_INFO: `/v3/projects/e224f65eb908460b866ec9f5b7f9c4d0/users/389ecd205fd741dbb3cd3acfba48f8fb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:07.912518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e224f65eb908460b866ec9f5b7f9c4d0, user_id=389ecd205fd741dbb3cd3acfba48f8fb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:07.916283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:07.963665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3857/7793] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:07 2022] PUT /identity/v3/projects/e224f65eb908460b866ec9f5b7f9c4d0/users/389ecd205fd741dbb3cd3acfba48f8fb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:07.974833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:07.975221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:07.975602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:08.038475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] MFA Rules not processed for user `389ecd205fd741dbb3cd3acfba48f8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:08.039715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:08.157097 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3937/7794] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:08.161257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:08.362105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf65d6-505a-43ec-9604-304704e030d0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:08.381202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:08.382052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:08.382568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:08.383011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:08.384173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:08.395399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:08.465781 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3858/7795] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:08 2022] POST /identity/v3/projects => generated 393 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:49:08.467630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:08.475814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:08.491606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebea05-c1b6-4c6e-9048-e650a9758993 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:08.616653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:08.618605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:08.619115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:08.619398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:08.620401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:08.627644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:08.664308 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3938/7796] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:08 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:08.665839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:08.682223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce563f-7155-4535-ac31-bdc00a5539e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:08.695272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:08.695924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:08.696317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:08.697450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:08.698298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:08.701960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:08.733564 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3859/7797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:49:08.738627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:08.755680 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5d160-4576-48db-9f28-e68b204a3f52 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:08.790811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3e869-9c07-4dbe-ad98-138e2dd556ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:08.791672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3e869-9c07-4dbe-ad98-138e2dd556ef admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:08.792164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3e869-9c07-4dbe-ad98-138e2dd556ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:08.793934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3e869-9c07-4dbe-ad98-138e2dd556ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:08.795387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3e869-9c07-4dbe-ad98-138e2dd556ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:08.798024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3e869-9c07-4dbe-ad98-138e2dd556ef admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:08.822826 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3939/7798] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:08.827188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:08.839374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef276f-cf0f-4e7d-b366-1bc191e718c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:08.849168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:08.849894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:08.850432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:08.850578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] PATH_INFO: `/v3/projects/6eb764ed2dc94c638d2613a5264f1aae/users/67c7905452724849bba17ec5dacf8419/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:08.883689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb764ed2dc94c638d2613a5264f1aae, user_id=67c7905452724849bba17ec5dacf8419, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:08.890288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:08.928925 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3860/7799] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:08 2022] PUT /identity/v3/projects/6eb764ed2dc94c638d2613a5264f1aae/users/67c7905452724849bba17ec5dacf8419/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:08.944282 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:08.944673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:08.945020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:09.028866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] MFA Rules not processed for user `67c7905452724849bba17ec5dacf8419`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:09.030527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:09.201379 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3940/7800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:09.211083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:09.218525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:09.419354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f272-0af8-4c11-8d91-f8f2eaed4f5c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:09.433723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:09.434961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:09.435265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:09.435713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:09.454292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:09.556820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:09.559000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:09.581187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3861/7801] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:09 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:10.369431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:10.374280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:10.457198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:10.459413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:10.553922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:10.592159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349e5e0-cb54-4783-8ec2-917c184eded6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:10.604710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:10.605415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:10.605777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:10.606067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:10.608412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:10.638493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89a5aa-ac3f-4e9c-ac43-23b2a540c690 service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:10.652496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:10.653442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:10.654420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:10.655146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] PATH_INFO: `/v3/users/db14c5e21a6e4120b57ae91ad77cb834` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:10.660461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db14c5e21a6e4120b57ae91ad77cb834)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:10.663351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:10.814449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db14c5e21a6e4120b57ae91ad77cb834'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:10.842747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db14c5e21a6e4120b57ae91ad77cb834'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:10.845134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db14c5e21a6e4120b57ae91ad77cb834'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:10.846029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db14c5e21a6e4120b57ae91ad77cb834'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:10.852226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:10.855644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:10.884200 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db14c5e21a6e4120b57ae91ad77cb834'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:10.944615 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3941/7802] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:10.960706 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3862/7803] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:10 2022] DELETE /identity/v3/users/db14c5e21a6e4120b57ae91ad77cb834 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:11.232024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:11.242630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:11.244505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:11.265222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f25a-9bfa-4e8f-a124-70a30f2bc81c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:11.279772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:11.400507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda72c-9433-42d5-897f-4d9046098214 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:11.407223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:11.409645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:11.410415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:11.410965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] PATH_INFO: `/v3/projects/767ac163e9fe4d51a864ae5083c5475a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:11.411215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:11.413151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767ac163e9fe4d51a864ae5083c5475a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:11.413407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:11.413750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:11.414062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] PATH_INFO: `/v3/users/389ecd205fd741dbb3cd3acfba48f8fb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:11.416134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:11.420855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] RBAC: Authorizing `identity:delete_user(user_id=389ecd205fd741dbb3cd3acfba48f8fb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:11.426839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:11.494627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767ac163e9fe4d51a864ae5083c5475a', 'request_id': 'req-bab161b5-a1fe-47be-8f1c-6a8913214031'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.529196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767ac163e9fe4d51a864ae5083c5475a', 'request_id': 'req-bab161b5-a1fe-47be-8f1c-6a8913214031'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.536970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389ecd205fd741dbb3cd3acfba48f8fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.546183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767ac163e9fe4d51a864ae5083c5475a', 'request_id': 'req-bab161b5-a1fe-47be-8f1c-6a8913214031'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.552988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389ecd205fd741dbb3cd3acfba48f8fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.554015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389ecd205fd741dbb3cd3acfba48f8fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.555003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389ecd205fd741dbb3cd3acfba48f8fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.568054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] The token cache is being invalidate because project 767ac163e9fe4d51a864ae5083c5475a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:11.568752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.569441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.570537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3546d3fe-21bf-4886-b8de-ffc8ea03862d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389ecd205fd741dbb3cd3acfba48f8fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:11.571217 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3942/7804] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:11 2022] DELETE /identity/v3/projects/767ac163e9fe4d51a864ae5083c5475a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:11.575560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:11.576966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:11.611973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:11.619666 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3863/7805] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:11 2022] DELETE /identity/v3/users/389ecd205fd741dbb3cd3acfba48f8fb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:11.625201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:11.625904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:11.626673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:11.674731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:11.677905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:11.715695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab161b5-a1fe-47be-8f1c-6a8913214031 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:11.826613 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3864/7806] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:11.845970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:11.847682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:11.874688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:11.876717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:11.877238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:11.878700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] PATH_INFO: `/v3/users/6a20858f323a4dd6aca31a561b2b5376` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:11.881031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a20858f323a4dd6aca31a561b2b5376)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:11.885980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:11.956762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:12.015538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5992699-b50b-4077-a3c8-7f7b4b9a2bf6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:12.015775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a20858f323a4dd6aca31a561b2b5376'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:12.028550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:12.029582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:12.030027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:12.034658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:12.060519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a20858f323a4dd6aca31a561b2b5376'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:12.062730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a20858f323a4dd6aca31a561b2b5376'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:12.064153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a20858f323a4dd6aca31a561b2b5376'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:12.083007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:12.084100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a20858f323a4dd6aca31a561b2b5376'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:12.088876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:12.131081 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3943/7807] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:11 2022] DELETE /identity/v3/users/6a20858f323a4dd6aca31a561b2b5376 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:12.135915 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3865/7808] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:12.939097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:12.940229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:13.048867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:13.114385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b0ff-31bc-4f13-beef-b5b6f0820f30 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:13.125638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:13.126356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:13.126636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:13.126911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] PATH_INFO: `/v3/projects/cd2312eba5694e52984f33961ced6337` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:13.130592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:13.131773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2312eba5694e52984f33961ced6337)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:13.132972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:13.133739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:13.215922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689d0bf-a7f7-41b8-83b4-8279fb5e0efc service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:13.258137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2312eba5694e52984f33961ced6337', 'request_id': 'req-c5166ba0-8eb9-4537-899e-30a8f50f557d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.276309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2312eba5694e52984f33961ced6337', 'request_id': 'req-c5166ba0-8eb9-4537-899e-30a8f50f557d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.302953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2312eba5694e52984f33961ced6337', 'request_id': 'req-c5166ba0-8eb9-4537-899e-30a8f50f557d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.328517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] The token cache is being invalidate because project cd2312eba5694e52984f33961ced6337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:13.328883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.329837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.346184 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3944/7809] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:12 2022] DELETE /identity/v3/projects/cd2312eba5694e52984f33961ced6337 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:13.401192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:13.401585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:13.402523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:13.403196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] PATH_INFO: `/v3/projects/e224f65eb908460b866ec9f5b7f9c4d0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:13.407145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e224f65eb908460b866ec9f5b7f9c4d0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:13.409749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:13.515662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e224f65eb908460b866ec9f5b7f9c4d0', 'request_id': 'req-ebc52330-78d9-493e-8980-5e099ca00db3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.528697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e224f65eb908460b866ec9f5b7f9c4d0', 'request_id': 'req-ebc52330-78d9-493e-8980-5e099ca00db3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.550235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e224f65eb908460b866ec9f5b7f9c4d0', 'request_id': 'req-ebc52330-78d9-493e-8980-5e099ca00db3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.600340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] The token cache is being invalidate because project e224f65eb908460b866ec9f5b7f9c4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:13.601163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.608964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:13.617821 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3866/7810] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:13 2022] DELETE /identity/v3/projects/e224f65eb908460b866ec9f5b7f9c4d0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:13.639237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:13.640683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:13.686213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5166ba0-8eb9-4537-899e-30a8f50f557d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:13.828619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:13.829230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:13.829606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:13.829969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] PATH_INFO: `/v3/users/67c7905452724849bba17ec5dacf8419` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:13.833053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c7905452724849bba17ec5dacf8419)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:13.841243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:14.035997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c7905452724849bba17ec5dacf8419'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:14.123826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c7905452724849bba17ec5dacf8419'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:14.124710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c7905452724849bba17ec5dacf8419'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:14.125526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c7905452724849bba17ec5dacf8419'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:14.148355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e14cc899-d4d9-413b-bb1a-987bda500e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c7905452724849bba17ec5dacf8419'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:14.157985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:14.180664 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3945/7811] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:13 2022] DELETE /identity/v3/users/67c7905452724849bba17ec5dacf8419 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:14.742436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:14.744001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:14.777448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc52330-78d9-493e-8980-5e099ca00db3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:14.900844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:14.902746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:14.903283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:14.903404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] PATH_INFO: `/v3/projects/6eb764ed2dc94c638d2613a5264f1aae` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:14.906202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb764ed2dc94c638d2613a5264f1aae)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:14.912330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:14.927304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:14.993414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb764ed2dc94c638d2613a5264f1aae', 'request_id': 'req-b0b04f86-2a7c-47a7-af27-599f2640d30d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:15.010047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb764ed2dc94c638d2613a5264f1aae', 'request_id': 'req-b0b04f86-2a7c-47a7-af27-599f2640d30d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:15.031420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb764ed2dc94c638d2613a5264f1aae', 'request_id': 'req-b0b04f86-2a7c-47a7-af27-599f2640d30d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:15.076849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] The token cache is being invalidate because project 6eb764ed2dc94c638d2613a5264f1aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:15.079638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:15.079638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b0b04f86-2a7c-47a7-af27-599f2640d30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:15.082192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3867/7812] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:14 2022] DELETE /identity/v3/projects/6eb764ed2dc94c638d2613a5264f1aae => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:15.086744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.087220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.089859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:15.130377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:15.135124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:15.284918 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3946/7813] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:15.292085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.293256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.294856 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:15.344410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:15.349691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:15.373994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3868/7814] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:15.378177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:15.407262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dfa39-4c83-43b1-b3e2-55cb0a4d5b22 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:15.417602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:15.419287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.419287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.419287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:15.420425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:15.421553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:15.425444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:15.473787 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3947/7815] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:15.477061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:15.496787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec141a-192b-4049-b781-c731b70e78d7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:15.508470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:15.508786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.509172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.509982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:15.510997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:15.513880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:15.652583 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3869/7816] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:15 2022] POST /identity/v3/projects => generated 399 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:15.661271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:15.680752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5532804-a0c0-4225-acac-ccdcfe668336 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:15.810013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:15.810939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.811554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.811554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:15.812436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:15.814736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:15.840811 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3948/7817] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:15 2022] POST /identity/v3/users => generated 306 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:15.844699 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:15.874214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9b8e-f379-4bdd-a7ef-2494c690f57c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:15.900468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:15.901572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.903321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.903929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:15.905303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:15.907337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:15.923920 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3870/7818] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:49:15.927690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:15.954021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbab75-7c40-4b58-a06b-828541245e80 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:15.967294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:15.968990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:15.969504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:15.970028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] PATH_INFO: `/v3/projects/36cb20160dc442eeb0407bd8945a509f/users/c5930af9ff9e4d0fa0b7e0616a5b7c78/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.000234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cb20160dc442eeb0407bd8945a509f, user_id=c5930af9ff9e4d0fa0b7e0616a5b7c78, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.004133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:16.023376 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3949/7819] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:15 2022] PUT /identity/v3/projects/36cb20160dc442eeb0407bd8945a509f/users/c5930af9ff9e4d0fa0b7e0616a5b7c78/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:16.027303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:16.046613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f09bf-84cb-4914-92f5-aadd7df2300f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:16.160703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aea24-0dba-4188-8fe5-4bf6d0424b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:16.161596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aea24-0dba-4188-8fe5-4bf6d0424b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.162134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aea24-0dba-4188-8fe5-4bf6d0424b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.162485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aea24-0dba-4188-8fe5-4bf6d0424b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.163320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6aea24-0dba-4188-8fe5-4bf6d0424b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.165246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6aea24-0dba-4188-8fe5-4bf6d0424b03 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:16.184003 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3871/7820] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:16.187543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:16.202408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349a09-c79b-49ae-ac4a-a2bc2c2a1040 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:16.210426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:16.211826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.212287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.212724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] PATH_INFO: `/v3/projects/36cb20160dc442eeb0407bd8945a509f/users/c5930af9ff9e4d0fa0b7e0616a5b7c78/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.215988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cb20160dc442eeb0407bd8945a509f, user_id=c5930af9ff9e4d0fa0b7e0616a5b7c78, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.219210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:16.236568 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3950/7821] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:16 2022] PUT /identity/v3/projects/36cb20160dc442eeb0407bd8945a509f/users/c5930af9ff9e4d0fa0b7e0616a5b7c78/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:16.247003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.247299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.247607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.286304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] MFA Rules not processed for user `c5930af9ff9e4d0fa0b7e0616a5b7c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:16.287536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:16.368860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:16.419941 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3872/7822] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:16 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:16.424711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:16.517330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:16.591745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764b5c-65c4-460d-b9ff-86f6b4e6bc33 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:16.608732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:16.609626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.609988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.610335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.611077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.613519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:16.659769 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3951/7823] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:16 2022] POST /identity/v3/projects => generated 399 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:16.660662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:16.677214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176145-9a9e-4107-b4e7-31c2e74fa411 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:16.812867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:16.813525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.813814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.814283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.814958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.820744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:16.888090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:16.894949 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3873/7824] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:16 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:49:16.909343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43d75-c25a-4612-bf73-7dac18c0f807 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:16.929878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:16.934482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.935614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.936130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.938182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.940732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:16.958840 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3952/7825] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:16.961823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:16.975721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1baa-16f7-4ad0-b96a-6936d41cca4c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:16.981717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb67200-9f82-4a43-8b3f-da91150bbe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:16.982879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb67200-9f82-4a43-8b3f-da91150bbe3b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:16.983403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb67200-9f82-4a43-8b3f-da91150bbe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:16.983886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb67200-9f82-4a43-8b3f-da91150bbe3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:16.984769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb67200-9f82-4a43-8b3f-da91150bbe3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:16.986671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb67200-9f82-4a43-8b3f-da91150bbe3b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:17.021735 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3874/7826] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:17.023286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:17.039079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde90366-d261-43a6-a8c8-a45f82617a10 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:17.052057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:17.052764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:17.053051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:17.053332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] PATH_INFO: `/v3/projects/0503dbb989ce45f69ecd54a88898b506/users/d57a55b417f14448b8428930cc79a72a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:17.082229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0503dbb989ce45f69ecd54a88898b506, user_id=d57a55b417f14448b8428930cc79a72a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:17.085183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:17.129428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3953/7827] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:17 2022] PUT /identity/v3/projects/0503dbb989ce45f69ecd54a88898b506/users/d57a55b417f14448b8428930cc79a72a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:17.142210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:17.142764 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:17.143173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:17.217833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] MFA Rules not processed for user `d57a55b417f14448b8428930cc79a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:17.219269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:17.423861 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3875/7828] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:17.440774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:17.442668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:17.592532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0dde7-8d5e-4848-b069-8e37210feda4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:17.600287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9f471-70a8-42c3-98c1-cba4ae0ffc6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:17.601087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f471-70a8-42c3-98c1-cba4ae0ffc6c service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:17.601382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f471-70a8-42c3-98c1-cba4ae0ffc6c service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:17.601689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f471-70a8-42c3-98c1-cba4ae0ffc6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:17.738660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9f471-70a8-42c3-98c1-cba4ae0ffc6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:17.740180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9f471-70a8-42c3-98c1-cba4ae0ffc6c service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:17.752829 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3954/7829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:17 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:18.481880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:18.593027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:18.620013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321beb6-0433-4811-8fa3-8b64067dd1b6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:18.626440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:18.630322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:18.630874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:18.632601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] PATH_INFO: `/v3/users/c5930af9ff9e4d0fa0b7e0616a5b7c78` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:18.635224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5930af9ff9e4d0fa0b7e0616a5b7c78)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:18.638456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:18.742141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5930af9ff9e4d0fa0b7e0616a5b7c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:18.753718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5930af9ff9e4d0fa0b7e0616a5b7c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:18.755111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5930af9ff9e4d0fa0b7e0616a5b7c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:18.756333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5930af9ff9e4d0fa0b7e0616a5b7c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:18.768638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5930af9ff9e4d0fa0b7e0616a5b7c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:18.802131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:18.804069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:18.804545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:18.810812 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3876/7830] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:18 2022] DELETE /identity/v3/users/c5930af9ff9e4d0fa0b7e0616a5b7c78 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:18.831547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:18.833445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:18.883480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:18.935030 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3955/7831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:18.939300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:18.941184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:19.033320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a06d0-c680-4feb-bf54-87abd2535d47 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:19.040873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:19.041582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:19.041935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:19.043343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:19.054387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:19.055936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:19.069370 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3877/7832] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:49:19.449584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:19.451076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:19.473327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1e3e-b5b8-41e2-8fa1-63e8c391f14d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:19.479668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:19.481360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:19.481740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:19.482120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] PATH_INFO: `/v3/projects/36cb20160dc442eeb0407bd8945a509f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:19.483767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cb20160dc442eeb0407bd8945a509f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:19.486026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:19.572405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cb20160dc442eeb0407bd8945a509f', 'request_id': 'req-112e1131-154a-4fe4-b154-0cb1d32a7c49'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.581380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cb20160dc442eeb0407bd8945a509f', 'request_id': 'req-112e1131-154a-4fe4-b154-0cb1d32a7c49'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.588540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cb20160dc442eeb0407bd8945a509f', 'request_id': 'req-112e1131-154a-4fe4-b154-0cb1d32a7c49'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.616884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] The token cache is being invalidate because project 36cb20160dc442eeb0407bd8945a509f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:19.617185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.634849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.634849 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3956/7833] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:19 2022] DELETE /identity/v3/projects/36cb20160dc442eeb0407bd8945a509f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:19.638935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:19.652457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924880-bd22-4c59-bff0-124ead1ee743 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:19.743650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:19.744444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:19.744831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:19.745207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] PATH_INFO: `/v3/users/d57a55b417f14448b8428930cc79a72a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:19.747565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57a55b417f14448b8428930cc79a72a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:19.749818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:19.756415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:19.841342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57a55b417f14448b8428930cc79a72a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.852475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57a55b417f14448b8428930cc79a72a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.853144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57a55b417f14448b8428930cc79a72a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.854046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57a55b417f14448b8428930cc79a72a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.872139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-63712011-3151-41db-9a08-59e4bab1ae43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57a55b417f14448b8428930cc79a72a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:19.919751 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3878/7834] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:19 2022] DELETE /identity/v3/users/d57a55b417f14448b8428930cc79a72a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:20.352979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:20.355597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:20.389878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e1131-154a-4fe4-b154-0cb1d32a7c49 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:20.557994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:20.559342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:20.559996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:20.560492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] PATH_INFO: `/v3/projects/0503dbb989ce45f69ecd54a88898b506` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:20.561906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0503dbb989ce45f69ecd54a88898b506)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:20.564554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:20.644593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0503dbb989ce45f69ecd54a88898b506', 'request_id': 'req-e7b40255-e9b5-42bc-9d85-99465d6481dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:20.654766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0503dbb989ce45f69ecd54a88898b506', 'request_id': 'req-e7b40255-e9b5-42bc-9d85-99465d6481dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:20.662970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:20.667086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0503dbb989ce45f69ecd54a88898b506', 'request_id': 'req-e7b40255-e9b5-42bc-9d85-99465d6481dd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:20.704895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] The token cache is being invalidate because project 0503dbb989ce45f69ecd54a88898b506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:20.705234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:20.706549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e7b40255-e9b5-42bc-9d85-99465d6481dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:20.725388 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3957/7835] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:20 2022] DELETE /identity/v3/projects/0503dbb989ce45f69ecd54a88898b506 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:20.732385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:20.732895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:20.733021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:20.772151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:20.772257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:20.893260 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3879/7836] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:20.895609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:20.895907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:20.896193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:20.950821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:20.953159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:20.971320 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3958/7837] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:20.975824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:20.989612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64669f8c-756c-4cca-aab5-a258c7541fa9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:20.995202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:20.996864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:20.997259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:20.997638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:20.998832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:20.999250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.001580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.025465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.032657 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3880/7838] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:21.037258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdc9dc-2da9-4b2b-b077-8c5943206cc1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.043610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.044553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.045182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.045723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.046640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.049119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.090399 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3959/7839] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:21 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:49:21.094926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.108443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193bdc-b09a-4287-b4f1-1f2d8c7422d4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.203743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.204715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.205007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.205288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.206182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.207942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.258372 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3881/7840] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:21 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:21.262950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.285897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59e646-5af0-47dc-b3cd-15b3ba9740c1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.291875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.294349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.294714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.295131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.295888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.297676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.311882 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3960/7841] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:49:21.317171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.329073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:21.337172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98789447-0d03-4e52-af1b-a35af655def3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.353115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.353992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.354499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.355127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] PATH_INFO: `/v3/projects/d073d4ecdec64475a35d81be491d904a/users/bc79cf7e98f848519873af8f79688d87/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.387168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073d4ecdec64475a35d81be491d904a, user_id=bc79cf7e98f848519873af8f79688d87, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.390459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.415434 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3882/7842] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:21 2022] PUT /identity/v3/projects/d073d4ecdec64475a35d81be491d904a/users/bc79cf7e98f848519873af8f79688d87/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:21.420005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.445024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ec57e-0178-4ba6-97f6-416f1bb0ecf1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.544773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b55648-dbb8-49a1-b862-7e18d52b8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.545801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55648-dbb8-49a1-b862-7e18d52b8f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.546507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55648-dbb8-49a1-b862-7e18d52b8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.547294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55648-dbb8-49a1-b862-7e18d52b8f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.550859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b55648-dbb8-49a1-b862-7e18d52b8f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.552665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b55648-dbb8-49a1-b862-7e18d52b8f9f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.566253 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3961/7843] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:21.569773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.585864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d3502-df7d-435a-aaab-d5675d31a6ca admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.592627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447335-6978-4675-affc-91ae21444763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.593452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447335-6978-4675-affc-91ae21444763 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.593809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447335-6978-4675-affc-91ae21444763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.594176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447335-6978-4675-affc-91ae21444763 admin admin] PATH_INFO: `/v3/projects/d073d4ecdec64475a35d81be491d904a/users/bc79cf7e98f848519873af8f79688d87/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.596279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31447335-6978-4675-affc-91ae21444763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073d4ecdec64475a35d81be491d904a, user_id=bc79cf7e98f848519873af8f79688d87, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.599064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31447335-6978-4675-affc-91ae21444763 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.614201 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3883/7844] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:21 2022] PUT /identity/v3/projects/d073d4ecdec64475a35d81be491d904a/users/bc79cf7e98f848519873af8f79688d87/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:21.625516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748271-e031-4ced-aca2-caf805126075 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.626200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748271-e031-4ced-aca2-caf805126075 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.626642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa748271-e031-4ced-aca2-caf805126075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.673015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-fa748271-e031-4ced-aca2-caf805126075 None None] MFA Rules not processed for user `bc79cf7e98f848519873af8f79688d87`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:21.674297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa748271-e031-4ced-aca2-caf805126075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:21.767717 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3962/7845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:21.769120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447335-6978-4675-affc-91ae21444763 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.860060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447335-6978-4675-affc-91ae21444763 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:21.865131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:21.865850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:21.866351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:21.866953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:21.867682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:21.869665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:21.935516 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3884/7846] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:21 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:21.939742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa748271-e031-4ced-aca2-caf805126075 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:21.967918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa748271-e031-4ced-aca2-caf805126075 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:22.025468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:22.097726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:22.098720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:22.099254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:22.099755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:22.100618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:22.103466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:22.146733 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3963/7847] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:21 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:22.151250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:22.169029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bf4eb-ec95-4ae9-af95-35b8ee28a4ce admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:22.174843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:22.175599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:22.175985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:22.176374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:22.177293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:22.179027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:22.206193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3885/7848] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:22.210084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:22.232650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf63b-77e3-402c-9c9c-45386c67cb56 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:22.242449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6027e18-7ae0-436b-81be-a4110b7a96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:22.243297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027e18-7ae0-436b-81be-a4110b7a96c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:22.243584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027e18-7ae0-436b-81be-a4110b7a96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:22.243857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6027e18-7ae0-436b-81be-a4110b7a96c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:22.244514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6027e18-7ae0-436b-81be-a4110b7a96c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:22.251812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6027e18-7ae0-436b-81be-a4110b7a96c9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:22.280374 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3964/7849] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:22.285112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:22.302822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eed170-470b-44f8-8bf0-98ec62fa5088 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:22.316810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:22.317433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:22.317724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:22.318019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] PATH_INFO: `/v3/projects/3ea779b8161e4a7e9b012d6a52419ecc/users/6becfa8de74244b7848d143e2a5c86c3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:22.341286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea779b8161e4a7e9b012d6a52419ecc, user_id=6becfa8de74244b7848d143e2a5c86c3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:22.346576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:22.378762 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3886/7850] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:22 2022] PUT /identity/v3/projects/3ea779b8161e4a7e9b012d6a52419ecc/users/6becfa8de74244b7848d143e2a5c86c3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:22.391217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:22.392366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:22.392366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:22.429980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] MFA Rules not processed for user `6becfa8de74244b7848d143e2a5c86c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:22.433752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:22.580205 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3965/7851] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:22.592958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:22.594964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:22.728607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4e705-df0a-465a-bbc3-82c91e1418e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:22.735615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdaf0-33bb-4647-af01-c8f71590a4bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:22.737253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdaf0-33bb-4647-af01-c8f71590a4bc service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:22.737666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdaf0-33bb-4647-af01-c8f71590a4bc service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:22.738054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdaf0-33bb-4647-af01-c8f71590a4bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:22.807393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:22.858756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdaf0-33bb-4647-af01-c8f71590a4bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:22.860211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdaf0-33bb-4647-af01-c8f71590a4bc service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:22.876188 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3887/7852] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:23.316154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:23.444202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bd251-b8ae-4ec5-b58f-fcda772758cc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:23.449818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:23.450450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:23.450743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:23.451022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] PATH_INFO: `/v3/users/bc79cf7e98f848519873af8f79688d87` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:23.452273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc79cf7e98f848519873af8f79688d87)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:23.456027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:23.509283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:23.521176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc79cf7e98f848519873af8f79688d87'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:23.545478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc79cf7e98f848519873af8f79688d87'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:23.546669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc79cf7e98f848519873af8f79688d87'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:23.548181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc79cf7e98f848519873af8f79688d87'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:23.558404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc79cf7e98f848519873af8f79688d87'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:23.578678 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3966/7853] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:23 2022] DELETE /identity/v3/users/bc79cf7e98f848519873af8f79688d87 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:23.583241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:23.583769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:23.584234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:23.609306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:23.610788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:23.709412 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3888/7854] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:23.753245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:23.757257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:23.921333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65d5f-390c-4aaa-b3d9-c0254f11c7ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:23.938935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:23.940797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:23.941176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:23.942077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:23.968000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:23.970085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:23.999349 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3967/7855] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:24.840340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:24.841892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:24.878640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f188-6d9e-410b-9cf4-97486d76fa70 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:24.907400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:24.908358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:24.908989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:24.909423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] PATH_INFO: `/v3/projects/d073d4ecdec64475a35d81be491d904a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:24.911194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d073d4ecdec64475a35d81be491d904a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:24.915927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:25.037733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd073d4ecdec64475a35d81be491d904a', 'request_id': 'req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.059509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd073d4ecdec64475a35d81be491d904a', 'request_id': 'req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.084000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd073d4ecdec64475a35d81be491d904a', 'request_id': 'req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.107566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] The token cache is being invalidate because project d073d4ecdec64475a35d81be491d904a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:25.108124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.109757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.112415 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3889/7856] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:24 2022] DELETE /identity/v3/projects/d073d4ecdec64475a35d81be491d904a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:25.116710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:25.137078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f85cb7-b6d2-4223-b8fb-d0ad59ac7ba6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:25.337807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:25.338499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:25.338784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:25.339622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] PATH_INFO: `/v3/users/6becfa8de74244b7848d143e2a5c86c3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:25.342860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6becfa8de74244b7848d143e2a5c86c3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:25.345399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:25.434611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6becfa8de74244b7848d143e2a5c86c3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.460525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:25.463194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6becfa8de74244b7848d143e2a5c86c3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.464350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6becfa8de74244b7848d143e2a5c86c3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.465690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6becfa8de74244b7848d143e2a5c86c3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.480489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dcaa5a1a-37b1-421d-8fed-812c3704a0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6becfa8de74244b7848d143e2a5c86c3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:25.517372 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3968/7857] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:25 2022] DELETE /identity/v3/users/6becfa8de74244b7848d143e2a5c86c3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:26.681957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:26.685415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:26.739044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e4ed-46b9-4cbe-a9c1-bbfd52c02270 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:26.860012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:26.888023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:26.888865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:26.889190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:26.889470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] PATH_INFO: `/v3/projects/3ea779b8161e4a7e9b012d6a52419ecc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:26.890962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea779b8161e4a7e9b012d6a52419ecc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:26.893307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:26.971968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea779b8161e4a7e9b012d6a52419ecc', 'request_id': 'req-189570a2-5485-4c1c-aa0c-15a48f1769b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:26.978390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea779b8161e4a7e9b012d6a52419ecc', 'request_id': 'req-189570a2-5485-4c1c-aa0c-15a48f1769b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:26.992456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea779b8161e4a7e9b012d6a52419ecc', 'request_id': 'req-189570a2-5485-4c1c-aa0c-15a48f1769b8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:27.027594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] The token cache is being invalidate because project 3ea779b8161e4a7e9b012d6a52419ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:27.029565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:27.030484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-189570a2-5485-4c1c-aa0c-15a48f1769b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:27.038242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:27.038683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:27.039155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:27.047406 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3890/7858] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:26 2022] DELETE /identity/v3/projects/3ea779b8161e4a7e9b012d6a52419ecc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:27.071411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:27.072713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:27.333991 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3969/7859] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:27.342914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:27.343204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:27.343484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:27.392703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:27.393949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:27.437903 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3891/7860] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:27.443285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:27.462101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664bb7a-9003-4f15-9627-830ded60c4d2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:27.474685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:27.475542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:27.476053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:27.476641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:27.478006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:27.478604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:27.481560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:27.551420 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3970/7861] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:27.553617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:27.566638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864fa1b-a9f5-47d6-bb27-1323f5f53e9d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:27.584265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:27.585407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:27.588032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:27.588610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:27.590019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:27.593009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:27.660687 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3892/7862] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:27 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:27.664740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:27.680610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d321e-5a69-4c78-a4a2-e5263993006c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:27.817895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:27.818948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:27.819409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:27.819840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:27.820633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:27.824175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:27.863924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3971/7863] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:27 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:27.865563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:27.894823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a24ba-a4c3-4569-9b15-ea67b3322f9e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:27.927616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:27.928652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:27.930616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:27.931093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:27.943383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:27.945054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:27.970565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3893/7864] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:27.974394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:27.994002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b5708-67f3-4d66-a604-b3e7e3591552 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:28.031405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ea2a7-7e33-4e05-937f-2f4ab36fd5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:28.032281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea2a7-7e33-4e05-937f-2f4ab36fd5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:28.032622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea2a7-7e33-4e05-937f-2f4ab36fd5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:28.032959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea2a7-7e33-4e05-937f-2f4ab36fd5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:28.033771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ea2a7-7e33-4e05-937f-2f4ab36fd5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:28.039355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ea2a7-7e33-4e05-937f-2f4ab36fd5c2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:28.072481 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3972/7865] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:28.076290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:28.097595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f95c0-7a8e-4222-b1ad-9312d6eb0490 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:28.127843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:28.127843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:28.128117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:28.128403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] PATH_INFO: `/v3/projects/bd551e6a2a3f4fa5b2320884f822fe6f/users/af40a537e2eb48c9ad31deca64c3ed42/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:28.212679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd551e6a2a3f4fa5b2320884f822fe6f, user_id=af40a537e2eb48c9ad31deca64c3ed42, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:28.216588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:28.282246 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3894/7866] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:28 2022] PUT /identity/v3/projects/bd551e6a2a3f4fa5b2320884f822fe6f/users/af40a537e2eb48c9ad31deca64c3ed42/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:28.293736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:28.294379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:28.294796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:28.365821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] MFA Rules not processed for user `af40a537e2eb48c9ad31deca64c3ed42`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:28.367517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:28.512746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:28.650296 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3973/7867] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:28.660035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:28.661867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:28.834956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7ac8-d91e-464e-baed-dbddeecc9c62 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:28.851669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:28.852792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:28.853618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:28.854128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:28.876013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:28.878682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:28.892178 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3895/7868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:31.675479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:31.693717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a5e2a-23b0-47ca-80ec-52a37ccc0dee None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:31.708136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:31.709029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:31.709484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:31.709921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:31.716517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:31.913471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:31.915293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c241-36bc-4335-b84b-3711e2052d6e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:31.948277 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3974/7869] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:36.018370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:36.020629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:36.049788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16998e-c131-42af-a52f-2909c5d918cb service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:36.059881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:36.060750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:36.061146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:36.061527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] PATH_INFO: `/v3/users/ae6dedfb15fe43bf86a7d7269ac5de2c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:36.063943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6dedfb15fe43bf86a7d7269ac5de2c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:36.066391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:36.098401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:36.171033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6dedfb15fe43bf86a7d7269ac5de2c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:36.192123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6dedfb15fe43bf86a7d7269ac5de2c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:36.192799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6dedfb15fe43bf86a7d7269ac5de2c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:36.193603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6dedfb15fe43bf86a7d7269ac5de2c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:36.224672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6dedfb15fe43bf86a7d7269ac5de2c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:36.282919 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3896/7870] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:36 2022] DELETE /identity/v3/users/ae6dedfb15fe43bf86a7d7269ac5de2c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:36.287627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:36.288437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:36.288866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:36.318362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:36.319814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:36.414184 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3975/7871] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:36.425053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:36.426748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:36.538834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b45390-55ce-48c9-9444-c55673e35504 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:36.545483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47ae3a-866c-4e02-9ffc-a70e4e57020d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:36.546811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ae3a-866c-4e02-9ffc-a70e4e57020d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:36.547439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ae3a-866c-4e02-9ffc-a70e4e57020d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:36.548122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ae3a-866c-4e02-9ffc-a70e4e57020d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:36.561510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47ae3a-866c-4e02-9ffc-a70e4e57020d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:36.563502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47ae3a-866c-4e02-9ffc-a70e4e57020d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:36.578304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3897/7872] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:36.976554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:36.978102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:37.002657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754aa4-c6a6-4afe-820f-152c9193820c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:37.008202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:37.009428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.010363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.011690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] PATH_INFO: `/v3/projects/98a26125acbf480287b9d4d30909cda7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.013485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a26125acbf480287b9d4d30909cda7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:37.015959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:37.088603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a26125acbf480287b9d4d30909cda7', 'request_id': 'req-c18bd49f-19e2-4e68-9668-109bc4981f2e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:37.096576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a26125acbf480287b9d4d30909cda7', 'request_id': 'req-c18bd49f-19e2-4e68-9668-109bc4981f2e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:37.104301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a26125acbf480287b9d4d30909cda7', 'request_id': 'req-c18bd49f-19e2-4e68-9668-109bc4981f2e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:37.108430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:37.125610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] The token cache is being invalidate because project 98a26125acbf480287b9d4d30909cda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:37.126035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:37.126826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c18bd49f-19e2-4e68-9668-109bc4981f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:37.132437 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3976/7873] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:36 2022] DELETE /identity/v3/projects/98a26125acbf480287b9d4d30909cda7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:37.134314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.135071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.135163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.159359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:37.160692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:37.246203 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3898/7874] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:37.253808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.254905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.255205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.311462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:37.317027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:37.338092 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3977/7875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:37.343433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:37.356887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c4474-63d7-447a-a794-677e79d4d0f1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:37.375644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:37.376604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.377052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.377475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.378344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:37.379097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:37.381115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:37.395786 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3899/7876] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:37.400046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:37.413797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c303f-8c2b-4588-8a3e-562a69ab108c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:37.429462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:37.430458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.431449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.431449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.432195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:37.437356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:37.500540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3978/7877] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:37 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:37.502100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:37.537897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aae4c-328c-4dcf-8e9c-7a852132a59c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:37.586303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:37.721396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:37.722380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.722830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.723273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.724081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:37.728942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:37.795480 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3900/7878] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:37 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:37.796864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:37.817936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e03d-767c-4ea7-8cf1-96ee7b06ebc5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:37.836301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:37.838495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.839473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.843309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.846466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:37.862271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:37.893604 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3979/7879] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:37.894833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:37.914998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2e32-2a7d-40cf-8b33-485ee07fca8a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:37.925040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9ea99-16ed-4392-90c0-faef75cb92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:37.925688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ea99-16ed-4392-90c0-faef75cb92f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:37.925970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ea99-16ed-4392-90c0-faef75cb92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:37.926325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ea99-16ed-4392-90c0-faef75cb92f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:37.926984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9ea99-16ed-4392-90c0-faef75cb92f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:37.928750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9ea99-16ed-4392-90c0-faef75cb92f3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:37.972852 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3901/7880] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:37.973505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:38.000299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9e71-0a79-441c-87bd-cfd3b5a1d39a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:38.019089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:38.019803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:38.020088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:38.020707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] PATH_INFO: `/v3/projects/2834507159ae4c0e958a9ed866339844/users/99c2dd7e4fcf4f44b2e621378493b58b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:38.066735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2834507159ae4c0e958a9ed866339844, user_id=99c2dd7e4fcf4f44b2e621378493b58b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:38.069795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:38.112806 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3980/7881] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:37 2022] PUT /identity/v3/projects/2834507159ae4c0e958a9ed866339844/users/99c2dd7e4fcf4f44b2e621378493b58b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:38.113440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:38.113738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:38.114017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:38.189197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] MFA Rules not processed for user `99c2dd7e4fcf4f44b2e621378493b58b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:38.191116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:38.315905 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3902/7882] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:38.321971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:38.326355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:38.508953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112ee6f-4c5f-4e4a-926f-b635211c5253 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:38.514362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a8748-8190-49ed-895e-ef85aa77c037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:38.515253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a8748-8190-49ed-895e-ef85aa77c037 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:38.515543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a8748-8190-49ed-895e-ef85aa77c037 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:38.515928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a8748-8190-49ed-895e-ef85aa77c037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:38.528736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a8748-8190-49ed-895e-ef85aa77c037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:38.530538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a8748-8190-49ed-895e-ef85aa77c037 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:38.552003 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3981/7883] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:43.481484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:43.483110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:43.681131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790da6e-a932-4acb-a9bc-5dc8eecc3f8c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:43.687443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:43.688748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:43.689045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:43.689330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] PATH_INFO: `/v3/users/3884912e30674c76a7361b94cc7dd5b6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:43.693217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3884912e30674c76a7361b94cc7dd5b6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:43.695239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:43.797224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:43.828013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3884912e30674c76a7361b94cc7dd5b6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:43.844253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3884912e30674c76a7361b94cc7dd5b6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:43.844949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3884912e30674c76a7361b94cc7dd5b6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:43.845739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3884912e30674c76a7361b94cc7dd5b6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:43.862831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3884912e30674c76a7361b94cc7dd5b6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:43.896474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3903/7884] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:43 2022] DELETE /identity/v3/users/3884912e30674c76a7361b94cc7dd5b6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:43.901005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:43.902704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:43.903154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:43.964300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:43.978277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:44.084234 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3982/7885] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:44.113300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:44.115775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:44.254787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ba3e4-340e-4ad4-b006-0cf1f86c82c1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:44.267061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b117-d3a2-4056-9fe2-b28a2b0b5f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:44.267714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b117-d3a2-4056-9fe2-b28a2b0b5f9f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:44.267997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b117-d3a2-4056-9fe2-b28a2b0b5f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:44.268419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b117-d3a2-4056-9fe2-b28a2b0b5f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:44.297407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74b117-d3a2-4056-9fe2-b28a2b0b5f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:44.299823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74b117-d3a2-4056-9fe2-b28a2b0b5f9f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:44.314484 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3904/7886] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:44.617466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:44.619189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:44.645833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc84ac-2609-4746-aef0-a65ff8df03c0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:44.657281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:44.657974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:44.658263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:44.658592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] PATH_INFO: `/v3/projects/2253698f76054151861015cee1581d1f` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:44.662132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2253698f76054151861015cee1581d1f)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:44.667467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:44.707818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:44.787402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2253698f76054151861015cee1581d1f', 'request_id': 'req-7c6c74ef-27fb-476a-a195-bea8ed35d572'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:44.795585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2253698f76054151861015cee1581d1f', 'request_id': 'req-7c6c74ef-27fb-476a-a195-bea8ed35d572'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:44.803882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2253698f76054151861015cee1581d1f', 'request_id': 'req-7c6c74ef-27fb-476a-a195-bea8ed35d572'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:44.835824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] The token cache is being invalidate because project 2253698f76054151861015cee1581d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:44.836305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:44.837816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7c6c74ef-27fb-476a-a195-bea8ed35d572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:44.840046 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3983/7887] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:44 2022] DELETE /identity/v3/projects/2253698f76054151861015cee1581d1f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:44.848839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:44.850045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:44.850499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:44.876490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:44.878124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:45.004625 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3905/7888] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:45.007117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.007975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.008413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.059032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:45.060491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:45.072858 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3984/7889] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:45.077876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.093393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe95e4-fdb0-4e3b-94a1-d84456b6bde4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.108951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.109598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.109896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.110269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.110880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:45.111191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.112823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.131911 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3906/7890] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:45.133090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.146011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41795153-a3a2-4782-a439-fea891ba3773 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.154180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.155152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.155864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.156306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.157514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.159752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.195381 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3985/7891] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:45 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:49:45.200630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.212453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828605-142a-48f9-bf1b-be0067c2bef7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.255414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:45.297301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.298241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.298806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.299369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.300192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.302500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.338230 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3907/7892] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:45 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:45.340129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.353355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44419-57c0-4f69-982e-6a40901f11fb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.360339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.362352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.362828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.363265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.364103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.366613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.380313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3986/7893] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:45.384050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.397966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2023a2-e5ef-4ae1-96c6-db1ae0d5cbb5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.404410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0247-7a07-4865-8c89-95c08063229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.405201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0247-7a07-4865-8c89-95c08063229c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.405499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0247-7a07-4865-8c89-95c08063229c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.405908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0247-7a07-4865-8c89-95c08063229c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.406789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0247-7a07-4865-8c89-95c08063229c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.408496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0247-7a07-4865-8c89-95c08063229c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.439329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.440034 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3908/7894] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:45.454112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6350a-3929-4213-ae17-1fd0b5df650a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.472534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.474211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.474701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.475256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] PATH_INFO: `/v3/projects/6de8cb3b3be24138b4d0cec07d41b5df/users/2f19db9ea7c94af8becde03ade484b1f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.499730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de8cb3b3be24138b4d0cec07d41b5df, user_id=2f19db9ea7c94af8becde03ade484b1f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.503356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.555731 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3987/7895] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:45 2022] PUT /identity/v3/projects/6de8cb3b3be24138b4d0cec07d41b5df/users/2f19db9ea7c94af8becde03ade484b1f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:45.558985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.559549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.560009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.593977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] MFA Rules not processed for user `2f19db9ea7c94af8becde03ade484b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:45.595543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:45.744713 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3909/7896] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:45.757758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:45.761267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:45.864515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ee069-8f80-4002-a2fe-e83fbecdf9f0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:45.868325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:45.868984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:45.869312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:45.869603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:45.897689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:45.899915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:45.928225 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3988/7897] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:47.263781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:47.265557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:47.394435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda82f-48ff-4b5d-9252-93a9afbe717b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:47.401881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:47.403096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:47.403611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:47.404068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] PATH_INFO: `/v3/users/0005cf1c5e004b919cb8579e7067d506` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:47.405721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0005cf1c5e004b919cb8579e7067d506)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:47.410021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:47.491032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0005cf1c5e004b919cb8579e7067d506'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:47.493715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:47.509518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0005cf1c5e004b919cb8579e7067d506'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:47.511525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0005cf1c5e004b919cb8579e7067d506'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:47.512412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0005cf1c5e004b919cb8579e7067d506'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:47.523268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0005cf1c5e004b919cb8579e7067d506'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:47.550824 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3910/7898] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:47 2022] DELETE /identity/v3/users/0005cf1c5e004b919cb8579e7067d506 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:48.299623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:48.321902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a21dc-0674-4e5c-88b0-b7b18904f24b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:48.447166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:48.493340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:48.494473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:48.497004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:48.497541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] PATH_INFO: `/v3/projects/7e3fcb9a911f4e73877d25649b67cd95` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:48.500337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3fcb9a911f4e73877d25649b67cd95)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:48.504252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:48.594197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3fcb9a911f4e73877d25649b67cd95', 'request_id': 'req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.603221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3fcb9a911f4e73877d25649b67cd95', 'request_id': 'req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.617941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3fcb9a911f4e73877d25649b67cd95', 'request_id': 'req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.643504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] The token cache is being invalidate because project 7e3fcb9a911f4e73877d25649b67cd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:48.643803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.644460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.649110 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3989/7899] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:48 2022] DELETE /identity/v3/projects/7e3fcb9a911f4e73877d25649b67cd95 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:48.653977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:48.655445 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:48.673731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a44c-eb77-4359-8563-5eb6da346634 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:48.761597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:48.762690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:48.762988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:48.763311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] PATH_INFO: `/v3/users/7d7ba18e92f541f68ead36cfb703062c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:48.764618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7ba18e92f541f68ead36cfb703062c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:48.766900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:48.836013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7ba18e92f541f68ead36cfb703062c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.850746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7ba18e92f541f68ead36cfb703062c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.851696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7ba18e92f541f68ead36cfb703062c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.852579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7ba18e92f541f68ead36cfb703062c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.862871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9bfdf03e-db6a-489a-bb11-4f5b1a80a0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7ba18e92f541f68ead36cfb703062c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:48.891651 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3911/7900] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:48 2022] DELETE /identity/v3/users/7d7ba18e92f541f68ead36cfb703062c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:48.971960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:48.974179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:48.990979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65fc7d-110f-4b2c-b91e-c67ab8b822eb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:49.120599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:49.121615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:49.122018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:49.122450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] PATH_INFO: `/v3/users/af40a537e2eb48c9ad31deca64c3ed42` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:49.124834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af40a537e2eb48c9ad31deca64c3ed42)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:49.128456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:49.275117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af40a537e2eb48c9ad31deca64c3ed42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.317017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af40a537e2eb48c9ad31deca64c3ed42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.317900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af40a537e2eb48c9ad31deca64c3ed42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.318780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af40a537e2eb48c9ad31deca64c3ed42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.352793 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af40a537e2eb48c9ad31deca64c3ed42'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.357646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:49.386094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:49.386395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:49.386765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:49.387048 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3990/7901] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:49:48 2022] DELETE /identity/v3/users/af40a537e2eb48c9ad31deca64c3ed42 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:49.426461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:49.426461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:49.428732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:49.430785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:49.485712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:49.547482 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3912/7902] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:49:49.561165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:49.562893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:49.613926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218bdb3-f297-4288-a23b-06f00dbcca8c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:49.620797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:49.620797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:49.620797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:49.620797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] PATH_INFO: `/v3/projects/5c518f9e07c44b21a3dde493ff2e09eb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:49.622626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c518f9e07c44b21a3dde493ff2e09eb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:49.625024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:49.668730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfddbb-83fb-4c06-bb5e-c2d7b4b1d76a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:49.675250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:49.676224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:49.676833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:49.677287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:49.692995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:49.695124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:49.698797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c518f9e07c44b21a3dde493ff2e09eb', 'request_id': 'req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.712179 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3913/7903] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:49:49.713570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c518f9e07c44b21a3dde493ff2e09eb', 'request_id': 'req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.722344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c518f9e07c44b21a3dde493ff2e09eb', 'request_id': 'req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.738570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] The token cache is being invalidate because project 5c518f9e07c44b21a3dde493ff2e09eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:49.738896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.739515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e0a0365a-4cc8-4e88-9f4a-4aedefcb18c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:49.741460 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3991/7904] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:49 2022] DELETE /identity/v3/projects/5c518f9e07c44b21a3dde493ff2e09eb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:50.003926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.006741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:50.028527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe3c9a-67a1-4241-b7b2-ea6c3e197485 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:50.136423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:50.137426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.137880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.138346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] PATH_INFO: `/v3/projects/bd551e6a2a3f4fa5b2320884f822fe6f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.139844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd551e6a2a3f4fa5b2320884f822fe6f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:50.142369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:50.232317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd551e6a2a3f4fa5b2320884f822fe6f', 'request_id': 'req-bbffb315-f09f-48fa-9885-ddc1244ecc17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:50.256163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd551e6a2a3f4fa5b2320884f822fe6f', 'request_id': 'req-bbffb315-f09f-48fa-9885-ddc1244ecc17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:50.280101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd551e6a2a3f4fa5b2320884f822fe6f', 'request_id': 'req-bbffb315-f09f-48fa-9885-ddc1244ecc17'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:50.298646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] The token cache is being invalidate because project bd551e6a2a3f4fa5b2320884f822fe6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:49:50.304527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:50.305786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bbffb315-f09f-48fa-9885-ddc1244ecc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:49:50.307618 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3914/7905] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:49:50 2022] DELETE /identity/v3/projects/bd551e6a2a3f4fa5b2320884f822fe6f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:49:50.312725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.313011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.313290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.340917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:50.342992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:50.458412 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3992/7906] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:50.467487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.472542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.472936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.500511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:50.501754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:50.519251 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3915/7907] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:50.523627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.534605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084ae6b-0a99-4d8b-959d-dfc9d18fe25c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:50.549990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:50.550890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.551178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.551492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.552155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:49:50.552563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:50.555228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:50.574418 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3993/7908] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:49:50.578086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.593480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5009fd-9515-4688-9434-746e21b30ffc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:50.601285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:50.601870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.602283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.602604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.604057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:50.606913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:50.627899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:50.671393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.671901 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3916/7909] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:49:50 2022] POST /identity/v3/projects => generated 361 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:49:50.685230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab4876-f364-42ac-b2ad-0a033eeb970a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:50.706123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:50.823920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:50.825203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.825665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.826097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.827170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:50.830649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:50.882599 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3994/7910] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:49:50 2022] POST /identity/v3/users => generated 281 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:49:50.883879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.899180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907aef-80b8-4da1-810e-cd2db1f1dd84 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:50.911396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:50.912119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.912475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.912823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.913552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:50.915335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:50.929116 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3917/7911] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:50.933232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.949108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7a60-5505-4cdb-b4cf-3f14077ce47d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:50.954534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa74bb8-78e3-444f-8c7c-b92835162954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:50.955472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa74bb8-78e3-444f-8c7c-b92835162954 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:50.955968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa74bb8-78e3-444f-8c7c-b92835162954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:50.956550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa74bb8-78e3-444f-8c7c-b92835162954 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:50.957334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa74bb8-78e3-444f-8c7c-b92835162954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:50.959355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa74bb8-78e3-444f-8c7c-b92835162954 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:50.978336 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3995/7912] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:49:50.983175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:50.998645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d5fb1-04e4-45ed-a02b-a4f910386165 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:51.004911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:51.005710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:51.006694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:51.006694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] PATH_INFO: `/v3/projects/283079e65a264caba8dd3c0c6142bbdd/users/2c9254d6138b460dbdaa761c3d6f6972/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:51.025862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283079e65a264caba8dd3c0c6142bbdd, user_id=2c9254d6138b460dbdaa761c3d6f6972, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:51.029676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:51.052341 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3918/7913] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:49:50 2022] PUT /identity/v3/projects/283079e65a264caba8dd3c0c6142bbdd/users/2c9254d6138b460dbdaa761c3d6f6972/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:49:51.063917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:51.064438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:51.065135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:51.115748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] MFA Rules not processed for user `2c9254d6138b460dbdaa761c3d6f6972`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:49:51.116676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:51.240689 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3996/7914] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:49:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:49:51.254068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:51.258080 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:51.349609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7969d-5a5a-415a-add2-fa225b50c7a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:51.353405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:51.354157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:51.354624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:51.354968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:51.368232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:51.369851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:51.404681 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3919/7915] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:49:52.205655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:49:52.207879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:52.513290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:49:52.519298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286728e7-8318-49d9-bd17-fb23f9f54efd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:49:52.530345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:49:52.531316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:49:52.532393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:49:52.532889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:49:52.535156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:49:52.558511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:49:52.560440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b34e8-ed5a-4cef-885b-3a2455820837 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:49:52.586879 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3997/7916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:49:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:01.380373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:02.578692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:02.853206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:02.855482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:02.955161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eea3d9-0d4d-47ba-808c-024a50edb4ad service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:02.960198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:02.960859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:02.961143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:02.961424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] PATH_INFO: `/v3/users/99c2dd7e4fcf4f44b2e621378493b58b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:02.962633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c2dd7e4fcf4f44b2e621378493b58b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:02.965404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:03.022678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c2dd7e4fcf4f44b2e621378493b58b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:03.033447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c2dd7e4fcf4f44b2e621378493b58b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:03.034264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c2dd7e4fcf4f44b2e621378493b58b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:03.035100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c2dd7e4fcf4f44b2e621378493b58b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:03.045884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c2dd7e4fcf4f44b2e621378493b58b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:03.072198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3920/7917] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:50:02 2022] DELETE /identity/v3/users/99c2dd7e4fcf4f44b2e621378493b58b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:03.076667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:03.077119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:03.077573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:03.108004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:03.109507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:03.253222 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3998/7918] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:03.272770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:03.276571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:03.383280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2d017-25b7-430a-abb6-6ef254e05e4c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:03.388833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2251e90-a802-4d09-bb18-bbb789a2b4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:03.389632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251e90-a802-4d09-bb18-bbb789a2b4aa service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:03.389949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251e90-a802-4d09-bb18-bbb789a2b4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:03.390316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251e90-a802-4d09-bb18-bbb789a2b4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:03.402900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251e90-a802-4d09-bb18-bbb789a2b4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:03.404368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2251e90-a802-4d09-bb18-bbb789a2b4aa service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:03.416154 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3921/7919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:04.198697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:04.200509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:04.215233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189ea8-6603-4037-869c-5f92fe060eaa None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:04.222511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:04.223410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.223832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.224167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] PATH_INFO: `/v3/projects/2834507159ae4c0e958a9ed866339844` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.226521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2834507159ae4c0e958a9ed866339844)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:04.228696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:04.316032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2834507159ae4c0e958a9ed866339844', 'request_id': 'req-d5a70747-a620-4ec0-afeb-db47b04bb386'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:04.326366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2834507159ae4c0e958a9ed866339844', 'request_id': 'req-d5a70747-a620-4ec0-afeb-db47b04bb386'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:04.337080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2834507159ae4c0e958a9ed866339844', 'request_id': 'req-d5a70747-a620-4ec0-afeb-db47b04bb386'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:04.362531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] The token cache is being invalidate because project 2834507159ae4c0e958a9ed866339844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:50:04.363488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:04.364768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d5a70747-a620-4ec0-afeb-db47b04bb386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:04.367365 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 3999/7920] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:50:04 2022] DELETE /identity/v3/projects/2834507159ae4c0e958a9ed866339844 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:04.373473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.374051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.374191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.385435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:04.405538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:04.407244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:04.528166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.528462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.528743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.534286 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3922/7921] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:04.565336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:04.566652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:04.583495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:04.593302 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4000/7922] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:04.595320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619130-a988-43f3-8fd9-3c4504957922 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:04.601814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:04.602485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.602771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.603051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.603726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:50:04.604733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:04.606965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:04.626796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3923/7923] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:50:04.633115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:04.645413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37390be-598b-416a-bc85-0d1b6d90a58a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:04.659371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:04.659711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.659947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.660228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.660939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:04.662953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:04.713056 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4001/7924] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:50:04 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:04.718128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:04.737390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e68e8-025a-4a60-9beb-44b25c60f1d1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:04.848185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:04.849108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.849550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.850055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.851001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:04.853401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:04.904198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3924/7925] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:50:04 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:04.908362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:04.920834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712c34-1e0d-4679-9d6a-2a5878fb8f08 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:04.926977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:04.928083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.928669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.929065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.929889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:04.931867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:04.945967 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4002/7926] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:04.950309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:04.965056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d81f7-8206-4d67-9957-ec9909471f02 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:04.975508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c2a9-27b1-43f0-88a7-5b00d7f442db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:04.975508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c2a9-27b1-43f0-88a7-5b00d7f442db admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:04.975508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c2a9-27b1-43f0-88a7-5b00d7f442db admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:04.975508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c2a9-27b1-43f0-88a7-5b00d7f442db admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:04.977610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5c2a9-27b1-43f0-88a7-5b00d7f442db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:04.978470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5c2a9-27b1-43f0-88a7-5b00d7f442db admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:04.998432 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3925/7927] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:05.002477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:05.029260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705160-b162-4725-a1af-d3e0152727b4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:05.037664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:05.038529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:05.038817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:05.039108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] PATH_INFO: `/v3/projects/db8a9e3545834bae8e85e87594153fcd/users/f4982401b8df43239f6c0a8b8b7db198/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:05.062344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8a9e3545834bae8e85e87594153fcd, user_id=f4982401b8df43239f6c0a8b8b7db198, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:05.065270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:05.086311 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4003/7928] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:50:05 2022] PUT /identity/v3/projects/db8a9e3545834bae8e85e87594153fcd/users/f4982401b8df43239f6c0a8b8b7db198/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:05.090528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:05.090821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:05.091100 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:05.134928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:05.137805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:05.263837 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3926/7929] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:05.273217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:05.275054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:05.314336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:05.396015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75f6b4-79a9-43c5-9ad2-bee64c2b434f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:05.402333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc0d2a-5f72-43aa-8dd9-8c82b8f3a9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:05.403500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc0d2a-5f72-43aa-8dd9-8c82b8f3a9bf service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:05.404054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc0d2a-5f72-43aa-8dd9-8c82b8f3a9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:05.404550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc0d2a-5f72-43aa-8dd9-8c82b8f3a9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:05.421434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc0d2a-5f72-43aa-8dd9-8c82b8f3a9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:05.423306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc0d2a-5f72-43aa-8dd9-8c82b8f3a9bf service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:05.439002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4004/7930] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:10.056038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:10.058457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:10.068670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:10.099146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e4232-079d-4289-bd35-6dfc90ca4e35 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:10.108609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:10.109456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:10.110714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:10.111379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] PATH_INFO: `/v3/users/2f19db9ea7c94af8becde03ade484b1f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:10.112936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f19db9ea7c94af8becde03ade484b1f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:10.115246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:10.244043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f19db9ea7c94af8becde03ade484b1f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.267548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f19db9ea7c94af8becde03ade484b1f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.268270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f19db9ea7c94af8becde03ade484b1f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.269072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f19db9ea7c94af8becde03ade484b1f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.280019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f19db9ea7c94af8becde03ade484b1f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.329115 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3927/7931] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:50:10 2022] DELETE /identity/v3/users/2f19db9ea7c94af8becde03ade484b1f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:10.333450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:10.334173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:10.334173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:10.372040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:10.374431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:10.494504 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4005/7932] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:10.514866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:10.516319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:10.602460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4611d6-9369-4395-9743-4a9ca3bd5291 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:10.608122 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494aa5c-1d43-4fe3-94c3-575d64489f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:10.608921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494aa5c-1d43-4fe3-94c3-575d64489f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:10.609314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494aa5c-1d43-4fe3-94c3-575d64489f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:10.609712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494aa5c-1d43-4fe3-94c3-575d64489f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:10.622176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494aa5c-1d43-4fe3-94c3-575d64489f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:10.624228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494aa5c-1d43-4fe3-94c3-575d64489f97 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:10.641943 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3928/7933] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:10.861190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:10.862657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:10.876708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc229cf8-d181-4ab7-a4d5-843f33c81736 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:10.881396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:10.882039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:10.882367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:10.883112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] PATH_INFO: `/v3/projects/6de8cb3b3be24138b4d0cec07d41b5df` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:10.884161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de8cb3b3be24138b4d0cec07d41b5df)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:10.887230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:10.955821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de8cb3b3be24138b4d0cec07d41b5df', 'request_id': 'req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.963057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de8cb3b3be24138b4d0cec07d41b5df', 'request_id': 'req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.971224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de8cb3b3be24138b4d0cec07d41b5df', 'request_id': 'req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.991884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] The token cache is being invalidate because project 6de8cb3b3be24138b4d0cec07d41b5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:50:10.992184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.993182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd0f1ae2-e301-4a56-aacb-dbf5578883fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:10.996010 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4006/7934] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:50:10 2022] DELETE /identity/v3/projects/6de8cb3b3be24138b4d0cec07d41b5df => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:11.000991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.001277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.001555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.035225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:11.036148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:11.110303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3929/7935] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:11.117788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.118857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.119139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.143005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:11.144270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:11.153189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4007/7936] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:11.157392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.167971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65cfc-ff7a-4ec3-a1d9-75fe1b82d330 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.173487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.174115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.174440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.174712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.175369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:50:11.175974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.177327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.180180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:11.194527 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3930/7937] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:50:11.196230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.206781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eae69-c731-419e-866e-869d567bdfe1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.212473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.214247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.214247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.214477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.216145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.216885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.268350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.268584 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4008/7938] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:50:11 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:11.281146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5242-d29c-433d-9648-8be0b905feb1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.388427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.389967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.389967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.389967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.390530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.392556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.420922 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3931/7939] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:50:11 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:11.424648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.443459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1be7-29fc-404f-8044-be705b4db85d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.454178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.455953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.456403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.456839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.457672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.460061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.477482 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4009/7940] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:50:11.482610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.493319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea53c-6be9-4150-aee8-1c2a77e5aa85 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.507855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ebe4f-98b5-444f-9c08-fe860d5a6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.509316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ebe4f-98b5-444f-9c08-fe860d5a6fab admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.509679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ebe4f-98b5-444f-9c08-fe860d5a6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.510031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ebe4f-98b5-444f-9c08-fe860d5a6fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.511901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ebe4f-98b5-444f-9c08-fe860d5a6fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.514682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ebe4f-98b5-444f-9c08-fe860d5a6fab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.569415 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3932/7941] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:11.570976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.582572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c200d-a19e-42fb-a382-3fe3c86df6c5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.588870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.590271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.590743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.591029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] PATH_INFO: `/v3/projects/3f11de4c7ef34e5c8442b13a60c4e6eb/users/bbb1be102ed641b8af71afa1ad779587/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.595227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:11.621445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f11de4c7ef34e5c8442b13a60c4e6eb, user_id=bbb1be102ed641b8af71afa1ad779587, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.624473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.654193 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4010/7942] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:50:11 2022] PUT /identity/v3/projects/3f11de4c7ef34e5c8442b13a60c4e6eb/users/bbb1be102ed641b8af71afa1ad779587/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:11.658081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.658789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.659073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.699739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] MFA Rules not processed for user `bbb1be102ed641b8af71afa1ad779587`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:11.702683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:11.835761 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3933/7943] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:11.841170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.931480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecb9a6-a30e-4c2c-b283-1409cbabc719 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:11.937859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:11.938528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:11.938825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:11.939209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:11.939860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:11.941852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:11.974170 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4011/7944] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:50:11 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:11.975591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:11.988467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cf230-86f2-4291-95f8-0e9612f1772e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.059610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.060689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.061037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.061311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.061965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:12.064383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:12.078559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:12.094921 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3934/7945] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:50:11 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:12.098955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:12.111679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1346aab-437f-4dcd-a831-bd9fbf90a961 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.116618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.117255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.117534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.117805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.118531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:12.121968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:12.134492 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4012/7946] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:12.138597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:12.149615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa52c-b615-4bc8-803a-0f22bf5de9e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.155315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.155993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.156276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.157242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] PATH_INFO: `/v3/projects/55a8c2e347cf495f984629f69d7bd849/users/f7020e133c18478cadba80fe0e9cee20/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.175193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a8c2e347cf495f984629f69d7bd849, user_id=f7020e133c18478cadba80fe0e9cee20, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:12.177990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:12.208057 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3935/7947] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:50:12 2022] PUT /identity/v3/projects/55a8c2e347cf495f984629f69d7bd849/users/f7020e133c18478cadba80fe0e9cee20/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:50:12.211967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:12.224005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b67b-dc37-4f38-98ea-6d6f26685fa8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.348099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854a5ed-962a-4b80-9958-60d4e67d5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.350503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a5ed-962a-4b80-9958-60d4e67d5af3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.350981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a5ed-962a-4b80-9958-60d4e67d5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.351409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854a5ed-962a-4b80-9958-60d4e67d5af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.352382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854a5ed-962a-4b80-9958-60d4e67d5af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:12.354681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854a5ed-962a-4b80-9958-60d4e67d5af3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:12.370252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4013/7948] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:12.374818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:12.391659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c693375-f5e0-4431-9cec-ef9983cb5e50 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.397055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.397896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.398358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.398608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] PATH_INFO: `/v3/projects/55a8c2e347cf495f984629f69d7bd849/users/f7020e133c18478cadba80fe0e9cee20/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.413976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a8c2e347cf495f984629f69d7bd849, user_id=f7020e133c18478cadba80fe0e9cee20, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:12.419077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:12.447339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3936/7949] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:50:12 2022] PUT /identity/v3/projects/55a8c2e347cf495f984629f69d7bd849/users/f7020e133c18478cadba80fe0e9cee20/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:12.452089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.452602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.453559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.500754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] MFA Rules not processed for user `f7020e133c18478cadba80fe0e9cee20`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:12.502559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:12.564767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:12.605716 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4014/7950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:12.619291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:12.621844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:12.705041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a524d-dee4-46df-a2a9-bcfb6dc5a4f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.708658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef513e-9908-400c-9511-28d51bc30d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.709288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef513e-9908-400c-9511-28d51bc30d51 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.709574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef513e-9908-400c-9511-28d51bc30d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.709853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef513e-9908-400c-9511-28d51bc30d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:12.720527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef513e-9908-400c-9511-28d51bc30d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:12.721768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef513e-9908-400c-9511-28d51bc30d51 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:12.735445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3937/7951] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:12.915602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:12.935423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d36c1-8f54-41d4-94ca-3b63be0744af None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:12.944689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:12.945387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:12.945718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:12.946525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:13.067856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:13.069511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:13.099373 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4015/7952] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:13.707360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:13.707864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:13.707964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:13.749072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] MFA Rules not processed for user `f4982401b8df43239f6c0a8b8b7db198`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:13.750460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:13.859679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3938/7953] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:13.865463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:13.867143 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:13.962873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a693cf-4748-48f5-9019-144caaff4acc service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:13.969533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:13.970085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:13.970413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:13.970688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:13.971839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:13.974040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:14.006654 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4016/7954] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:50:13 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:14.007895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:14.020098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9450c33-6e55-4d8a-96f6-b0f2958e1467 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:14.025501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeff6e-b42d-4059-b96c-666625101864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:14.026837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeff6e-b42d-4059-b96c-666625101864 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:14.027191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeff6e-b42d-4059-b96c-666625101864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:14.027392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeff6e-b42d-4059-b96c-666625101864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:14.028055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeff6e-b42d-4059-b96c-666625101864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:14.029682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeff6e-b42d-4059-b96c-666625101864 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:14.040684 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3939/7955] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:14.044795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:14.056578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911683c-6045-4aa6-8e52-edaa0931cfa7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:14.063551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:14.064635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:14.065120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:14.065462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] PATH_INFO: `/v3/system/users/a7a5dcedcf8749edad38ce025f9a892e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:14.083699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a7a5dcedcf8749edad38ce025f9a892e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:14.085358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:14.106735 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4017/7956] 10.222.0.23 () {60 vars in 1378 bytes} [Mon Oct 31 05:50:14 2022] PUT /identity/v3/system/users/a7a5dcedcf8749edad38ce025f9a892e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:14.108480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:14.108776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:14.109057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:14.140391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] MFA Rules not processed for user `a7a5dcedcf8749edad38ce025f9a892e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:14.141984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:14.185517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:14.276791 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3940/7957] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:14 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 05:50:14.277327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:14.378422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:14.501047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a9fb-a9c9-453b-b007-af8147d4baa1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:14.570650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a5dcedcf8749edad38ce025f9a892e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:14.571297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:14.571708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:14.571986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] PATH_INFO: `/v3/services` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:14.572608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:14.574190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:14.591530 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4018/7958] 10.222.0.23 () {58 vars in 1110 bytes} [Mon Oct 31 05:50:14 2022] GET /identity/v3/services => generated 2191 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:14.595910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:14.777614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90159e1a-8b6c-4558-906c-f16eed976d8a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:14.851730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a5dcedcf8749edad38ce025f9a892e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:14.854981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:14.855420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:14.856033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] PATH_INFO: `/v3/limits` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:14.857062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:14.859744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 31 05:50:14.955936 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 31 05:50:14.957060 n-d-862355-5 devstack@keystone.service[81999]: ERROR keystone.server.flask.application Oct 31 05:50:14.957852 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3941/7959] 10.222.0.23 () {60 vars in 1126 bytes} [Mon Oct 31 05:50:14 2022] POST /identity/v3/limits => generated 124 bytes in 362 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 05:50:14.962795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:15.106211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7d68f-ced5-4bcb-863a-46c44aa96d8a None tempest-ImageQuotaTest-1671619400-system-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:15.115451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:15.147544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a5dcedcf8749edad38ce025f9a892e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:15.148170 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:15.148448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:15.148834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:15.149326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:15.150496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:15.162198 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4019/7960] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 31 05:50:14 2022] GET /identity/v3/registered_limits => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:50:15.165234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:15.178562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:15.304125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952da4b6-055e-4c3b-803e-2f091ccd65be None tempest-ImageQuotaTest-1671619400-system-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:15.351042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a5dcedcf8749edad38ce025f9a892e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:15.351833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:15.352117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:15.352544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:15.353512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:15.354824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:15.367337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3942/7961] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 31 05:50:15 2022] GET /identity/v3/registered_limits => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:50:20.485526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:20.499696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc147-d3e0-4e59-a1c0-9130f8f07ef9 None tempest-ImageQuotaTest-1671619400-system-admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:20.528279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:20.528279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:20.528279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:20.528279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] PATH_INFO: `/v3/users/f4982401b8df43239f6c0a8b8b7db198` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:20.528737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4982401b8df43239f6c0a8b8b7db198)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:20.528737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:20.594404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4982401b8df43239f6c0a8b8b7db198'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:20.615669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4982401b8df43239f6c0a8b8b7db198'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:20.617438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4982401b8df43239f6c0a8b8b7db198'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:20.619313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4982401b8df43239f6c0a8b8b7db198'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:20.628098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4982401b8df43239f6c0a8b8b7db198'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:20.646517 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4020/7962] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:50:20 2022] DELETE /identity/v3/users/f4982401b8df43239f6c0a8b8b7db198 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:20.846715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:20.849425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:20.957892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f390a-744a-4d0e-b9bf-18280a3ff23f None tempest-ImageQuotaTest-1671619400-system-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:20.964745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:20.965420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:20.965709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:20.966112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] PATH_INFO: `/v3/projects/db8a9e3545834bae8e85e87594153fcd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:20.967339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8a9e3545834bae8e85e87594153fcd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:20.969663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:21.000252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:21.040474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8a9e3545834bae8e85e87594153fcd', 'request_id': 'req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.050806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8a9e3545834bae8e85e87594153fcd', 'request_id': 'req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.063516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8a9e3545834bae8e85e87594153fcd', 'request_id': 'req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.081843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] The token cache is being invalidate because project db8a9e3545834bae8e85e87594153fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:50:21.082138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.082841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.087356 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3943/7963] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:50:20 2022] DELETE /identity/v3/projects/db8a9e3545834bae8e85e87594153fcd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:21.089204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:21.107956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404436b-504d-46ec-b136-ffd5145b3491 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:21.196272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:21.196923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:21.197204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:21.197477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] PATH_INFO: `/v3/users/a7a5dcedcf8749edad38ce025f9a892e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:21.199519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a5dcedcf8749edad38ce025f9a892e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:21.201454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:21.268853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:21.292846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a5dcedcf8749edad38ce025f9a892e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.310156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a5dcedcf8749edad38ce025f9a892e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.311563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a5dcedcf8749edad38ce025f9a892e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.313013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a5dcedcf8749edad38ce025f9a892e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.325887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a5dcedcf8749edad38ce025f9a892e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:21.343949 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4021/7964] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:50:21 2022] DELETE /identity/v3/users/a7a5dcedcf8749edad38ce025f9a892e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:31.078118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:31.339591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=6,keystone:SELECT=17,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:44.570229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:44.573865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:44.683797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8fcfd-457a-4fa9-b041-4234f68a55c7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:44.755321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:44.756224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:44.756224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:44.756518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:44.758910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:44.774029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:44.777227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ec5cc-e583-4330-8223-518431d61959 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:44.791141 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3944/7965] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:49.373479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:49.375098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:49.451834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ebd23-ecaa-4009-a821-b76c2ab93f10 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:49.456550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:49.457204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:49.457490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:49.457770 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] PATH_INFO: `/v3/users/2c9254d6138b460dbdaa761c3d6f6972` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:49.458989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9254d6138b460dbdaa761c3d6f6972)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:49.460944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:49.511812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9254d6138b460dbdaa761c3d6f6972'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:49.524608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9254d6138b460dbdaa761c3d6f6972'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:49.525362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9254d6138b460dbdaa761c3d6f6972'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:49.526134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9254d6138b460dbdaa761c3d6f6972'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:49.533552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9254d6138b460dbdaa761c3d6f6972'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:49.548319 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4022/7966] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:50:49 2022] DELETE /identity/v3/users/2c9254d6138b460dbdaa761c3d6f6972 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:49.552898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:49.553351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:49.553448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:49.573703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:49.574951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:49.636296 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3945/7967] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:49.645959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:49.647428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:49.720183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdc07-6cb7-4112-9719-2acdf313cac3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:49.723792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e148f5-475c-4c6b-8331-bda8ef942eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:49.724405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e148f5-475c-4c6b-8331-bda8ef942eef service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:49.724687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e148f5-475c-4c6b-8331-bda8ef942eef service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:49.724964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e148f5-475c-4c6b-8331-bda8ef942eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:49.734826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e148f5-475c-4c6b-8331-bda8ef942eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:49.736264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e148f5-475c-4c6b-8331-bda8ef942eef service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:49.747314 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4023/7968] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:50:49.924718 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:49.926654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:49.940660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604c0f9-b9cd-4e75-8739-da1a7c97925f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:49.945534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:49.946259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:49.946671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:49.946960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] PATH_INFO: `/v3/projects/283079e65a264caba8dd3c0c6142bbdd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:49.949334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283079e65a264caba8dd3c0c6142bbdd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:49.951275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:49.985045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:50.000729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283079e65a264caba8dd3c0c6142bbdd', 'request_id': 'req-e1ab410e-8c67-4476-8827-2293a401e9d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:50.006217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283079e65a264caba8dd3c0c6142bbdd', 'request_id': 'req-e1ab410e-8c67-4476-8827-2293a401e9d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:50.015090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283079e65a264caba8dd3c0c6142bbdd', 'request_id': 'req-e1ab410e-8c67-4476-8827-2293a401e9d3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:50.028338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] The token cache is being invalidate because project 283079e65a264caba8dd3c0c6142bbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:50:50.028634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:50.029326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e1ab410e-8c67-4476-8827-2293a401e9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:50:50.030882 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3946/7969] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:50:49 2022] DELETE /identity/v3/projects/283079e65a264caba8dd3c0c6142bbdd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:50.035791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.036107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.036384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.054804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:50.084310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:50.085527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:50.149346 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4024/7970] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:50:50.158408 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.158773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.159164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.179717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:50.180848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:50.188927 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3947/7971] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:50:50.193221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.204265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef47f-37f2-4659-9483-063a55a9f002 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.209035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.209650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.209934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.210247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.210902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:50:50.211207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.213885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.229316 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4025/7972] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:50:50.230623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.240077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5ebd2-1220-4069-890c-96a2cef59c1f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.245147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.245974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.246259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.246613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.247407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.249607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.304713 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3948/7973] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:50:50 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:50.306954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.318372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1ad8b-6d60-4fc2-a958-6581c6e68a5f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.380429 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.381128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.381306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.381581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.382244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.384159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.410444 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4026/7974] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:50:50 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:50:50.411652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.422180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940d34-5c71-42a0-9dc8-0ebffd2c7ac6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.426725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.427332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.427609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.427879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.428883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.430587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.440798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3949/7975] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:50:50.444904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.455947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205b7b6-223a-45c0-803f-de6ef857cc6f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.460623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13495a-4803-41e7-b363-09f12d5a92d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.461232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13495a-4803-41e7-b363-09f12d5a92d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.461518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13495a-4803-41e7-b363-09f12d5a92d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.461795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13495a-4803-41e7-b363-09f12d5a92d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.462469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13495a-4803-41e7-b363-09f12d5a92d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.464459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13495a-4803-41e7-b363-09f12d5a92d3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.475479 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4027/7976] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:50:50.480281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.490571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994a82-0cb9-4d16-b71d-173e54b1ae28 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.495741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.496407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.496674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.496946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] PATH_INFO: `/v3/projects/c8e82ce300184c6893bc4aa48538b8b7/users/4a562190345b4735844b5cc78ddc8914/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.511995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e82ce300184c6893bc4aa48538b8b7, user_id=4a562190345b4735844b5cc78ddc8914, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.514786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.528219 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3950/7977] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:50:50 2022] PUT /identity/v3/projects/c8e82ce300184c6893bc4aa48538b8b7/users/4a562190345b4735844b5cc78ddc8914/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:50:50.538697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.539093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.539457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.569691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] MFA Rules not processed for user `4a562190345b4735844b5cc78ddc8914`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:50:50.570924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:50.624731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:50:50.646033 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4028/7978] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:50:50.656701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:50:50.658516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:50:50.770047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141c49-c276-482b-8fb4-d6e7cc9e6a99 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:50:50.774356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcdf0f-a48d-4b68-bf10-1502a1651f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:50:50.774809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcdf0f-a48d-4b68-bf10-1502a1651f22 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:50:50.775088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcdf0f-a48d-4b68-bf10-1502a1651f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:50:50.775423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcdf0f-a48d-4b68-bf10-1502a1651f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:50:50.785026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcdf0f-a48d-4b68-bf10-1502a1651f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:50:50.786483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcdf0f-a48d-4b68-bf10-1502a1651f22 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:50:50.798615 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3951/7979] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:50:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:00.642501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:00.794004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:13.209849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:13.211450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:13.304624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc17b46-c741-4873-ab06-7a8665f02363 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:13.310007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:13.310723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:13.311011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:13.311291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] PATH_INFO: `/v3/users/bbb1be102ed641b8af71afa1ad779587` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:13.312481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb1be102ed641b8af71afa1ad779587)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:13.314495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:13.380916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb1be102ed641b8af71afa1ad779587'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:13.402728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb1be102ed641b8af71afa1ad779587'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:13.403591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb1be102ed641b8af71afa1ad779587'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:13.404382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb1be102ed641b8af71afa1ad779587'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:13.412618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb1be102ed641b8af71afa1ad779587'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:13.427799 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4029/7980] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:13 2022] DELETE /identity/v3/users/bbb1be102ed641b8af71afa1ad779587 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:13.432716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:13.433275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:13.433460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:13.453948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:13.455202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:13.544948 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3952/7981] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:13.554440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:13.556008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:13.631339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7454ec-4a83-4a0a-ac32-91bb842a322a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:13.636641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:13.637379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:13.638050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:13.638050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:13.649101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:13.651194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:13.667158 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4030/7982] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:13.994814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:13.996959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:14.011686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890d60d-528d-45ff-87c4-482acf494e30 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:14.030551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:14.030551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.031031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.031136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] PATH_INFO: `/v3/projects/3f11de4c7ef34e5c8442b13a60c4e6eb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.032522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f11de4c7ef34e5c8442b13a60c4e6eb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:14.035190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:14.100051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f11de4c7ef34e5c8442b13a60c4e6eb', 'request_id': 'req-471cbd1d-ee30-4cab-b610-1617771fa5cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.105606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f11de4c7ef34e5c8442b13a60c4e6eb', 'request_id': 'req-471cbd1d-ee30-4cab-b610-1617771fa5cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.113732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f11de4c7ef34e5c8442b13a60c4e6eb', 'request_id': 'req-471cbd1d-ee30-4cab-b610-1617771fa5cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.125930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] The token cache is being invalidate because project 3f11de4c7ef34e5c8442b13a60c4e6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:14.126419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.127068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.128587 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3953/7983] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:13 2022] DELETE /identity/v3/projects/3f11de4c7ef34e5c8442b13a60c4e6eb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:14.132795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:14.143564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea166-5840-44a8-b0e6-d886a5cbb05f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:14.163978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:14.206341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:14.206977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.207265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.207542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] PATH_INFO: `/v3/users/f7020e133c18478cadba80fe0e9cee20` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.208684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7020e133c18478cadba80fe0e9cee20)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:14.210661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:14.267624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7020e133c18478cadba80fe0e9cee20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.280726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7020e133c18478cadba80fe0e9cee20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.281454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7020e133c18478cadba80fe0e9cee20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.282114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7020e133c18478cadba80fe0e9cee20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.292757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-dbf52501-62af-4a6d-9fea-59e6c5cf5fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7020e133c18478cadba80fe0e9cee20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.320212 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4031/7984] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:14 2022] DELETE /identity/v3/users/f7020e133c18478cadba80fe0e9cee20 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:14.603762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:14.605563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:14.620396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cbd1d-ee30-4cab-b610-1617771fa5cb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:14.680941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:14.682097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.682459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.682757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] PATH_INFO: `/v3/projects/55a8c2e347cf495f984629f69d7bd849` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.683958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a8c2e347cf495f984629f69d7bd849)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:14.686212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:14.719657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:14.738464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a8c2e347cf495f984629f69d7bd849', 'request_id': 'req-e6929031-9217-4ffe-97a9-abf7d4fdc85d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.745217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a8c2e347cf495f984629f69d7bd849', 'request_id': 'req-e6929031-9217-4ffe-97a9-abf7d4fdc85d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.752702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a8c2e347cf495f984629f69d7bd849', 'request_id': 'req-e6929031-9217-4ffe-97a9-abf7d4fdc85d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.766482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] The token cache is being invalidate because project 55a8c2e347cf495f984629f69d7bd849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:14.766773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.767424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e6929031-9217-4ffe-97a9-abf7d4fdc85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:14.768912 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3954/7985] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:14 2022] DELETE /identity/v3/projects/55a8c2e347cf495f984629f69d7bd849 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:14.773917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.774234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.774517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.795634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:14.796852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:14.865632 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4032/7986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:14.874467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.874971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.875328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.896062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:14.897301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:14.906047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3955/7987] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:14.910416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:14.923366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97896-bcbf-4fc2-a031-680ee553df51 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:14.928354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:14.928982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.929603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.929887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.930563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:14.930866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:14.933755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:14.945465 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4033/7988] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:51:14.949977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:14.960347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd2002-354c-4a9c-a5a2-a5b16d9d6c7b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:14.965464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:14.966085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:14.966409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:14.966688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:14.967334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:14.969238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:14.997865 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3956/7989] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:14 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:15.002299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.014046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b912b-2397-41e6-89bf-790be733e434 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.043020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:15.078837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.079536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.079821 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.080100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.080736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.082723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.109380 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4034/7990] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:15 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:15.110577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.122076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783194b6-a782-4c7e-b55e-dc2a3ce93d03 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.131178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.131823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.132107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.132383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.133041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.135366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.149647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3957/7991] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:15.152205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.163141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fccff-0ab6-4ee7-95a6-a390db5b4701 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.168803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79bd43-7ca3-46a0-b46d-1cc9d9d6d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.169466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79bd43-7ca3-46a0-b46d-1cc9d9d6d896 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.169746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79bd43-7ca3-46a0-b46d-1cc9d9d6d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.170019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79bd43-7ca3-46a0-b46d-1cc9d9d6d896 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.170703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79bd43-7ca3-46a0-b46d-1cc9d9d6d896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.172311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79bd43-7ca3-46a0-b46d-1cc9d9d6d896 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.189496 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4035/7992] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:15.190990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.202235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b113d-a3c9-4a9f-b678-6084d95bdc73 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.207131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.207815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.208099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.208375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] PATH_INFO: `/v3/projects/9e2e41decfcc4e11b6b7d247622fdf5d/users/e15356766f944a8e99451604233393d6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.225507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2e41decfcc4e11b6b7d247622fdf5d, user_id=e15356766f944a8e99451604233393d6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.228886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.242354 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3958/7993] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:15 2022] PUT /identity/v3/projects/9e2e41decfcc4e11b6b7d247622fdf5d/users/e15356766f944a8e99451604233393d6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:15.253470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.254048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.254353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.291183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] MFA Rules not processed for user `e15356766f944a8e99451604233393d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:15.292602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:15.358985 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4036/7994] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:15.363255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.427268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3372-8191-410f-b6c5-65f92f261aef admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.433439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.434262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.434540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.434903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.435611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.437721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.474414 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3959/7995] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:15 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:15.475938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.488140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96a19-b03f-480a-aeac-07a3133a90a1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.549973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.550837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.551107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.551407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.552066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.554216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.578079 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4037/7996] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:15 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:15.582022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.592583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c436-2020-4861-91d8-5cc4aeb4fb24 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.597313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.597933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.598322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.598604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.599246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.600995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.613734 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3960/7997] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:15.617756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.629299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5b746-f252-426a-9f9a-7fad8ba94063 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.633910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.635694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.635977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.636505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] PATH_INFO: `/v3/projects/c7498fb66b1047c696261cafe8cb7844/users/1845f0d2550b4209bafc5f0e0cdccf05/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.652348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7498fb66b1047c696261cafe8cb7844, user_id=1845f0d2550b4209bafc5f0e0cdccf05, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.655171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.669575 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4038/7998] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:15 2022] PUT /identity/v3/projects/c7498fb66b1047c696261cafe8cb7844/users/1845f0d2550b4209bafc5f0e0cdccf05/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:15.673543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.685923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd59a-4c6c-45db-b8ff-f05bfec360a6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.707837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:15.748613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe116-f704-4ffd-88cf-cb8b35203104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.749232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe116-f704-4ffd-88cf-cb8b35203104 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.749515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe116-f704-4ffd-88cf-cb8b35203104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.749791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe116-f704-4ffd-88cf-cb8b35203104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.750965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe116-f704-4ffd-88cf-cb8b35203104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.752576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe116-f704-4ffd-88cf-cb8b35203104 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.766744 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3961/7999] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:15.767923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.773383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:15.781433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a72ea4-7dbe-4ec5-aaf8-89f3da28d0c8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:15.786495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:15.787300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.787586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.787996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] PATH_INFO: `/v3/projects/c7498fb66b1047c696261cafe8cb7844/users/1845f0d2550b4209bafc5f0e0cdccf05/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.790024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7498fb66b1047c696261cafe8cb7844, user_id=1845f0d2550b4209bafc5f0e0cdccf05, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:15.792787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:15.806271 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4039/8000] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:15 2022] PUT /identity/v3/projects/c7498fb66b1047c696261cafe8cb7844/users/1845f0d2550b4209bafc5f0e0cdccf05/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:15.817180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:15.817382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:15.818111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:15.858691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] MFA Rules not processed for user `1845f0d2550b4209bafc5f0e0cdccf05`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:15.860360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:15.946557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3962/8001] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:15.959107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:15.961541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:16.033033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de84a89-6d27-48d2-942c-47c015d82ca7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:16.036942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:16.037695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:16.038100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:16.038513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:16.049612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:16.051359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:16.063315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4040/8002] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:16.147704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:16.161928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582bd6-792c-48dc-ae6f-f79194d85be6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:16.166775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede95a-b8eb-4f94-8b01-d4d7c724872d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:16.167527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede95a-b8eb-4f94-8b01-d4d7c724872d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:16.167918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede95a-b8eb-4f94-8b01-d4d7c724872d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:16.168364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede95a-b8eb-4f94-8b01-d4d7c724872d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:16.241830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede95a-b8eb-4f94-8b01-d4d7c724872d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:16.243463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede95a-b8eb-4f94-8b01-d4d7c724872d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:16.254458 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3963/8003] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:19.096466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:19.188322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf04d8-9d98-4550-904b-e88ff4f4c788 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:19.194813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:19.195009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:19.195313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:19.195795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] PATH_INFO: `/v3/users/e15356766f944a8e99451604233393d6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:19.198127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15356766f944a8e99451604233393d6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:19.200531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:19.269904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15356766f944a8e99451604233393d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:19.295844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15356766f944a8e99451604233393d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:19.296921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15356766f944a8e99451604233393d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:19.301185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15356766f944a8e99451604233393d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:19.326365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15356766f944a8e99451604233393d6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:19.346588 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4041/8004] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:19 2022] DELETE /identity/v3/users/e15356766f944a8e99451604233393d6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:19.347954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:19.348399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:19.348591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:19.370615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:19.371879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:19.423918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:19.458519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3964/8005] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:19.467013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:19.469463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:19.488326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:19.547682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73153-93d3-4fef-9e25-c22fb3c2af66 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:19.552186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:19.553067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:19.553506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:19.553969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:19.566178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:19.567573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:19.581771 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4042/8006] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:51:20.343951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:20.345438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:20.368954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e6825-50f6-4b2b-a9e4-965a27c23c82 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:20.391111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:20.391777 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:20.392058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:20.392374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] PATH_INFO: `/v3/projects/9e2e41decfcc4e11b6b7d247622fdf5d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:20.393479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2e41decfcc4e11b6b7d247622fdf5d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:20.395434 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:20.472604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2e41decfcc4e11b6b7d247622fdf5d', 'request_id': 'req-e46fbb62-66d7-4a42-b88a-5568616bf40f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.480790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2e41decfcc4e11b6b7d247622fdf5d', 'request_id': 'req-e46fbb62-66d7-4a42-b88a-5568616bf40f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.494276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2e41decfcc4e11b6b7d247622fdf5d', 'request_id': 'req-e46fbb62-66d7-4a42-b88a-5568616bf40f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.512817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] The token cache is being invalidate because project 9e2e41decfcc4e11b6b7d247622fdf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:20.513125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.514194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.515582 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3965/8007] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:20 2022] DELETE /identity/v3/projects/9e2e41decfcc4e11b6b7d247622fdf5d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:20.522058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:20.533216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d490bbb-6f56-4d27-a560-712b25f719d5 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:20.607378 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:20.607952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:20.608556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:20.608841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] PATH_INFO: `/v3/users/1845f0d2550b4209bafc5f0e0cdccf05` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:20.610183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1845f0d2550b4209bafc5f0e0cdccf05)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:20.611979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:20.668318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1845f0d2550b4209bafc5f0e0cdccf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.691091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1845f0d2550b4209bafc5f0e0cdccf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.692451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1845f0d2550b4209bafc5f0e0cdccf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.693307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1845f0d2550b4209bafc5f0e0cdccf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.702420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8748e655-b65c-4c40-a27a-b7243d9ebc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1845f0d2550b4209bafc5f0e0cdccf05'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:20.720441 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4043/8008] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:20 2022] DELETE /identity/v3/users/1845f0d2550b4209bafc5f0e0cdccf05 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:21.304378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.306843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:21.323554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fbb62-66d7-4a42-b88a-5568616bf40f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.416761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.417462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.417841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.418125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] PATH_INFO: `/v3/projects/c7498fb66b1047c696261cafe8cb7844` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.419327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7498fb66b1047c696261cafe8cb7844)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.421229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.479267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7498fb66b1047c696261cafe8cb7844', 'request_id': 'req-ebe294b0-219f-4db4-a641-ab6a8bab9c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:21.485693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7498fb66b1047c696261cafe8cb7844', 'request_id': 'req-ebe294b0-219f-4db4-a641-ab6a8bab9c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:21.497052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7498fb66b1047c696261cafe8cb7844', 'request_id': 'req-ebe294b0-219f-4db4-a641-ab6a8bab9c78'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:21.505461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:21.513608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] The token cache is being invalidate because project c7498fb66b1047c696261cafe8cb7844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:21.514844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:21.516702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ebe294b0-219f-4db4-a641-ab6a8bab9c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:21.518858 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3966/8009] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:21 2022] DELETE /identity/v3/projects/c7498fb66b1047c696261cafe8cb7844 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:21.524904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.525883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.525883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.552286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:21.554262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:21.606928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:21.644884 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4044/8010] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:21.653131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.653538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.653826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.674857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:21.676070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:21.684519 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3967/8011] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:21.688928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.699828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cff44-9199-4b7e-bed6-c591bec48ea8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.704569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.705270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.705621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.705990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.706746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:21.707116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.708828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.724714 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4045/8012] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:51:21.726082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.736123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3f7b-9ea5-4564-a1bf-5230140f0a87 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.740868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.741719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.741915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.742292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.743004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.745629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.776790 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3968/8013] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:21 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:21.777926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.788154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529234b-37f0-40b2-a026-005a3da9d498 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.847251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.847875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.848160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.848472 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.849120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.851096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.874428 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4046/8014] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:21 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:21.878672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.889927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebac3d-8532-4de6-8afb-2734a2e8b54c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.895332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.895887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.896173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.896450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.897101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.898739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.909833 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3969/8015] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:21.914351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.924591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782171c7-cf93-4ee6-b2d7-1d390d89c94d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.929251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce6816-25ef-4f6d-8e63-6b5993ded82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.929862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce6816-25ef-4f6d-8e63-6b5993ded82e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.930166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce6816-25ef-4f6d-8e63-6b5993ded82e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.930460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce6816-25ef-4f6d-8e63-6b5993ded82e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.931833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce6816-25ef-4f6d-8e63-6b5993ded82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.933454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce6816-25ef-4f6d-8e63-6b5993ded82e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.944541 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4047/8016] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:21.949432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:21.959567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc83e34-8460-438c-ab17-e17ad339ac8b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:21.964307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:21.964963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:21.965242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:21.965549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] PATH_INFO: `/v3/projects/ccf543105fdc4c7d8bb0e226fc2a4ecb/users/0614fc73995b4d1ca8aacbd267328beb/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:21.981037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf543105fdc4c7d8bb0e226fc2a4ecb, user_id=0614fc73995b4d1ca8aacbd267328beb, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:21.983721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:21.997780 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3970/8017] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:21 2022] PUT /identity/v3/projects/ccf543105fdc4c7d8bb0e226fc2a4ecb/users/0614fc73995b4d1ca8aacbd267328beb/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:22.008438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.008727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.009003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.038820 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] MFA Rules not processed for user `0614fc73995b4d1ca8aacbd267328beb`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:22.040035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:22.108306 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4048/8018] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:22.113029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.177726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a81d-a48e-4b61-ac75-46ed302a1e3c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.183394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.184016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.184297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.184570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.185202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.187135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.215512 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3971/8019] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:22 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:22.219393 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.230749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5575fb5-e04e-4bff-bf1e-f250b8138ea2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.258350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:22.299165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.299817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.300103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.300439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.301203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.303347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.331679 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4049/8020] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:22 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:22.332832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.344322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08fcb-86c5-44e7-95f5-ffe604bc2ee7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.350259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.351296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.351612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.351943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.352544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.354410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.375347 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3972/8021] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:22.379668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.392255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32769c28-4de9-4720-a5c0-cb23b599098f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.397557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.398483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.398844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.399122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] PATH_INFO: `/v3/projects/53074ddcf9f148c489cd692182335954/users/ce1d4f52664245c28f7342747e801735/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.418502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53074ddcf9f148c489cd692182335954, user_id=ce1d4f52664245c28f7342747e801735, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.421585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.438419 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4050/8022] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:22 2022] PUT /identity/v3/projects/53074ddcf9f148c489cd692182335954/users/ce1d4f52664245c28f7342747e801735/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:22.442934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.455065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08034-e7cb-41c1-99a2-5ef553fec748 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.534779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee29d-2b76-42c9-a5d2-df7e5200a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.535512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee29d-2b76-42c9-a5d2-df7e5200a75a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.535858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee29d-2b76-42c9-a5d2-df7e5200a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.536202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee29d-2b76-42c9-a5d2-df7e5200a75a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.536949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee29d-2b76-42c9-a5d2-df7e5200a75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.538732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee29d-2b76-42c9-a5d2-df7e5200a75a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.554383 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3973/8023] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:22.557747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.569007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d524a6-6fad-40f6-8c58-e3fdab899e55 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.574807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.575498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.575780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.576059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] PATH_INFO: `/v3/projects/53074ddcf9f148c489cd692182335954/users/ce1d4f52664245c28f7342747e801735/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.578080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53074ddcf9f148c489cd692182335954, user_id=ce1d4f52664245c28f7342747e801735, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.581391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.592883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4051/8024] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:22 2022] PUT /identity/v3/projects/53074ddcf9f148c489cd692182335954/users/ce1d4f52664245c28f7342747e801735/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:22.605293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.605596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.605866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.616082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:22.642823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] MFA Rules not processed for user `ce1d4f52664245c28f7342747e801735`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:22.644820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:22.735975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3974/8025] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:22.748516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:22.750745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:22.823337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38eeb3-06ac-454e-9ca4-be77419d262d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:22.827117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:22.827811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:22.828607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:22.828607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:22.898810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:22.901396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:22.912636 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4052/8026] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:26.658870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:26.660456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:26.676291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa0e79-4ad1-4811-aea8-9e94ef1d180a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:26.680468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af39eb-27cd-46df-a92b-84f84c3baea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:26.681781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af39eb-27cd-46df-a92b-84f84c3baea5 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:26.682346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af39eb-27cd-46df-a92b-84f84c3baea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:26.682728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af39eb-27cd-46df-a92b-84f84c3baea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:26.693153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af39eb-27cd-46df-a92b-84f84c3baea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:26.694868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af39eb-27cd-46df-a92b-84f84c3baea5 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:26.707331 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3975/8027] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:32.910223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:36.701468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=38 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:36.959759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:37.099440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62c1a5-6abb-4588-9f0a-0db5a73950fa service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:37.108001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:37.108773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:37.109169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:37.109514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] PATH_INFO: `/v3/users/0614fc73995b4d1ca8aacbd267328beb` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:37.110814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0614fc73995b4d1ca8aacbd267328beb)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:37.112873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:37.223620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0614fc73995b4d1ca8aacbd267328beb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:37.257380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0614fc73995b4d1ca8aacbd267328beb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:37.257993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0614fc73995b4d1ca8aacbd267328beb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:37.258668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0614fc73995b4d1ca8aacbd267328beb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:37.272546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0614fc73995b4d1ca8aacbd267328beb'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:37.307240 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4053/8028] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:36 2022] DELETE /identity/v3/users/0614fc73995b4d1ca8aacbd267328beb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:37.309127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143335-4637-4747-9af6-1980e0caa4be None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:37.309582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143335-4637-4747-9af6-1980e0caa4be None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:37.310038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143335-4637-4747-9af6-1980e0caa4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:37.364109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-51143335-4637-4747-9af6-1980e0caa4be None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:37.379432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51143335-4637-4747-9af6-1980e0caa4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:37.515615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:37.516420 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3976/8029] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:37.517508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:37.666911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7343b8-8fbf-4850-82c5-a724e56c81a4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:37.676308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:37.678340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:37.678629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:37.678909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:37.700107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:37.703501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:37.735494 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4054/8030] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:38.303228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143335-4637-4747-9af6-1980e0caa4be None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:38.304736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51143335-4637-4747-9af6-1980e0caa4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:38.330841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143335-4637-4747-9af6-1980e0caa4be None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:38.341928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:38.343858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:38.344262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:38.344747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] PATH_INFO: `/v3/projects/ccf543105fdc4c7d8bb0e226fc2a4ecb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:38.348808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf543105fdc4c7d8bb0e226fc2a4ecb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:38.350957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:38.434802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf543105fdc4c7d8bb0e226fc2a4ecb', 'request_id': 'req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.443506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf543105fdc4c7d8bb0e226fc2a4ecb', 'request_id': 'req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.463630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf543105fdc4c7d8bb0e226fc2a4ecb', 'request_id': 'req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.487790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] The token cache is being invalidate because project ccf543105fdc4c7d8bb0e226fc2a4ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:38.488269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.489199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.494919 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3977/8031] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:38 2022] DELETE /identity/v3/projects/ccf543105fdc4c7d8bb0e226fc2a4ecb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:38.498890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:38.512788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07737606-ae28-4289-a604-dbcc89609e6a service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:38.549829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:38.610529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:38.611342 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:38.611764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:38.612154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] PATH_INFO: `/v3/users/ce1d4f52664245c28f7342747e801735` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:38.613427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1d4f52664245c28f7342747e801735)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:38.616407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:38.695478 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1d4f52664245c28f7342747e801735'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.716221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1d4f52664245c28f7342747e801735'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.716894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1d4f52664245c28f7342747e801735'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.718463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1d4f52664245c28f7342747e801735'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.733470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e79483ec-0c88-4796-a9a7-9b421cf64e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1d4f52664245c28f7342747e801735'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:38.762613 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4055/8032] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:38 2022] DELETE /identity/v3/users/ce1d4f52664245c28f7342747e801735 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:39.238269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.239996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:39.280943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c56d3-8b44-4350-9ce7-a38c844a27f5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.369395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.370248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.370629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.371172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] PATH_INFO: `/v3/projects/53074ddcf9f148c489cd692182335954` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.372466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53074ddcf9f148c489cd692182335954)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.374506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.410821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:39.437040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53074ddcf9f148c489cd692182335954', 'request_id': 'req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:39.443359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53074ddcf9f148c489cd692182335954', 'request_id': 'req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:39.454430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53074ddcf9f148c489cd692182335954', 'request_id': 'req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:39.468860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] The token cache is being invalidate because project 53074ddcf9f148c489cd692182335954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:39.469202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:39.469883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-68c9a1fe-dd7d-4f14-9094-0f86c7ae24c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:39.471901 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3978/8033] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:39 2022] DELETE /identity/v3/projects/53074ddcf9f148c489cd692182335954 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:39.480196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.480402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.480696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.501650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:39.502916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:39.578203 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4056/8034] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:39.582254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.582493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.582966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.607368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:39.608665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:39.619814 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3979/8035] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:39.623670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.635421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5e0b-8203-470a-844c-ab7801858818 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.641302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.642195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.642718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.643101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.643869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:39.644284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.646009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.663645 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4057/8036] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:51:39.664925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.675059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e372-962b-4b4a-943f-cfcde027d6b8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.682209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.682209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.682209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.682606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.683088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.685074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.737645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3980/8037] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:39.738158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.754418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656314df-0786-46c4-9713-d10806a28321 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.785968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:39.825103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.825733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.826013 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.826667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.826957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.828903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.851911 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4058/8038] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:39 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:39.856821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.868458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719dfc2-c242-40a1-a2d6-a212448ab556 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.873500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.874131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.874449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.874735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.875391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.877039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.888968 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3981/8039] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:39.893092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.905040 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611c4d5-ee20-433c-9213-d129ea2d8e56 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.911485 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002deb7-f4e9-4a37-b310-d7bc795d2770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.912115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002deb7-f4e9-4a37-b310-d7bc795d2770 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.912741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002deb7-f4e9-4a37-b310-d7bc795d2770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.913074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002deb7-f4e9-4a37-b310-d7bc795d2770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.914222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002deb7-f4e9-4a37-b310-d7bc795d2770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.916748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002deb7-f4e9-4a37-b310-d7bc795d2770 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.928193 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4059/8040] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:39.932912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:39.943050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae1b9-bb68-4b2c-be20-e69fba720d63 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:39.948211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:39.948870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:39.949152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:39.949436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] PATH_INFO: `/v3/projects/15ba53e9decd416d8b3068a135d35de6/users/cbac21a8189142b8aa1a17f0b38b0ef1/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:39.964990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ba53e9decd416d8b3068a135d35de6, user_id=cbac21a8189142b8aa1a17f0b38b0ef1, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:39.967714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:39.989122 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3982/8041] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:39 2022] PUT /identity/v3/projects/15ba53e9decd416d8b3068a135d35de6/users/cbac21a8189142b8aa1a17f0b38b0ef1/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:40.000660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.000947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.001223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.031663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] MFA Rules not processed for user `cbac21a8189142b8aa1a17f0b38b0ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:40.032911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:40.117411 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4060/8042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:40.122755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.205815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde5c34-4395-401c-97a0-5dd6a0a8804b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:40.211705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:40.212921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.213195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.213470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.214130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:40.216227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:40.270007 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3983/8043] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:40 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:40.271837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.304609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c4fd-7cb9-4602-ba97-7d805b4c2464 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:40.380634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:40.381650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.387410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.387760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.388535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:40.390671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:40.424558 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4061/8044] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:40 2022] POST /identity/v3/users => generated 301 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:40.428630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.441746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d409c-8bec-4675-8d4c-58919a4cc72a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:40.448218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:40.448939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.449316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.449660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.450491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:40.452177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:40.465685 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3984/8045] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:40.469816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.480706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f652-4ac8-4331-b329-268c64434f28 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:40.485771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:40.486480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.486765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.487069 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] PATH_INFO: `/v3/projects/094829dc5dce4b1b94a034de72e000a7/users/d8465aaa6f1945fc860dc747a2f0c44e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.504796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094829dc5dce4b1b94a034de72e000a7, user_id=d8465aaa6f1945fc860dc747a2f0c44e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:40.507572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:40.524267 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4062/8046] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:40 2022] PUT /identity/v3/projects/094829dc5dce4b1b94a034de72e000a7/users/d8465aaa6f1945fc860dc747a2f0c44e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:40.532330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.560706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3e45-6ec8-4de5-9b4d-1c3db214ea5d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:40.574787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:40.641391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d44edd-a8f2-47c8-b469-172b6073346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:40.642059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d44edd-a8f2-47c8-b469-172b6073346d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.642377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d44edd-a8f2-47c8-b469-172b6073346d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.642655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d44edd-a8f2-47c8-b469-172b6073346d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.643310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d44edd-a8f2-47c8-b469-172b6073346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:40.644976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d44edd-a8f2-47c8-b469-172b6073346d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:40.661101 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3985/8047] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:40.662386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.670587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:40.676641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac341a7c-2c97-4946-82d0-05fc298c38a8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:40.685336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:40.686030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.686349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.686628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] PATH_INFO: `/v3/projects/094829dc5dce4b1b94a034de72e000a7/users/d8465aaa6f1945fc860dc747a2f0c44e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.688669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094829dc5dce4b1b94a034de72e000a7, user_id=d8465aaa6f1945fc860dc747a2f0c44e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:40.691437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:40.704712 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4063/8048] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:40 2022] PUT /identity/v3/projects/094829dc5dce4b1b94a034de72e000a7/users/d8465aaa6f1945fc860dc747a2f0c44e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:40.804524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:40.804826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:40.805107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:40.838443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] MFA Rules not processed for user `d8465aaa6f1945fc860dc747a2f0c44e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:40.840349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:40.923863 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3986/8049] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:40.936084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:40.940723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:41.012447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfbfbd-8984-4b10-94b2-e841824aee77 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:41.017346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6ce42-2c2a-45c8-92b5-75ddbb7ae28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:41.017983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ce42-2c2a-45c8-92b5-75ddbb7ae28d service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:41.018288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ce42-2c2a-45c8-92b5-75ddbb7ae28d service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:41.018571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ce42-2c2a-45c8-92b5-75ddbb7ae28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:41.030244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6ce42-2c2a-45c8-92b5-75ddbb7ae28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:41.031364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6ce42-2c2a-45c8-92b5-75ddbb7ae28d service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:41.041997 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4064/8050] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:41.192741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:41.292688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5f98f-f77b-4841-be4c-defd16e70563 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:41.298303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:41.299019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:41.300233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:41.300732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] PATH_INFO: `/v3/users/cbac21a8189142b8aa1a17f0b38b0ef1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:41.302317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbac21a8189142b8aa1a17f0b38b0ef1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:41.304912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:41.377208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:41.390290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbac21a8189142b8aa1a17f0b38b0ef1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:41.399159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbac21a8189142b8aa1a17f0b38b0ef1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:41.400803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbac21a8189142b8aa1a17f0b38b0ef1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:41.401233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbac21a8189142b8aa1a17f0b38b0ef1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:41.410287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbac21a8189142b8aa1a17f0b38b0ef1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:41.428860 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3987/8051] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:41 2022] DELETE /identity/v3/users/cbac21a8189142b8aa1a17f0b38b0ef1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:41.433474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:41.434575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:41.434859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:41.454939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:41.456412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:41.519267 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4065/8052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:41.529141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:41.530723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:41.530871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:41.532110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:41.635615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321b314-740d-4dfb-981b-83b5e1fd8b29 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:41.639853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:41.640562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:41.640919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:41.641262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:41.643026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0748-8116-4ec8-806f-98469bf7e921 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:41.652017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:41.652958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:41.653299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:41.653735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:41.656505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:41.686274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:41.688796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:41.689203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:41.691407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:41.706103 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3988/8053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:41.710245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4066/8054] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:42.206767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:42.208420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:42.234207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d98baf-ec1b-49c2-9770-73a5cde36614 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:42.241504 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:42.242263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:42.242549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:42.242827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] PATH_INFO: `/v3/projects/15ba53e9decd416d8b3068a135d35de6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:42.244325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ba53e9decd416d8b3068a135d35de6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:42.246773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:42.339430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ba53e9decd416d8b3068a135d35de6', 'request_id': 'req-84940e23-20f9-438b-b736-0593153340a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.348722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ba53e9decd416d8b3068a135d35de6', 'request_id': 'req-84940e23-20f9-438b-b736-0593153340a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.369824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ba53e9decd416d8b3068a135d35de6', 'request_id': 'req-84940e23-20f9-438b-b736-0593153340a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.395270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] The token cache is being invalidate because project 15ba53e9decd416d8b3068a135d35de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:42.395658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.398519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.406351 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3989/8055] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:42 2022] DELETE /identity/v3/projects/15ba53e9decd416d8b3068a135d35de6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:42.406767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:42.421586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74275019-60d6-4e4f-8812-16c66dc3f165 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:42.441083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:42.488530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:42.489360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:42.489768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:42.490285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] PATH_INFO: `/v3/users/d8465aaa6f1945fc860dc747a2f0c44e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:42.491571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8465aaa6f1945fc860dc747a2f0c44e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:42.494223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:42.552318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8465aaa6f1945fc860dc747a2f0c44e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.565688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8465aaa6f1945fc860dc747a2f0c44e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.566520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8465aaa6f1945fc860dc747a2f0c44e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.567167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8465aaa6f1945fc860dc747a2f0c44e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.574714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dd0f31f-f542-4fcb-a04d-3124bf11b785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8465aaa6f1945fc860dc747a2f0c44e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:42.591883 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4067/8056] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:42 2022] DELETE /identity/v3/users/d8465aaa6f1945fc860dc747a2f0c44e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:42.968332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:42.971314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:42.994045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84940e23-20f9-438b-b736-0593153340a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.054753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:43.074223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.075015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.075152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.075429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] PATH_INFO: `/v3/projects/094829dc5dce4b1b94a034de72e000a7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.076614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094829dc5dce4b1b94a034de72e000a7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.078590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.135788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094829dc5dce4b1b94a034de72e000a7', 'request_id': 'req-1c9eddb0-afb2-4625-b57f-f6c181963b50'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:43.142801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094829dc5dce4b1b94a034de72e000a7', 'request_id': 'req-1c9eddb0-afb2-4625-b57f-f6c181963b50'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:43.156796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094829dc5dce4b1b94a034de72e000a7', 'request_id': 'req-1c9eddb0-afb2-4625-b57f-f6c181963b50'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:43.171778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] The token cache is being invalidate because project 094829dc5dce4b1b94a034de72e000a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:43.172077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:43.173137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1c9eddb0-afb2-4625-b57f-f6c181963b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:43.178286 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3990/8057] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:42 2022] DELETE /identity/v3/projects/094829dc5dce4b1b94a034de72e000a7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:43.180012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.180297 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.180571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.202014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:43.203266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:43.279423 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4068/8058] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:43.287206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.287502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.287800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.310066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:43.311511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:43.319972 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3991/8059] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:43.325213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.335284 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a4ee-4033-426e-8b91-ffa1e59d78bd None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.342212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.343162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.343569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.343921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.344736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:43.345241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.346988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.364939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4069/8060] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:51:43.366102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.377430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ddb13-e281-4477-afd3-bf97b27b1760 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.382566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.383309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.383596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.383883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.385219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.387628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.422220 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3992/8061] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:43 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:43.423414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.435540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34d40-69cf-48bc-9b5b-a60b1fedd08c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.465425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:43.519686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.520652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.521162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.521659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.522737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.525313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.559424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4070/8062] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:43 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:43.563649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.575178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f82dee-f787-4914-a99b-a5148c72aa6c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.580359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.581003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.581277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.581550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.582246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.584508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.600585 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3993/8063] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:43.605353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.617219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669db6e-39de-4382-9184-2f0b4d0bc32e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.624104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75046cda-9efb-4c63-8591-b7fb3eaa87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.625633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046cda-9efb-4c63-8591-b7fb3eaa87e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.626031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046cda-9efb-4c63-8591-b7fb3eaa87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.626448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046cda-9efb-4c63-8591-b7fb3eaa87e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.627341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046cda-9efb-4c63-8591-b7fb3eaa87e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.628983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046cda-9efb-4c63-8591-b7fb3eaa87e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.646273 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4071/8064] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:51:43.648539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.661765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c66c-a18c-4460-9415-c515e59e32a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.667642 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.668340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.668621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.668980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] PATH_INFO: `/v3/projects/8964e92e29944e85b94298fd3b3547f5/users/5d0a182867904f21bf76e3234cfdd759/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.687602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8964e92e29944e85b94298fd3b3547f5, user_id=5d0a182867904f21bf76e3234cfdd759, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.690553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.707503 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3994/8065] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:43 2022] PUT /identity/v3/projects/8964e92e29944e85b94298fd3b3547f5/users/5d0a182867904f21bf76e3234cfdd759/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:43.719713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.719996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.720281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.752898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] MFA Rules not processed for user `5d0a182867904f21bf76e3234cfdd759`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:43.754419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:43.855527 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4072/8066] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:43.855873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:43.947274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651e12f-562a-4946-9ab1-7f7dbe334cc0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:43.953329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:43.953965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:43.954288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:43.954570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:43.955369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:43.957803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:43.981359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:44.000622 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3995/8067] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:43 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:44.005034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.018706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea4606-d369-4275-a83d-af12e02d5f9b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.091374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.092475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.092937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.093376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.095145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.097401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.128154 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4073/8068] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:44 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:44.132165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.144206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e09528-889f-4e47-9dfb-2cf16aa44bf9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.149186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.150584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.151170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.151462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.152120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.153812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.168658 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3996/8069] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:44.169951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.180111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e1d4-feaf-4533-b870-85eceaacb97b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.185978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.186691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.187370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.187370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] PATH_INFO: `/v3/projects/5d8e81ff046c4df18e6897365c3aa869/users/870218dd623f4084b957541518b3a1c8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.217216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8e81ff046c4df18e6897365c3aa869, user_id=870218dd623f4084b957541518b3a1c8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.220320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.246869 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4074/8070] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:44 2022] PUT /identity/v3/projects/5d8e81ff046c4df18e6897365c3aa869/users/870218dd623f4084b957541518b3a1c8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:44.247706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.281646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9787-f0d2-426d-89a6-9a9400d9e371 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.396483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f014f8-ae2e-41ee-b6ab-2c7be90ac415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.397124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f014f8-ae2e-41ee-b6ab-2c7be90ac415 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.397409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f014f8-ae2e-41ee-b6ab-2c7be90ac415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.398042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f014f8-ae2e-41ee-b6ab-2c7be90ac415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.399149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f014f8-ae2e-41ee-b6ab-2c7be90ac415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.401944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f014f8-ae2e-41ee-b6ab-2c7be90ac415 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.415796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3997/8071] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:44.419425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.425848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:44.437028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea0426-4c7a-4263-8ef3-04569f9f4759 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.448970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.449969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.450354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.450698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] PATH_INFO: `/v3/projects/5d8e81ff046c4df18e6897365c3aa869/users/870218dd623f4084b957541518b3a1c8/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.453193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8e81ff046c4df18e6897365c3aa869, user_id=870218dd623f4084b957541518b3a1c8, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.456591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.491483 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4075/8072] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:44 2022] PUT /identity/v3/projects/5d8e81ff046c4df18e6897365c3aa869/users/870218dd623f4084b957541518b3a1c8/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:44.502524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.503171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.503827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.557918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] MFA Rules not processed for user `870218dd623f4084b957541518b3a1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:44.559341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:44.652951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.655656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:44.698455 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3998/8073] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:44.710926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.714800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:44.786038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77fe7-cf1f-4b39-b0ec-c5bf40f9b027 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.789979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.791289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.791640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.792016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.794675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7eebfe-2477-4536-9f1e-db5be8dc6b59 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.802181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.803011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.803202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.803717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.804273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.804831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.806569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:44.815288 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3999/8074] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:44.892048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:44.894595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:44.918781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4076/8075] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:51:44.920759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:44.934302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892826-f2f5-435e-8711-67e665238aff service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:44.938882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:44.939332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:44.939612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:44.939885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:44.944772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:45.012487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:45.014323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:45.028228 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4000/8076] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:45.169194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:45.173386 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:45.278768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef03114-0b33-4915-9c48-8e5a7d272c8d service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:45.283288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:45.283915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:45.284213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:45.284484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:45.291721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:45.308977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:45.320484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:45.323918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:45.342523 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4077/8077] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:46.699438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:46.701235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:46.719695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432fa16-3f3e-4211-9309-1ad02c7aacbb service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:46.725367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:46.726270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:46.726739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:46.727184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:46.733789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:46.770595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:46.772673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:46.789184 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4001/8078] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:51:50.283587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:50.303247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40773-bf8e-49fe-a3f0-eb283a8fc58f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:50.308555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:50.309295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:50.309648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:50.309991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:50.312011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:50.408674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:50.410481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8ed53-3262-4c65-ac8b-b66d40dcf5f3 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:50.425298 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4078/8079] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:54.053962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:54.067723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7a513-b8ea-4947-861d-bec48c89bfd7 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:54.073442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:54.074494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:54.075121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:54.075596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] PATH_INFO: `/v3/users/5d0a182867904f21bf76e3234cfdd759` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:54.076973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0a182867904f21bf76e3234cfdd759)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:54.079154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:54.168741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0a182867904f21bf76e3234cfdd759'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.188767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0a182867904f21bf76e3234cfdd759'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.189618 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0a182867904f21bf76e3234cfdd759'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.190617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0a182867904f21bf76e3234cfdd759'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.206177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0a182867904f21bf76e3234cfdd759'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.230183 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4002/8080] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:54 2022] DELETE /identity/v3/users/5d0a182867904f21bf76e3234cfdd759 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:54.234108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:54.235121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:54.235720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:54.277674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:54.279408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:54.386565 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4079/8081] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:54.398748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:54.401138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:54.538197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c699823-d4a7-4fe4-9acc-b479b7451f8b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:54.543611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dc494-2fd3-4e01-ac0d-34e43a94e54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:54.544596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dc494-2fd3-4e01-ac0d-34e43a94e54a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:54.545136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dc494-2fd3-4e01-ac0d-34e43a94e54a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:54.545643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dc494-2fd3-4e01-ac0d-34e43a94e54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:54.558131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dc494-2fd3-4e01-ac0d-34e43a94e54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:54.560808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dc494-2fd3-4e01-ac0d-34e43a94e54a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:54.585861 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4003/8082] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:54.860522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:54.862482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:54.876812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29c3f-7e0c-4f0f-be53-dd905f9f6d53 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:54.881972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:54.882865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:54.883255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:54.883641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] PATH_INFO: `/v3/users/4a562190345b4735844b5cc78ddc8914` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:54.886490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a562190345b4735844b5cc78ddc8914)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:54.888798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:54.964107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a562190345b4735844b5cc78ddc8914'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.977382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a562190345b4735844b5cc78ddc8914'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.978803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a562190345b4735844b5cc78ddc8914'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:54.979473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a562190345b4735844b5cc78ddc8914'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.012629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a562190345b4735844b5cc78ddc8914'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.029803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:55.036262 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4080/8083] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:54 2022] DELETE /identity/v3/users/4a562190345b4735844b5cc78ddc8914 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:55.041743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.042253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.042677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.062272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:55.075521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:55.077711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:55.093487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:55.095753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:55.183297 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4004/8084] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:55.193230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:55.197231 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:55.260148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eef397-7831-46e1-a9a2-c92bab55a592 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:55.265837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:55.267353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.268480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.269049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] PATH_INFO: `/v3/projects/8964e92e29944e85b94298fd3b3547f5` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.270870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8964e92e29944e85b94298fd3b3547f5)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:55.273232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:55.319582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25068e5-2bc1-40dc-a921-9a2b71f3fefb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:55.325575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:55.326680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.327218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.327713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.341782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:55.343701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:55.356339 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4005/8085] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:55.363717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8964e92e29944e85b94298fd3b3547f5', 'request_id': 'req-4b1b038c-0926-4946-a1d0-f475467fc84d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.372963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8964e92e29944e85b94298fd3b3547f5', 'request_id': 'req-4b1b038c-0926-4946-a1d0-f475467fc84d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.379453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8964e92e29944e85b94298fd3b3547f5', 'request_id': 'req-4b1b038c-0926-4946-a1d0-f475467fc84d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.400880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] The token cache is being invalidate because project 8964e92e29944e85b94298fd3b3547f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:55.401177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.402667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.405018 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4081/8086] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:55 2022] DELETE /identity/v3/projects/8964e92e29944e85b94298fd3b3547f5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:55.408970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:55.423279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695751b-d8f4-480d-9ed0-18c818e29a9d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:55.506745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:55.507580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.507877 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.508154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] PATH_INFO: `/v3/users/870218dd623f4084b957541518b3a1c8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.509898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=870218dd623f4084b957541518b3a1c8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:55.512869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:55.595168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:55.596738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:55.615212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b038c-0926-4946-a1d0-f475467fc84d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:55.623401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:55.624126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.624440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.624668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] PATH_INFO: `/v3/projects/c8e82ce300184c6893bc4aa48538b8b7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.626365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870218dd623f4084b957541518b3a1c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.626514 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e82ce300184c6893bc4aa48538b8b7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:55.628427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:55.632789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:55.640196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870218dd623f4084b957541518b3a1c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.641472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870218dd623f4084b957541518b3a1c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.642411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870218dd623f4084b957541518b3a1c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.653401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-31f2287b-0745-4849-b840-1f8a77c7d0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870218dd623f4084b957541518b3a1c8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.675801 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4006/8087] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:55 2022] DELETE /identity/v3/users/870218dd623f4084b957541518b3a1c8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:55.704279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e82ce300184c6893bc4aa48538b8b7', 'request_id': 'req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.712127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e82ce300184c6893bc4aa48538b8b7', 'request_id': 'req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.731522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e82ce300184c6893bc4aa48538b8b7', 'request_id': 'req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.745593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] The token cache is being invalidate because project c8e82ce300184c6893bc4aa48538b8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:55.745943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.746801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-09bbc67b-f217-42b1-be2c-aaf72fbf2e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:55.748473 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4082/8088] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:55 2022] DELETE /identity/v3/projects/c8e82ce300184c6893bc4aa48538b8b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:55.754360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.754658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.755044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.780923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:55.782345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:55.850323 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4007/8089] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:55.858763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.859052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.859332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.880632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:55.881946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:55.891512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4083/8090] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:55.895654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:55.910469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa3338-94a4-4923-8e37-7e908e605fb6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:55.916205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:55.916814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.917115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.917358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.918024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:55.918402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:55.920149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:55.934643 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4008/8091] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:51:55.939202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:55.951304 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee7a4-c38b-4aec-bbcb-de35fba43df1 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:55.956153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:55.956779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:55.957067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:55.957887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:55.958026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:55.959964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:55.965832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:55.997458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4084/8092] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:55 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:56.002864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.015905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cd18b-47c5-4fa1-a0b2-044f1c9fef89 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.042730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.044479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.096157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.096795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.097312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.097312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.097946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.099896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.124205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea112ee7-8393-48c5-814f-4c9c4e707baf admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.128342 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4009/8093] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:56.129558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.130318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.130973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.131255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.131529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] PATH_INFO: `/v3/projects/5d8e81ff046c4df18e6897365c3aa869` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.132699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8e81ff046c4df18e6897365c3aa869)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.135268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.141404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444a805-070a-4187-8375-b1bc8c87fba4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.148743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.150576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.150576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.150905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.151288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.153132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.169161 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4010/8094] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:56.171120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.182587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a4bbd-5d57-4b03-8d72-3ae65159ada5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.200746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8e81ff046c4df18e6897365c3aa869', 'request_id': 'req-d3bea174-d198-4a36-acef-a53bd924fd10'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.208316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8e81ff046c4df18e6897365c3aa869', 'request_id': 'req-d3bea174-d198-4a36-acef-a53bd924fd10'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.214981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8e81ff046c4df18e6897365c3aa869', 'request_id': 'req-d3bea174-d198-4a36-acef-a53bd924fd10'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.218268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:56.233428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] The token cache is being invalidate because project 5d8e81ff046c4df18e6897365c3aa869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:56.234133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.235511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d3bea174-d198-4a36-acef-a53bd924fd10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.237537 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4085/8095] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:56 2022] DELETE /identity/v3/projects/5d8e81ff046c4df18e6897365c3aa869 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:56.242436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895882b7-5a87-4292-9b84-1b2f44a3d77e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.244076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895882b7-5a87-4292-9b84-1b2f44a3d77e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.244635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895882b7-5a87-4292-9b84-1b2f44a3d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.249310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.250014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.250390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.250735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.251493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.253189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.268281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-895882b7-5a87-4292-9b84-1b2f44a3d77e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:56.270212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-895882b7-5a87-4292-9b84-1b2f44a3d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.271938 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4011/8096] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:56.275811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.277592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.286466 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4086/8097] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:56.297653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.297948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.298245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.298997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792d4ff-68f0-4a5c-b86b-1219f1434dbf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.312537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad977fb9-84a0-4a61-91c5-6e1fcd7d7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.315350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977fb9-84a0-4a61-91c5-6e1fcd7d7006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.315486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977fb9-84a0-4a61-91c5-6e1fcd7d7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.315749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977fb9-84a0-4a61-91c5-6e1fcd7d7006 admin admin] PATH_INFO: `/v3/projects/b4b6bffcb20d407998b3a1d79736670e/users/41b34bf04d1a47648e9e5da5c845fb9a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.322869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:56.324385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.333343 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4087/8098] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:56.337198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.338180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977fb9-84a0-4a61-91c5-6e1fcd7d7006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b6bffcb20d407998b3a1d79736670e, user_id=41b34bf04d1a47648e9e5da5c845fb9a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.341124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977fb9-84a0-4a61-91c5-6e1fcd7d7006 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.348560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5e45-987f-4a6f-b8c3-9d1e51dd83ca None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.355569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.356479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.356956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.357689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.358604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:56.359122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.360955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.361538 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4012/8099] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:56 2022] PUT /identity/v3/projects/b4b6bffcb20d407998b3a1d79736670e/users/41b34bf04d1a47648e9e5da5c845fb9a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:56.374030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.374409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.374762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.392287 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4088/8100] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:51:56.393720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.405248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] MFA Rules not processed for user `41b34bf04d1a47648e9e5da5c845fb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:56.406460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6ebb-2af0-43cc-923f-d25ac93d344e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.406620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.470364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:56.489140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.489824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.490237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.490571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.491321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.493379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.504677 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4013/8101] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:56.514124 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.516081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.529596 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4089/8102] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:56.530958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.594751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b7530-efe2-46c4-bff0-15a988f3e23a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.603734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf566d-a040-4616-9fbc-197e891d0964 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.608570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.609210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.609493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.609772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.610465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.612383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.641133 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4090/8103] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:56.646581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.655991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.656689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.656976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.657253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.659735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6a40e-f1db-4b22-8f04-a2c41e043a0d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.663022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:56.679874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.681916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.682249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.682531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.683638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.685734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.698189 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4091/8104] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:51:56.702051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.716057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c79a7-3501-4ffd-b3cc-416adb494e6c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.721781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.722415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.722695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.722968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.723604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.725205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.726297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.728770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.738319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4014/8105] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:56.738621 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4092/8106] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:51:56.742214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.750712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.756874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357041-f11a-49c0-a4db-dae8263dbcb5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.762842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f13db-2d08-49b9-9539-b58da3ea34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.763585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f13db-2d08-49b9-9539-b58da3ea34b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.763822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f13db-2d08-49b9-9539-b58da3ea34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.764062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25deecb2-d187-4acf-8fba-2ea93d43145b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:56.764275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f13db-2d08-49b9-9539-b58da3ea34b2 admin admin] PATH_INFO: `/v3/projects/4e80401dd20641ef95fd413915e460c6/users/79d3117c8b8249a5b7258bf73f90638f/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.769325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:56.770612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.770895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.771185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] PATH_INFO: `/v3/users/41b34bf04d1a47648e9e5da5c845fb9a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.772317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b34bf04d1a47648e9e5da5c845fb9a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.774830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.780903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f13db-2d08-49b9-9539-b58da3ea34b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e80401dd20641ef95fd413915e460c6, user_id=79d3117c8b8249a5b7258bf73f90638f, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:56.783615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f13db-2d08-49b9-9539-b58da3ea34b2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:56.800283 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4015/8107] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:56 2022] PUT /identity/v3/projects/4e80401dd20641ef95fd413915e460c6/users/79d3117c8b8249a5b7258bf73f90638f/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:51:56.812852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.813135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.813416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.831158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b34bf04d1a47648e9e5da5c845fb9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.844318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] MFA Rules not processed for user `79d3117c8b8249a5b7258bf73f90638f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:56.845553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.846630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b34bf04d1a47648e9e5da5c845fb9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.847340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b34bf04d1a47648e9e5da5c845fb9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.847960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b34bf04d1a47648e9e5da5c845fb9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.875226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ff97c26b-a2a8-4959-8d7d-1c76f8fff2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b34bf04d1a47648e9e5da5c845fb9a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:56.895659 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4093/8108] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:56 2022] DELETE /identity/v3/users/41b34bf04d1a47648e9e5da5c845fb9a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:56.901671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:56.901960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:56.902290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:56.927086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:56.929038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:56.947608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:56.957102 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4016/8109] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:56.961281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:56.966268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:57.021395 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4094/8110] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:51:57.033070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.034954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:57.054204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d89a-7de6-4236-aeb0-a8a3d7e42104 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.060275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.061160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.061541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.061898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.062844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.065189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.097638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:57.111998 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4017/8111] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:56 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:57.112879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.122361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb25b2f-902e-4e75-bc6e-fabd0419013f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.195453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.197880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.198928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.199524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.200180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748bfbb-06cd-4319-86ab-1d477027a399 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.205002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.205582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.205880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.206140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.206923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.208844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.214683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.216152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.231970 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4095/8112] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:57.235351 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4018/8113] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:57 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:57.240039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.257502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0250-aadf-40df-a260-4f4d4c17f79f service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.273016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.273728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.274482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.274482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.275165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.276969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.309822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4096/8114] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:57.312033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.324022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334913-c6f9-409e-9c40-d007fa4621e2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.335307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.336133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.337706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.337706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] PATH_INFO: `/v3/projects/d8e9e109c619442683fbd46b37b2608c/users/91932163fa5546ffbb66f6c4fd521c2b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.355394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e9e109c619442683fbd46b37b2608c, user_id=91932163fa5546ffbb66f6c4fd521c2b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.358254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.381678 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4019/8115] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:57 2022] PUT /identity/v3/projects/d8e9e109c619442683fbd46b37b2608c/users/91932163fa5546ffbb66f6c4fd521c2b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:57.383321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.396372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c1358-5d07-4c77-9efa-27badea7a5b9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.522968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.523609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.523891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.524167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.526061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.530822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.533403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:57.546858 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4097/8116] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:57.550875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.568556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914a23-fff4-4c78-b0c9-c2e74773c402 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.592435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94d580-5ca1-4015-8ceb-f77b3f77bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.593137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d580-5ca1-4015-8ceb-f77b3f77bb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.593418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d580-5ca1-4015-8ceb-f77b3f77bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.593693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d580-5ca1-4015-8ceb-f77b3f77bb2b admin admin] PATH_INFO: `/v3/projects/d8e9e109c619442683fbd46b37b2608c/users/91932163fa5546ffbb66f6c4fd521c2b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.596079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94d580-5ca1-4015-8ceb-f77b3f77bb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e9e109c619442683fbd46b37b2608c, user_id=91932163fa5546ffbb66f6c4fd521c2b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.599696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94d580-5ca1-4015-8ceb-f77b3f77bb2b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.622601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.626066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:57.638433 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4020/8117] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:57 2022] PUT /identity/v3/projects/d8e9e109c619442683fbd46b37b2608c/users/91932163fa5546ffbb66f6c4fd521c2b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:57.652469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.652887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.653339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.658021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b3117-1dd5-4490-9a68-095082bd7f9d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.690004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] MFA Rules not processed for user `91932163fa5546ffbb66f6c4fd521c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:57.691697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:57.778795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:57.779467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.779749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.780027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] PATH_INFO: `/v3/projects/b4b6bffcb20d407998b3a1d79736670e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:57.782569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b6bffcb20d407998b3a1d79736670e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:57.784467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:57.827735 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4021/8118] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:57.835821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:57.837854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:57.897256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:57.911370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b6bffcb20d407998b3a1d79736670e', 'request_id': 'req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:57.923987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917768-b3eb-4068-b13e-0c9aa61c3939 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:57.925784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b6bffcb20d407998b3a1d79736670e', 'request_id': 'req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:57.940263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b6bffcb20d407998b3a1d79736670e', 'request_id': 'req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:57.964534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] The token cache is being invalidate because project b4b6bffcb20d407998b3a1d79736670e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:51:57.964970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:57.966037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9fdd3ab9-0bb8-47aa-8eb3-9d857aaab060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:57.974667 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4098/8119] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:57 2022] DELETE /identity/v3/projects/b4b6bffcb20d407998b3a1d79736670e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:57.978453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62472a-ab27-463e-a3e9-2c57c3735c02 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:57.979328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62472a-ab27-463e-a3e9-2c57c3735c02 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:57.979614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62472a-ab27-463e-a3e9-2c57c3735c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.017495 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3f62472a-ab27-463e-a3e9-2c57c3735c02 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:58.018769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3f62472a-ab27-463e-a3e9-2c57c3735c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:58.028500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.032009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.033596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.034126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.038656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:58.153331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.153972 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4099/8120] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:58.155364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.155634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.155819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.156068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.184304 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4022/8121] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:58.184946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:58.187301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:58.197776 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4100/8122] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:58.202426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.220206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf287-0d28-49ef-8540-18fd61e2dc1a service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.227196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.229299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.229652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.230001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.230801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:51:58.231268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.234356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.254365 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4023/8123] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:51:58.255518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.278402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a848-b614-4bb5-8c58-9bb2bdea9492 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.287057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.288242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.288690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.289127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.290231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.292407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.330867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:58.343808 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4101/8124] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:51:58 2022] POST /identity/v3/projects => generated 353 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:51:58.344552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.360641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba14ad-8075-4248-b448-789a21775f8a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.458017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.458688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.458958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.459232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.459923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.462459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.488813 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4024/8125] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:51:58 2022] POST /identity/v3/users => generated 277 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:51:58.492864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.503578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7521a1-3466-4b78-b5d1-c854d8886179 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.509180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.509778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.510056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.510525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.511168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.513071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.526221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4102/8126] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:58.528686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.544000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f482-99fc-42b0-a72c-791b89abc8f6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.549551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271c899-d35c-4643-a8c6-5c81d7a847a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.550223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271c899-d35c-4643-a8c6-5c81d7a847a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.550876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271c899-d35c-4643-a8c6-5c81d7a847a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.550876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271c899-d35c-4643-a8c6-5c81d7a847a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.551414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271c899-d35c-4643-a8c6-5c81d7a847a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.553212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271c899-d35c-4643-a8c6-5c81d7a847a0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.566512 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4025/8127] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:51:58.570538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.582019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6437-4559-4b62-87ba-9b1b8d39b05f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.587301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.587988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.588263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.588700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] PATH_INFO: `/v3/projects/0acf30f3695b4618bb808e7059858774/users/1bdfd55903514e73ad0998726b940ba7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.608420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acf30f3695b4618bb808e7059858774, user_id=1bdfd55903514e73ad0998726b940ba7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.613099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.638187 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4103/8128] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:51:58 2022] PUT /identity/v3/projects/0acf30f3695b4618bb808e7059858774/users/1bdfd55903514e73ad0998726b940ba7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:58.649598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.649880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.650182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.667871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:58.695741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] MFA Rules not processed for user `1bdfd55903514e73ad0998726b940ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:58.698947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:58.812319 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4026/8129] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:58.822832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:58.824692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:58.903019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba209fd-c279-441d-8872-8bd63155e315 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:58.907542 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eb18d-177f-4f5f-b069-4948b79eddf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:58.908279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eb18d-177f-4f5f-b069-4948b79eddf7 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:58.908746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eb18d-177f-4f5f-b069-4948b79eddf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:58.909093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eb18d-177f-4f5f-b069-4948b79eddf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:58.927430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eb18d-177f-4f5f-b069-4948b79eddf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:58.929182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eb18d-177f-4f5f-b069-4948b79eddf7 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:58.942045 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4104/8130] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:51:59.010441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:59.012165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:59.089296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940beb9-132e-43b9-a34d-5312dfe170fd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:59.095617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:59.096489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:59.096640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:59.096982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] PATH_INFO: `/v3/users/79d3117c8b8249a5b7258bf73f90638f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:59.098573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d3117c8b8249a5b7258bf73f90638f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:59.100160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:59.160781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d3117c8b8249a5b7258bf73f90638f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:59.173610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d3117c8b8249a5b7258bf73f90638f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:59.174406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d3117c8b8249a5b7258bf73f90638f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:59.175024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d3117c8b8249a5b7258bf73f90638f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:59.183866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d3117c8b8249a5b7258bf73f90638f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:51:59.209661 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4027/8131] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:51:59 2022] DELETE /identity/v3/users/79d3117c8b8249a5b7258bf73f90638f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:51:59.216425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:59.217191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:59.217528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:59.246123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:51:59.247574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:59.342358 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4105/8132] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:51:59.362318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:59.366141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:59.405921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:51:59.480754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf447c-37ce-48a2-b0e0-bf8b3eecfe78 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:59.484600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:59.485185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:59.485471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:59.485752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:59.497064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:59.499575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:51:59.514303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4028/8133] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:51:59.927174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:51:59.928755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:51:59.944041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44886-9416-49db-805f-2d8f7c4d35bc None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:51:59.950876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:51:59.952782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:51:59.953319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:51:59.953534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] PATH_INFO: `/v3/projects/4e80401dd20641ef95fd413915e460c6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:51:59.955021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e80401dd20641ef95fd413915e460c6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:51:59.956958 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:00.016936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e80401dd20641ef95fd413915e460c6', 'request_id': 'req-b4a65cb9-9730-4500-98d7-50ed0810358e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.027111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e80401dd20641ef95fd413915e460c6', 'request_id': 'req-b4a65cb9-9730-4500-98d7-50ed0810358e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.033742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e80401dd20641ef95fd413915e460c6', 'request_id': 'req-b4a65cb9-9730-4500-98d7-50ed0810358e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.035601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:00.052623 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] The token cache is being invalidate because project 4e80401dd20641ef95fd413915e460c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:00.052924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.054440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.058202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4106/8134] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:51:59 2022] DELETE /identity/v3/projects/4e80401dd20641ef95fd413915e460c6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:00.061053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:00.073052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428e5d6-e945-4052-bcb7-c347c180dd1f service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:00.155451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:00.157166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:00.157608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:00.158052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] PATH_INFO: `/v3/users/91932163fa5546ffbb66f6c4fd521c2b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:00.159426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91932163fa5546ffbb66f6c4fd521c2b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:00.161570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:00.186208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:00.187924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:00.209760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65cb9-9730-4500-98d7-50ed0810358e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:00.222012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:00.222732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:00.223014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:00.223330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] PATH_INFO: `/v3/users/129030291b0644019ce64d039013f327` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:00.224501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129030291b0644019ce64d039013f327)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:00.226488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:00.250253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91932163fa5546ffbb66f6c4fd521c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.264369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91932163fa5546ffbb66f6c4fd521c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.265071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91932163fa5546ffbb66f6c4fd521c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.266111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91932163fa5546ffbb66f6c4fd521c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.275939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91932163fa5546ffbb66f6c4fd521c2b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.300130 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4029/8135] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:00 2022] DELETE /identity/v3/users/91932163fa5546ffbb66f6c4fd521c2b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:00.303109 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129030291b0644019ce64d039013f327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.318527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129030291b0644019ce64d039013f327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.319634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129030291b0644019ce64d039013f327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.321182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129030291b0644019ce64d039013f327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.332414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129030291b0644019ce64d039013f327'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.361607 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4107/8136] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:00 2022] DELETE /identity/v3/users/129030291b0644019ce64d039013f327 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:00.559425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:00.561096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:00.615671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:00.644672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1bc3-eeb6-4240-878b-b7707c861ab8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:00.705197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:00.705858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:00.706167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:00.706507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] PATH_INFO: `/v3/projects/49dd613fa6ff47f387e251b7ed25177e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:00.707673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49dd613fa6ff47f387e251b7ed25177e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:00.709587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:00.771360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49dd613fa6ff47f387e251b7ed25177e', 'request_id': 'req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.780271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49dd613fa6ff47f387e251b7ed25177e', 'request_id': 'req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.790954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49dd613fa6ff47f387e251b7ed25177e', 'request_id': 'req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.805645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] The token cache is being invalidate because project 49dd613fa6ff47f387e251b7ed25177e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:00.805882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.806555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.808380 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4030/8137] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:00 2022] DELETE /identity/v3/projects/49dd613fa6ff47f387e251b7ed25177e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:00.812426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:00.814045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:00.831381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39f7c-a002-47cb-a87f-bf713faf9f46 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:00.906465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:00.907141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:00.907895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:00.908191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] PATH_INFO: `/v3/users/b934e606eae94a0eafda734f7ed97769` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:00.909481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b934e606eae94a0eafda734f7ed97769)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:00.911792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:00.974912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b934e606eae94a0eafda734f7ed97769'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.998859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b934e606eae94a0eafda734f7ed97769'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:00.999031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:00.999718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b934e606eae94a0eafda734f7ed97769'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.000388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b934e606eae94a0eafda734f7ed97769'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.000511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.003263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=20,keystone:SELECT=78 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:01.019961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e629c9dd-849a-485e-8031-bc5db7a13ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b934e606eae94a0eafda734f7ed97769'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.022892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff5e4-a203-4f17-b2c9-1818ecd848a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.031221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.032624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.033007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.033636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] PATH_INFO: `/v3/projects/d8e9e109c619442683fbd46b37b2608c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.036007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e9e109c619442683fbd46b37b2608c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.037953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.043502 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4108/8138] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:00 2022] DELETE /identity/v3/users/b934e606eae94a0eafda734f7ed97769 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:01.106318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e9e109c619442683fbd46b37b2608c', 'request_id': 'req-4d75f914-6f09-4df3-9670-67d5bb8a77df'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.115198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e9e109c619442683fbd46b37b2608c', 'request_id': 'req-4d75f914-6f09-4df3-9670-67d5bb8a77df'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.125461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e9e109c619442683fbd46b37b2608c', 'request_id': 'req-4d75f914-6f09-4df3-9670-67d5bb8a77df'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.135064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:01.140765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] The token cache is being invalidate because project d8e9e109c619442683fbd46b37b2608c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:01.141645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.142802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4d75f914-6f09-4df3-9670-67d5bb8a77df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.145083 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4031/8139] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:00 2022] DELETE /identity/v3/projects/d8e9e109c619442683fbd46b37b2608c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:01.150789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.151185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.151536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.176460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:01.177764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.240339 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4109/8140] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:01.249843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.250372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.250561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.271334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:01.272577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.285193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4032/8141] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:01.290475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.302683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090c9d1-b29a-4713-9212-a09be6c16c43 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.308947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.309582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.312575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.312575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.312575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:01.312575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.313124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.314962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.317384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.333419 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4110/8142] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:01.338273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.344530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d1ea-3d63-45b1-820d-438167216ded None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.351210 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.351980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.352530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.353540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] PATH_INFO: `/v3/projects/1c0cc5283ee54a1c927dfbf7a8f94463` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.355132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0cc5283ee54a1c927dfbf7a8f94463)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.356634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3cd40-b35c-4df3-bae1-3fb5447963ca admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.360600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.361784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.362487 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.362796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.363122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.363766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.365694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.404410 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4111/8143] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:01.408684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.416774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0cc5283ee54a1c927dfbf7a8f94463', 'request_id': 'req-d4092f69-dbf3-44f0-a483-18c87d2f8613'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.422855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0cc5283ee54a1c927dfbf7a8f94463', 'request_id': 'req-d4092f69-dbf3-44f0-a483-18c87d2f8613'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.432572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0cc5283ee54a1c927dfbf7a8f94463', 'request_id': 'req-d4092f69-dbf3-44f0-a483-18c87d2f8613'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.447772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] The token cache is being invalidate because project 1c0cc5283ee54a1c927dfbf7a8f94463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:01.448176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.448872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d4092f69-dbf3-44f0-a483-18c87d2f8613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.453767 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4033/8144] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:01 2022] DELETE /identity/v3/projects/1c0cc5283ee54a1c927dfbf7a8f94463 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:01.458409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c261-cd40-403d-a532-82d1829fd6ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.458686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c261-cd40-403d-a532-82d1829fd6ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.458963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c261-cd40-403d-a532-82d1829fd6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.481958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-03f9c261-cd40-403d-a532-82d1829fd6ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:01.483275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-03f9c261-cd40-403d-a532-82d1829fd6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.494453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2d23-1a08-4010-88f4-4fdc4bac370a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.499367 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.500205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.500552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.500901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.501620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.503656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.529168 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4112/8145] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:01.533147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.538691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.554757 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d98387-1151-46c0-9486-ba58d6fcc907 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.557250 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4034/8146] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:01.560517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.561318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.561778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.562229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.563023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.565152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.566659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.567001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.567492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.580353 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4113/8147] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:01.581558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.591789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03087ca-ed95-44a9-8333-bcbd26304cfb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.594352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:01.595586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.597494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.598106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.598470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.598750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.599399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.601014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.607292 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4035/8148] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:01.614252 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.621637 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4114/8149] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:52:01.623411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.625960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaec1f-f6a9-4008-987c-aa968d32104e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.631766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.632431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.632712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.632989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.633683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:01.633809 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482052-6dd8-4d3c-83bc-6f596caed19c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.633996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.635772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.639697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63866-aa06-42bb-ac34-ce40cac99170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.640572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63866-aa06-42bb-ac34-ce40cac99170 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.641036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63866-aa06-42bb-ac34-ce40cac99170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.641481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63866-aa06-42bb-ac34-ce40cac99170 admin admin] PATH_INFO: `/v3/projects/436a20bfd36a4b268c1249afe3fb2244/users/4cf12e47d2754ca68d8ae95961720f20/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.649788 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4036/8150] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:52:01.654579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:01.655150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.658125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63866-aa06-42bb-ac34-ce40cac99170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436a20bfd36a4b268c1249afe3fb2244, user_id=4cf12e47d2754ca68d8ae95961720f20, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.666592 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63866-aa06-42bb-ac34-ce40cac99170 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.671586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333993c9-3cc0-44a2-abc5-c77357028cbe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.677167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.677811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.678194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.678444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.679109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.681823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.691736 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4115/8151] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:01 2022] PUT /identity/v3/projects/436a20bfd36a4b268c1249afe3fb2244/users/4cf12e47d2754ca68d8ae95961720f20/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:01.695822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.696152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.696438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.721599 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4037/8152] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:01.722511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.730942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] MFA Rules not processed for user `4cf12e47d2754ca68d8ae95961720f20`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:01.732316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.760763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:01.804666 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865adbe-2948-4a54-9dfb-977184510879 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.810886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.811857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.812150 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.814481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.815270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.818204 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4116/8153] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:01.818378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.818486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.819106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.833195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c28a7-b315-4657-b698-9a5613598b03 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.838835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.839470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.839758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.840033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] PATH_INFO: `/v3/users/1bdfd55903514e73ad0998726b940ba7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.841079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4038/8154] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:01.841224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdfd55903514e73ad0998726b940ba7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.841824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.843137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.851727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0faaf-b1c4-4188-b8f0-cd9f887ba94e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.857110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:01.857726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:01.858052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:01.858352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:01.859005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:01.860898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:01.894192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4039/8155] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:01.894430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdfd55903514e73ad0998726b940ba7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.894541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.907723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdfd55903514e73ad0998726b940ba7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.908545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdfd55903514e73ad0998726b940ba7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.909167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdfd55903514e73ad0998726b940ba7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.917199 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdfd55903514e73ad0998726b940ba7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:01.931245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4117/8156] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:01 2022] DELETE /identity/v3/users/1bdfd55903514e73ad0998726b940ba7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:01.932288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:01.933755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:01.958836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ead34-f41d-4fec-ac55-d64712ba9966 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:01.988541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:02.003359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b98b-5354-4a37-9d36-be3560195529 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.008731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.009408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.009706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.009986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.010654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.012842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.018837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffd9d5-f938-4559-ae95-ddcdc37e1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.019478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd9d5-f938-4559-ae95-ddcdc37e1c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.019762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd9d5-f938-4559-ae95-ddcdc37e1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.020039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffd9d5-f938-4559-ae95-ddcdc37e1c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.020681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd9d5-f938-4559-ae95-ddcdc37e1c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.022308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffd9d5-f938-4559-ae95-ddcdc37e1c37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.033574 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4040/8157] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:02.036753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4118/8158] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:01 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:02.036918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.036918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.036918 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.037812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.039467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.051833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e65d0-000b-43e3-9fd9-57539b1250e6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.054863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:02.056583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.057462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.058076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.058437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.058835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.059539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.061197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.064341 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4041/8159] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:02.065159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.077029 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4119/8160] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:02.077230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897729d0-5b0d-401e-ac09-e3c117973d16 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.079085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.080481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.081168 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.081475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.081849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.082000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.082601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.084460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.095796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4042/8161] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:02.096828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.106870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664845-1e77-49d5-9598-1394fe23df20 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.111594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.112244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.112529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.112805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] PATH_INFO: `/v3/projects/3929fc1424c3432f9fffead61b10a598/users/9788d585e06a48f29c35538496c44791/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.128106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3929fc1424c3432f9fffead61b10a598, user_id=9788d585e06a48f29c35538496c44791, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.130840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.145135 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4043/8162] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:02 2022] PUT /identity/v3/projects/3929fc1424c3432f9fffead61b10a598/users/9788d585e06a48f29c35538496c44791/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:02.149579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.150529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e848-dde0-4b96-a3d8-b78d80521a52 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.153935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:02.201915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.202652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.202931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.203204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.215455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585af62c-41be-40c7-84d8-11be92cb4462 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.220335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff901dd-e33e-4327-a392-eb35d3a6571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.221298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff901dd-e33e-4327-a392-eb35d3a6571d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.221876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff901dd-e33e-4327-a392-eb35d3a6571d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.221876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff901dd-e33e-4327-a392-eb35d3a6571d admin admin] PATH_INFO: `/v3/projects/ad4f90ca2978419eb86e63380e09115c/users/ee4327607c034daaa9299ecf42715129/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.240662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff901dd-e33e-4327-a392-eb35d3a6571d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4f90ca2978419eb86e63380e09115c, user_id=ee4327607c034daaa9299ecf42715129, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.244401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff901dd-e33e-4327-a392-eb35d3a6571d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.259731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4044/8163] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:02 2022] PUT /identity/v3/projects/ad4f90ca2978419eb86e63380e09115c/users/ee4327607c034daaa9299ecf42715129/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:02.261001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.261298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.261570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.273781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.275285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.280708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:02.281909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.285611 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4120/8164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:02.285914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.297165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552415fc-dad6-435b-a9f7-ae2c2fc7a926 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.347481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:02.361855 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4045/8165] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:02.372883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.374521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.380214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.380844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.381128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.381409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.382379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.385071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.401082 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4121/8166] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:02.402167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.414065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caba88-4e13-4e24-a0ea-248c61828e6b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.422385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9b9c6-d2f7-4860-9606-f49b2b117fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.423062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b9c6-d2f7-4860-9606-f49b2b117fde admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.423345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b9c6-d2f7-4860-9606-f49b2b117fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.423621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b9c6-d2f7-4860-9606-f49b2b117fde admin admin] PATH_INFO: `/v3/projects/ad4f90ca2978419eb86e63380e09115c/users/ee4327607c034daaa9299ecf42715129/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.426048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9b9c6-d2f7-4860-9606-f49b2b117fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4f90ca2978419eb86e63380e09115c, user_id=ee4327607c034daaa9299ecf42715129, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.428890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9b9c6-d2f7-4860-9606-f49b2b117fde admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.442128 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4122/8167] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:02 2022] PUT /identity/v3/projects/ad4f90ca2978419eb86e63380e09115c/users/ee4327607c034daaa9299ecf42715129/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:02.448673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a7191-d64b-419e-828d-42edec53a7ad None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.452403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.452698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.452976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.491635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] MFA Rules not processed for user `ee4327607c034daaa9299ecf42715129`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:02.493822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.502938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:02.515501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.516419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.516803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.517177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.571683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4123/8168] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:02.572690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.574003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.591640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.593006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.603647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4046/8169] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:52:02.607126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.608503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.650368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968b940-78a8-461f-a86f-0729b20b6852 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.656006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.656664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.656947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.657365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] PATH_INFO: `/v3/projects/0acf30f3695b4618bb808e7059858774` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.658691 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acf30f3695b4618bb808e7059858774)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.660599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.678839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e813-eefc-4281-be22-ac5be82ca679 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.683163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.683791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.684074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.684348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.686532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.720624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:02.722141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acf30f3695b4618bb808e7059858774', 'request_id': 'req-cd9107a4-0a71-472d-8bfc-f8727ebc488f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:02.731588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acf30f3695b4618bb808e7059858774', 'request_id': 'req-cd9107a4-0a71-472d-8bfc-f8727ebc488f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:02.740203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acf30f3695b4618bb808e7059858774', 'request_id': 'req-cd9107a4-0a71-472d-8bfc-f8727ebc488f'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:02.755857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] The token cache is being invalidate because project 0acf30f3695b4618bb808e7059858774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:02.756244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:02.757024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-cd9107a4-0a71-472d-8bfc-f8727ebc488f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:02.762197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4124/8170] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:02 2022] DELETE /identity/v3/projects/0acf30f3695b4618bb808e7059858774 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:02.764068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.764507 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.764819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.767111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.768759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc6d9-8142-4873-978c-f3d3cbf0d8d7 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.781099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4047/8171] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:02.789733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:02.791651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.877449 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4125/8172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:02.885648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.885937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.886246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.912055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:02.913533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:02.923524 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4048/8173] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:02.928333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.941067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248fca8-88ca-431e-b914-636517a3f401 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.946706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.947356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.947638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.947914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:02.948566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:02.948879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:02.950527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:02.970766 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4126/8174] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:02.974608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:02.988547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e070c-da55-4dae-9fde-752ba7efd0a7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:02.998517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:02.999312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:02.999602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:02.999882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.000649 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.004030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.049286 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4049/8175] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:02 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:03.051620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.067410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4addbb-972b-4bc8-93be-83384c3f766e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.156155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.157108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.157532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.157813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.158500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.160737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.190190 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4127/8176] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:03 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:03.192527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.213212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500863a-ba8d-4e6e-b998-cbee594c3993 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.223758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.224600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.224863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.225136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.225791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.227762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.238808 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4050/8177] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:03.242711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.254697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd56c-c3aa-446c-b567-1314f1de8d59 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.261154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8377ce4-84a2-4c91-a492-b1df94aa2b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.261782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8377ce4-84a2-4c91-a492-b1df94aa2b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.262361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8377ce4-84a2-4c91-a492-b1df94aa2b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.262638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8377ce4-84a2-4c91-a492-b1df94aa2b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.263289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8377ce4-84a2-4c91-a492-b1df94aa2b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.265283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8377ce4-84a2-4c91-a492-b1df94aa2b9b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.283957 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4128/8178] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:03.290396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.300825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864348d-f909-42ee-ac74-ddb847516ce8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.308187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.308938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.309253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.309529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] PATH_INFO: `/v3/projects/06fbf86d259a44158d08b148e8b00a2a/users/cf71e68c28104438b0cd0573fdf57b00/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.312490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:03.329222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fbf86d259a44158d08b148e8b00a2a, user_id=cf71e68c28104438b0cd0573fdf57b00, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.332249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.365716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4051/8179] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:03 2022] PUT /identity/v3/projects/06fbf86d259a44158d08b148e8b00a2a/users/cf71e68c28104438b0cd0573fdf57b00/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:03.377650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.378007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.378771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.417505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] MFA Rules not processed for user `cf71e68c28104438b0cd0573fdf57b00`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:03.418814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:03.469795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:03.533369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.543595 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4129/8180] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:03.625715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4aa17-2c63-4e62-92a2-151186570c33 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.632401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.634627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.634627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.635166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.635957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.640069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.681506 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4052/8181] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:03 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:03.682812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.700153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f4b95-2699-4c8f-adca-b17aabe6193a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.771400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.772415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.773158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.773790 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.775066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.777411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.809155 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4130/8182] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:03 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:03.810778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.824225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f135-eecf-4f6f-9809-a463020be875 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.829828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.830627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.831019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.831402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.832160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.834024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.851423 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4053/8183] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:03.856567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.869463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e2e22-adb3-4df3-a281-cdf798892480 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:03.876750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:03.879203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:03.879673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:03.880119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] PATH_INFO: `/v3/projects/e763738b8252473f9b09db1eec927581/users/9658b85d8df747f1974699dcedf51114/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:03.908647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e763738b8252473f9b09db1eec927581, user_id=9658b85d8df747f1974699dcedf51114, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:03.912371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:03.940132 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4131/8184] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:03 2022] PUT /identity/v3/projects/e763738b8252473f9b09db1eec927581/users/9658b85d8df747f1974699dcedf51114/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:03.940471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:03.956547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ae8ab-5849-47f2-9281-eaabc8f4be04 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:04.026035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c2e58-a253-4a98-87cd-b81fe13013b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:04.026755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c2e58-a253-4a98-87cd-b81fe13013b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:04.027051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c2e58-a253-4a98-87cd-b81fe13013b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:04.027357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c2e58-a253-4a98-87cd-b81fe13013b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:04.028010 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c2e58-a253-4a98-87cd-b81fe13013b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:04.029735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c2e58-a253-4a98-87cd-b81fe13013b7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:04.046718 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4054/8185] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:52:04.050772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:04.072593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58d60-1247-4efe-ac6b-96290da978bd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:04.079916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:04.081273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:04.081578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:04.081921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] PATH_INFO: `/v3/projects/e763738b8252473f9b09db1eec927581/users/9658b85d8df747f1974699dcedf51114/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:04.085601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e763738b8252473f9b09db1eec927581, user_id=9658b85d8df747f1974699dcedf51114, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:04.091122 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:04.107682 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4132/8186] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:04 2022] PUT /identity/v3/projects/e763738b8252473f9b09db1eec927581/users/9658b85d8df747f1974699dcedf51114/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:04.121094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:04.121646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:04.121893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:04.180047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] MFA Rules not processed for user `9658b85d8df747f1974699dcedf51114`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:04.185172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:04.268961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:04.336253 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4055/8187] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:04.350229 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:04.352047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:04.464137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d9add-f07a-4d24-9b9e-cd66d350e11e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:04.471844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e08696-b615-4bf3-a894-d8e14b5ff513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:04.472566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e08696-b615-4bf3-a894-d8e14b5ff513 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:04.472853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e08696-b615-4bf3-a894-d8e14b5ff513 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:04.473132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e08696-b615-4bf3-a894-d8e14b5ff513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:04.488443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e08696-b615-4bf3-a894-d8e14b5ff513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:04.489896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e08696-b615-4bf3-a894-d8e14b5ff513 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:04.502969 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4133/8188] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:04.958745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:05.037355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92b0ef-25b3-410c-892d-e35162cb1560 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:05.042676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:05.043333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:05.043612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:05.043885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] PATH_INFO: `/v3/users/cf71e68c28104438b0cd0573fdf57b00` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:05.045033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf71e68c28104438b0cd0573fdf57b00)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:05.047148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:05.136070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf71e68c28104438b0cd0573fdf57b00'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:05.146396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf71e68c28104438b0cd0573fdf57b00'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:05.147137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf71e68c28104438b0cd0573fdf57b00'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:05.147816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf71e68c28104438b0cd0573fdf57b00'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:05.156841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf71e68c28104438b0cd0573fdf57b00'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:05.182043 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4056/8189] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:04 2022] DELETE /identity/v3/users/cf71e68c28104438b0cd0573fdf57b00 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:05.186713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:05.189808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:05.189808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:05.214234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:05.215502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:05.247559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:05.304695 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4134/8190] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:05.316832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:05.319251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:05.448163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5df3e-c304-4e1d-a392-1dbb9f60f059 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:05.453344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:05.454096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:05.454519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:05.454879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:05.466964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:05.469195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:05.475826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:05.534458 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4057/8191] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:06.083132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:06.084602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:06.112178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6e73-8640-464f-a2fa-810e91c125d7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:06.125163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:06.129684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:06.129927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:06.130374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] PATH_INFO: `/v3/projects/06fbf86d259a44158d08b148e8b00a2a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:06.131581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fbf86d259a44158d08b148e8b00a2a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:06.133678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:06.213439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fbf86d259a44158d08b148e8b00a2a', 'request_id': 'req-b8555e5e-d511-41d8-8810-eeb9b7fae006'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.226761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fbf86d259a44158d08b148e8b00a2a', 'request_id': 'req-b8555e5e-d511-41d8-8810-eeb9b7fae006'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.241332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fbf86d259a44158d08b148e8b00a2a', 'request_id': 'req-b8555e5e-d511-41d8-8810-eeb9b7fae006'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.268824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] The token cache is being invalidate because project 06fbf86d259a44158d08b148e8b00a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:06.269134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.269922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.273459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4135/8192] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:06 2022] DELETE /identity/v3/projects/06fbf86d259a44158d08b148e8b00a2a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:06.278358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:06.290119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e9992-e904-42ff-ab5f-f6aba2f7ad56 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:06.363664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:06.364544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:06.365078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:06.365578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] PATH_INFO: `/v3/users/9658b85d8df747f1974699dcedf51114` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:06.367040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9658b85d8df747f1974699dcedf51114)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:06.371960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:06.456269 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9658b85d8df747f1974699dcedf51114'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.476657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9658b85d8df747f1974699dcedf51114'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.478117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9658b85d8df747f1974699dcedf51114'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.479072 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9658b85d8df747f1974699dcedf51114'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.499084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-30ae4a07-edc4-4567-a3e7-4b978847d0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9658b85d8df747f1974699dcedf51114'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:06.537192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4058/8193] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:06 2022] DELETE /identity/v3/users/9658b85d8df747f1974699dcedf51114 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:07.017058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.019602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:07.050924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555e5e-d511-41d8-8810-eeb9b7fae006 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.138031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.138896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.139426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.139811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] PATH_INFO: `/v3/projects/e763738b8252473f9b09db1eec927581` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.147496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e763738b8252473f9b09db1eec927581)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:07.150402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:07.212083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e763738b8252473f9b09db1eec927581', 'request_id': 'req-e665002f-d42f-4c91-bfdc-5bcfaf129b22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:07.214772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:07.221234 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e763738b8252473f9b09db1eec927581', 'request_id': 'req-e665002f-d42f-4c91-bfdc-5bcfaf129b22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:07.231341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e763738b8252473f9b09db1eec927581', 'request_id': 'req-e665002f-d42f-4c91-bfdc-5bcfaf129b22'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:07.254728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] The token cache is being invalidate because project e763738b8252473f9b09db1eec927581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:07.255257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:07.257425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e665002f-d42f-4c91-bfdc-5bcfaf129b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:07.263031 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4136/8194] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:07 2022] DELETE /identity/v3/projects/e763738b8252473f9b09db1eec927581 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:07.265462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.267432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.267885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.296345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:07.306862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:07.433868 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4059/8195] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:07.441745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.442120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.442489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.501389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:07.503137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:07.514868 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4137/8196] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:07.519283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.543959 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0b1c-e682-4ede-af07-9ad3543a7c03 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.549205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.549993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.550328 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.550608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.551440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:07.551755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:07.553393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:07.577511 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4060/8197] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:07.578834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.596014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec866b97-a6cc-4542-a5f6-bd076bddf1ff None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.611390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34cd29-45d3-4abe-803d-45444934bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.612295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34cd29-45d3-4abe-803d-45444934bb77 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.612758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34cd29-45d3-4abe-803d-45444934bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.613189 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34cd29-45d3-4abe-803d-45444934bb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.614015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34cd29-45d3-4abe-803d-45444934bb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:07.616016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34cd29-45d3-4abe-803d-45444934bb77 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:07.691417 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4138/8198] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:07 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:07.693042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.710539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac36789-179b-4e7a-9d77-5ea810ff9f7b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.717543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:07.800744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.801396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.801687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.801970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.802657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:07.805003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:07.822081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.822081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.822081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.847634 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4061/8199] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:07 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:07.851522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.872464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf19dc-4271-4e35-87b9-d425dcb8745d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.876953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:07.878361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:07.884202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.888268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.888727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.889021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.890195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:07.892578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:07.910263 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4062/8200] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:07.916003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.927853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1deb-3f83-4efb-99a1-973892252b2a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.934245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.934987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.935482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.935828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:07.936562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:07.938399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:07.954189 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4063/8201] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:07.958173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:07.970893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f0432-7344-4ee9-a8b1-b71a53f97a02 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:07.982807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ba036-cbbd-46b6-a455-4227d347072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:07.983834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ba036-cbbd-46b6-a455-4227d347072f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:07.984018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ba036-cbbd-46b6-a455-4227d347072f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:07.984293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ba036-cbbd-46b6-a455-4227d347072f admin admin] PATH_INFO: `/v3/projects/6cf8b495dff449189206eae88a93f723/users/b86e09c13e4e40a7b64763339d71809a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.000625 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4139/8202] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:08.001959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.006652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:08.011186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ba036-cbbd-46b6-a455-4227d347072f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf8b495dff449189206eae88a93f723, user_id=b86e09c13e4e40a7b64763339d71809a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.015091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ba036-cbbd-46b6-a455-4227d347072f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.023153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507bad6-36ed-4908-a0cf-19e44fb966ab None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.032962 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4064/8203] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:07 2022] PUT /identity/v3/projects/6cf8b495dff449189206eae88a93f723/users/b86e09c13e4e40a7b64763339d71809a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:08.041328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.041978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.042306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.042993 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.043692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.044579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.044933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.045160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.045811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.081143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] MFA Rules not processed for user `b86e09c13e4e40a7b64763339d71809a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:08.082670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:08.084417 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4140/8204] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:08 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:08.089414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.179921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa6860-050c-495a-9ba9-9a7c61095077 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.183044 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4065/8205] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:08.187083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.189111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.189823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.190182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.190531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.191226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.193473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.201310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64659397-294c-4488-a68c-932c74bb7a02 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.206786 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.207619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.208109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.208483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.209397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.212493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.226615 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4141/8206] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:08 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:08.228896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.241014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec61e8-35db-4b97-809b-4070a168824d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.247195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.247988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.248352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.248703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.249408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.251140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.252660 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4066/8207] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:08 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:08.256545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.257130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:08.277834 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4142/8208] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:08.278552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:08.279679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.293493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436ac5-c054-494e-af55-8b4bc169145f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.335552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8645-e21a-4207-af59-072a33f8e832 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.344867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.345513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.345803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.346083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.346794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.352726 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.371837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.372539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.372829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.373111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] PATH_INFO: `/v3/projects/882c4703518044aaa0ca5d7a1dfd5865/users/55416a415fb748c5b7c0fd3952b58dfd/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.392242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882c4703518044aaa0ca5d7a1dfd5865, user_id=55416a415fb748c5b7c0fd3952b58dfd, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.394212 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4067/8209] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:08 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:08.396798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.397598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.411285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1630e-7994-4689-8325-b358a46b4d16 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.413874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4143/8210] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:08 2022] PUT /identity/v3/projects/882c4703518044aaa0ca5d7a1dfd5865/users/55416a415fb748c5b7c0fd3952b58dfd/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:08.420221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.487127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.487932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.488324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.488730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.489489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.491484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.506799 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4068/8211] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:08.511638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.513629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7ccbf-9dbc-4439-b296-d52d86758177 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.519228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.520655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.520655 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.520916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.521482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.523409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.525333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5751-880a-4651-beb7-82ad3d7f7677 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.532985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.533782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.534169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.534515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] PATH_INFO: `/v3/projects/a5b3ae518e444acb8d0b9cbc4e575c61/users/abdac577249f47c3b6ed71be24c9acb6/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.542002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4144/8212] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:52:08.543850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.554906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b3ae518e444acb8d0b9cbc4e575c61, user_id=abdac577249f47c3b6ed71be24c9acb6, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.557696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c1a1-5e15-4899-9850-8dc40c863a7e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.559000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.563578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.564433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.564772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.565056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] PATH_INFO: `/v3/projects/882c4703518044aaa0ca5d7a1dfd5865/users/55416a415fb748c5b7c0fd3952b58dfd/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.567108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882c4703518044aaa0ca5d7a1dfd5865, user_id=55416a415fb748c5b7c0fd3952b58dfd, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.569984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.578337 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4069/8213] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:08 2022] PUT /identity/v3/projects/a5b3ae518e444acb8d0b9cbc4e575c61/users/abdac577249f47c3b6ed71be24c9acb6/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:08.581055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.586016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4145/8214] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:08 2022] PUT /identity/v3/projects/882c4703518044aaa0ca5d7a1dfd5865/users/55416a415fb748c5b7c0fd3952b58dfd/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:08.685127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb18990-d0c8-4515-af69-c476652594f5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.720779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:08.768608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74cbb-32dc-4a32-b7a0-539d233fb0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.769310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74cbb-32dc-4a32-b7a0-539d233fb0ed admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.769602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74cbb-32dc-4a32-b7a0-539d233fb0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.770605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74cbb-32dc-4a32-b7a0-539d233fb0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.771270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74cbb-32dc-4a32-b7a0-539d233fb0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.773016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74cbb-32dc-4a32-b7a0-539d233fb0ed admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.790525 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4070/8215] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:08.792145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:08.807260 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd03e0-1d9b-453b-b412-79fc31dd1886 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:08.813171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:08.814637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.814637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.814897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] PATH_INFO: `/v3/projects/a5b3ae518e444acb8d0b9cbc4e575c61/users/abdac577249f47c3b6ed71be24c9acb6/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.817075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b3ae518e444acb8d0b9cbc4e575c61, user_id=abdac577249f47c3b6ed71be24c9acb6, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:08.819968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:08.833097 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4146/8216] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:08 2022] PUT /identity/v3/projects/a5b3ae518e444acb8d0b9cbc4e575c61/users/abdac577249f47c3b6ed71be24c9acb6/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:08.935708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:08.936340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:08.936775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:08.980392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] MFA Rules not processed for user `abdac577249f47c3b6ed71be24c9acb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:08.981881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:09.036861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:09.039248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:09.091421 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4071/8217] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:09.104374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:09.105883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:09.129924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:09.153121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09bba3-1dfb-4096-84df-5bc572442efa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:09.164041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:09.166657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:09.167053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:09.167466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] PATH_INFO: `/v3/users/4cf12e47d2754ca68d8ae95961720f20` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:09.181624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf12e47d2754ca68d8ae95961720f20)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:09.187401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:09.194290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dd16e-1241-430c-a29c-b979c966b429 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:09.200264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:09.201401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:09.209561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:09.210030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:09.224240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:09.228118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:09.252549 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4072/8218] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:09.299038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf12e47d2754ca68d8ae95961720f20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:09.316409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf12e47d2754ca68d8ae95961720f20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:09.317415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf12e47d2754ca68d8ae95961720f20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:09.318355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf12e47d2754ca68d8ae95961720f20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:09.329333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ad98f198-149a-46c6-9235-cc96ef9fea70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf12e47d2754ca68d8ae95961720f20'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:09.359292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:09.359826 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4147/8219] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:09 2022] DELETE /identity/v3/users/4cf12e47d2754ca68d8ae95961720f20 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:09.370033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:09.370570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:09.370850 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:09.375743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1345f-757d-4246-95bc-cfefaf410de3 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:09.400513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:09.402414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:09.466316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:09.467333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:09.467725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:09.468094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:09.470411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:09.477025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:09.511139 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4148/8220] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:09.521280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:09.523190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:09.616400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:09.620094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:09.657104 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4073/8221] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:09.658031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f84a6-b0c7-48d9-ba87-1af8917edf3f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:09.663323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:09.664353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:09.664951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:09.665488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:09.682413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:09.684591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:09.698043 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4149/8222] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:52:10.197816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:10.200402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:10.223746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d57961-382c-4074-a8dc-dad05837fbb4 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:10.232948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:10.233947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:10.234456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:10.234898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] PATH_INFO: `/v3/projects/436a20bfd36a4b268c1249afe3fb2244` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:10.236968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=436a20bfd36a4b268c1249afe3fb2244)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:10.241478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:10.336341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436a20bfd36a4b268c1249afe3fb2244', 'request_id': 'req-f593927d-0212-42af-8b3f-03e6be2288fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.345818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436a20bfd36a4b268c1249afe3fb2244', 'request_id': 'req-f593927d-0212-42af-8b3f-03e6be2288fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.361802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436a20bfd36a4b268c1249afe3fb2244', 'request_id': 'req-f593927d-0212-42af-8b3f-03e6be2288fd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.376556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] The token cache is being invalidate because project 436a20bfd36a4b268c1249afe3fb2244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:10.377007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.377830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.380198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4074/8223] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:10 2022] DELETE /identity/v3/projects/436a20bfd36a4b268c1249afe3fb2244 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:10.384516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:10.394854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f89a1-6a3c-4248-8e12-99ca076f303a service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:10.417544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:10.475252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:10.476259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:10.476637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:10.477805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] PATH_INFO: `/v3/users/ee4327607c034daaa9299ecf42715129` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:10.480876 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4327607c034daaa9299ecf42715129)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:10.483087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:10.545492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4327607c034daaa9299ecf42715129'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.561518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4327607c034daaa9299ecf42715129'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.562286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4327607c034daaa9299ecf42715129'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.562905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4327607c034daaa9299ecf42715129'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.570437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bc650099-2a1d-49af-94fb-6f49afa69f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4327607c034daaa9299ecf42715129'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:10.591825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4150/8224] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:10 2022] DELETE /identity/v3/users/ee4327607c034daaa9299ecf42715129 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:10.920432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:10.926437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:10.960541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593927d-0212-42af-8b3f-03e6be2288fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:11.077589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:11.078285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.078725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.079118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] PATH_INFO: `/v3/projects/ad4f90ca2978419eb86e63380e09115c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.080475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4f90ca2978419eb86e63380e09115c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:11.082563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:11.142347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:11.164458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4f90ca2978419eb86e63380e09115c', 'request_id': 'req-48907deb-d716-44ea-9b9f-33aab5fa2082'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:11.175846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4f90ca2978419eb86e63380e09115c', 'request_id': 'req-48907deb-d716-44ea-9b9f-33aab5fa2082'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:11.190054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4f90ca2978419eb86e63380e09115c', 'request_id': 'req-48907deb-d716-44ea-9b9f-33aab5fa2082'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:11.209265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] The token cache is being invalidate because project ad4f90ca2978419eb86e63380e09115c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:11.210429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:11.211289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-48907deb-d716-44ea-9b9f-33aab5fa2082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:11.215473 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4075/8225] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:10 2022] DELETE /identity/v3/projects/ad4f90ca2978419eb86e63380e09115c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:11.224265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.225313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.226294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.289842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:11.291535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:11.462655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4151/8226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:11.472077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.472077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.472315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.514991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:11.516888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:11.536278 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4076/8227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:11.541452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:11.557467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f3ec-d9bd-4aff-b04f-b425eba16aeb None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:11.570322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:11.571887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.572174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.572459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.577526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:11.577852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:11.580224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:11.626195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4152/8228] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:11.629467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:11.652301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a57b1c-a181-4eaa-8b5f-21f10133b8ad None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:11.659427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:11.660191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.660680 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.661067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.662043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:11.664442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:11.739244 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4077/8229] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:11 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:11.745243 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:11.759766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf6da-3e99-4fc2-bafe-50fce7b5b97c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:11.799328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:11.864553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:11.865335 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.865717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.866095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.867014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:11.869992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:11.902874 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4153/8230] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:11 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:11.907146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:11.941373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edc8b2-340a-454f-b1d8-65b720ee9c2f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:11.950076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:11.950956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.951315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.951661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.952457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:11.954165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:11.972856 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4078/8231] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:11.973585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:11.986275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931ab02-7323-4eb8-bfbb-e48b27eef624 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:11.992719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fee59-6b4c-4c5d-9659-f08f552f8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:11.993590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fee59-6b4c-4c5d-9659-f08f552f8c89 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:11.994080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fee59-6b4c-4c5d-9659-f08f552f8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:11.994477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fee59-6b4c-4c5d-9659-f08f552f8c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:11.995209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fee59-6b4c-4c5d-9659-f08f552f8c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:11.997060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fee59-6b4c-4c5d-9659-f08f552f8c89 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:12.019338 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:12.030858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd85a9-69f3-47d4-8f87-3bc9d699cb94 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:12.031117 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4154/8232] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:12.036244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:12.037025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:12.037390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:12.037732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] PATH_INFO: `/v3/projects/c836645acf03435db125de095c372395/users/9894d96578184e7e93f83865b82e7ba4/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:12.061257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c836645acf03435db125de095c372395, user_id=9894d96578184e7e93f83865b82e7ba4, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:12.064289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:12.084345 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4079/8233] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:12 2022] PUT /identity/v3/projects/c836645acf03435db125de095c372395/users/9894d96578184e7e93f83865b82e7ba4/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:12.091214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002fb76-6a4b-4667-9969-1887d6537964 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:12.091618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002fb76-6a4b-4667-9969-1887d6537964 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:12.092070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002fb76-6a4b-4667-9969-1887d6537964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:12.126443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1002fb76-6a4b-4667-9969-1887d6537964 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:12.128082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1002fb76-6a4b-4667-9969-1887d6537964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:12.251070 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4155/8234] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:12.266747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:12.268643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:12.374948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41610-36fe-45c5-b024-2947f5ee53e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:12.387670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:12.388433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:12.388814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:12.389185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:12.419845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:12.425876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:12.470014 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4080/8235] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:13.690009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a833-c650-4bfd-9569-42f1f7e2613f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:13.690599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a833-c650-4bfd-9569-42f1f7e2613f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:13.690753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a833-c650-4bfd-9569-42f1f7e2613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:13.754185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c039a833-c650-4bfd-9569-42f1f7e2613f None None] MFA Rules not processed for user `9894d96578184e7e93f83865b82e7ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:13.755750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c039a833-c650-4bfd-9569-42f1f7e2613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:13.936370 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4156/8236] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:13.949573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:13.951772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:14.119175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfb3c8-ca1d-41f0-8d8e-2ecc5d92b02d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:14.129757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:14.130466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:14.130820 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:14.131009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:14.147257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:14.149545 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:14.164997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:14.183829 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4081/8237] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:15.282176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:15.282652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:15.282787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:15.329111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] MFA Rules not processed for user `55416a415fb748c5b7c0fd3952b58dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:15.330456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:15.349517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:15.447553 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4157/8238] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:15.460244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:15.462532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:15.495724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6385bf3-816b-4b44-94b3-8ae591af206b service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:15.499767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd03c3-4dc6-46c0-83c1-b33a24f0ef08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:15.501091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd03c3-4dc6-46c0-83c1-b33a24f0ef08 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:15.505153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd03c3-4dc6-46c0-83c1-b33a24f0ef08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:15.505463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd03c3-4dc6-46c0-83c1-b33a24f0ef08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:15.521529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd03c3-4dc6-46c0-83c1-b33a24f0ef08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:15.524875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd03c3-4dc6-46c0-83c1-b33a24f0ef08 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:15.553984 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4082/8239] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:15.651567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:15.666195 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bdf1d-b329-4b3f-b269-c351f97b2ced None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:15.670309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:15.670935 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:15.671219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:15.671489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:15.673619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:15.760380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:15.763661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:15.780649 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4158/8240] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:18.616217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:18.617127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:18.617572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:18.647105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:18.648646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:18.660686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4083/8241] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:19.109640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:19.112338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:19.128744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1f8e6-bb78-4357-a6c8-018e15fb3267 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:19.134002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:19.134668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:19.134950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:19.135230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:19.137000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:19.151120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:19.152599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06f95c-bdd2-428b-a537-a221b0cd815c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:19.167445 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4159/8242] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:28.639549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:29.158359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=55 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:34.014870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:34.016360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:34.031502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f138-1bef-4201-8f8d-a59216b63740 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:34.036105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:34.036944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:34.037420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:34.037846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] PATH_INFO: `/v3/users/b86e09c13e4e40a7b64763339d71809a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:34.039243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86e09c13e4e40a7b64763339d71809a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:34.042228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:34.095810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86e09c13e4e40a7b64763339d71809a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.104991 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86e09c13e4e40a7b64763339d71809a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.105997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86e09c13e4e40a7b64763339d71809a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.106897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86e09c13e4e40a7b64763339d71809a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.116390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86e09c13e4e40a7b64763339d71809a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.140990 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4084/8243] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:34 2022] DELETE /identity/v3/users/b86e09c13e4e40a7b64763339d71809a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:34.143257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:34.143750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:34.143840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:34.167464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:34.169131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:34.250390 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4160/8244] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:34.258729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:34.260690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:34.342494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb12f-da1c-464d-9153-a74fad692537 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:34.346960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:34.347608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:34.347893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:34.348170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:34.358884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:34.360441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:34.372885 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4085/8245] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:34.683450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:34.684891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:34.702697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e6483-e9c2-4ce6-9d51-b5b687c87032 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:34.713473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:34.714140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:34.714473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:34.714755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] PATH_INFO: `/v3/projects/6cf8b495dff449189206eae88a93f723` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:34.715907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf8b495dff449189206eae88a93f723)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:34.718000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:34.768854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf8b495dff449189206eae88a93f723', 'request_id': 'req-749dde38-7c3f-4ac1-90fd-1e066ccf667c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.776142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf8b495dff449189206eae88a93f723', 'request_id': 'req-749dde38-7c3f-4ac1-90fd-1e066ccf667c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.781756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf8b495dff449189206eae88a93f723', 'request_id': 'req-749dde38-7c3f-4ac1-90fd-1e066ccf667c'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.794765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] The token cache is being invalidate because project 6cf8b495dff449189206eae88a93f723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:34.795064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.795719 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.797251 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4161/8246] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:34 2022] DELETE /identity/v3/projects/6cf8b495dff449189206eae88a93f723 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:34.801412 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:34.812018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076810-1279-4010-9a89-a2dc94fd903a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:34.874460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:34.875112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:34.875395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:34.875671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] PATH_INFO: `/v3/users/abdac577249f47c3b6ed71be24c9acb6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:34.876794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=abdac577249f47c3b6ed71be24c9acb6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:34.878797 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:34.895159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:34.927097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abdac577249f47c3b6ed71be24c9acb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.936099 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abdac577249f47c3b6ed71be24c9acb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.936740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abdac577249f47c3b6ed71be24c9acb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.937377 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abdac577249f47c3b6ed71be24c9acb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.945251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ee68615d-03d3-49b6-b7f2-45beb32a9dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abdac577249f47c3b6ed71be24c9acb6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:34.969301 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4086/8247] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:34 2022] DELETE /identity/v3/users/abdac577249f47c3b6ed71be24c9acb6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:35.315227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.316639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:35.333481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dde38-7c3f-4ac1-90fd-1e066ccf667c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.393265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.393910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.394219 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.394501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] PATH_INFO: `/v3/projects/a5b3ae518e444acb8d0b9cbc4e575c61` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.395630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b3ae518e444acb8d0b9cbc4e575c61)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.397581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.429072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:35.449760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b3ae518e444acb8d0b9cbc4e575c61', 'request_id': 'req-eab6e342-593e-4809-bb89-0e2e849512c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:35.457248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b3ae518e444acb8d0b9cbc4e575c61', 'request_id': 'req-eab6e342-593e-4809-bb89-0e2e849512c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:35.464425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b3ae518e444acb8d0b9cbc4e575c61', 'request_id': 'req-eab6e342-593e-4809-bb89-0e2e849512c9'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:35.478286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] The token cache is being invalidate because project a5b3ae518e444acb8d0b9cbc4e575c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:35.478693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:35.479401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-eab6e342-593e-4809-bb89-0e2e849512c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:35.481131 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4162/8248] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:35 2022] DELETE /identity/v3/projects/a5b3ae518e444acb8d0b9cbc4e575c61 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:35.485941 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.486424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.486543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.506889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:35.508177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:35.573106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4087/8249] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:35.580857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.581140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.581418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.603695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:35.604889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:35.612763 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4163/8250] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:35.617121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.627295 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e5430-391a-4706-930a-ab6cb7ff0de7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.631885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.632495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.632778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.633076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.633735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:35.634041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.635688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.648136 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4088/8251] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:35.652927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.662732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a743-b10c-4fdb-ad2d-0d9bf9c0e8fe None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.668105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.668714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.668994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.669266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.669905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.671843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.702227 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4164/8252] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:35 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:35.703850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.715063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c62de3-19fb-40be-94a9-b3487a3c95ff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.771219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.771839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.772123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.772399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.773045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.776468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.798241 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4089/8253] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:35 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:35.802391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.813308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dac124-34ea-4a7f-a0bd-efcd84d9f54b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.818114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.818795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.819074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.819349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.819991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.821884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.832192 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4165/8254] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:52:35.836681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.847455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478a7c3-c026-4270-9559-cd537369ff42 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.852743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af3b06-6712-471d-82ab-897782ce1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.853489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3b06-6712-471d-82ab-897782ce1c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.853850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3b06-6712-471d-82ab-897782ce1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.854162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3b06-6712-471d-82ab-897782ce1c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.854827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af3b06-6712-471d-82ab-897782ce1c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.856404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af3b06-6712-471d-82ab-897782ce1c08 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.861883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:35.871200 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4090/8255] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:35.872528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:35.883008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b78d2-e0df-4a1d-9a1a-57838a2ee744 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:35.888121 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:35.888777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.889056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.889360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] PATH_INFO: `/v3/projects/830289bd53c8468f94783ec8f20801f4/users/bf5e665a16ef4a448ecf09a49d3840d8/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.904612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=830289bd53c8468f94783ec8f20801f4, user_id=bf5e665a16ef4a448ecf09a49d3840d8, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:35.907302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:35.920875 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4166/8256] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:35 2022] PUT /identity/v3/projects/830289bd53c8468f94783ec8f20801f4/users/bf5e665a16ef4a448ecf09a49d3840d8/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:35.933028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:35.933316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:35.933598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:35.964098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] MFA Rules not processed for user `bf5e665a16ef4a448ecf09a49d3840d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:35.965348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:36.037144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.037435 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4091/8257] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:36.039012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:36.042488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.106818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86134a-4bf8-465e-bd6e-15e97c7b4954 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.112379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.113001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.113288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.113569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.114239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.116162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.125265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76c28-5094-4c7d-9d15-616b0ea0dabc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.130603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.131213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.131491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.131764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.135383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:36.145310 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4092/8258] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:36 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:36.150102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.183491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:36.202652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.204672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.214424 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4167/8259] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:52:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:52:36.215038 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab00d7c-1170-4fdb-acdb-618fc6bd04ec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.220165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.220580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.220865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.221138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.221771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.223737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.251176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4093/8260] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:36 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:36.252272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.265797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b569e87-e110-4f5d-a28e-8479005aecbf service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.270692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.271315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.271598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.271874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.272700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.274519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.296888 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4168/8261] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:36.310257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.317050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:36.327051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a5614-6774-4a3a-92df-760ad146b9b7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.334909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.335594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.335880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.336751 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] PATH_INFO: `/v3/projects/76f9bc16fa0e40bcaa5f68557f1cf2b9/users/905adba9cbb6432e85302d7584476037/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.354846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f9bc16fa0e40bcaa5f68557f1cf2b9, user_id=905adba9cbb6432e85302d7584476037, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.357687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.374479 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4094/8262] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:36 2022] PUT /identity/v3/projects/76f9bc16fa0e40bcaa5f68557f1cf2b9/users/905adba9cbb6432e85302d7584476037/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:36.378521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.402398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbffaab-2036-4987-ace2-b4b960794fe5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.467207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b63f2-58a8-4357-8e4e-8de9094167be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.467828 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b63f2-58a8-4357-8e4e-8de9094167be admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.468107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b63f2-58a8-4357-8e4e-8de9094167be admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.468666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b63f2-58a8-4357-8e4e-8de9094167be admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.469320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b63f2-58a8-4357-8e4e-8de9094167be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.470956 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b63f2-58a8-4357-8e4e-8de9094167be admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.481830 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4169/8263] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:36.485936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.497418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3a6f-7723-4571-a8ac-547ae7dc3b89 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.502084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.502801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.503087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.503366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] PATH_INFO: `/v3/projects/76f9bc16fa0e40bcaa5f68557f1cf2b9/users/905adba9cbb6432e85302d7584476037/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.505293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f9bc16fa0e40bcaa5f68557f1cf2b9, user_id=905adba9cbb6432e85302d7584476037, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.507982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.519079 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4095/8264] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:36 2022] PUT /identity/v3/projects/76f9bc16fa0e40bcaa5f68557f1cf2b9/users/905adba9cbb6432e85302d7584476037/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:36.529738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.530095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.530496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.560641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] MFA Rules not processed for user `905adba9cbb6432e85302d7584476037`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:36.561835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:36.642671 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4170/8265] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:36.655803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:36.657868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:36.720565 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d39ce-5282-4270-8b2b-61255937673a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:36.724258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e6c2-a2a6-4657-9b5c-d9a52535169e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:36.724885 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e6c2-a2a6-4657-9b5c-d9a52535169e service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:36.725165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e6c2-a2a6-4657-9b5c-d9a52535169e service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:36.725438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e6c2-a2a6-4657-9b5c-d9a52535169e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:36.735676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e6c2-a2a6-4657-9b5c-d9a52535169e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:36.737111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e6c2-a2a6-4657-9b5c-d9a52535169e service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:36.747155 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4096/8266] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:37.137594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:37.201171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:37.213380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c17f5-dcfd-438b-9f53-696716904590 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:37.218797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:37.219882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:37.220172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:37.220450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] PATH_INFO: `/v3/users/bf5e665a16ef4a448ecf09a49d3840d8` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:37.221581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5e665a16ef4a448ecf09a49d3840d8)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:37.223562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:37.273305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5e665a16ef4a448ecf09a49d3840d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.287007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5e665a16ef4a448ecf09a49d3840d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.287782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5e665a16ef4a448ecf09a49d3840d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.288417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5e665a16ef4a448ecf09a49d3840d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.296333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5e665a16ef4a448ecf09a49d3840d8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.310230 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4171/8267] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:37 2022] DELETE /identity/v3/users/bf5e665a16ef4a448ecf09a49d3840d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:37.314684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:37.315057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:37.315392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:37.335128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:37.336862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:37.407108 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4097/8268] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:37.417575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:37.419154 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:37.518404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d053-4acd-43c1-870f-da42d31b01fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:37.524421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:37.525063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:37.525348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:37.525631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:37.537967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:37.539524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:37.550817 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4172/8269] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:37.863070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:37.865256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:37.884937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2423-984b-4bc0-9070-d18404f1f974 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:37.897078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:37.897724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:37.898005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:37.898339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] PATH_INFO: `/v3/projects/830289bd53c8468f94783ec8f20801f4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:37.900029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830289bd53c8468f94783ec8f20801f4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:37.902120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:37.958184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830289bd53c8468f94783ec8f20801f4', 'request_id': 'req-78375c9f-3126-41ea-af0d-fe626cd78b81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.966169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830289bd53c8468f94783ec8f20801f4', 'request_id': 'req-78375c9f-3126-41ea-af0d-fe626cd78b81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.974420 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830289bd53c8468f94783ec8f20801f4', 'request_id': 'req-78375c9f-3126-41ea-af0d-fe626cd78b81'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.976001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:37.992270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] The token cache is being invalidate because project 830289bd53c8468f94783ec8f20801f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:37.993304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.993949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:37.999109 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4098/8270] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:37 2022] DELETE /identity/v3/projects/830289bd53c8468f94783ec8f20801f4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:38.003256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:38.015833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c50588-df54-4cd0-bc9f-b16d0a88e10a service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:38.093141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:38.093905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.094209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.094484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] PATH_INFO: `/v3/users/905adba9cbb6432e85302d7584476037` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.095591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905adba9cbb6432e85302d7584476037)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:38.097501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:38.113797 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:38.146438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905adba9cbb6432e85302d7584476037'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.159815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905adba9cbb6432e85302d7584476037'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.160543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905adba9cbb6432e85302d7584476037'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.161156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905adba9cbb6432e85302d7584476037'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.168729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-2d65dc85-eb5a-483b-8eac-b94adcd04ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905adba9cbb6432e85302d7584476037'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.181890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4173/8271] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:38 2022] DELETE /identity/v3/users/905adba9cbb6432e85302d7584476037 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:38.481567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:38.483714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:38.499839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375c9f-3126-41ea-af0d-fe626cd78b81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:38.563939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:38.564974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.565288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.565693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] PATH_INFO: `/v3/projects/76f9bc16fa0e40bcaa5f68557f1cf2b9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.567222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f9bc16fa0e40bcaa5f68557f1cf2b9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:38.569503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:38.626032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f9bc16fa0e40bcaa5f68557f1cf2b9', 'request_id': 'req-86ab929b-d543-4ff2-ae59-9a673904a8e7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.632756 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f9bc16fa0e40bcaa5f68557f1cf2b9', 'request_id': 'req-86ab929b-d543-4ff2-ae59-9a673904a8e7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.642603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f9bc16fa0e40bcaa5f68557f1cf2b9', 'request_id': 'req-86ab929b-d543-4ff2-ae59-9a673904a8e7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.654648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] The token cache is being invalidate because project 76f9bc16fa0e40bcaa5f68557f1cf2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:38.654971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.655625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-86ab929b-d543-4ff2-ae59-9a673904a8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:38.657137 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4099/8272] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:38 2022] DELETE /identity/v3/projects/76f9bc16fa0e40bcaa5f68557f1cf2b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:38.662538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.663021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.663202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.684187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:38.685384 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:38.755176 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4174/8273] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:38.765888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.767251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.767251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.788415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:38.790271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:38.798967 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4100/8274] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:38.803398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:38.815085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee9f36-16b3-46a9-947b-5dbc53ef4f04 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:38.819918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:38.820653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.821766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.822048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.822789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:38.823101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:38.824833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:38.838667 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4175/8275] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:38.843199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:38.852974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f0bac-cc5a-427a-b51e-340d890caf85 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:38.858241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:38.858865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.859149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.859424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.860074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:38.861987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:38.906428 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4101/8276] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:38 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:38.909300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:38.920882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92af68-668b-43e0-bded-a75c33e72b45 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:38.980275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:38.980892 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:38.981175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:38.981451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:38.982097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:38.984117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.010371 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4176/8277] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:38 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:39.011654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.022268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d36b-a5d3-47aa-ae6e-0a97757f62e6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.027981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.028164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.028449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.028785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.029372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.030996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.042391 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4102/8278] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:39.046235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.057254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ee269-556b-4532-a410-ff6192c7ad5d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.061896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a421aec-33ab-4b36-820c-93a3eebf79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.062531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a421aec-33ab-4b36-820c-93a3eebf79a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.062811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a421aec-33ab-4b36-820c-93a3eebf79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.063081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a421aec-33ab-4b36-820c-93a3eebf79a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.063812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a421aec-33ab-4b36-820c-93a3eebf79a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.065413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a421aec-33ab-4b36-820c-93a3eebf79a3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.071416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:39.077315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4177/8279] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:39.081236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.092658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb244f-4686-4b25-9446-b52f2f90ddfc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.097463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.098616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.098964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.099319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] PATH_INFO: `/v3/projects/83110b021736424887d4a3eff0afdeaf/users/79cf841f5ea64250816d0ffd8109f8d1/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.116202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83110b021736424887d4a3eff0afdeaf, user_id=79cf841f5ea64250816d0ffd8109f8d1, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.119456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.133964 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4103/8280] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:39 2022] PUT /identity/v3/projects/83110b021736424887d4a3eff0afdeaf/users/79cf841f5ea64250816d0ffd8109f8d1/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:39.146014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.146324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.146632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.180064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] MFA Rules not processed for user `79cf841f5ea64250816d0ffd8109f8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:39.181351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:39.249856 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4178/8281] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:39.265679 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.267674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:39.292759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:39.344812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182e3f-4f4a-42c5-8ab4-410291d1df2a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.348775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.349141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.349547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.349755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.359456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.360907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.371059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4104/8282] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:39.395200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.484146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62855-c9ce-449c-a336-f74d0408a5d3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.490103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.490874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.491160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.491589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] PATH_INFO: `/v3/users/79cf841f5ea64250816d0ffd8109f8d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.493265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79cf841f5ea64250816d0ffd8109f8d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.495540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.563065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79cf841f5ea64250816d0ffd8109f8d1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:39.574367 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.575863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:39.588907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79cf841f5ea64250816d0ffd8109f8d1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:39.589689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79cf841f5ea64250816d0ffd8109f8d1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:39.590373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79cf841f5ea64250816d0ffd8109f8d1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:39.599430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-486a210d-b29f-4d63-8b83-ddf34b0704f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79cf841f5ea64250816d0ffd8109f8d1'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:39.634195 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4179/8283] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:52:39 2022] DELETE /identity/v3/users/79cf841f5ea64250816d0ffd8109f8d1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:39.636307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.636605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.636889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.665701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:39.668580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:39.674397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:39.699995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ae23-d478-455a-a829-763106d19777 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.752977 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4180/8284] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:39.766010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:39.768572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:39.776153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.776779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.777061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.777334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.779074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:39.794728 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.796314 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.818747 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4105/8285] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:52:39.840193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b19204-3bea-423a-9ede-2e3f3881c8a0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:39.844057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1df48-3c5f-4170-9ac6-aa19b12ad90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:39.845871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1df48-3c5f-4170-9ac6-aa19b12ad90a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:39.846182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1df48-3c5f-4170-9ac6-aa19b12ad90a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:39.846511 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1df48-3c5f-4170-9ac6-aa19b12ad90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:39.858201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1df48-3c5f-4170-9ac6-aa19b12ad90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:39.859683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1df48-3c5f-4170-9ac6-aa19b12ad90a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:39.870914 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4181/8286] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:40.239204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.240732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:40.260104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a08932-30fb-4413-b982-d8e89505286c service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.265329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.265879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.266192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.266473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] PATH_INFO: `/v3/projects/83110b021736424887d4a3eff0afdeaf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.267663 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83110b021736424887d4a3eff0afdeaf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.269599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.319607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:40.336067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83110b021736424887d4a3eff0afdeaf', 'request_id': 'req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:40.346481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83110b021736424887d4a3eff0afdeaf', 'request_id': 'req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:40.354451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83110b021736424887d4a3eff0afdeaf', 'request_id': 'req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:40.366081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] The token cache is being invalidate because project 83110b021736424887d4a3eff0afdeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:52:40.366409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:40.367040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0ed2969d-fb3d-457e-8fcd-5db20313c9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:52:40.369110 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4106/8287] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:52:40 2022] DELETE /identity/v3/projects/83110b021736424887d4a3eff0afdeaf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:52:40.374114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13d00-898c-457b-b725-2000c845799e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.374496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13d00-898c-457b-b725-2000c845799e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.374842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13d00-898c-457b-b725-2000c845799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.395240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-51a13d00-898c-457b-b725-2000c845799e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:40.396523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-51a13d00-898c-457b-b725-2000c845799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:40.468243 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4182/8288] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:52:40.476015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.476340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.477518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.498182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:40.499459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:40.507679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4107/8289] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:40.511963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a13d00-898c-457b-b725-2000c845799e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.522942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a13d00-898c-457b-b725-2000c845799e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.528166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.528785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.529070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.529345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.530001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:52:40.530345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.531979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.544832 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4183/8290] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:52:40.549271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.559502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bee0fd-e333-45da-99ba-ef62cd6a77f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.564261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.564881 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.565214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.565466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.566475 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.568575 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.603566 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4108/8291] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:52:40 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:52:40.604556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.615916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3afa29-51fc-4df9-b8e2-2f4cc94dd59d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.656845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:40.679213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.679962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.680248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.680523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.681187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.683157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.705312 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4184/8292] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:52:40 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:52:40.710014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.721133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811d0c1-3393-4335-905e-1c113d7c2b34 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.725762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.726453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.726684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.727621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.728308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.729916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.740194 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4109/8293] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:52:40.744399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.754694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251389-fc58-4cee-a4c1-3d03b41a83d8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.760482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a890-c3f6-44f0-837a-4f61dc5b5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.761325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a890-c3f6-44f0-837a-4f61dc5b5a4d admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.761608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a890-c3f6-44f0-837a-4f61dc5b5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.761884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a890-c3f6-44f0-837a-4f61dc5b5a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.762812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3a890-c3f6-44f0-837a-4f61dc5b5a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.764413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3a890-c3f6-44f0-837a-4f61dc5b5a4d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.777249 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4185/8294] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:52:40.781481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.793710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10837d-2c37-466a-96bd-23dac59c492b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:40.799701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:40.800463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.800752 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.801031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] PATH_INFO: `/v3/projects/12949da690af4c33bd77f19c93b1ac0d/users/5daed6fe61a440bab29cc53f947e1128/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.817526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12949da690af4c33bd77f19c93b1ac0d, user_id=5daed6fe61a440bab29cc53f947e1128, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:40.820218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:40.837068 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4110/8295] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:52:40 2022] PUT /identity/v3/projects/12949da690af4c33bd77f19c93b1ac0d/users/5daed6fe61a440bab29cc53f947e1128/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:52:40.848096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fa6c3-87ad-4ac8-b3df-06e45634695f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:40.848388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fa6c3-87ad-4ac8-b3df-06e45634695f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:40.848670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fa6c3-87ad-4ac8-b3df-06e45634695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:40.881213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0b8fa6c3-87ad-4ac8-b3df-06e45634695f None None] MFA Rules not processed for user `5daed6fe61a440bab29cc53f947e1128`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:40.882630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b8fa6c3-87ad-4ac8-b3df-06e45634695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:40.950078 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4186/8296] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:52:40.962684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:52:40.964457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:41.025919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a53b25-0d1e-492e-97af-1ff7af7c8e01 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:52:41.029673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:52:41.030330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:41.030710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:41.030878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:41.040677 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:52:41.042600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:52:41.057633 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4111/8297] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:52:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:52:50.947191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:51.050506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:52:57.513206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3687-a16e-402b-a9e0-cdbecc7f96fb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:52:57.513791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3687-a16e-402b-a9e0-cdbecc7f96fb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:52:57.513791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3687-a16e-402b-a9e0-cdbecc7f96fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:52:57.541449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-db2e3687-a16e-402b-a9e0-cdbecc7f96fb None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:52:57.542789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db2e3687-a16e-402b-a9e0-cdbecc7f96fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:52:57.605721 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4187/8298] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:52:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:07.597886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=25 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:13.566186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:13.657164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e0dd7-84bc-45cd-8d40-216b0a769286 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:13.663632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:13.664472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:13.664871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:13.665262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] PATH_INFO: `/v3/users/5daed6fe61a440bab29cc53f947e1128` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:13.667020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daed6fe61a440bab29cc53f947e1128)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:13.669351 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:13.746871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daed6fe61a440bab29cc53f947e1128'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:13.757849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daed6fe61a440bab29cc53f947e1128'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:13.758982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daed6fe61a440bab29cc53f947e1128'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:13.762782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daed6fe61a440bab29cc53f947e1128'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:13.776007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daed6fe61a440bab29cc53f947e1128'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:13.801425 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4112/8299] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:53:13 2022] DELETE /identity/v3/users/5daed6fe61a440bab29cc53f947e1128 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:13.807055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:13.807564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:13.807751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:13.829508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:13.830992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:13.910483 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4188/8300] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:53:13.916816 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:13.918393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:14.010964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad44fda-0ede-4925-ab41-7738621ecb92 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:14.015700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71cdfe-5828-44fc-8de6-a87726662363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:14.016464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71cdfe-5828-44fc-8de6-a87726662363 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:14.016845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71cdfe-5828-44fc-8de6-a87726662363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:14.017389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71cdfe-5828-44fc-8de6-a87726662363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:14.029289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71cdfe-5828-44fc-8de6-a87726662363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:14.031110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71cdfe-5828-44fc-8de6-a87726662363 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:14.043197 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4113/8301] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:53:14.450937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:14.452476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:14.477138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43a65c-e16f-45c8-8829-82754c3e6209 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:14.482708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:14.483990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:14.484435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:14.484885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] PATH_INFO: `/v3/projects/12949da690af4c33bd77f19c93b1ac0d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:14.487458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12949da690af4c33bd77f19c93b1ac0d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:14.490618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:14.576277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12949da690af4c33bd77f19c93b1ac0d', 'request_id': 'req-9bdff881-b123-431c-b020-f7f068906d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:14.597415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12949da690af4c33bd77f19c93b1ac0d', 'request_id': 'req-9bdff881-b123-431c-b020-f7f068906d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:14.614675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12949da690af4c33bd77f19c93b1ac0d', 'request_id': 'req-9bdff881-b123-431c-b020-f7f068906d43'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:14.655173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] The token cache is being invalidate because project 12949da690af4c33bd77f19c93b1ac0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:53:14.656933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:14.657960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9bdff881-b123-431c-b020-f7f068906d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:14.661065 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4189/8302] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:53:14 2022] DELETE /identity/v3/projects/12949da690af4c33bd77f19c93b1ac0d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:14.667376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:14.667898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:14.668076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:14.698166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:14.699574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:14.727553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:14.805017 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4114/8303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:14.814732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:14.815836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:14.816324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:14.842589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:14.844151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:14.854582 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4190/8304] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:14.858868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:14.870430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fff6d-8978-49ef-b6c0-3220e629ed29 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:14.876981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:14.877845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:14.878039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:14.878405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:14.879138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:53:14.879690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:14.881360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:14.897679 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4115/8305] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:53:14.901075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:14.918474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851b78a-606f-483d-bcb8-08bf63f9ce8a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:14.926846 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:14.927479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:14.927764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:14.928044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:14.928871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:14.931407 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:14.966999 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4191/8306] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:53:14 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:14.972859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:14.998572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81a83-5177-439a-8db9-cf5c36d6be08 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.090557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.091207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.091477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.091779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.092415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.094438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.125516 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4116/8307] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:53:14 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:15.126587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.140493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8b27-2a2a-4a41-907d-450857ff3144 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.146308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.146942 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.147225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.147505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.148812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.150708 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.163950 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4192/8308] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:53:15.168929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.182533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c20ed-e3ee-4bc5-ae3f-b5a32dba94d1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.189379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1f28-5932-47ac-98e5-b6686d6b4118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.190270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1f28-5932-47ac-98e5-b6686d6b4118 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.190559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1f28-5932-47ac-98e5-b6686d6b4118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.190839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1f28-5932-47ac-98e5-b6686d6b4118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.191911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1f28-5932-47ac-98e5-b6686d6b4118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.193180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1f28-5932-47ac-98e5-b6686d6b4118 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.205850 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4117/8309] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:53:15.210737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.226774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa741a-1560-4c70-addb-8c62a0bf4d5a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.232525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.233464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.233686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.233982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] PATH_INFO: `/v3/projects/73f3bd429dfc4271ad4ce8706563177f/users/ed54f2504de146b7b337d2d7349b63a7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.250652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f3bd429dfc4271ad4ce8706563177f, user_id=ed54f2504de146b7b337d2d7349b63a7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.253314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.268706 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4193/8310] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:53:15 2022] PUT /identity/v3/projects/73f3bd429dfc4271ad4ce8706563177f/users/ed54f2504de146b7b337d2d7349b63a7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:15.279955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.280379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.280712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.317012 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] MFA Rules not processed for user `ed54f2504de146b7b337d2d7349b63a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:15.318312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:15.389581 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4118/8311] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:15.394094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.417995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:15.486750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02934a0f-182e-48ec-a436-212e020acefb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.491646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.492812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.493097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.493402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.494073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.496012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.531462 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4194/8312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:15.535694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.548625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ead4f-2901-490e-b58e-700e8008dc69 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.564609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:15.627608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.628251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.628620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.628899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.629603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.631765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.656483 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4119/8313] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:53:15 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:15.660446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.676881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bbd77-ac2a-4928-85d6-3371901dff37 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.688060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.688774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.689326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.689831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.690626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.692532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.708264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4195/8314] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:53:15.712395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.724224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a8f9-f559-44a4-a5ec-86e539d80a25 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.731343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8771b-fc2d-4ba2-bd7c-03b2f5ee1ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.732235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8771b-fc2d-4ba2-bd7c-03b2f5ee1ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.732628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8771b-fc2d-4ba2-bd7c-03b2f5ee1ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.733190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8771b-fc2d-4ba2-bd7c-03b2f5ee1ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.733824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8771b-fc2d-4ba2-bd7c-03b2f5ee1ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.735928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8771b-fc2d-4ba2-bd7c-03b2f5ee1ce1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.748307 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4120/8315] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:53:15.752492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:15.764172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aab7d-8060-4064-ae60-3c595849fbd5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:15.770126 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:15.770803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.771082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.771359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] PATH_INFO: `/v3/projects/1d171a9ee5bd477185a5ca439256b0bc/users/df9e970c60f44f07baa58409c52297ac/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.788153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d171a9ee5bd477185a5ca439256b0bc, user_id=df9e970c60f44f07baa58409c52297ac, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:15.791597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:15.811998 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4196/8316] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:53:15 2022] PUT /identity/v3/projects/1d171a9ee5bd477185a5ca439256b0bc/users/df9e970c60f44f07baa58409c52297ac/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:15.823523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:15.824024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:15.824373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:15.856500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] MFA Rules not processed for user `df9e970c60f44f07baa58409c52297ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:15.857829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:15.950440 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4121/8317] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:15.954938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.068305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10970300-2fdf-4479-b3ec-326b07a7bdfa admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.079618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.081073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.081434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.081779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.082775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.086277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.125683 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4197/8318] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:16.129670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.142669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab58270-02a0-4d97-ad07-42f7e0aa7eef None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.208211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.208735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.209022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.209350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.209921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.212414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.240475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.246514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4122/8319] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:53:16 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:16.252300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df945-0a1d-40b5-8894-ccb307b87d86 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.265062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.269662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.270064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.270519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.271309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.273886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.286648 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4198/8320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:53:16.290668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.303828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1a931-9576-4e65-9372-af1228d7fa88 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.309917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.311229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.311623 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.312192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] PATH_INFO: `/v3/projects/0a571019e8ac44949e8830efd73ae0b2/users/ae78a7e993f540a08d179c26c3399a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.327824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:16.332763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a571019e8ac44949e8830efd73ae0b2, user_id=ae78a7e993f540a08d179c26c3399a3d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.336863 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.352731 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4123/8321] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:53:16 2022] PUT /identity/v3/projects/0a571019e8ac44949e8830efd73ae0b2/users/ae78a7e993f540a08d179c26c3399a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:16.356709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.373165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb525df-f628-4676-83ba-2d56ea072fc5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.423027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:16.450305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b5968-7bc4-4746-bda8-d2a227e0f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.450951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5968-7bc4-4746-bda8-d2a227e0f128 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.451265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5968-7bc4-4746-bda8-d2a227e0f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.451546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5968-7bc4-4746-bda8-d2a227e0f128 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.452204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b5968-7bc4-4746-bda8-d2a227e0f128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.453869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b5968-7bc4-4746-bda8-d2a227e0f128 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.466580 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4199/8322] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:53:16.470804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.482221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6859ad-b781-49b7-a077-01799bb3e435 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.486842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.487502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.487945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.488223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] PATH_INFO: `/v3/projects/0a571019e8ac44949e8830efd73ae0b2/users/ae78a7e993f540a08d179c26c3399a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.490260 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a571019e8ac44949e8830efd73ae0b2, user_id=ae78a7e993f540a08d179c26c3399a3d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.494407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.504474 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4124/8323] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:53:16 2022] PUT /identity/v3/projects/0a571019e8ac44949e8830efd73ae0b2/users/ae78a7e993f540a08d179c26c3399a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:53:16.515740 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70c5dd-f86c-409f-8d4e-6b0f8278e9c5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.516030 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70c5dd-f86c-409f-8d4e-6b0f8278e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.516309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70c5dd-f86c-409f-8d4e-6b0f8278e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.549135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7e70c5dd-f86c-409f-8d4e-6b0f8278e9c5 None None] MFA Rules not processed for user `ae78a7e993f540a08d179c26c3399a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:16.550452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e70c5dd-f86c-409f-8d4e-6b0f8278e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:16.625820 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4200/8324] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:53:16.638403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:16.640188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:16.702585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204e09-4456-4565-b254-af3fbdfc510b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:16.712304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:16.712933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:16.713488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:16.713488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:16.774275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:16.775713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:16.784865 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4125/8325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:17.111146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:17.111710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:17.111710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:17.142360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] MFA Rules not processed for user `9894d96578184e7e93f83865b82e7ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:17.143734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:17.217857 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4201/8326] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:17.721472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:17.723540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:17.796405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597c98-3f28-41f5-88c4-ee064aa42792 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:17.800760 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:17.801667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:17.801951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:17.802264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:17.804136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:17.830939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:17.832906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:17.866369 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4126/8327] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:17.867486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:17.872540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:17.982415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8a213-227f-4f79-bcd7-39fad844026b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:17.988102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:17.988748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:17.989035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:17.989695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:17.991895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:18.007334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:18.009756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:18.015685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:18.025713 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4202/8328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:53:18.331304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:18.347227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e720e0-663c-4f0a-bba7-1e96df34cd2e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:18.351053 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:18.352471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:18.352749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:18.353019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:18.393979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:18.433635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:18.435419 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:18.450534 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4127/8329] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:18.998496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:19.013841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917bf33-325a-4ff1-9641-da6e41c01aca service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:19.017857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:19.018764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:19.019216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:19.019639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:19.031959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:19.033414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:19.044897 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4203/8330] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:20.137869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:20.139622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:20.162424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106920-2900-41b8-b282-54bb3660b516 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:20.167216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:20.168454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:20.168990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:20.169509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:20.172084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:20.206330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:20.209234 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:20.234111 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4128/8331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:20.978009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:20.981117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:21.084978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671c0da-7ed1-4686-820d-52a63628ad4a service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:21.091470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683439-a11a-408a-8791-816c60109772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:21.092133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683439-a11a-408a-8791-816c60109772 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:21.092416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683439-a11a-408a-8791-816c60109772 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:21.092692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683439-a11a-408a-8791-816c60109772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:21.094584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-81683439-a11a-408a-8791-816c60109772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:21.111373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81683439-a11a-408a-8791-816c60109772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:21.113000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81683439-a11a-408a-8791-816c60109772 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:21.128164 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4204/8332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:22.742719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:22.762197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4296-26c5-494f-88d8-1454ccea78b2 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:22.771650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:22.772291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:22.772586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:22.773599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:22.776180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:22.796850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:22.799721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba898e56-2438-448d-9139-db133245ec88 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:22.813981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4129/8333] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:25.288715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683439-a11a-408a-8791-816c60109772 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:25.364298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683439-a11a-408a-8791-816c60109772 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:25.369537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:25.370377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:25.370661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:25.370969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] PATH_INFO: `/v3/users/ed54f2504de146b7b337d2d7349b63a7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:25.372181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed54f2504de146b7b337d2d7349b63a7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:25.374114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:25.428684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed54f2504de146b7b337d2d7349b63a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:25.442826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed54f2504de146b7b337d2d7349b63a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:25.443685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed54f2504de146b7b337d2d7349b63a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:25.444354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed54f2504de146b7b337d2d7349b63a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:25.452926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed54f2504de146b7b337d2d7349b63a7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:25.454963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:25.478503 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4205/8334] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:53:25 2022] DELETE /identity/v3/users/ed54f2504de146b7b337d2d7349b63a7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:25.483052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:25.483889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:25.484602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:25.506891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:25.508681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:25.578684 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4130/8335] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:53:25.585484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:25.587136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:25.653839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f914-e98d-42a6-a54e-97d2e8e0f721 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:25.657583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:25.658328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:25.658615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:25.658891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:25.669235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:25.670715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:25.681508 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4206/8336] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:25.979208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:25.980954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:25.996097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd42b-9f85-476e-9184-77dddb028a7f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:26.010902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:26.011651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:26.011937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:26.012259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] PATH_INFO: `/v3/projects/73f3bd429dfc4271ad4ce8706563177f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:26.014847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f3bd429dfc4271ad4ce8706563177f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:26.016927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:26.073262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f3bd429dfc4271ad4ce8706563177f', 'request_id': 'req-d7339f07-74eb-4c1d-83cd-ae171b4c1425'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.079312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f3bd429dfc4271ad4ce8706563177f', 'request_id': 'req-d7339f07-74eb-4c1d-83cd-ae171b4c1425'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.089867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f3bd429dfc4271ad4ce8706563177f', 'request_id': 'req-d7339f07-74eb-4c1d-83cd-ae171b4c1425'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.102626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] The token cache is being invalidate because project 73f3bd429dfc4271ad4ce8706563177f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:53:26.103062 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.103862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.108358 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4131/8337] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:53:25 2022] DELETE /identity/v3/projects/73f3bd429dfc4271ad4ce8706563177f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:26.109636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:26.121458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d5948-6b62-4d84-938c-e2bca46d3e82 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:26.198803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:26.199371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:26.199731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:26.200080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] PATH_INFO: `/v3/users/df9e970c60f44f07baa58409c52297ac` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:26.201508 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9e970c60f44f07baa58409c52297ac)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:26.203729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:26.314104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9e970c60f44f07baa58409c52297ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.333281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9e970c60f44f07baa58409c52297ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.334029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9e970c60f44f07baa58409c52297ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.334721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9e970c60f44f07baa58409c52297ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.343689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9e970c60f44f07baa58409c52297ac'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.360335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4207/8338] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:53:26 2022] DELETE /identity/v3/users/df9e970c60f44f07baa58409c52297ac => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:26.679238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:26.680747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:26.702636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f07-74eb-4c1d-83cd-ae171b4c1425 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:26.746415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:26.777783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:26.778465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:26.778747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:26.779020 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] PATH_INFO: `/v3/projects/1d171a9ee5bd477185a5ca439256b0bc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:26.780130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d171a9ee5bd477185a5ca439256b0bc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:26.782011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:26.829077 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d171a9ee5bd477185a5ca439256b0bc', 'request_id': 'req-9e7a8745-2a34-4685-9f09-82c038821a8e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.834928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d171a9ee5bd477185a5ca439256b0bc', 'request_id': 'req-9e7a8745-2a34-4685-9f09-82c038821a8e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.842678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d171a9ee5bd477185a5ca439256b0bc', 'request_id': 'req-9e7a8745-2a34-4685-9f09-82c038821a8e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.854692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] The token cache is being invalidate because project 1d171a9ee5bd477185a5ca439256b0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:53:26.855048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.855706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:26.857316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4132/8339] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:53:26 2022] DELETE /identity/v3/projects/1d171a9ee5bd477185a5ca439256b0bc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:26.861411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:26.862963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:26.876240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549b8cf-c51e-4738-873f-990d74652e68 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:26.885268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:26.937151 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:26.937805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:26.938086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:26.938394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] PATH_INFO: `/v3/users/ae78a7e993f540a08d179c26c3399a3d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:26.939845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae78a7e993f540a08d179c26c3399a3d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:26.941477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:26.999245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae78a7e993f540a08d179c26c3399a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.012618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae78a7e993f540a08d179c26c3399a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.013666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae78a7e993f540a08d179c26c3399a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.014483 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae78a7e993f540a08d179c26c3399a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.021996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9241d24-49f2-4da4-9e0f-6aaac37d8fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae78a7e993f540a08d179c26c3399a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.037328 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4208/8340] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:53:26 2022] DELETE /identity/v3/users/ae78a7e993f540a08d179c26c3399a3d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:53:27.334853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.337137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:27.350831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8745-2a34-4685-9f09-82c038821a8e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.421759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.422499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.422782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.423057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] PATH_INFO: `/v3/projects/0a571019e8ac44949e8830efd73ae0b2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.424198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a571019e8ac44949e8830efd73ae0b2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.426278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.479398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a571019e8ac44949e8830efd73ae0b2', 'request_id': 'req-bd991e1d-a018-415d-a9bf-44ac2c74d096'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.489472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a571019e8ac44949e8830efd73ae0b2', 'request_id': 'req-bd991e1d-a018-415d-a9bf-44ac2c74d096'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.494045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:27.497997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a571019e8ac44949e8830efd73ae0b2', 'request_id': 'req-bd991e1d-a018-415d-a9bf-44ac2c74d096'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.511970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] The token cache is being invalidate because project 0a571019e8ac44949e8830efd73ae0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:53:27.512201 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.512835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bd991e1d-a018-415d-a9bf-44ac2c74d096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:27.514672 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4133/8341] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:53:27 2022] DELETE /identity/v3/projects/0a571019e8ac44949e8830efd73ae0b2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:27.519566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.520097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.520097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.541480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:27.542116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:27.605948 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4209/8342] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:27.615254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.615675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.616060 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.637477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:27.639616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:27.649223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4134/8343] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:27.652810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.665276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14748-f7e9-46dc-a1c7-52e86984cfe4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.670903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.671601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.671933 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.672306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.673364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:53:27.673696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.675380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.690345 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4210/8344] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:53:27.692297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.703123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ada49-56b6-491f-aad5-0b961d538d53 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.708119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.709021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.709149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.709436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.710250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.712932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.742453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4135/8345] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:53:27 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:53:27.747010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.759071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da54c-452f-462a-b8cf-aa33e7840024 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.779208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:27.822682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.823294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.823573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.823845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.824480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.826449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.847659 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4211/8346] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:53:27 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:53:27.852599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.862828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147146-9253-4ffa-a29a-5ae569e98708 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.868084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.868687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.868971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.869250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.869897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.871531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.881314 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4136/8347] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:53:27.885357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.895825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b394a1-f341-46cd-81c3-b7867f4dd94c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.900694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167549b-ec18-46cf-82e8-bf4c1b2a4400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.901300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167549b-ec18-46cf-82e8-bf4c1b2a4400 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.901583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167549b-ec18-46cf-82e8-bf4c1b2a4400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.901860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167549b-ec18-46cf-82e8-bf4c1b2a4400 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.902535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167549b-ec18-46cf-82e8-bf4c1b2a4400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.904130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167549b-ec18-46cf-82e8-bf4c1b2a4400 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.914532 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4212/8348] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:53:27.918442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:27.928342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418cbdb-f1f4-4bf6-b6c8-c1c871ef7f81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:27.933608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:27.934304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.934589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.934869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] PATH_INFO: `/v3/projects/96b9b651985b468c958bf286a817c7ba/users/3f75f04c844b4d668a39227b4d29aa0b/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:27.950619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b9b651985b468c958bf286a817c7ba, user_id=3f75f04c844b4d668a39227b4d29aa0b, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:27.953288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:27.966261 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4137/8349] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:53:27 2022] PUT /identity/v3/projects/96b9b651985b468c958bf286a817c7ba/users/3f75f04c844b4d668a39227b4d29aa0b/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:27.977181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1c42c-1e6b-40f5-9cba-dc0c0be331c5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:27.977466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1c42c-1e6b-40f5-9cba-dc0c0be331c5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:27.977762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1c42c-1e6b-40f5-9cba-dc0c0be331c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:28.005665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-98b1c42c-1e6b-40f5-9cba-dc0c0be331c5 None None] MFA Rules not processed for user `3f75f04c844b4d668a39227b4d29aa0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:28.006889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98b1c42c-1e6b-40f5-9cba-dc0c0be331c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:28.070829 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4213/8350] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:28.081495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:28.083308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:28.144149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaf96b-6aed-4787-aa45-916b9b40b586 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:28.147837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1986ee-f28a-497a-bd4f-d108d6c46c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:28.148943 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1986ee-f28a-497a-bd4f-d108d6c46c7f service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:28.149225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1986ee-f28a-497a-bd4f-d108d6c46c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:28.149507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1986ee-f28a-497a-bd4f-d108d6c46c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:28.157888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1986ee-f28a-497a-bd4f-d108d6c46c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:28.159348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1986ee-f28a-497a-bd4f-d108d6c46c7f service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:28.168827 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4138/8351] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:29.565314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:29.565874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:29.566053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:29.587264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] MFA Rules not processed for user `3f75f04c844b4d668a39227b4d29aa0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:29.588553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:29.595595 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4214/8352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:38.164547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:39.581400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=60,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:46.535492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd0e5-9ebb-49a4-8890-4fb622ed670c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:46.536255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd0e5-9ebb-49a4-8890-4fb622ed670c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:46.536255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd0e5-9ebb-49a4-8890-4fb622ed670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:46.581368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9f1dd0e5-9ebb-49a4-8890-4fb622ed670c None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:46.582834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f1dd0e5-9ebb-49a4-8890-4fb622ed670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:46.671289 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4139/8353] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:53:46.725116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:46.727547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:46.807064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060dc41-04ea-4ab4-89eb-ffd0fdb716d0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:46.812123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:46.812752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:46.814449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:46.814764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:46.824307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:46.825913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:46.834642 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4215/8354] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:53:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:53:47.423371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d8454-eb0b-4dcb-8c2d-30154377ea0e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:47.423665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d8454-eb0b-4dcb-8c2d-30154377ea0e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:47.424236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d8454-eb0b-4dcb-8c2d-30154377ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:47.444768 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d50d8454-eb0b-4dcb-8c2d-30154377ea0e None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:47.445973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d50d8454-eb0b-4dcb-8c2d-30154377ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:47.453472 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4140/8355] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:53:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:47.466567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:47.481566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de747561-e3f3-498b-bc43-143c90962e80 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:47.487573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:47.488395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:47.488864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:47.489400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:47.500515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:47.502595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:47.513746 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4216/8356] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:53:47.949291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d1ff-d622-414f-8aa1-2928d7d962a6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:47.949930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d1ff-d622-414f-8aa1-2928d7d962a6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:47.949930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d1ff-d622-414f-8aa1-2928d7d962a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:47.974969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e834d1ff-d622-414f-8aa1-2928d7d962a6 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:47.976494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e834d1ff-d622-414f-8aa1-2928d7d962a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:47.984057 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4141/8357] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:53:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:48.002200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:48.018197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837dc5-c280-4905-a157-d9164f72fde8 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:48.023979 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:48.024591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:48.024875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:48.025153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:48.034974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:48.036645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:48.046284 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4217/8358] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:53:48.424441 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:48.424748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:48.425027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:48.446626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:48.447880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:48.456010 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4142/8359] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:48.469621 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:48.483619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2875b3-8dbb-40eb-a005-d9e8151b27ec service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:48.489826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c19e8-311f-4c4a-98f5-429179362d83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:48.490548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c19e8-311f-4c4a-98f5-429179362d83 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:48.490894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c19e8-311f-4c4a-98f5-429179362d83 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:48.491725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c19e8-311f-4c4a-98f5-429179362d83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:48.501173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c19e8-311f-4c4a-98f5-429179362d83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:48.502888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c19e8-311f-4c4a-98f5-429179362d83 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:48.513102 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4218/8360] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:53:52.173591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:52.268804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e7865-62dd-473f-b5c2-1ceb284dd48b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:52.279501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:52.280519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:52.281359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:52.281908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] PATH_INFO: `/v3/users/3f75f04c844b4d668a39227b4d29aa0b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:52.285014 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f75f04c844b4d668a39227b4d29aa0b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:52.289766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:52.389317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f75f04c844b4d668a39227b4d29aa0b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:52.403171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f75f04c844b4d668a39227b4d29aa0b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:52.404183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f75f04c844b4d668a39227b4d29aa0b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:52.405272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f75f04c844b4d668a39227b4d29aa0b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:52.423271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f75f04c844b4d668a39227b4d29aa0b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:52.432204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:52.447143 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4143/8361] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:53:52 2022] DELETE /identity/v3/users/3f75f04c844b4d668a39227b4d29aa0b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:52.451953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:52.452587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:52.452587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:52.485394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:52.486839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:52.571343 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4219/8362] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:52.577182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:52.578938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:52.676791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38618-99cd-4995-98fa-4507c09fbf25 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:52.680982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ba1e3-2ec0-4ecf-8478-b5a941f27209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:52.681613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ba1e3-2ec0-4ecf-8478-b5a941f27209 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:52.681897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ba1e3-2ec0-4ecf-8478-b5a941f27209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:52.682202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ba1e3-2ec0-4ecf-8478-b5a941f27209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:52.697626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ba1e3-2ec0-4ecf-8478-b5a941f27209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:52.701472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ba1e3-2ec0-4ecf-8478-b5a941f27209 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:52.722391 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4144/8363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:53:52.971878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:52.973871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:53.006310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1f197-9f7a-4cdc-8102-77f0ba59c336 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:53.019054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:53.019714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:53.020000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:53.020283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] PATH_INFO: `/v3/projects/96b9b651985b468c958bf286a817c7ba` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:53.027075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b9b651985b468c958bf286a817c7ba)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:53.029065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:53.121639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:53:53.130544 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b9b651985b468c958bf286a817c7ba', 'request_id': 'req-e6912a56-8a05-4a21-900f-9bcdbc4856c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:53.161034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b9b651985b468c958bf286a817c7ba', 'request_id': 'req-e6912a56-8a05-4a21-900f-9bcdbc4856c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:53.168240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b9b651985b468c958bf286a817c7ba', 'request_id': 'req-e6912a56-8a05-4a21-900f-9bcdbc4856c4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:53.186694 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] The token cache is being invalidate because project 96b9b651985b468c958bf286a817c7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:53:53.187124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:53.188041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:53:53.190496 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4220/8364] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:53:52 2022] DELETE /identity/v3/projects/96b9b651985b468c958bf286a817c7ba => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:53:56.541474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d7686-6a74-4b7d-b989-b4facc897de6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:56.542031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d7686-6a74-4b7d-b989-b4facc897de6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:56.542031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d7686-6a74-4b7d-b989-b4facc897de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:56.561665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c35d7686-6a74-4b7d-b989-b4facc897de6 None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:53:56.562890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c35d7686-6a74-4b7d-b989-b4facc897de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:56.621480 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4145/8365] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:53:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:53:57.240583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:53:57.242723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:57.305320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a56-8a05-4a21-900f-9bcdbc4856c4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:53:57.308990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:53:57.309612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:53:57.309898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:53:57.310209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:53:57.311951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:53:57.324364 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:53:57.325816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313fdb-74d6-49ea-9792-58de65dc4226 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:53:57.337209 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4221/8366] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:53:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:54:06.614036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=56,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:54:07.330424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=4,keystone:SELECT=33,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:54:36.352922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:54:36.353461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:54:36.353461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:54:36.386083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] MFA Rules not processed for user `9894d96578184e7e93f83865b82e7ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:54:36.388924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:54:36.456742 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4146/8367] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:54:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:54:46.448167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=25 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:54:56.074602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46473-d1de-44d5-bc68-7a5b40f7ee8c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:54:56.075136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46473-d1de-44d5-bc68-7a5b40f7ee8c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:54:56.075136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46473-d1de-44d5-bc68-7a5b40f7ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:54:56.094491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6bd46473-d1de-44d5-bc68-7a5b40f7ee8c None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:54:56.095683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bd46473-d1de-44d5-bc68-7a5b40f7ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:54:56.103312 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4222/8368] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:54:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:54:57.310061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:54:57.311492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:54:57.383165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5079bf-6251-4c5e-a98b-0e66b797011a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:54:57.388463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:54:57.389074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:54:57.389355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:54:57.389630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:54:57.391344 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:54:57.405097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:54:57.406700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:54:57.419027 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4147/8369] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:54:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:55:06.089537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:55:07.412482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=32 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:55:18.179986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f91f-4509-485b-80de-7c6c3e91aad1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:55:18.180490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f91f-4509-485b-80de-7c6c3e91aad1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:55:18.180610 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f91f-4509-485b-80de-7c6c3e91aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:55:18.239779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ee50f91f-4509-485b-80de-7c6c3e91aad1 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:55:18.241004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee50f91f-4509-485b-80de-7c6c3e91aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:55:18.316539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4223/8370] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 05:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:55:18.367846 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:55:18.369375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:55:18.455141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b6d1a-d21b-4bb9-9b01-c2cd94159c0a service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:55:18.460967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:55:18.461590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:55:18.461869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:55:18.462162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:55:18.471022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:55:18.472584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:55:18.481620 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4148/8371] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 05:55:19.763950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:55:19.764488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:55:19.764662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:55:19.784714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:55:19.786534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:55:19.793514 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4224/8372] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:55:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:55:28.478036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=37 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:55:29.779074 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=39 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:55:50.528373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:55:50.530238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:55:50.551167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c337-f37e-4557-abdd-2c13ba70d479 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:55:50.556330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:55:50.556954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:55:50.557247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:55:50.557523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:55:50.559309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:55:50.574647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:55:50.575616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:55:50.590159 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4149/8373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:55:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:00.584271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:05.000656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:05.003142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:05.116945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7b5c1-7b13-4170-bbdc-63997b41cb01 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:05.122451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:05.123206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.123577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.123895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] PATH_INFO: `/v3/users/9894d96578184e7e93f83865b82e7ba4` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.125137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9894d96578184e7e93f83865b82e7ba4)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:05.127414 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:05.195203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9894d96578184e7e93f83865b82e7ba4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.213687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9894d96578184e7e93f83865b82e7ba4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.214467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9894d96578184e7e93f83865b82e7ba4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.215086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9894d96578184e7e93f83865b82e7ba4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.226799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-6e29402a-7c28-44cb-87f4-970f97140f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9894d96578184e7e93f83865b82e7ba4'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.265062 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4225/8374] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:56:04 2022] DELETE /identity/v3/users/9894d96578184e7e93f83865b82e7ba4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:05.482842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:05.508965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4206cf7-607a-4c53-a791-fbffe50fd437 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:05.577076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:05.577636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.577917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.578226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] PATH_INFO: `/v3/projects/c836645acf03435db125de095c372395` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.579483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c836645acf03435db125de095c372395)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:05.582033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:05.634497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c836645acf03435db125de095c372395', 'request_id': 'req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.640716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c836645acf03435db125de095c372395', 'request_id': 'req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.648586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c836645acf03435db125de095c372395', 'request_id': 'req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.660093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] The token cache is being invalidate because project c836645acf03435db125de095c372395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:56:05.660392 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.661036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-178911c7-5837-4f4d-b8e6-2e3f5e6c9d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:05.662593 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4150/8375] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:56:05 2022] DELETE /identity/v3/projects/c836645acf03435db125de095c372395 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:05.667632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.667917 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.668244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.689224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:05.690547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:05.754213 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4226/8376] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:05.762755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.763043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.763316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.785415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:05.786645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:05.794675 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4151/8377] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:05.798891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:05.809575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6946-3f46-4536-8413-d8605cd431f6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:05.814140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:05.814781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.815449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.815541 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.816144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:56:05.816447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:05.818065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:05.829924 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4227/8378] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 05:56:05.834912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:05.844426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c9ad8-a7b8-40a5-93b9-930d31ae33f4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:05.849754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:05.850389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.850669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.850940 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.851714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:05.853627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:05.883335 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4152/8379] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:56:05 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:56:05.887043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:05.897251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49813-e7ae-49d6-b64c-934a140a1025 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:05.900904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:05.961723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:05.962390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:05.962715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:05.963164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:05.963816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:05.965803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:05.989162 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4228/8380] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:56:05 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:56:05.993296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:06.005064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796136c1-e1a2-4d1e-8fce-d6812da0a505 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:06.009849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:06.010502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:06.010783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:06.011312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:06.011964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:06.013572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:06.026449 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4153/8381] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:56:06.030235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:06.041281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f92511-3e67-4375-8672-b2f476d678cc admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:06.045930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367f680-e7b2-472b-93d6-c96fb40b7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:06.046570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f680-e7b2-472b-93d6-c96fb40b7963 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:06.046854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f680-e7b2-472b-93d6-c96fb40b7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:06.047129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f680-e7b2-472b-93d6-c96fb40b7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:06.047774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367f680-e7b2-472b-93d6-c96fb40b7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:06.049537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367f680-e7b2-472b-93d6-c96fb40b7963 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:06.060838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4229/8382] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:56:06.065564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:06.075737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd80e-7dc6-43af-a585-e85caf5c7f1f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:06.080608 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:06.081341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:06.081624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:06.081905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] PATH_INFO: `/v3/projects/f50520515f1044429e90ffe18957e3e3/users/472e3271c6b04ec9aed42ad556a2af75/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:06.097241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50520515f1044429e90ffe18957e3e3, user_id=472e3271c6b04ec9aed42ad556a2af75, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:06.099913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:06.113516 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4154/8383] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:56:06 2022] PUT /identity/v3/projects/f50520515f1044429e90ffe18957e3e3/users/472e3271c6b04ec9aed42ad556a2af75/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:06.123972 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d47f-cdf6-477b-a0bf-246af63b4ed5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:06.124257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d47f-cdf6-477b-a0bf-246af63b4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:06.124532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d47f-cdf6-477b-a0bf-246af63b4ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:06.153786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a6b5d47f-cdf6-477b-a0bf-246af63b4ed5 None None] MFA Rules not processed for user `472e3271c6b04ec9aed42ad556a2af75`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:06.154946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a6b5d47f-cdf6-477b-a0bf-246af63b4ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:06.220263 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4230/8384] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:06.231647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:06.233339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:06.274960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:06.316691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3386e-61bb-4ffe-ae35-118093f4eb9d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:06.320381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:06.321030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:06.321310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:06.321580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:06.333074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:06.334553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:06.344469 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4155/8385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:56:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:13.095325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:13.096156 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:13.096629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:13.117539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:13.118768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:13.180397 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4231/8386] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 05:56:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:13.200869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:13.203279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:13.295159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d594-f9c1-4adf-8517-30d09206e527 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:13.300930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf7760-0d90-49e9-8e60-38560b8e9ca8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:13.301612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7760-0d90-49e9-8e60-38560b8e9ca8 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:13.302018 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7760-0d90-49e9-8e60-38560b8e9ca8 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:13.302336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7760-0d90-49e9-8e60-38560b8e9ca8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:13.312058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf7760-0d90-49e9-8e60-38560b8e9ca8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:13.313654 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf7760-0d90-49e9-8e60-38560b8e9ca8 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:13.323217 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4156/8387] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 05:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 05:56:14.505783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:14.535193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:14.588747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4f6f-ae06-4232-be02-fe90866309de None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:14.593906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:14.594698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:14.594978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:14.595334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] PATH_INFO: `/v3/users/472e3271c6b04ec9aed42ad556a2af75` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:14.597379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=472e3271c6b04ec9aed42ad556a2af75)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:14.599500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:14.660276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472e3271c6b04ec9aed42ad556a2af75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:14.673080 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472e3271c6b04ec9aed42ad556a2af75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:14.674522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472e3271c6b04ec9aed42ad556a2af75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:14.675023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472e3271c6b04ec9aed42ad556a2af75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:14.683264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472e3271c6b04ec9aed42ad556a2af75'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:14.698410 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4232/8388] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 05:56:14 2022] DELETE /identity/v3/users/472e3271c6b04ec9aed42ad556a2af75 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:14.702962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:14.703417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:14.703511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:14.724890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:14.726371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:14.805174 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4157/8389] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:14.812585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:14.814888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:14.887959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8a1dd-52da-4f4f-8d9d-6f1c5c231ecd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:14.896561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74430f-1814-49d7-a906-1ddebbb15a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:14.897183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74430f-1814-49d7-a906-1ddebbb15a08 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:14.897464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74430f-1814-49d7-a906-1ddebbb15a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:14.897736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74430f-1814-49d7-a906-1ddebbb15a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:14.908762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74430f-1814-49d7-a906-1ddebbb15a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:14.910960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74430f-1814-49d7-a906-1ddebbb15a08 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:14.923417 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4233/8390] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:15.253712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.255720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:15.292163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131648-d33e-45a1-ad63-2b8a97d49095 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.298500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.300131 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.300692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.300976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] PATH_INFO: `/v3/projects/f50520515f1044429e90ffe18957e3e3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.302229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50520515f1044429e90ffe18957e3e3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.304193 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.358402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50520515f1044429e90ffe18957e3e3', 'request_id': 'req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:15.364032 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:15.366272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50520515f1044429e90ffe18957e3e3', 'request_id': 'req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:15.377045 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50520515f1044429e90ffe18957e3e3', 'request_id': 'req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:15.390337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] The token cache is being invalidate because project f50520515f1044429e90ffe18957e3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 05:56:15.390708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:15.391438 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70d3ab55-765b-4ae4-bb33-8aeb94e7f3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 05:56:15.394172 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4158/8391] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 05:56:15 2022] DELETE /identity/v3/projects/f50520515f1044429e90ffe18957e3e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:15.399583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.399886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.400298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.425739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:15.426989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:15.469124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:15.510295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4234/8392] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:15.514801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183103bf-38ba-414e-beac-1f2191569962 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.515348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183103bf-38ba-414e-beac-1f2191569962 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.515348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183103bf-38ba-414e-beac-1f2191569962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.539655 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-183103bf-38ba-414e-beac-1f2191569962 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:15.541237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-183103bf-38ba-414e-beac-1f2191569962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:15.553405 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4159/8393] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:15.554692 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.565609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe4e8-e698-40df-b282-808e7367c6ee None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.570897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.571609 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.571962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.572302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.573073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 05:56:15.573445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.575190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.589641 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4235/8394] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 05:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 05:56:15.594262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183103bf-38ba-414e-beac-1f2191569962 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.603732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183103bf-38ba-414e-beac-1f2191569962 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.608570 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.609175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.609457 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.609727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.610389 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.613121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.650118 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4160/8395] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:56:15 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:56:15.654374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.668569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a0c1-b26a-4be4-aa65-4eff04869ec7 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.745106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.745733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.746020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.746327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.747037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.749174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.773350 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4236/8396] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:56:15 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:56:15.777235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.788942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe1189-b3db-476e-ad3c-b6de7de87e62 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.793787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.794436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.794720 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.794997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.795636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.797218 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.809565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4161/8397] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:56:15.813493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.824246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0903490-9abd-4d18-8ccc-d101bcede0fd admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.829164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6490b-c7dc-4b33-9fef-a915cd742948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.829827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6490b-c7dc-4b33-9fef-a915cd742948 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.830171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6490b-c7dc-4b33-9fef-a915cd742948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.830588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6490b-c7dc-4b33-9fef-a915cd742948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.831245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6490b-c7dc-4b33-9fef-a915cd742948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.832860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6490b-c7dc-4b33-9fef-a915cd742948 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.844720 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4237/8398] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:56:15.849016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:15.859266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb7d65-c1c9-4881-93ad-da8d024d20dc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:15.864289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:15.864975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.865266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.865550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] PATH_INFO: `/v3/projects/3d51f138ed63467d9e876d3925317eea/users/e11556658474410ab60d5a44805c77f3/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.882347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d51f138ed63467d9e876d3925317eea, user_id=e11556658474410ab60d5a44805c77f3, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:15.885345 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:15.901435 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4162/8399] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:56:15 2022] PUT /identity/v3/projects/3d51f138ed63467d9e876d3925317eea/users/e11556658474410ab60d5a44805c77f3/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 05:56:15.913838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:15.914127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:15.914459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:15.948464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] MFA Rules not processed for user `e11556658474410ab60d5a44805c77f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:15.949870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:16.029270 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4238/8400] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:16.033967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.104961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8586-d423-4834-94c0-e4d823cedddb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.109852 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.110587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.110931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.112148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.114181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.115136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.149235 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4163/8401] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 05:56:16 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 05:56:16.150405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.162779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc955fb-30a7-4777-9679-84c5e8ba333f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.200787 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:16.228500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.229224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.229601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.229889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.230571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.233065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.262696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.262887 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4239/8402] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 05:56:16 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 05:56:16.275968 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15429c-d760-4e21-a190-98bd7bc047fd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.281578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.282530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.283001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.283719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.284381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.289922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.300483 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4164/8403] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 05:56:16.310206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.325606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bcbca-a6c1-49e3-bd5f-f65e77ab7909 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.332922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.334998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.335300 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.335585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] PATH_INFO: `/v3/projects/a7ec48230df74e51aae7c1921f8f745d/users/aa728534438c46a2ba197ad594719a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.358762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ec48230df74e51aae7c1921f8f745d, user_id=aa728534438c46a2ba197ad594719a3d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.362311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.381002 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4240/8404] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:56:16 2022] PUT /identity/v3/projects/a7ec48230df74e51aae7c1921f8f745d/users/aa728534438c46a2ba197ad594719a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:16.384971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.395653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9160-0698-45ed-b094-5b39f09b002e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.450500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:16.462791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b4db3-7545-43bf-b02e-9d367647c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.463620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4db3-7545-43bf-b02e-9d367647c780 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.464194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4db3-7545-43bf-b02e-9d367647c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.466236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4db3-7545-43bf-b02e-9d367647c780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.466236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b4db3-7545-43bf-b02e-9d367647c780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.467025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b4db3-7545-43bf-b02e-9d367647c780 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.479357 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4165/8405] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 05:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 05:56:16.483396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.504191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad9c4e-dbe9-46e3-8fd2-f83c73c13813 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.509449 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.510289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.510576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.511370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] PATH_INFO: `/v3/projects/a7ec48230df74e51aae7c1921f8f745d/users/aa728534438c46a2ba197ad594719a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.513094 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ec48230df74e51aae7c1921f8f745d, user_id=aa728534438c46a2ba197ad594719a3d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.515938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.528270 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4241/8406] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 05:56:16 2022] PUT /identity/v3/projects/a7ec48230df74e51aae7c1921f8f745d/users/aa728534438c46a2ba197ad594719a3d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 05:56:16.539222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.539517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.539836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.575160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] MFA Rules not processed for user `aa728534438c46a2ba197ad594719a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:16.576533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:16.666225 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4166/8407] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:16.673976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:16.675936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:16.772980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8fca7-9216-42b3-83d5-fa016ed7541a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:16.778966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477d8f9-cea0-4777-9c5b-c916115337cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:16.779656 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477d8f9-cea0-4777-9c5b-c916115337cc service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:16.780001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477d8f9-cea0-4777-9c5b-c916115337cc service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:16.780362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477d8f9-cea0-4777-9c5b-c916115337cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:16.852626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477d8f9-cea0-4777-9c5b-c916115337cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:16.854573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477d8f9-cea0-4777-9c5b-c916115337cc service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:16.865767 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4242/8408] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:56:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:19.803281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:19.804723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:19.878635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f067-2079-45f5-90a2-95e41e202da7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:19.887102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a1f4a-d952-4ea7-ae82-8c9908c1b154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:19.887742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a1f4a-d952-4ea7-ae82-8c9908c1b154 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:19.888023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a1f4a-d952-4ea7-ae82-8c9908c1b154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:19.888298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a1f4a-d952-4ea7-ae82-8c9908c1b154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:19.900357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a1f4a-d952-4ea7-ae82-8c9908c1b154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:19.902110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a1f4a-d952-4ea7-ae82-8c9908c1b154 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:19.913812 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4167/8409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:56:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:22.962332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:22.962841 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:22.963077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:22.989986 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] MFA Rules not processed for user `e11556658474410ab60d5a44805c77f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:22.991940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:23.000012 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4243/8410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:29.909397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=65 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:32.983458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:33.581204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:33.581744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:33.581744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:33.603221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:56:33.604442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:33.662935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4168/8411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:56:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:56:43.655126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=25 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:46.349279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:46.362669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226c1b-a4a4-438e-bb69-632e50ab55b0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:46.366291 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:46.366894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:46.367171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:46.367443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:46.369113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:46.385057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:46.386769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:46.400647 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4244/8412] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:56:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:47.578490 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:56:47.579971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:47.597281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568ae1-0226-498f-8095-3e01585cdc34 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:56:47.600868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:56:47.601474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:56:47.601753 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:56:47.602022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:56:47.603733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:56:47.619875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:56:47.621282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:56:47.634624 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4169/8413] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:56:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:56:56.393047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:56:57.627324 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:57:12.792023 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:57:12.793548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:57:12.874036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448a88-0704-4508-8c92-356b48b52bc0 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:57:12.880803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:57:12.880803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:57:12.880803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:57:12.880803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:57:12.882428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:57:12.900277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:57:12.901998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:57:12.916609 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4245/8414] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:57:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:57:13.075418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:57:13.088213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d735952-4cec-4aec-b047-e052058f4ce8 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:57:13.092416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:57:13.093093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:57:13.093362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:57:13.093661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:57:13.095591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:57:13.109736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:57:13.111247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:57:13.123149 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4170/8415] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:57:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:57:13.267076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:57:13.269614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:57:13.290629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1ccab-2c78-4026-9f3b-596402bc4d74 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:57:13.296814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:57:13.297469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:57:13.298305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:57:13.298305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:57:13.299988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:57:13.318582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:57:13.321397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:57:13.340305 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4246/8416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:57:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:57:13.549112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:57:13.560698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f82e-00ee-457d-8632-55889259a98b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:57:13.564509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:57:13.565120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:57:13.565401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:57:13.565675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:57:13.567407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:57:13.584833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:57:13.586297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:57:13.600783 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4171/8417] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:57:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:57:23.331940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=38 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:57:23.592844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=12 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:58:26.931844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:26.951029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15767-57ac-458d-a333-1026ea9f246d service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:26.959616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:26.960435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:26.960864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:26.961293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:26.963474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:26.980524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:26.982413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:26.997313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4247/8418] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:28.165307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:28.178473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebd974-2e11-4321-a3ad-e45ea92bbe97 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:28.182074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:28.182714 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:28.182997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:28.183272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:28.185015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:28.197740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:28.199184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:28.210444 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4172/8419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:29.414710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:29.436204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1866-71ce-49b7-924e-90d5add75f54 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:29.445620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:29.446582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:29.447041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:29.447627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:29.451256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:29.473349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:29.475112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ea1d-645f-425e-b433-c931b4125ea2 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:29.491221 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4248/8420] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:33.413809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:33.428465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8d92-a71e-46bb-bf35-e3e0ddaf051b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:33.433458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:33.434059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:33.434383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:33.434656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:33.437068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:33.452017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:33.453620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:33.467269 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4173/8421] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:39.371741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:39.372294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:39.372463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:39.393894 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] MFA Rules not processed for user `e11556658474410ab60d5a44805c77f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:58:39.395528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:39.403257 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4249/8422] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:58:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:58:39.732873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:39.745246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a592cb-9e2e-46bf-8548-d6ac9386e7bb service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:39.749103 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:39.749727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:39.750016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:39.750364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:39.752184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:39.766041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:39.767717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:39.780897 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4174/8423] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:40.160280 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:40.184031 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c37cb7-3613-4649-a97a-10128641f05f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:40.190070 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:40.191568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:40.192106 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:40.192688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:40.194819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:40.213728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:40.215391 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:40.246374 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4250/8424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:42.188871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:42.221938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511db7e9-ede4-4f9c-bb9e-0e644777fcf9 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:42.226064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:42.227117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:42.227403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:42.227676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:42.229476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:42.244273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:42.245750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:42.261299 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4175/8425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:47.041808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:47.043363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:47.062537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c74dde-76e6-423e-bb6c-627d181e8942 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:47.068050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:47.068668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:47.068949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:47.069224 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:47.071016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:47.086506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:47.088758 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f75799-f8c3-45d6-87ed-8a40a49bee0a service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:47.102542 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4251/8426] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:50.832568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:58:50.850243 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9317f-9e52-421a-88a7-e81fcce1adf1 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:58:50.856715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:58:50.857560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:50.857845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:50.858121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:50.860039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:50.870982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:58:50.872592 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d679f-0bc1-4e82-af03-401ee860b540 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:58:50.882126 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4176/8427] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:58:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:58:57.095428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=27 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:58:59.050274 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:58:59.050825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:58:59.050825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:58:59.070438 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:58:59.071638 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:58:59.078636 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4252/8428] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 05:58:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 05:59:00.877741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=34 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:59:09.065334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:59:19.102580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:59:19.103083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:59:19.103178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:59:19.151056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 05:59:19.152187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:59:19.178501 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4177/8429] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Oct 31 05:59:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 05:59:19.184502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:59:19.202578 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5909c-29f7-4911-9419-62fbe95ed32b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:59:19.206272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:59:19.206881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:59:19.207161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:59:19.207434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:59:19.209136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:59:19.292573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:59:19.294663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:59:19.304415 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4253/8430] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:59:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 05:59:22.731204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:59:22.739599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c617-5885-4017-bfd4-88db1b05985f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:59:22.743547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:59:22.744160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:59:22.744446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:59:22.744721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:59:22.746855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:59:22.758988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:59:22.760678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:59:22.772087 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4178/8431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:59:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:59:23.027947 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 05:59:23.036545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdbb08-48fc-40fb-9009-89b244ec75e9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 05:59:23.040208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 05:59:23.040752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 05:59:23.041034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 05:59:23.041308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 05:59:23.043095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 05:59:23.059293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 05:59:23.060704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 05:59:23.075082 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4254/8432] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 05:59:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 05:59:32.765993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=28 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 05:59:33.066992 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=47 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:00:05.119146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:00:05.146407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91066-a2c0-4b15-80ac-ee111eb027a1 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:00:05.151927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:00:05.152738 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:05.153024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:05.153300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:05.155092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:00:05.185584 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:00:05.187209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15110632-3dad-49b3-a0af-4106bb33444a service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:00:05.200935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4179/8433] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:00:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:00:15.193821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=15 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:00:28.026849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:00:28.044426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe6836-cb7a-4e4a-8f3a-b85176e01fbb service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:00:28.049589 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:00:28.057381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:28.057381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:28.057381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:28.057381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:00:28.070834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:00:28.072601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2309-ea2c-4a51-a25c-d1c9665ebbb2 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:00:28.097484 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4255/8434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:00:33.885916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18521a67-0a55-4217-a218-97342c2b455c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:33.886794 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18521a67-0a55-4217-a218-97342c2b455c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:33.887073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18521a67-0a55-4217-a218-97342c2b455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:33.913333 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-18521a67-0a55-4217-a218-97342c2b455c None None] MFA Rules not processed for user `e11556658474410ab60d5a44805c77f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:00:33.914673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18521a67-0a55-4217-a218-97342c2b455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:00:33.922645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4180/8435] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:00:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:00:34.616019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:34.617083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:34.617366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:34.673187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:00:34.675711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:00:34.688111 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4256/8436] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:00:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:00:34.701525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18521a67-0a55-4217-a218-97342c2b455c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:00:34.719196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18521a67-0a55-4217-a218-97342c2b455c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:00:34.725772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b2e4-3df2-487c-bbc1-8b7af2a37647 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:00:34.726569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b2e4-3df2-487c-bbc1-8b7af2a37647 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:34.727216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b2e4-3df2-487c-bbc1-8b7af2a37647 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:34.727491 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b2e4-3df2-487c-bbc1-8b7af2a37647 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:34.736598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b2e4-3df2-487c-bbc1-8b7af2a37647 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:00:34.738554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b2e4-3df2-487c-bbc1-8b7af2a37647 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:00:34.749316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4181/8437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:00:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:00:44.669927 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=19 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:00:44.744737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:00:56.513346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:00:56.528176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e366e6e-8002-4d28-9824-2f719cdfccef None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:00:56.539490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:00:56.540669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:56.541180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:56.542459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:56.549153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:00:56.585941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:00:56.589663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e613e0-cbcd-4a86-a2dd-a861ca9e49b3 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:00:56.610637 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4257/8438] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:00:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:00:59.555933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:00:59.556407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:00:59.556407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:00:59.575691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] MFA Rules not processed for user `9788d585e06a48f29c35538496c44791`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:00:59.576886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:00:59.584364 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4182/8439] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:00:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:01:00.342924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:00.343381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:00.343593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:00.364419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:01:00.365619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:01:00.374403 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4258/8440] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:01:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:01:00.386156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:00.401625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab599e5-8609-461c-be85-1b76582454a7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:00.406554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:00.407248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:00.407597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:00.407939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:00.417605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:00.419207 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:00.429621 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4183/8441] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:10.358539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:01:10.424644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:01:20.720857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:20.739590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a842a84-fdb2-44f5-b573-aea3bf173fa4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:20.745814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e6b2-df6f-486e-8fcb-1349f95593f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:20.746481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e6b2-df6f-486e-8fcb-1349f95593f7 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:20.746767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e6b2-df6f-486e-8fcb-1349f95593f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:20.747048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e6b2-df6f-486e-8fcb-1349f95593f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:20.755857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e6b2-df6f-486e-8fcb-1349f95593f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:20.757459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e6b2-df6f-486e-8fcb-1349f95593f7 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:20.767627 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4259/8442] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:21.253195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:21.269429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3431a-1058-40f8-9239-e129dc4ed986 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:21.276409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:21.277027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:21.277316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:21.277590 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:21.289563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:21.291213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:21.301894 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4184/8443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:21.551269 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc5e8-6526-4e6b-b7cf-a6a43058afbf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:21.551560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc5e8-6526-4e6b-b7cf-a6a43058afbf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:21.551839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc5e8-6526-4e6b-b7cf-a6a43058afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:21.583226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f0fbc5e8-6526-4e6b-b7cf-a6a43058afbf None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:01:21.585066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f0fbc5e8-6526-4e6b-b7cf-a6a43058afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:01:21.591587 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4260/8444] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Oct 31 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:01:21.597349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:21.606732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfe3f0-7393-4f98-a44f-b40f9ea41f1f service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:21.610317 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:21.610919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:21.611264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:21.611656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:21.613660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:01:21.626673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:21.628126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:21.639609 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4185/8445] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:22.781803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd9f5-ca6d-445e-9746-dc2e08655cdb None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:22.782308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd9f5-ca6d-445e-9746-dc2e08655cdb None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:22.782418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd9f5-ca6d-445e-9746-dc2e08655cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:22.803502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-750fd9f5-ca6d-445e-9746-dc2e08655cdb None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:01:22.804693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-750fd9f5-ca6d-445e-9746-dc2e08655cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:01:22.813140 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4261/8446] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:01:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:01:22.826219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:22.841581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac99b76-6efd-4a83-a8cb-c6145e66bc50 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:22.846479 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:22.847076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:22.847368 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:22.847643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:22.856173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:22.857722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:22.867792 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4186/8447] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:32.797005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=17 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:01:32.863294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=18 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:01:49.718435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:49.718976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:49.719130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:49.740010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] MFA Rules not processed for user `e11556658474410ab60d5a44805c77f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:01:49.741256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:01:49.749363 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4262/8448] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:01:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:01:49.790824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:49.792255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:01:49.878822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e83b4-8628-479b-ac12-fba1b6f8d614 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:49.883305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:49.884280 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:49.884562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:49.884839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:49.906245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:49.907646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:49.933255 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4187/8449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:50.976622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:01:50.986811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0cfc4-de6b-4475-b00d-39518f974876 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:01:50.990574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:01:50.991194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:01:50.992116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:01:50.992116 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:01:51.007537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:01:51.009256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:01:51.031032 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4263/8450] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:01:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:01:59.929160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=42 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:02:01.018995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:15.408577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:15.417869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286c582-7dbf-4653-8644-6e87d9d224cc service glance] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:15.421508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:15.422119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:15.422428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:15.422747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:15.424792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:15.512818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:15.514296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:15.534922 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4188/8451] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:21.907831 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:21.909430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:21.924685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f73df-7c1a-4c68-a498-1e2ea190c721 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:21.929263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:21.929926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:21.930238 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:21.930518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] PATH_INFO: `/v3/users/9788d585e06a48f29c35538496c44791` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:21.944576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9788d585e06a48f29c35538496c44791)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:21.946611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:21.994100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9788d585e06a48f29c35538496c44791'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.006385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9788d585e06a48f29c35538496c44791'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.007087 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9788d585e06a48f29c35538496c44791'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.007685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9788d585e06a48f29c35538496c44791'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.014930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9788d585e06a48f29c35538496c44791'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.027908 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4264/8452] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:03:21 2022] DELETE /identity/v3/users/9788d585e06a48f29c35538496c44791 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:22.204638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:22.217146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281cb7-b0e0-457f-8080-eb0b2dee16e2 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:22.277835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:22.278499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:22.278782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:22.279059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] PATH_INFO: `/v3/projects/3929fc1424c3432f9fffead61b10a598` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:22.295111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3929fc1424c3432f9fffead61b10a598)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:22.297061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:22.344054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3929fc1424c3432f9fffead61b10a598', 'request_id': 'req-34ace124-7b2c-480e-bcdf-fedfeae6be3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.349510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3929fc1424c3432f9fffead61b10a598', 'request_id': 'req-34ace124-7b2c-480e-bcdf-fedfeae6be3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.351188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:22.357911 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3929fc1424c3432f9fffead61b10a598', 'request_id': 'req-34ace124-7b2c-480e-bcdf-fedfeae6be3e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.370342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] The token cache is being invalidate because project 3929fc1424c3432f9fffead61b10a598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:03:22.370629 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.371247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.372737 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4189/8453] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:03:22 2022] DELETE /identity/v3/projects/3929fc1424c3432f9fffead61b10a598 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:03:22.377420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:22.378813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:22.391881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e9b74-1df4-408d-b25c-ed586e37c1a5 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:22.447658 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:22.448290 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:22.448567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:22.448840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] PATH_INFO: `/v3/users/55416a415fb748c5b7c0fd3952b58dfd` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:22.462389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55416a415fb748c5b7c0fd3952b58dfd)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:22.464298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:22.510397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55416a415fb748c5b7c0fd3952b58dfd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.514784 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:22.524397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55416a415fb748c5b7c0fd3952b58dfd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.525075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55416a415fb748c5b7c0fd3952b58dfd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.525707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55416a415fb748c5b7c0fd3952b58dfd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.532864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55416a415fb748c5b7c0fd3952b58dfd'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.545159 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4265/8454] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:03:22 2022] DELETE /identity/v3/users/55416a415fb748c5b7c0fd3952b58dfd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:22.728387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:22.729910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:22.743492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ace124-7b2c-480e-bcdf-fedfeae6be3e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:22.804308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:22.805048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:22.805401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:22.805765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] PATH_INFO: `/v3/projects/882c4703518044aaa0ca5d7a1dfd5865` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:22.818462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882c4703518044aaa0ca5d7a1dfd5865)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:22.820403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:22.868842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882c4703518044aaa0ca5d7a1dfd5865', 'request_id': 'req-3918f0cd-7608-4ec7-bfba-792a749ee1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.874429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882c4703518044aaa0ca5d7a1dfd5865', 'request_id': 'req-3918f0cd-7608-4ec7-bfba-792a749ee1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.883129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882c4703518044aaa0ca5d7a1dfd5865', 'request_id': 'req-3918f0cd-7608-4ec7-bfba-792a749ee1c9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.896000 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] The token cache is being invalidate because project 882c4703518044aaa0ca5d7a1dfd5865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:03:22.896224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.896871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:22.898382 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4190/8455] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:03:22 2022] DELETE /identity/v3/projects/882c4703518044aaa0ca5d7a1dfd5865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:32.541838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:32.776071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:32.777695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:32.881311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313cc79-dbb3-4ad2-aaed-c4c416d44303 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:32.892754 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=59 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:32.962686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:32.963322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:32.963606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:32.963885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:32.965812 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:32.982836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:32.984503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:32.998373 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4266/8456] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:34.986703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:34.988824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:35.009068 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f0cd-7608-4ec7-bfba-792a749ee1c9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:35.014644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:35.015336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:35.015683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:35.016028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:35.017890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:35.033109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:35.034744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e70481-8a86-440a-9eaa-b43639f877d6 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:35.048624 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4191/8457] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:39.508851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:39.510295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:39.574499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5217ac7-7762-4b41-b1a0-cceab25ccc0b service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:39.579535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:39.580172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:39.580456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:39.580736 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] PATH_INFO: `/v3/users/e11556658474410ab60d5a44805c77f3` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:39.581890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11556658474410ab60d5a44805c77f3)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:39.583855 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:39.597866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:39.632256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11556658474410ab60d5a44805c77f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:39.644921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11556658474410ab60d5a44805c77f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:39.645580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11556658474410ab60d5a44805c77f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:39.646215 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11556658474410ab60d5a44805c77f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:39.652998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11556658474410ab60d5a44805c77f3'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:39.666648 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4267/8458] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:03:39 2022] DELETE /identity/v3/users/e11556658474410ab60d5a44805c77f3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:39.671375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:39.671875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:39.672484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:39.700879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:03:39.702098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:39.761242 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4192/8459] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:03:39.771448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:39.773022 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:39.834471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d422eb-b5a7-4ecd-af08-9c677b8e977c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:39.838323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:39.838969 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:39.839251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:39.839527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:39.849537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:39.851012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:39.861043 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4268/8460] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:40.031473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.032983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:40.045456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aec1d-a423-4254-ba57-2b802ddc3307 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.050116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.050792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.051076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.051360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] PATH_INFO: `/v3/projects/3d51f138ed63467d9e876d3925317eea` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.052522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d51f138ed63467d9e876d3925317eea)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.054495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.103815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d51f138ed63467d9e876d3925317eea', 'request_id': 'req-8286199b-1a17-4140-b482-46dbd9bc68e0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.109237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d51f138ed63467d9e876d3925317eea', 'request_id': 'req-8286199b-1a17-4140-b482-46dbd9bc68e0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.116544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d51f138ed63467d9e876d3925317eea', 'request_id': 'req-8286199b-1a17-4140-b482-46dbd9bc68e0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.128092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] The token cache is being invalidate because project 3d51f138ed63467d9e876d3925317eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:03:40.128384 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.129008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.130514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4193/8461] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:03:40 2022] DELETE /identity/v3/projects/3d51f138ed63467d9e876d3925317eea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:40.135181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.145539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c6cc-3eb8-4016-a1e4-6e002ed6a7c5 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.201783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.202456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.202738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.203015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] PATH_INFO: `/v3/users/aa728534438c46a2ba197ad594719a3d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.204209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa728534438c46a2ba197ad594719a3d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.206207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.243849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:40.254697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa728534438c46a2ba197ad594719a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.268055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa728534438c46a2ba197ad594719a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.268789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa728534438c46a2ba197ad594719a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.269408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa728534438c46a2ba197ad594719a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.276637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c36ee28f-5363-403c-9c0f-69e4c9391ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa728534438c46a2ba197ad594719a3d'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.292882 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4269/8462] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:03:40 2022] DELETE /identity/v3/users/aa728534438c46a2ba197ad594719a3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:40.471002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.472444 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:40.489128 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286199b-1a17-4140-b482-46dbd9bc68e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.546031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.546708 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.547507 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.547793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] PATH_INFO: `/v3/projects/a7ec48230df74e51aae7c1921f8f745d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.548927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ec48230df74e51aae7c1921f8f745d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.550869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.557138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:40.598323 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ec48230df74e51aae7c1921f8f745d', 'request_id': 'req-617b46a3-1325-48da-a19e-f318007f30fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.603901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ec48230df74e51aae7c1921f8f745d', 'request_id': 'req-617b46a3-1325-48da-a19e-f318007f30fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.611916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ec48230df74e51aae7c1921f8f745d', 'request_id': 'req-617b46a3-1325-48da-a19e-f318007f30fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.623853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] The token cache is being invalidate because project a7ec48230df74e51aae7c1921f8f745d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:03:40.624120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.624761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-617b46a3-1325-48da-a19e-f318007f30fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:03:40.626907 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4194/8463] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:03:40 2022] DELETE /identity/v3/projects/a7ec48230df74e51aae7c1921f8f745d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:40.632052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.632527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.632630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.673815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:03:40.674957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:40.733745 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4270/8464] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:03:40.741887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.742383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.742481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.762958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:03:40.764155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:40.772914 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4195/8465] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:03:40.777445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.788710 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5c637-502d-4a83-a544-87617097f0b3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.793287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.793891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.794200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.794475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.795220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:03:40.795533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.797159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.809793 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4271/8466] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 06:03:40.814977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.824283 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b307373-84d7-4783-8bee-b56a2b2936cd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.829770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.830416 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.830701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.830978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.831617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.833506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.870082 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4196/8467] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:03:40 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:03:40.874490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.885410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339507-1724-469d-b37f-f44062f4745b admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.940943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.941475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.941755 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.942027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.942753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.944666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.965895 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4272/8468] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:03:40 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:03:40.970311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:40.980769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274cfc-e543-48a5-abfb-7860b77e7e45 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:40.985958 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:40.986603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:40.986887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:40.987163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:40.987831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:40.989435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:40.999187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4197/8469] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:03:41.004366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.014896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286adfa6-5ad1-421b-aebc-65fbc79e31db admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.019539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ef928-1f4d-4eb1-9f3f-a36e79ceb96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.020140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ef928-1f4d-4eb1-9f3f-a36e79ceb96c admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.020419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ef928-1f4d-4eb1-9f3f-a36e79ceb96c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.020695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ef928-1f4d-4eb1-9f3f-a36e79ceb96c admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.021331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ef928-1f4d-4eb1-9f3f-a36e79ceb96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.022967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ef928-1f4d-4eb1-9f3f-a36e79ceb96c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.033872 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4273/8470] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:03:41.037946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.048521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecfb4-bb35-4ea8-86f4-8dbc62297c06 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.053037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.053682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.053962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.054284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] PATH_INFO: `/v3/projects/50af30ac005b4b429e25d10f11ed517a/users/5ea9416099fa474b9279490007180741/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.069320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50af30ac005b4b429e25d10f11ed517a, user_id=5ea9416099fa474b9279490007180741, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.071987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.084947 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4198/8471] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:03:41 2022] PUT /identity/v3/projects/50af30ac005b4b429e25d10f11ed517a/users/5ea9416099fa474b9279490007180741/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:41.096140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.096428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.096702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.104747 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:41.127059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] MFA Rules not processed for user `5ea9416099fa474b9279490007180741`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:03:41.128256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:41.193137 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4274/8472] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:03:41.197929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.259277 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b92de-9ffe-4b61-a8d9-d61931f9abb0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.263937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.264560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.264842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.265119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.265774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.267908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.296743 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4199/8473] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:03:41 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:03:41.301204 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.312005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120a69a-ffe1-4aac-97ec-07a4b23682f7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.368208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.368830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.369107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.369380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.370006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.371967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.393458 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4275/8474] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:03:41 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:03:41.397073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.408509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079775-77f1-44b1-adcc-9b0e13ab2ae3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.413222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.413830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.414109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.414417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.415061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.416638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.417874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:41.428861 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4200/8475] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:03:41.432412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.443484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ad50-114e-4346-b18a-d7520c481975 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.448017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.448724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.449015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.449294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] PATH_INFO: `/v3/projects/4d0147eafe6f4712864b1abe7b38e799/users/c44238683fae42dab07e20f0795b0cec/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.463924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0147eafe6f4712864b1abe7b38e799, user_id=c44238683fae42dab07e20f0795b0cec, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.466664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.479963 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4276/8476] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:03:41 2022] PUT /identity/v3/projects/4d0147eafe6f4712864b1abe7b38e799/users/c44238683fae42dab07e20f0795b0cec/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:03:41.484096 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.495180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0562e-3ead-4927-978e-e912bb5c1891 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.551697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031f699-e6d3-400c-b2e5-0468a1eeab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.552309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f699-e6d3-400c-b2e5-0468a1eeab94 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.552600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f699-e6d3-400c-b2e5-0468a1eeab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.552883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f699-e6d3-400c-b2e5-0468a1eeab94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.553524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031f699-e6d3-400c-b2e5-0468a1eeab94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.555147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031f699-e6d3-400c-b2e5-0468a1eeab94 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.564996 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4201/8477] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:03:41.569173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.579751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18106-79bb-42e9-9cbf-c0d5cbc965e4 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.584791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.585446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.585731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.586008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] PATH_INFO: `/v3/projects/4d0147eafe6f4712864b1abe7b38e799/users/c44238683fae42dab07e20f0795b0cec/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.587976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0147eafe6f4712864b1abe7b38e799, user_id=c44238683fae42dab07e20f0795b0cec, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.590665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.601459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4277/8478] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:03:41 2022] PUT /identity/v3/projects/4d0147eafe6f4712864b1abe7b38e799/users/c44238683fae42dab07e20f0795b0cec/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:03:41.613301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.613598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.613882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.642734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] MFA Rules not processed for user `c44238683fae42dab07e20f0795b0cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:03:41.643952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:41.712666 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4202/8479] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:03:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:03:41.724540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:41.726333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:41.779081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:03:41.786359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916ab9b-5e02-407f-86b1-1c1732ece563 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:41.790197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed159ea-864d-418f-800d-93cdc2b5450b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:41.790799 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed159ea-864d-418f-800d-93cdc2b5450b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:41.791084 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed159ea-864d-418f-800d-93cdc2b5450b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:41.791354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed159ea-864d-418f-800d-93cdc2b5450b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:41.847802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed159ea-864d-418f-800d-93cdc2b5450b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:41.849296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed159ea-864d-418f-800d-93cdc2b5450b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:41.858272 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4278/8480] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:43.882480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:43.884175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:43.896690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf7a1-f3fd-4ee0-99b7-5204136d0ceb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:43.900356 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:43.900970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:43.901255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:43.901532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:43.910648 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:43.912088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:43.921816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4203/8481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:48.126435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:48.126928 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:48.127261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:48.147537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] MFA Rules not processed for user `5ea9416099fa474b9279490007180741`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:03:48.148806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:48.155778 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4279/8482] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:03:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:03:50.811969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:50.823737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1064aa-2832-4f9b-839c-8d67b974ff90 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:50.828055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:50.828687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:50.828995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:50.829273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:50.831079 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:50.845970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:50.848917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456d90d-cd99-473e-b1c2-796c1300d069 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:50.861816 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4204/8483] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:03:57.384029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:03:57.385538 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:57.467528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad170726-5ef6-488d-83c8-bad1e9c8f0d3 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:03:57.473171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:03:57.473672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:03:57.473953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:03:57.474254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:03:57.475975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:03:57.491330 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:03:57.493006 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:03:57.506345 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4280/8484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:03:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:04:00.856107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=77 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:04:07.499103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=64 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:05:11.290632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:05:11.291220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:05:11.291220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:05:11.310902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] MFA Rules not processed for user `5ea9416099fa474b9279490007180741`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:05:11.312094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:05:11.319347 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4205/8485] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:05:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:05:11.653546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:05:11.663883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3cde5-d3ee-4d97-8788-b86c6a5b2799 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:05:11.667677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:05:11.668452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:05:11.668742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:05:11.669021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:05:11.670825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:05:11.684193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:05:11.685599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:05:11.697624 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4281/8486] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:05:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:05:13.925204 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:05:13.935739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f01f72-0e66-437b-baba-98f9c5aa8214 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:05:13.939359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:05:13.939981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:05:13.940266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:05:13.940542 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:05:13.943264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:05:13.956307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:05:13.958091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:05:13.970224 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4206/8487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:05:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:05:14.093353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:05:14.094923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:05:14.177966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1267-6fa5-4ac7-acf7-2a9d840070e9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:05:14.183305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:05:14.184062 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:05:14.184344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:05:14.184618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:05:14.186381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:05:14.202356 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:05:14.204092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:05:14.218352 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4282/8488] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:05:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:05:23.965826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:05:24.211431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=38 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:05:55.204047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:05:55.222342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4d46-72cc-475a-b61b-e6fe89195f27 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:05:55.227892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:05:55.228506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:05:55.228792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:05:55.229069 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:05:55.230916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:05:55.245176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:05:55.246803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f40d5-87de-4112-9b47-9be0c774d4dd service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:05:55.267445 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4207/8489] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:05:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:06:00.491245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:06:00.492698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:06:00.509034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37c10a-adf1-4888-8ce1-6cbdbc837bbf service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:06:00.514187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:06:00.514804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:06:00.515088 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:06:00.515368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:06:00.517203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:06:00.532887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:06:00.534550 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:06:00.547938 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4283/8490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:06:05.254723 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:06:09.159835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:06:09.160972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:06:09.161327 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:06:09.183510 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] MFA Rules not processed for user `5ea9416099fa474b9279490007180741`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:06:09.184982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:06:09.193332 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4208/8491] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:06:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:06:09.881293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:06:09.896003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250efb5-cf21-48bf-ad7c-90972347276b service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:06:09.901771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:06:09.902503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:06:09.902783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:06:09.903060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:06:09.904851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:06:09.918813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:06:09.920207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:06:09.936220 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4284/8492] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:06:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:06:19.178470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:06:19.927411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=12 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:06:59.164436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:06:59.175095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3674c-252f-4557-bbe1-78a8880a3a9d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:06:59.178986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:06:59.179603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:06:59.179888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:06:59.180162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:06:59.181868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:06:59.198330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:06:59.200026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ab51-cfcb-4366-9c38-2576319daa49 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:06:59.214557 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4209/8493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:06:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:00.405318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:00.414654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec305-aa82-41fb-a54a-9fcdea0fb425 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:00.418209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:00.418805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:00.419085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:00.419355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:00.421042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:00.437456 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:00.438903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:00.459310 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4285/8494] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:01.234519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:01.235081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:01.235190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:01.266938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:01.268146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:01.276711 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4210/8495] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Oct 31 06:07:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:01.302444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:01.316231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd6fc-40f0-400a-a478-9bc9c35207bf service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:01.321751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb214dde-2531-4ef4-b529-eb5f2e443cfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:01.322379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214dde-2531-4ef4-b529-eb5f2e443cfd service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:01.322663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214dde-2531-4ef4-b529-eb5f2e443cfd service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:01.322939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214dde-2531-4ef4-b529-eb5f2e443cfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:01.331307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214dde-2531-4ef4-b529-eb5f2e443cfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:01.332888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214dde-2531-4ef4-b529-eb5f2e443cfd service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:01.342688 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4286/8496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:05.852902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:05.925485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c502e75-6b50-428b-a81f-6cdd116eda44 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:05.930867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:05.931531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:05.931815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:05.932092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] PATH_INFO: `/v3/users/5ea9416099fa474b9279490007180741` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:05.933250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea9416099fa474b9279490007180741)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:05.935224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:05.983600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea9416099fa474b9279490007180741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:05.990915 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea9416099fa474b9279490007180741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:05.991544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea9416099fa474b9279490007180741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:05.992162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea9416099fa474b9279490007180741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:05.999437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea9416099fa474b9279490007180741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.018756 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4211/8497] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:07:05 2022] DELETE /identity/v3/users/5ea9416099fa474b9279490007180741 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:06.024145 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:06.024614 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:06.024737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:06.046211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:06.047689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:06.116067 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4287/8498] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:06.128745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:06.130742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:06.189123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5013f3-332e-44af-bc67-cbaa650c3c26 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:06.192984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:06.193595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:06.193889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:06.194175 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:06.200023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:06.204449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:06.205887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:06.216956 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4212/8499] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:06.383605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:06.385428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:06.398222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec38e2-1a83-4572-abb2-520761a7af71 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:06.402985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:06.403626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:06.403907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:06.404186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] PATH_INFO: `/v3/projects/50af30ac005b4b429e25d10f11ed517a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:06.405310 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50af30ac005b4b429e25d10f11ed517a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:06.407258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:06.460230 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50af30ac005b4b429e25d10f11ed517a', 'request_id': 'req-183231d3-3e2f-4d6d-bacc-ae895f6a3885'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.466819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50af30ac005b4b429e25d10f11ed517a', 'request_id': 'req-183231d3-3e2f-4d6d-bacc-ae895f6a3885'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.476559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50af30ac005b4b429e25d10f11ed517a', 'request_id': 'req-183231d3-3e2f-4d6d-bacc-ae895f6a3885'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.489017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] The token cache is being invalidate because project 50af30ac005b4b429e25d10f11ed517a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:07:06.489482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.490119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.491697 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4288/8500] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:07:06 2022] DELETE /identity/v3/projects/50af30ac005b4b429e25d10f11ed517a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:06.495774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:06.505855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba10f9-d09b-4ef0-a542-649a23e4a8ae service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:06.561624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:06.562307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:06.562591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:06.562868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] PATH_INFO: `/v3/users/c44238683fae42dab07e20f0795b0cec` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:06.563979 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44238683fae42dab07e20f0795b0cec)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:06.566026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:06.612133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44238683fae42dab07e20f0795b0cec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.619605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44238683fae42dab07e20f0795b0cec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.620219 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44238683fae42dab07e20f0795b0cec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.620821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44238683fae42dab07e20f0795b0cec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.628061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-56bef712-306b-41b9-ae2b-5b4c2efc7846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44238683fae42dab07e20f0795b0cec'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:06.646265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4213/8501] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:07:06 2022] DELETE /identity/v3/users/c44238683fae42dab07e20f0795b0cec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:06.926066 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:06.929464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:06.946018 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183231d3-3e2f-4d6d-bacc-ae895f6a3885 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:07.001818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:07.014323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:07.015119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:07.015488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:07.015822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] PATH_INFO: `/v3/projects/4d0147eafe6f4712864b1abe7b38e799` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:07.016970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0147eafe6f4712864b1abe7b38e799)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:07.018998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:07.065634 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0147eafe6f4712864b1abe7b38e799', 'request_id': 'req-fb426e26-2ee5-4f19-8391-07be3fa68a03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:07.072211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0147eafe6f4712864b1abe7b38e799', 'request_id': 'req-fb426e26-2ee5-4f19-8391-07be3fa68a03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:07.077789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0147eafe6f4712864b1abe7b38e799', 'request_id': 'req-fb426e26-2ee5-4f19-8391-07be3fa68a03'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:07.090743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] The token cache is being invalidate because project 4d0147eafe6f4712864b1abe7b38e799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:07:07.091047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:07.091663 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fb426e26-2ee5-4f19-8391-07be3fa68a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:07.093138 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4289/8502] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:07:06 2022] DELETE /identity/v3/projects/4d0147eafe6f4712864b1abe7b38e799 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:15.079535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:15.080446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:15.081075 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:15.103081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:15.104281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:15.169083 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4214/8503] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 06:07:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:15.181847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8a9c-35fb-4a25-809f-d712bc3e76ad None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:15.182346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8a9c-35fb-4a25-809f-d712bc3e76ad None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:15.182437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8a9c-35fb-4a25-809f-d712bc3e76ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:15.202434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a72e8a9c-35fb-4a25-809f-d712bc3e76ad None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:15.203636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a72e8a9c-35fb-4a25-809f-d712bc3e76ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:15.212264 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4290/8504] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 06:07:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:15.218359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:15.229427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0876eb-eba7-4ce5-97cf-506db070fc88 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:15.234600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a1b7-4ad1-433f-8bec-06b3cbeb46ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:15.235220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a1b7-4ad1-433f-8bec-06b3cbeb46ff service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:15.235503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a1b7-4ad1-433f-8bec-06b3cbeb46ff service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:15.235778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a1b7-4ad1-433f-8bec-06b3cbeb46ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:15.242798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:15.245303 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a1b7-4ad1-433f-8bec-06b3cbeb46ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:15.247035 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a1b7-4ad1-433f-8bec-06b3cbeb46ff service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:15.261946 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4215/8505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:16.518531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.519068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.519068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.539262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:16.540455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:16.598702 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4291/8506] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:16.609285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.609798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.609798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.629555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:16.631310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:16.639724 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4216/8507] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:16.644496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:16.654684 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70097a20-09f0-457f-a1c6-b36cbcd97aa4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:16.659344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:16.659989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.660276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.660555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.661206 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:07:16.661515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:16.663879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:16.679778 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4292/8508] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 06:07:16.692685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:16.703635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6925ed-1cc9-4092-9fc9-0f9d899ead0e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:16.708272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:16.709390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.709673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.709946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.710628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:16.712508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:16.742795 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4217/8509] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:07:16 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:07:16.747148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:16.758046 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462831e3-7d7c-4959-803c-5304b79f9cde admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:16.816865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:16.817490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.817776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.818734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.819389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:16.821346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:16.837657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:16.846569 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4293/8510] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:07:16 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:07:16.848574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:16.859967 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba778-c52f-4db8-9cdb-8320601e6131 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:16.864672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:16.865870 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.866171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.866568 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.867241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:16.868831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:16.882565 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4218/8511] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 06:07:16.887932 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:16.899749 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8eba7-fca4-4d37-83a3-311251222978 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:16.904494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbe101-d524-4770-a718-48bec1c47fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:16.905110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbe101-d524-4770-a718-48bec1c47fba admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.905397 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbe101-d524-4770-a718-48bec1c47fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.905676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbe101-d524-4770-a718-48bec1c47fba admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.906358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbe101-d524-4770-a718-48bec1c47fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:16.907973 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbe101-d524-4770-a718-48bec1c47fba admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:16.919530 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4294/8512] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:07:16.923823 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:16.934758 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0fa2-3ef8-4984-bf7c-457858ea6981 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:16.939520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:16.940181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.940461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.940735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] PATH_INFO: `/v3/projects/00610c2dd1464f7c9e3a63d253513c8c/users/8f18f28c07384181883a844580fb8b98/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:16.955613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00610c2dd1464f7c9e3a63d253513c8c, user_id=8f18f28c07384181883a844580fb8b98, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:16.958275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:16.974191 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4219/8513] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:07:16 2022] PUT /identity/v3/projects/00610c2dd1464f7c9e3a63d253513c8c/users/8f18f28c07384181883a844580fb8b98/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:16.985918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:16.986251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:16.986532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.016534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] MFA Rules not processed for user `8f18f28c07384181883a844580fb8b98`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:17.017737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:17.084921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4295/8514] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:17.089449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.154601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dc007-2ab6-4a6a-9c91-7b9661c40563 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.159363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.159987 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.160272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.160552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.161205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.163292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.190006 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4220/8515] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:07:17 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:07:17.194265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.205137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea21d4-893f-4424-be55-7418f266ca1d None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.262412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.263055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.263339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.263616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.264288 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.266281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.290846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4296/8516] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:07:17 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:07:17.292580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.303027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd8ae3-fb2c-4139-bb6b-b533b403462e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.307647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.308253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.308534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.308809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.309451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.311084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.322098 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4221/8517] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 06:07:17.326322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.337389 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aab14-5540-4c8f-a03c-0ab4731cfc55 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.341949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.342631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.342910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.343183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] PATH_INFO: `/v3/projects/e50ae8934026453799230f0d835f534d/users/d08a28dd92de4e55b180713ded9ca5fb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.359306 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50ae8934026453799230f0d835f534d, user_id=d08a28dd92de4e55b180713ded9ca5fb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.361978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.375306 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4297/8518] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:07:17 2022] PUT /identity/v3/projects/e50ae8934026453799230f0d835f534d/users/d08a28dd92de4e55b180713ded9ca5fb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:17.379298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.389827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b22ad-d161-4e9c-9e20-846cefacc024 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.446031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7581-fab3-4100-adf6-511fe83aa013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.446668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7581-fab3-4100-adf6-511fe83aa013 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.446949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7581-fab3-4100-adf6-511fe83aa013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.447221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7581-fab3-4100-adf6-511fe83aa013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.447854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed7581-fab3-4100-adf6-511fe83aa013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.449429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed7581-fab3-4100-adf6-511fe83aa013 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.459080 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4222/8519] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:07:17.463346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.473667 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738be32-98f9-40a7-bf6f-cf12abae484a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.479042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05185d-1058-4542-b51d-1367142ae458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.479695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05185d-1058-4542-b51d-1367142ae458 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.479977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05185d-1058-4542-b51d-1367142ae458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.480255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05185d-1058-4542-b51d-1367142ae458 admin admin] PATH_INFO: `/v3/projects/e50ae8934026453799230f0d835f534d/users/d08a28dd92de4e55b180713ded9ca5fb/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.482190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05185d-1058-4542-b51d-1367142ae458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50ae8934026453799230f0d835f534d, user_id=d08a28dd92de4e55b180713ded9ca5fb, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.484824 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05185d-1058-4542-b51d-1367142ae458 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.495313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4298/8520] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:07:17 2022] PUT /identity/v3/projects/e50ae8934026453799230f0d835f534d/users/d08a28dd92de4e55b180713ded9ca5fb/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:17.506709 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.506996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.507264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.514610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:17.537335 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] MFA Rules not processed for user `d08a28dd92de4e55b180713ded9ca5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:17.538589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:17.607355 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4223/8521] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:17.621205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.621696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.621810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.642490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] MFA Rules not processed for user `8f18f28c07384181883a844580fb8b98`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:17.643746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:17.667466 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:17.700378 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4299/8522] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:17.713945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:17.715443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:17.791857 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3678a8-a8fb-4349-b6f2-686d8825edbc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:17.797357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:17.797963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:17.798274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:17.798553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:17.806859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:17.808428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:17.817171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4224/8523] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:18.195049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:18.264768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234012a-9f70-46ed-9f58-33d17df26749 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:18.269789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:18.270434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:18.270717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:18.271093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:18.272949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:18.284160 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:18.285778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a831423-cfc7-49f5-a4a0-620924163440 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:18.296438 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4300/8524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:27.813259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=67 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:28.292064 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=44 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:30.091177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:30.104626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505a3f-25f9-4c17-b9fe-0e6ac1e41763 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:30.110046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:30.110675 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:30.110955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:30.111258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:30.119778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:30.121329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:30.131966 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4225/8525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:30.147236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82ed8-fdac-4396-bc56-29902e385c40 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:30.147664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82ed8-fdac-4396-bc56-29902e385c40 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:30.147767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82ed8-fdac-4396-bc56-29902e385c40 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:30.149124 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4301/8526] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 06:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 06:07:30.153387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 06:07:30.166930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:30.175164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb3dd-3a69-486c-af3e-7f01c15f53bb service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:30.180461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd08a28dd92de4e55b180713ded9ca5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50ae8934026453799230f0d835f534d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:30.181074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:30.181358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:30.181637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] PATH_INFO: `/v3/projects/e50ae8934026453799230f0d835f534d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:30.182778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] RBAC: Authorizing `identity:get_project(project_id=e50ae8934026453799230f0d835f534d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:30.184525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:30.186106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4226/8527] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 06:07:30 2022] GET /identity/v3/projects/e50ae8934026453799230f0d835f534d => generated 391 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:07:30.497157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae7ece-af83-4b59-9e7f-3faaab7f6a94 None None] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:30.497440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae7ece-af83-4b59-9e7f-3faaab7f6a94 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:30.497715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae7ece-af83-4b59-9e7f-3faaab7f6a94 None None] PATH_INFO: `/` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:30.499153 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4302/8528] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 06:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 06:07:30.504082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] Authenticating service token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 06:07:30.506042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:30.525421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:30.534002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3ecd-4e01-4cac-a039-84801040f04d tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:30.540071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd08a28dd92de4e55b180713ded9ca5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50ae8934026453799230f0d835f534d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:30.540695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:30.541109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:30.541387 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] PATH_INFO: `/v3/projects/e50ae8934026453799230f0d835f534d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:30.542573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] RBAC: Authorizing `identity:get_project(project_id=e50ae8934026453799230f0d835f534d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:30.544358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:30.545967 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4227/8529] 10.222.0.23 () {58 vars in 1443 bytes} [Mon Oct 31 06:07:30 2022] GET /identity/v3/projects/e50ae8934026453799230f0d835f534d => generated 391 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:07:30.707513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae7ece-af83-4b59-9e7f-3faaab7f6a94 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:30.709175 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-49ae7ece-af83-4b59-9e7f-3faaab7f6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:30.772788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae7ece-af83-4b59-9e7f-3faaab7f6a94 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:30.776409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:30.777026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:30.777311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:30.777590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:30.779320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:30.791748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:30.793185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce6267-f3f1-4883-8d3c-0b9198caaabe service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:30.803798 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4303/8530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:34.602734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:34.666886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd660e0-3e67-44ff-8fc8-253c5526d285 tempest-ServersAdminNegativeTestJSON-480395544 tempest-ServersAdminNegativeTestJSON-480395544-project-admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:34.671466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:34.672112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:34.672422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:34.672698 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] PATH_INFO: `/v3/users/8f18f28c07384181883a844580fb8b98` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:34.673834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f18f28c07384181883a844580fb8b98)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:34.675790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:34.722041 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f18f28c07384181883a844580fb8b98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:34.729375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f18f28c07384181883a844580fb8b98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:34.729996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f18f28c07384181883a844580fb8b98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:34.730631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f18f28c07384181883a844580fb8b98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:34.737664 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f18f28c07384181883a844580fb8b98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:34.757260 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4228/8531] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:07:34 2022] DELETE /identity/v3/users/8f18f28c07384181883a844580fb8b98 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:34.762093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c605-7085-4631-a967-21378464d849 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:34.762591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c605-7085-4631-a967-21378464d849 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:34.762699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c605-7085-4631-a967-21378464d849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:34.781602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8f17c605-7085-4631-a967-21378464d849 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:34.782854 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8f17c605-7085-4631-a967-21378464d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:34.841061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4304/8532] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:34.851739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:34.853125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:34.908135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:34.912274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bd573-53f6-4ce5-bd50-c88acda121f0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:34.917727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:34.918552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:34.919009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:34.919436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:34.928950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:34.931458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:34.940193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4229/8533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:35.111173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c605-7085-4631-a967-21378464d849 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:35.112616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8f17c605-7085-4631-a967-21378464d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:35.124569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c605-7085-4631-a967-21378464d849 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:35.129220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:35.129878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.130176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.130465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] PATH_INFO: `/v3/projects/00610c2dd1464f7c9e3a63d253513c8c` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.132468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00610c2dd1464f7c9e3a63d253513c8c)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:35.134697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:35.183324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00610c2dd1464f7c9e3a63d253513c8c', 'request_id': 'req-07b1ee07-23b0-4767-985f-bcbfbe617948'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.190255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00610c2dd1464f7c9e3a63d253513c8c', 'request_id': 'req-07b1ee07-23b0-4767-985f-bcbfbe617948'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.197098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00610c2dd1464f7c9e3a63d253513c8c', 'request_id': 'req-07b1ee07-23b0-4767-985f-bcbfbe617948'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.209445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] The token cache is being invalidate because project 00610c2dd1464f7c9e3a63d253513c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:07:35.210001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.210671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.212160 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4305/8534] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:07:35 2022] DELETE /identity/v3/projects/00610c2dd1464f7c9e3a63d253513c8c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:35.216220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:35.225894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd50cc2-c74e-4139-9d65-13a02509e84b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:35.285164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:35.285807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.286093 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.286400 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] PATH_INFO: `/v3/users/d08a28dd92de4e55b180713ded9ca5fb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.287628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08a28dd92de4e55b180713ded9ca5fb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:35.289481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:35.337534 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08a28dd92de4e55b180713ded9ca5fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.345415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08a28dd92de4e55b180713ded9ca5fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.346098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08a28dd92de4e55b180713ded9ca5fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.346847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08a28dd92de4e55b180713ded9ca5fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.354818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d89eb747-f56e-4961-a986-8fcc87319d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08a28dd92de4e55b180713ded9ca5fb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.372237 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4230/8535] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:07:35 2022] DELETE /identity/v3/users/d08a28dd92de4e55b180713ded9ca5fb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:07:35.640422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:35.641974 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:35.663689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ee07-23b0-4767-985f-bcbfbe617948 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:35.688363 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:35.723387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:35.724025 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.724305 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.724577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] PATH_INFO: `/v3/projects/e50ae8934026453799230f0d835f534d` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.726183 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50ae8934026453799230f0d835f534d)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:35.728076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:35.776380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50ae8934026453799230f0d835f534d', 'request_id': 'req-a006003f-293a-43e0-a697-4c05b6391bd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.782376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50ae8934026453799230f0d835f534d', 'request_id': 'req-a006003f-293a-43e0-a697-4c05b6391bd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.788452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50ae8934026453799230f0d835f534d', 'request_id': 'req-a006003f-293a-43e0-a697-4c05b6391bd0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.800492 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] The token cache is being invalidate because project e50ae8934026453799230f0d835f534d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:07:35.800779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.801399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-a006003f-293a-43e0-a697-4c05b6391bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:07:35.803047 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4306/8536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:07:35 2022] DELETE /identity/v3/projects/e50ae8934026453799230f0d835f534d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:07:35.808898 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.809410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.809508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.829326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:35.830563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:35.889476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4231/8537] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:35.899255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.899540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.899818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.919678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:35.920867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:35.929052 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4307/8538] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:35.933448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:35.943105 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41eb67-abe8-4827-b5c3-16b33e454889 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:35.948289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:35.948890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.949172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.949454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.950102 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:07:35.950436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:35.952029 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:35.958721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:35.968389 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4232/8539] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 06:07:35.969464 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:35.978856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2e92-e3b5-4d6b-9cd6-d2f6696042ca None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:35.983475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:35.984071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:35.984352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:35.984629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:35.985263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:35.987218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:36.015016 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4308/8540] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:07:35 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:07:36.019167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:36.029059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aaa85-04f9-4b77-93a4-8574d4f73a57 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:36.086271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:36.086872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:36.087154 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:36.087429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:36.088085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:36.089985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:36.110587 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4233/8541] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:07:36 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:07:36.114697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:36.125477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39145-98a1-40e4-8d09-82cf0885a170 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:36.130019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:36.130651 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:36.130934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:36.131763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:36.132362 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:36.133963 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:36.144138 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4309/8542] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:07:36.148191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:36.158095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e675b82-a366-46f3-8e80-8e2faebfbbf5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:36.162904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ca2c9-7920-4fc5-b586-d7e23870c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:36.163506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ca2c9-7920-4fc5-b586-d7e23870c510 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:36.163789 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ca2c9-7920-4fc5-b586-d7e23870c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:36.164066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ca2c9-7920-4fc5-b586-d7e23870c510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:36.164705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ca2c9-7920-4fc5-b586-d7e23870c510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:36.166365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ca2c9-7920-4fc5-b586-d7e23870c510 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:36.177682 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4234/8543] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:07:36.182418 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:36.192477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2ff20-29e3-4c77-a276-869cf6221ade admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:36.197898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:36.198585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:36.198867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:36.199144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] PATH_INFO: `/v3/projects/13b07db7e36f4e3d853dd9666a0a6b27/users/2434176a57b14c44b3643d8be5464017/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:36.213416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b07db7e36f4e3d853dd9666a0a6b27, user_id=2434176a57b14c44b3643d8be5464017, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:36.216148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:36.228651 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4310/8544] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:07:36 2022] PUT /identity/v3/projects/13b07db7e36f4e3d853dd9666a0a6b27/users/2434176a57b14c44b3643d8be5464017/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:07:36.233813 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c159f8-e020-4317-9e0f-afad84c464f4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:36.234112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c159f8-e020-4317-9e0f-afad84c464f4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:36.234429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c159f8-e020-4317-9e0f-afad84c464f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:36.253638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e0c159f8-e020-4317-9e0f-afad84c464f4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:36.254876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0c159f8-e020-4317-9e0f-afad84c464f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:36.317501 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4235/8545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:36.327931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:36.329613 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:36.386875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b915220-2704-4c6c-8514-bf30d62e0fa6 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:36.390557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6badf-a277-45ea-a8cc-734db639bed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:36.391168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6badf-a277-45ea-a8cc-734db639bed1 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:36.391450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6badf-a277-45ea-a8cc-734db639bed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:36.391730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6badf-a277-45ea-a8cc-734db639bed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:36.399392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:36.401673 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6badf-a277-45ea-a8cc-734db639bed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:36.403616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6badf-a277-45ea-a8cc-734db639bed1 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:36.415019 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4311/8546] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:40.173512 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:40.174011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:40.174090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:40.205574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] MFA Rules not processed for user `2434176a57b14c44b3643d8be5464017`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:40.207049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:40.282369 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4236/8547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:40.294706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:40.295535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:40.295818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:40.315864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] MFA Rules not processed for user `2434176a57b14c44b3643d8be5464017`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:40.317102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:40.325009 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4312/8548] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:40.338076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:40.339538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:40.349352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:40.424946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64236784-b410-4d7b-8f68-c488efef6318 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:40.431311 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a74c-fe94-4c9d-b031-76a07fb317ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:40.431938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a74c-fe94-4c9d-b031-76a07fb317ee service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:40.432217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a74c-fe94-4c9d-b031-76a07fb317ee service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:40.432492 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a74c-fe94-4c9d-b031-76a07fb317ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:40.441169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a74c-fe94-4c9d-b031-76a07fb317ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:40.442800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a74c-fe94-4c9d-b031-76a07fb317ee service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:40.452650 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4237/8549] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:50.309944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:50.448363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=31 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:07:52.083295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:52.093888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73224c0-ca5d-489e-8c71-7d3f5358858b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:52.097643 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:52.098318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:52.098600 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:52.098875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:52.101897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:52.114826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:52.116909 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:52.128136 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4313/8550] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:07:52.222721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:52.223187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:52.223286 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:52.243727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:07:52.244928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:52.308550 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4238/8551] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 06:07:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:07:52.314526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:52.326671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a3346-a4ce-4b74-975d-849e11996347 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:52.331726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:52.332326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:52.332611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:52.332887 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:52.334659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:52.345929 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:52.347554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:52.357870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4314/8552] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:07:52.534596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:07:52.536097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:52.547458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e907e6-f152-42f0-a948-a483fbc8422d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:07:52.550931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:07:52.551536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:07:52.551819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:07:52.552092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:07:52.554427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:07:52.570184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:07:52.571625 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:07:52.586217 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4239/8553] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:07:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:08:02.353704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=12 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:02.578081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=35 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:32.836355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:32.847994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11f9e2-3614-4a82-a5b3-b5c8e052b5f3 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:32.853213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:32.853849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:32.854130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:32.854605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] PATH_INFO: `/v3/users/2434176a57b14c44b3643d8be5464017` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:32.856044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2434176a57b14c44b3643d8be5464017)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:32.858009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:32.907474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2434176a57b14c44b3643d8be5464017'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:32.919903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2434176a57b14c44b3643d8be5464017'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:32.920607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2434176a57b14c44b3643d8be5464017'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:32.921209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2434176a57b14c44b3643d8be5464017'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:32.929436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f079c77c-d664-4767-bf1e-f7dae113b209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2434176a57b14c44b3643d8be5464017'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:32.944087 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4315/8554] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:08:32 2022] DELETE /identity/v3/users/2434176a57b14c44b3643d8be5464017 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:08:33.122034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.137358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d4ab-a5cf-4437-b10d-af17d306611b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.196583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.197135 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.197413 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.197685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] PATH_INFO: `/v3/projects/13b07db7e36f4e3d853dd9666a0a6b27` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.198812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b07db7e36f4e3d853dd9666a0a6b27)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.200691 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.246223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b07db7e36f4e3d853dd9666a0a6b27', 'request_id': 'req-ca538644-32c5-4857-9b7d-6197d9b6f6af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:33.251672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b07db7e36f4e3d853dd9666a0a6b27', 'request_id': 'req-ca538644-32c5-4857-9b7d-6197d9b6f6af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:33.261426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b07db7e36f4e3d853dd9666a0a6b27', 'request_id': 'req-ca538644-32c5-4857-9b7d-6197d9b6f6af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:33.273509 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] The token cache is being invalidate because project 13b07db7e36f4e3d853dd9666a0a6b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:08:33.273799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:33.274463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ca538644-32c5-4857-9b7d-6197d9b6f6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:08:33.275942 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4240/8555] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:08:33 2022] DELETE /identity/v3/projects/13b07db7e36f4e3d853dd9666a0a6b27 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:08:33.280926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.281214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.281519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.302191 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:08:33.303556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:33.362435 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4316/8556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:08:33.371169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.371456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.371732 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.393055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:08:33.394312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:33.403281 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4241/8557] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:08:33.407546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.417488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410fe22-ab36-4aa1-bb9f-e30ad7e44944 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.422339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.422960 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.423245 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.423526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.424184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:08:33.424489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.426743 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.439571 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4317/8558] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:08:33.444284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.453883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bccd64-5046-4bc3-a7b9-f954f943ed94 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.460209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.460842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.461121 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.461395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.462046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.463974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.491358 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4242/8559] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:08:33 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:08:33.495582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.506276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a149c-2b18-475c-9e1d-fe3770b20e7a admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.562086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.562721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.563003 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.563275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.563900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.565863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.573914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:33.588252 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4318/8560] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:08:33 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:08:33.592360 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.603133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8d0c2-7af2-47de-864e-8abe18141480 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.607740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.608343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.608627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.608901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.609544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.611166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.621682 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4243/8561] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:08:33.625649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.636427 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a068b-529d-4fee-9f15-d533747290fb admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.640982 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affe56d-d86b-4cdd-bc9a-03b5ca16f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.641576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe56d-d86b-4cdd-bc9a-03b5ca16f472 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.641853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe56d-d86b-4cdd-bc9a-03b5ca16f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.642124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe56d-d86b-4cdd-bc9a-03b5ca16f472 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.642786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affe56d-d86b-4cdd-bc9a-03b5ca16f472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.644373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affe56d-d86b-4cdd-bc9a-03b5ca16f472 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.656315 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4319/8562] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:08:33.660589 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.671309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0146d-4c01-4d2c-bc09-31c641828003 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.676197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.677483 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.677778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.678058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] PATH_INFO: `/v3/projects/c4b0ee833f57459c840cca9d5366e563/users/4f13d9a49cb14407aeb45bc34b3777b7/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.692569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b0ee833f57459c840cca9d5366e563, user_id=4f13d9a49cb14407aeb45bc34b3777b7, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.695349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.707817 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4244/8563] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:08:33 2022] PUT /identity/v3/projects/c4b0ee833f57459c840cca9d5366e563/users/4f13d9a49cb14407aeb45bc34b3777b7/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:08:33.713605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68fa6b-7d29-45ca-93c4-d7810e3f1660 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.713923 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68fa6b-7d29-45ca-93c4-d7810e3f1660 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.714265 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68fa6b-7d29-45ca-93c4-d7810e3f1660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.733549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6d68fa6b-7d29-45ca-93c4-d7810e3f1660 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:08:33.734785 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6d68fa6b-7d29-45ca-93c4-d7810e3f1660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:33.794634 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4320/8564] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:08:33.804725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:33.806447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:33.837791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:33.868305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994ad0-12e8-4729-bc47-7e537ea41d1e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:33.871990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8644f-90bc-430d-ace6-63f703d1b725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:33.872616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8644f-90bc-430d-ace6-63f703d1b725 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:33.872901 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8644f-90bc-430d-ace6-63f703d1b725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:33.873189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8644f-90bc-430d-ace6-63f703d1b725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:33.882272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8644f-90bc-430d-ace6-63f703d1b725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:33.883707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8644f-90bc-430d-ace6-63f703d1b725 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:33.893413 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4245/8565] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:08:37.870235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:37.870713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:37.870808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:37.921873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] MFA Rules not processed for user `4f13d9a49cb14407aeb45bc34b3777b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:08:37.923172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:38.003811 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4321/8566] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:08:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:08:38.015066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:38.015622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:38.015622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:38.037163 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] MFA Rules not processed for user `4f13d9a49cb14407aeb45bc34b3777b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:08:38.038440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:38.045495 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4246/8567] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:08:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:08:38.057598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:38.059075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:38.141737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f13d-cba2-48fe-9e28-ad7635fd1a65 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:38.149266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:38.149910 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:38.150236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:38.150513 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:38.155601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:38.160885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:38.163348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:38.173436 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4322/8568] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:08:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:08:41.482220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:41.502631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b63f2-d0ac-4dda-ab0d-63d7c23df2b1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:41.510316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:41.511192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:41.511626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:41.512241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:41.514268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:41.531639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:41.533814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c5afd-7181-4925-ae98-61118c77f59f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:41.548835 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4247/8569] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:08:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:08:48.168830 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:51.540716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=23 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:08:52.627328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:08:52.628827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:52.651208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75bc1d-8728-45fb-a950-96b6f8e59272 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:08:52.655563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:08:52.656186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:08:52.656470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:08:52.656750 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:08:52.658577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:08:52.671899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:08:52.673346 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3542-2431-4ce2-9d06-916bc56b751a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:08:52.684802 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4323/8570] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:08:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:09:02.678528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=10 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:09:14.933152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:14.933724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:14.933724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:14.972248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:14.973450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:14.982797 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4248/8571] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 06:09:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:09:15.041050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae328b-4e67-474b-8e0c-986b698238b5 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:15.041523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae328b-4e67-474b-8e0c-986b698238b5 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:15.041628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae328b-4e67-474b-8e0c-986b698238b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:15.060937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8dae328b-4e67-474b-8e0c-986b698238b5 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:15.062164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8dae328b-4e67-474b-8e0c-986b698238b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:15.072182 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4324/8572] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:09:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:09:15.082775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:09:15.092638 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a08118-23a7-4adb-b1ef-54a7bf329cfa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:09:15.096251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b308-e6b9-454a-8634-13889615521f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:09:15.096850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b308-e6b9-454a-8634-13889615521f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:15.097130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b308-e6b9-454a-8634-13889615521f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:15.097404 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b308-e6b9-454a-8634-13889615521f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:15.108120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b308-e6b9-454a-8634-13889615521f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:09:15.109550 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b308-e6b9-454a-8634-13889615521f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:09:15.121708 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4249/8573] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:09:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:09:16.250721 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:16.251279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:16.251431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:16.274135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:16.275354 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:16.284655 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4325/8574] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 06:09:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:09:20.987611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:20.988172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:20.988172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:21.020050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:21.022980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:21.078270 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4250/8575] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:09:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:09:21.089583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:09:21.112172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a2be5-f9bf-4d64-a025-e5afef97124b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:09:21.116822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:09:21.117244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:09:21.117612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:21.117964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:21.118341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:21.131291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5fab7-93b4-4fb0-bb96-5b7ac73acd66 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:09:21.137588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:09:21.138089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:09:21.138244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:21.138526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:21.138806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:21.139633 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:09:21.140620 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:21.155539 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4326/8576] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:09:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:09:21.156762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:09:21.158553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bfdbb-2596-4a50-963f-786176adbe09 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:09:21.174576 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4251/8577] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:09:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:09:26.022940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:09:26.035476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c33e9-b543-494a-b543-a679d82a5f38 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:09:26.042111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:09:26.042752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:26.043035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:26.043311 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:26.045072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:26.059968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:09:26.061567 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99365bc-2934-460c-95b7-21731669ec8c service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:09:26.075133 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4327/8578] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:09:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:09:28.177126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:28.177792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:28.178086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:28.197187 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] MFA Rules not processed for user `4f13d9a49cb14407aeb45bc34b3777b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:28.198421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:28.205221 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4252/8579] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:09:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:09:30.996521 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6de2e-14e9-4cd6-ac5b-f52f3664d6ae None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:30.997060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6de2e-14e9-4cd6-ac5b-f52f3664d6ae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:30.997155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6de2e-14e9-4cd6-ac5b-f52f3664d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:31.040366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-89b6de2e-14e9-4cd6-ac5b-f52f3664d6ae None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:31.041626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-89b6de2e-14e9-4cd6-ac5b-f52f3664d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:31.048323 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4328/8580] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Oct 31 06:09:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:09:31.064215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:09:31.075174 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268b3b-aad7-4e62-8073-a6334d4b4d81 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:09:31.078996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:09:31.079622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:31.079908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:31.080186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:31.088188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:09:31.089603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:09:31.097327 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4253/8581] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:09:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:09:32.147028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e255-4e61-4544-bab8-c86158afb8f1 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:32.147566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e255-4e61-4544-bab8-c86158afb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:32.147566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e255-4e61-4544-bab8-c86158afb8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:32.168443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6a76e255-4e61-4544-bab8-c86158afb8f1 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:09:32.169564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6a76e255-4e61-4544-bab8-c86158afb8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:09:32.179285 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4329/8582] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:09:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:09:32.218209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:09:32.231251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416c17-c509-4164-bce4-526e8e864387 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:09:32.236639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:09:32.237242 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:09:32.237520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:09:32.237793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:09:32.247894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:09:32.249671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:09:32.261828 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4254/8583] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:09:42.162642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=35 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:09:42.255717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=61 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:10:09.023999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5577e-14e3-4114-b0fe-fa311ec7552e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:09.024596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5577e-14e3-4114-b0fe-fa311ec7552e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:09.024596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5577e-14e3-4114-b0fe-fa311ec7552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:09.043676 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-d1c5577e-14e3-4114-b0fe-fa311ec7552e None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:09.044874 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d1c5577e-14e3-4114-b0fe-fa311ec7552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:09.051333 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4330/8584] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 06:10:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:09.064380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:09.074290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ab08-30e7-484c-a551-a65e5823ad34 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:09.077938 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:09.078573 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:09.078876 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:09.079136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:09.086811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:09.088222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:09.095908 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4255/8585] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:10:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:10:09.494838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069d3b-74a2-4497-b95e-61e8aa024808 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:09.495042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069d3b-74a2-4497-b95e-61e8aa024808 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:09.495328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069d3b-74a2-4497-b95e-61e8aa024808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:09.518657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-36069d3b-74a2-4497-b95e-61e8aa024808 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:09.519883 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-36069d3b-74a2-4497-b95e-61e8aa024808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:09.530756 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4331/8586] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:10:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:09.570693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:09.583982 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5565a3-289a-4f92-96c0-667d036e2074 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:09.589617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:09.590394 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:09.590681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:09.590960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:09.600871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:09.602481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:09.613198 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4256/8587] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:10:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:10:16.954493 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:16.955027 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:16.955133 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:16.979690 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:16.981177 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:16.991314 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4332/8588] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:10:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:17.007787 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:17.019574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899c2c0-35cc-4597-996e-8c67756ef2a6 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:17.025934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:17.026610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:17.026895 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:17.027171 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:17.036433 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:17.037993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:17.048487 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4257/8589] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:10:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:10:24.191941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:24.211999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f196c2-64dd-409e-bb30-7767a15baa61 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:24.216795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:24.217479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.217764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.218044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] PATH_INFO: `/v3/users/4f13d9a49cb14407aeb45bc34b3777b7` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.219278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f13d9a49cb14407aeb45bc34b3777b7)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:24.221226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:24.276738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f13d9a49cb14407aeb45bc34b3777b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.294906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f13d9a49cb14407aeb45bc34b3777b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.295646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f13d9a49cb14407aeb45bc34b3777b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.296250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f13d9a49cb14407aeb45bc34b3777b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.303294 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-256d972e-7136-4fb2-aba8-48312d27ee17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f13d9a49cb14407aeb45bc34b3777b7'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.316623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4333/8590] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:10:24 2022] DELETE /identity/v3/users/4f13d9a49cb14407aeb45bc34b3777b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:10:24.493357 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:24.505147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cc795-828f-4326-8e67-981fc64e5613 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:24.563523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:24.564092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.564370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.564640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] PATH_INFO: `/v3/projects/c4b0ee833f57459c840cca9d5366e563` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.565737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b0ee833f57459c840cca9d5366e563)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:24.567652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:24.615406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b0ee833f57459c840cca9d5366e563', 'request_id': 'req-f284cb22-0eca-475c-9f48-13cc8aa83491'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.621004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b0ee833f57459c840cca9d5366e563', 'request_id': 'req-f284cb22-0eca-475c-9f48-13cc8aa83491'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.628517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b0ee833f57459c840cca9d5366e563', 'request_id': 'req-f284cb22-0eca-475c-9f48-13cc8aa83491'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.640604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] The token cache is being invalidate because project c4b0ee833f57459c840cca9d5366e563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:10:24.640897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.641533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f284cb22-0eca-475c-9f48-13cc8aa83491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:10:24.643055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4258/8591] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:10:24 2022] DELETE /identity/v3/projects/c4b0ee833f57459c840cca9d5366e563 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:10:24.648687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.648970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.649242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.671085 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:24.672308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:24.731838 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4334/8592] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:10:24.739835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.740061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.740339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.761016 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:24.762237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:24.769981 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4259/8593] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:24.775172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:24.784772 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e733fc4-fa71-4bea-80e1-f355a4d13300 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:24.789833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:24.790486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.790763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.791035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.791685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:10:24.791968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:24.793552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:24.805383 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4335/8594] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:10:24.809578 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:24.818767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4bf84-5658-48f9-95e3-95b88963258c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:24.823974 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:24.824569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.824848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.825119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.825783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:24.827697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:24.855038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4260/8595] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:10:24 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:10:24.859161 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:24.869581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137c62-f891-44de-92ae-4d82ca6c2851 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:24.907703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:10:24.927595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:24.928211 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.928519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.929387 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.930029 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:24.932055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:24.952720 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4336/8596] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:10:24 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:10:24.956793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:24.967639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234ca8-ab67-4fab-9cc9-dd0fe2ef0cb8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:24.972574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:24.973179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:24.973464 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:24.973744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:24.974440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:24.976930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:24.988902 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4261/8597] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:10:24.994055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:25.004559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462802b-e41d-42d0-aa6d-478c065ca127 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:25.009945 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe155ac5-6f9c-45c5-9c2c-714aaa9c2ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:25.010851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe155ac5-6f9c-45c5-9c2c-714aaa9c2ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:25.011164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe155ac5-6f9c-45c5-9c2c-714aaa9c2ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:25.011450 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe155ac5-6f9c-45c5-9c2c-714aaa9c2ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:25.012099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe155ac5-6f9c-45c5-9c2c-714aaa9c2ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:25.014009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe155ac5-6f9c-45c5-9c2c-714aaa9c2ae4 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:25.025554 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4337/8598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 06:10:25.031027 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:25.042755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316996a8-d194-43e2-8c5f-c638b9205d82 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:25.047422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:25.048087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:25.048366 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:25.048640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] PATH_INFO: `/v3/projects/26d30873d282402a97e7a4e57d64f0f1/users/7f09a021ddb848eaa9f342ea166ccef0/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:25.057902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:10:25.067142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d30873d282402a97e7a4e57d64f0f1, user_id=7f09a021ddb848eaa9f342ea166ccef0, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:25.071033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:25.084770 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4262/8599] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:10:25 2022] PUT /identity/v3/projects/26d30873d282402a97e7a4e57d64f0f1/users/7f09a021ddb848eaa9f342ea166ccef0/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:10:25.090564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6046-f9c1-4609-b94e-64b20dcbc35d None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:25.090900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6046-f9c1-4609-b94e-64b20dcbc35d None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:25.091180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6046-f9c1-4609-b94e-64b20dcbc35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:25.110826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-736b6046-f9c1-4609-b94e-64b20dcbc35d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:25.112065 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-736b6046-f9c1-4609-b94e-64b20dcbc35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:25.174505 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4338/8600] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:10:25.185763 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:25.187500 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:25.248371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7970d-b401-4fe7-9db6-37d870164f0f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:25.251975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:25.252587 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:25.252866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:25.253139 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:25.263448 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:25.264872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:25.274435 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4263/8601] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:10:29.517829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958499d-ca66-4f80-91cf-2def1cf0d97a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:29.518359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958499d-ca66-4f80-91cf-2def1cf0d97a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:29.518460 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958499d-ca66-4f80-91cf-2def1cf0d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:29.551675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9958499d-ca66-4f80-91cf-2def1cf0d97a None None] MFA Rules not processed for user `7f09a021ddb848eaa9f342ea166ccef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:29.553033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9958499d-ca66-4f80-91cf-2def1cf0d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:29.625981 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4339/8602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:10:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:29.641339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:29.643358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:29.722562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808248-014d-4672-b20e-d93dc9cfaff7 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:29.728482 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbfb38-a119-4323-81ee-0ac0ecc12f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:29.729092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbfb38-a119-4323-81ee-0ac0ecc12f69 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:29.729371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbfb38-a119-4323-81ee-0ac0ecc12f69 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:29.729644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbfb38-a119-4323-81ee-0ac0ecc12f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:29.737254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbfb38-a119-4323-81ee-0ac0ecc12f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:29.738872 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbfb38-a119-4323-81ee-0ac0ecc12f69 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:29.748651 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4264/8603] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:10:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:10:31.009761 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:31.010501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:31.010602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:31.032035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] MFA Rules not processed for user `7f09a021ddb848eaa9f342ea166ccef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:31.033255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:31.041403 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4340/8604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:31.401759 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf6641-f2d2-4e03-b4d4-9a167dfb1579 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:31.402358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf6641-f2d2-4e03-b4d4-9a167dfb1579 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:31.402832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf6641-f2d2-4e03-b4d4-9a167dfb1579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:31.561947 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-77cf6641-f2d2-4e03-b4d4-9a167dfb1579 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:10:31.563229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-77cf6641-f2d2-4e03-b4d4-9a167dfb1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:10:31.570663 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4265/8605] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:10:31.582829 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:10:31.593193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76678b9-6cb5-4c53-847e-5bb18d94a4f2 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:10:31.597275 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:10:31.597885 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:10:31.598186 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:10:31.598468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:10:31.607313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:10:31.608858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:10:31.617815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4341/8606] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:10:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:10:41.419054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:10:41.613851 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:11:49.470391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:11:49.470962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:11:49.470962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:11:49.514910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:11:49.516136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:11:49.523055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4266/8607] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:11:49.536554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:11:49.537940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:11:49.550078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c012ec3-5229-43c3-b47e-ccb9cb417748 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:11:49.553954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c1b5e-5668-4f74-bd5a-92e46949f165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:11:49.554738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1b5e-5668-4f74-bd5a-92e46949f165 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:11:49.555579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1b5e-5668-4f74-bd5a-92e46949f165 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:11:49.555860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1b5e-5668-4f74-bd5a-92e46949f165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:11:49.563107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c1b5e-5668-4f74-bd5a-92e46949f165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:11:49.564530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c1b5e-5668-4f74-bd5a-92e46949f165 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:11:49.573612 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4342/8608] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:11:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:11:59.509268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=12 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:11:59.569044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:12:05.262382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:12:05.264342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:12:05.361719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba9df-6b57-470c-b973-737c3b71b1d2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:12:05.366725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:12:05.368002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:12:05.368281 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:12:05.368557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:12:05.370374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:12:05.381929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:12:05.384108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:12:05.394447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4267/8609] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:12:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:12:12.866021 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:12:12.866504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:12:12.866606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:12:12.886262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] MFA Rules not processed for user `7f09a021ddb848eaa9f342ea166ccef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:12:12.887457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:12:12.894470 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4343/8610] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:12:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:12:13.856632 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:12:13.858127 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:12:13.871337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418d65-0659-4ade-ad6c-d7e4fb3fe0b6 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:12:13.876296 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:12:13.876902 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:12:13.877180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:12:13.877450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:12:13.879153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:12:13.891721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:12:13.893267 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:12:13.904582 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4268/8611] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:12:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:12:19.031016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:12:19.045355 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f82d8-b5c0-4f6a-a86f-d5be3a6c80d6 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:12:19.050938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:12:19.051590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:12:19.051875 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:12:19.052155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:12:19.053895 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:12:19.066171 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:12:19.067771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:12:19.078028 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4344/8612] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:12:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:12:23.900003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=47 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:12:29.073796 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:13:09.583288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:13:09.595037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeceaa-be48-47d9-a019-7fe46c1e1aa2 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:13:09.600305 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:13:09.600907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:13:09.601185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:13:09.601450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:13:09.603209 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:13:09.617562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:13:09.619159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:13:09.630601 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4269/8613] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:13:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:13:09.807223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:13:09.817223 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c422cd-286e-4ce0-8226-5a5d32ac7202 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:13:09.820734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:13:09.821334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:13:09.821616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:13:09.821890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:13:09.823627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:13:09.846944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:13:09.848373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24191220-cd5f-48f3-8a5a-b2fc3d00f967 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:13:09.871901 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4345/8614] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:13:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:13:09.936972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:13:09.947230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12582-d395-4f74-bcb7-bc992c659353 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:13:09.952449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:13:09.953046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:13:09.953329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:13:09.953606 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:13:09.955349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:13:09.966916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:13:09.968471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23423b2-3f40-44b2-b926-a823271d0ea9 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:13:09.977996 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4270/8615] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:13:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:13:19.869153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=13 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:13:19.973962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=12 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:13:26.739271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:13:26.739741 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:13:26.739833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:13:26.759410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] MFA Rules not processed for user `7f09a021ddb848eaa9f342ea166ccef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:13:26.760608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:13:26.768609 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4346/8616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:13:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:13:27.065653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3862-489c-4a69-9490-2798267961b6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:13:27.066177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3862-489c-4a69-9490-2798267961b6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:13:27.066276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3862-489c-4a69-9490-2798267961b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:13:27.087803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-37de3862-489c-4a69-9490-2798267961b6 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:13:27.088986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-37de3862-489c-4a69-9490-2798267961b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:13:27.096469 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4271/8617] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:13:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:13:27.108313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:13:27.117869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80958da6-3914-489f-98bd-3d2b2b374581 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:13:27.121994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:13:27.122635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:13:27.122920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:13:27.123196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:13:27.130209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:13:27.131635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:13:27.139964 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4347/8618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:13:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:13:37.082834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:13:37.135962 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:14:54.714095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3862-489c-4a69-9490-2798267961b6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:14:54.723489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3862-489c-4a69-9490-2798267961b6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:14:54.727195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:14:54.727874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:14:54.728158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:14:54.728432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:14:54.730222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:14:54.757614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:14:54.759083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:14:54.770260 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4272/8619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:14:55.958334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:14:55.968005 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919bd43-bf5e-4582-b6af-a87e50fd56a6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:14:55.971944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:14:55.972626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:14:55.972976 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:14:55.973353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:14:55.975118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:14:55.989420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:14:55.990888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:14:56.001633 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4348/8620] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:14:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:04.765395 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=11 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:15:05.997435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:15:13.405148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:15:13.413812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d95a6-afbb-48d6-923b-e5f420ad473a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:15:13.417337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:15:13.417931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:13.418235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:13.418506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:13.421147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:13.430447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:15:13.431904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:15:13.440619 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4273/8621] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:15:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:13.674368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:15:13.689591 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115efb9e-67ad-496c-bcbc-27d5b63e2b61 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:15:13.693240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:15:13.693901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:13.694210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:13.694482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:13.696338 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:13.706959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:15:13.708405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:15:13.717210 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4349/8622] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:15:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:14.134791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:15:14.136237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:14.153365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a4bd7-d7e2-4955-bab6-79f7c0cd907f service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:15:14.161466 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:15:14.162178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:14.162528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:14.162810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:14.164595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:14.178065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:15:14.179704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:15:14.190975 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4274/8623] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:15:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:19.460921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:15:19.476465 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec188fd9-9bad-4a27-80b3-4e3a82b12393 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:15:19.483409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:15:19.484107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:19.484452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:19.484788 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:19.486664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:19.500049 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:15:19.501649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:15:19.513004 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4350/8624] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:15:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:20.864576 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:15:20.877159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c666da4-c071-472c-96ca-6feb220c0df4 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:15:20.883505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:15:20.884205 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:20.884562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:20.884793 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:20.886597 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:20.899480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:15:20.901067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aa257-b8e4-4215-8a8c-472d81807bc3 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:15:20.912496 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4275/8625] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:15:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:29.310301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:15:29.322301 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43282176-15be-4552-8925-4a45cb5eee74 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:15:29.329076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512dcc8-27a9-42f0-a48f-7a769f478c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:15:29.329775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512dcc8-27a9-42f0-a48f-7a769f478c06 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:29.330123 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512dcc8-27a9-42f0-a48f-7a769f478c06 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:29.330489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512dcc8-27a9-42f0-a48f-7a769f478c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:29.338677 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512dcc8-27a9-42f0-a48f-7a769f478c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:15:29.340369 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512dcc8-27a9-42f0-a48f-7a769f478c06 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:15:29.349548 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4351/8626] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:15:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:15:30.578628 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:15:30.579106 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:15:30.579211 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:15:30.597839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] MFA Rules not processed for user `7f09a021ddb848eaa9f342ea166ccef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:15:30.599074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:15:30.605813 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4276/8627] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:15:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:15:39.345448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=18 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:15:40.593047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=21 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:16:30.288425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:16:30.288957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:16:30.288957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:16:30.309858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:16:30.311093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:16:30.322753 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4352/8628] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:16:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:16:30.334118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:16:30.343572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d3bab-cfb8-4793-a5b0-613e59777607 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:16:30.347111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:16:30.347712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:16:30.347993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:16:30.348264 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:16:30.358315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:16:30.359730 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:16:30.370391 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4277/8629] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:16:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:16:40.304646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:16:40.365729 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:13.068553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:13.080041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b848-19ca-4ef8-a80d-297245e00a75 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:13.085345 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:13.085881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:13.086188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:13.086458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:13.094725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:13.096296 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:13.106387 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4353/8630] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:17:23.102412 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:24.058284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:24.070061 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500c07-41a9-46c5-8eb7-e0465cf57f64 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:24.075019 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27522128-992a-4c32-929d-8255fb6183e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:24.075619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27522128-992a-4c32-929d-8255fb6183e3 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:24.075896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27522128-992a-4c32-929d-8255fb6183e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:24.076166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27522128-992a-4c32-929d-8255fb6183e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:24.084859 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27522128-992a-4c32-929d-8255fb6183e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:24.086443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27522128-992a-4c32-929d-8255fb6183e3 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:24.096038 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4278/8631] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:17:34.092013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:40.237051 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:40.246539 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7ca0-1e79-4a45-971e-c1073cdb2272 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:40.250292 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:40.250898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:40.251180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:40.251453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:40.261497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:40.262970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:40.291862 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4354/8632] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:17:43.412757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:43.413215 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:43.413309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:43.474607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:17:43.476960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:43.490359 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4279/8633] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:17:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:17:43.494994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:43.505836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:43.507209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c0b5-adf2-4432-bd9b-1c27c1d26465 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:43.514816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:43.516864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:43.517468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:43.517971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] PATH_INFO: `/v3/users/7f09a021ddb848eaa9f342ea166ccef0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:43.521907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f09a021ddb848eaa9f342ea166ccef0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:43.525435 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:43.536133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3ac2-2851-4e1d-9c64-383037d5f504 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:43.542916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:43.543749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:43.544191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:43.544465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:43.555081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:43.556665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:43.567862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4280/8634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:17:43.589746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f09a021ddb848eaa9f342ea166ccef0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.604028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f09a021ddb848eaa9f342ea166ccef0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.604905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f09a021ddb848eaa9f342ea166ccef0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.605588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f09a021ddb848eaa9f342ea166ccef0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.612904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f7af3e84-2995-41d0-8f66-da6ca71fbc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f09a021ddb848eaa9f342ea166ccef0'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.625169 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4355/8635] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:17:43 2022] DELETE /identity/v3/users/7f09a021ddb848eaa9f342ea166ccef0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:17:43.803803 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:43.817439 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7c866-8e52-47f5-9586-f63661543dea service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:43.875451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:43.876090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:43.876376 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:43.876653 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] PATH_INFO: `/v3/projects/26d30873d282402a97e7a4e57d64f0f1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:43.877774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d30873d282402a97e7a4e57d64f0f1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:43.880331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:43.926414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d30873d282402a97e7a4e57d64f0f1', 'request_id': 'req-b358e7cc-078d-4dea-ae6b-46aa7d843a09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.931811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d30873d282402a97e7a4e57d64f0f1', 'request_id': 'req-b358e7cc-078d-4dea-ae6b-46aa7d843a09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.939325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d30873d282402a97e7a4e57d64f0f1', 'request_id': 'req-b358e7cc-078d-4dea-ae6b-46aa7d843a09'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.964749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] The token cache is being invalidate because project 26d30873d282402a97e7a4e57d64f0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:17:43.965042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.965672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b358e7cc-078d-4dea-ae6b-46aa7d843a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:17:43.967150 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4281/8636] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:17:43 2022] DELETE /identity/v3/projects/26d30873d282402a97e7a4e57d64f0f1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:17:43.972090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:43.972375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:43.972652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.021236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:17:44.022612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:44.082551 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4356/8637] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:17:44.090528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.090814 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.091089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.110208 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:17:44.111399 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:44.119184 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4282/8638] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:17:44.123576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.133814 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f2fe3-cc37-458c-b591-343e41439d6b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.138405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.139370 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.139660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.139938 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.140584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:17:44.140890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.142529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.154543 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4357/8639] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:17:44.158779 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.168017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46341-6068-4cb1-bc99-13dd0fb90856 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.172767 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.173371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.173652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.173924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.174600 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.176555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.208225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:44.215592 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4283/8640] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:17:44 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:17:44.220037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.230480 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afeb7a-0789-46ee-ab92-3c3bbe443935 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.235167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:44.289752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.290341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.290629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.290905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.291549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.293496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.315038 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4358/8641] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:17:44 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:17:44.319776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.329854 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704507b3-b5c7-4794-b248-64c1ee8fd82a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.334585 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.335184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.335461 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.335735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.336375 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.337963 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.347882 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4284/8642] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:17:44.351701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.361702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818221-c345-4f95-8059-35723ac38894 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.366934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98bf61-0d66-424b-a9b3-6522251729ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.367536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98bf61-0d66-424b-a9b3-6522251729ca admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.367822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98bf61-0d66-424b-a9b3-6522251729ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.368103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98bf61-0d66-424b-a9b3-6522251729ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.368742 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98bf61-0d66-424b-a9b3-6522251729ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.370413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98bf61-0d66-424b-a9b3-6522251729ca admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.381540 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4359/8643] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:17:44.385537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.396298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d287a-da2d-4a44-b698-c3bdb4b60608 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.401031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.401773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.402056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.402391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] PATH_INFO: `/v3/projects/feff1ced979d4de5b972353c7c132f62/users/f50766b053f749d6ba1715bc97daaecf/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.417977 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=feff1ced979d4de5b972353c7c132f62, user_id=f50766b053f749d6ba1715bc97daaecf, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.420706 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.434458 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4285/8644] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:17:44 2022] PUT /identity/v3/projects/feff1ced979d4de5b972353c7c132f62/users/f50766b053f749d6ba1715bc97daaecf/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:17:44.439565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac72fd-4027-42a6-b2db-4b001e9ca24c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.439849 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac72fd-4027-42a6-b2db-4b001e9ca24c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.440125 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac72fd-4027-42a6-b2db-4b001e9ca24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.459762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-50ac72fd-4027-42a6-b2db-4b001e9ca24c None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:17:44.460961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-50ac72fd-4027-42a6-b2db-4b001e9ca24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:44.520687 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4360/8645] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:17:44.530458 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:44.532167 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:44.589851 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96392-1a74-41b7-bc6a-8b2565748a1f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:44.593544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63f7f-67cf-4d2c-9f6b-6e875453d1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:44.594178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63f7f-67cf-4d2c-9f6b-6e875453d1fa service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:44.594471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63f7f-67cf-4d2c-9f6b-6e875453d1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:44.594746 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63f7f-67cf-4d2c-9f6b-6e875453d1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:44.604724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe63f7f-67cf-4d2c-9f6b-6e875453d1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:44.606160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe63f7f-67cf-4d2c-9f6b-6e875453d1fa service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:44.616316 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4286/8646] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:17:48.875129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:48.876083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:48.876443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:48.907248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] MFA Rules not processed for user `f50766b053f749d6ba1715bc97daaecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:17:48.908711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:48.985928 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4361/8647] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:17:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:17:48.997884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d4f0-f302-4753-910a-9a211346394f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:48.998467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d4f0-f302-4753-910a-9a211346394f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:48.998467 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d4f0-f302-4753-910a-9a211346394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:49.019952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8768d4f0-f302-4753-910a-9a211346394f None None] MFA Rules not processed for user `f50766b053f749d6ba1715bc97daaecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:17:49.021268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8768d4f0-f302-4753-910a-9a211346394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:49.028452 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4287/8648] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:17:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:17:49.041089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:49.042527 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:49.067453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:49.131401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8898b2-6552-4e66-ad44-3e8c4075a4a4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:49.138322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb1792-f3e5-4f6d-8676-6113f5f1eee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:49.139248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb1792-f3e5-4f6d-8676-6113f5f1eee8 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:49.139533 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb1792-f3e5-4f6d-8676-6113f5f1eee8 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:49.139813 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb1792-f3e5-4f6d-8676-6113f5f1eee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:49.149273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb1792-f3e5-4f6d-8676-6113f5f1eee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:49.151008 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb1792-f3e5-4f6d-8676-6113f5f1eee8 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:49.162202 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4362/8649] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:17:49.777044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768d4f0-f302-4753-910a-9a211346394f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:17:49.778494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8768d4f0-f302-4753-910a-9a211346394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:49.854493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768d4f0-f302-4753-910a-9a211346394f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:17:49.859524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:17:49.860143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:17:49.860427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:17:49.860700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:17:49.862544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:17:49.873588 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:17:49.875190 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:17:49.885925 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4288/8650] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:17:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:17:59.157358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=26 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:17:59.881993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:00.483706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:00.484228 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:00.484327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:00.504462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] MFA Rules not processed for user `f50766b053f749d6ba1715bc97daaecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:00.505760 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:00.512633 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4363/8651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:00.770538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:00.779780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bd826-f232-4004-9175-7d8d94556778 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:00.783514 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:00.784140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:00.784421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:00.784695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:00.786681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:00.796822 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:00.798271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:00.807106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4289/8652] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:10.498050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:10.804095 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:25.608888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:25.622713 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c8521-6e82-47f0-b879-b007d646c6b8 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:25.627545 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:25.628188 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:25.628471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:25.628746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] PATH_INFO: `/v3/users/f50766b053f749d6ba1715bc97daaecf` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:25.629905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50766b053f749d6ba1715bc97daaecf)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:25.632042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:25.700139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50766b053f749d6ba1715bc97daaecf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:25.714252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50766b053f749d6ba1715bc97daaecf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:25.714900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50766b053f749d6ba1715bc97daaecf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:25.715515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50766b053f749d6ba1715bc97daaecf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:25.722566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-39858c6a-da03-4d58-829b-823714fd72a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50766b053f749d6ba1715bc97daaecf'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:25.735536 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4364/8653] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:18:25 2022] DELETE /identity/v3/users/f50766b053f749d6ba1715bc97daaecf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:25.923429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:25.936364 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b5d7-5464-4241-885b-ea8a4cf5f7b0 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:25.996685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:25.997256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:25.997541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:25.997812 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] PATH_INFO: `/v3/projects/feff1ced979d4de5b972353c7c132f62` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:25.998966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feff1ced979d4de5b972353c7c132f62)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.000838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.052681 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feff1ced979d4de5b972353c7c132f62', 'request_id': 'req-b5e50ef8-ae16-4995-9468-66941756d222'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:26.058521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feff1ced979d4de5b972353c7c132f62', 'request_id': 'req-b5e50ef8-ae16-4995-9468-66941756d222'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:26.065907 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feff1ced979d4de5b972353c7c132f62', 'request_id': 'req-b5e50ef8-ae16-4995-9468-66941756d222'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:26.077518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] The token cache is being invalidate because project feff1ced979d4de5b972353c7c132f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:18:26.077811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:26.078477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b5e50ef8-ae16-4995-9468-66941756d222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:26.080176 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4290/8654] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:18:25 2022] DELETE /identity/v3/projects/feff1ced979d4de5b972353c7c132f62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:26.084889 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.086333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.086333 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.107675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:26.108881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:26.169145 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4365/8655] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:26.178021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.178343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.178626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.198782 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:26.199992 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:26.207805 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4291/8656] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:26.212197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.221827 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e348f8-8a7f-4334-9f16-12267e1be40b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.227262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.227881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.228158 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.228428 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.229067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:18:26.229366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.230985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.243592 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4366/8657] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:18:26.247804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.256819 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98edc-3c35-4ac6-aab6-f8e140e73ba5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.261999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.262639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.262920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.263191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.263834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.265954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.295329 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4292/8658] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:18:26 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:26.299532 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.310775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e0007-1a9d-4225-9f2b-54df5e25d7c0 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.368248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.368886 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.369166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.369437 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.370060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.372000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.379970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:26.395850 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4367/8659] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:18:26 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:26.401222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.411674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac6245-b32b-44a8-898a-ab909ad6d530 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.416695 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.417358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.417640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.417914 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.418598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.420189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.430158 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4293/8660] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:18:26.434059 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.444164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1663e-70dd-43ff-aedb-303c93da9884 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.449703 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03369-d57c-4687-bb54-0fd8aa796aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.450337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03369-d57c-4687-bb54-0fd8aa796aab admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.450642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03369-d57c-4687-bb54-0fd8aa796aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.450915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03369-d57c-4687-bb54-0fd8aa796aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.451552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece03369-d57c-4687-bb54-0fd8aa796aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.453138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece03369-d57c-4687-bb54-0fd8aa796aab admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.464773 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4368/8661] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:18:26.469050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.480494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5bec-2b9c-4a74-b26a-50694f1c0900 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.485235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.485930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.486346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.486634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] PATH_INFO: `/v3/projects/5a10450bd0da4eefbf2daeacb2068327/users/891a8275ef3d4b9b8d6e8736d0609e8e/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.501792 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a10450bd0da4eefbf2daeacb2068327, user_id=891a8275ef3d4b9b8d6e8736d0609e8e, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.504427 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.518228 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4294/8662] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:18:26 2022] PUT /identity/v3/projects/5a10450bd0da4eefbf2daeacb2068327/users/891a8275ef3d4b9b8d6e8736d0609e8e/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:26.528975 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1592f-94dd-4b21-abef-01934aa11728 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.529287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1592f-94dd-4b21-abef-01934aa11728 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.529560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1592f-94dd-4b21-abef-01934aa11728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.557644 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-44b1592f-94dd-4b21-abef-01934aa11728 None None] MFA Rules not processed for user `891a8275ef3d4b9b8d6e8736d0609e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:26.558899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-44b1592f-94dd-4b21-abef-01934aa11728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:26.622503 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4369/8663] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:26.632551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:26.634216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:26.666251 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:26.695151 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbbfac-a9b2-4c66-b7e4-d87a18eb6c3f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:26.699383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:26.699994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:26.700271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:26.700538 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:26.708772 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:26.710954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:26.719627 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4295/8664] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:34.695179 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:34.695715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:34.695808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:34.719353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:34.720767 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:34.810976 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4370/8665] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:18:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:18:34.823562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:34.825094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:34.842024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbfe02-6709-4d0f-8724-6ff07dcb9682 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:34.848424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec448be-8f7e-470e-9870-49d536a23385 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:34.849247 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec448be-8f7e-470e-9870-49d536a23385 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:34.849532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec448be-8f7e-470e-9870-49d536a23385 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:34.849808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec448be-8f7e-470e-9870-49d536a23385 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:34.860052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec448be-8f7e-470e-9870-49d536a23385 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:34.861704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec448be-8f7e-470e-9870-49d536a23385 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:34.873810 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4296/8666] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:38.704130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:38.783205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bafdc-2a93-4971-89df-220ad0e3c131 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:38.788695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:38.789682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:38.789970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:38.790285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] PATH_INFO: `/v3/users/891a8275ef3d4b9b8d6e8736d0609e8e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:38.791467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891a8275ef3d4b9b8d6e8736d0609e8e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:38.793400 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:38.798180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:38.842246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891a8275ef3d4b9b8d6e8736d0609e8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:38.855726 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891a8275ef3d4b9b8d6e8736d0609e8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:38.856405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891a8275ef3d4b9b8d6e8736d0609e8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:38.857020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891a8275ef3d4b9b8d6e8736d0609e8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:38.863981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891a8275ef3d4b9b8d6e8736d0609e8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:38.875944 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4371/8667] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:18:38 2022] DELETE /identity/v3/users/891a8275ef3d4b9b8d6e8736d0609e8e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:38.880472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:38.880975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:38.881086 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:38.900871 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:38.902064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:38.963698 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4297/8668] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:38.973733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:38.975096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:39.033060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa31bb4-e393-4daa-855f-41c324ae17a3 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.036789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ae131-d8de-4f29-86a6-fc516f754238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.037402 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae131-d8de-4f29-86a6-fc516f754238 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.037685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae131-d8de-4f29-86a6-fc516f754238 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.038004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae131-d8de-4f29-86a6-fc516f754238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.047281 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ae131-d8de-4f29-86a6-fc516f754238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.048707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ae131-d8de-4f29-86a6-fc516f754238 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.059550 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4372/8669] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:18:39.236919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.238477 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:39.255838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f86b0-b8d9-49bb-b44b-6bcc14851937 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.273460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.274170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.274499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.274778 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] PATH_INFO: `/v3/projects/5a10450bd0da4eefbf2daeacb2068327` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.276025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a10450bd0da4eefbf2daeacb2068327)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.277998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.328998 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a10450bd0da4eefbf2daeacb2068327', 'request_id': 'req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:39.336259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a10450bd0da4eefbf2daeacb2068327', 'request_id': 'req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:39.344897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a10450bd0da4eefbf2daeacb2068327', 'request_id': 'req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:39.361179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] The token cache is being invalidate because project 5a10450bd0da4eefbf2daeacb2068327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:18:39.361672 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:39.362547 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-89ed0972-ccb2-47ef-a2ec-1e3fa8322a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:39.364725 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4298/8670] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:18:39 2022] DELETE /identity/v3/projects/5a10450bd0da4eefbf2daeacb2068327 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:39.371033 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.371323 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.371598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.391871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:39.393081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:39.451370 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4373/8671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:39.459184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.459478 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.459799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.479454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:39.480657 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:39.488492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4299/8672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:39.493390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.503134 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafeeff-fae2-48c3-ab0c-5e63553a7934 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.508398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.508994 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.509271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.509543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.510208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:18:39.510510 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.512095 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.523795 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4374/8673] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 06:18:39.528036 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.537310 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0137-bbdd-4951-90c7-d43b561a0393 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.541981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.542616 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.542903 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.543176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.543815 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.545694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.574092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4300/8674] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:18:39 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:39.578349 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.588319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37d8f-a54e-4975-9beb-f39f96bf9c6f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.596978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:39.649675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.650221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.650506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.650782 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.651417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.653334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.673960 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4375/8675] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:18:39 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:39.678320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.688634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7311dec-e24f-4688-b54d-7f8b83614ec4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.693273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.693875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.694688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.694965 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.695703 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.697350 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.703132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:39.708798 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4301/8676] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:18:39.713341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.723630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc31f-eb5f-4cfc-8f83-bb96a8fbd297 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.728299 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28314fed-afdf-418d-8222-420c47e99ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.728897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28314fed-afdf-418d-8222-420c47e99ffb admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.729184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28314fed-afdf-418d-8222-420c47e99ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.729459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28314fed-afdf-418d-8222-420c47e99ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.730097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28314fed-afdf-418d-8222-420c47e99ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.731751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28314fed-afdf-418d-8222-420c47e99ffb admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.742559 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4376/8677] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 06:18:39.746735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.757181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d509-782b-4de6-a23e-12ac57dc0c23 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.761997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.762733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.762996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.763272 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] PATH_INFO: `/v3/projects/317eecc7b0ec4b93819b7411c8557879/users/2588984d36a14fc98c14f4ba8b998752/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.778214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=317eecc7b0ec4b93819b7411c8557879, user_id=2588984d36a14fc98c14f4ba8b998752, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.780839 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.793492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4302/8678] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:18:39 2022] PUT /identity/v3/projects/317eecc7b0ec4b93819b7411c8557879/users/2588984d36a14fc98c14f4ba8b998752/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:39.804077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.804375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.804649 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.831826 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] MFA Rules not processed for user `2588984d36a14fc98c14f4ba8b998752`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:39.833052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:39.897217 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4377/8679] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:39.907214 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:39.908897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:39.965712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a628e-a07d-48a6-9dfb-822cec71b6ae admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:39.969304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8cce1-b873-4e76-8f25-3d16008ca7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:39.969905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8cce1-b873-4e76-8f25-3d16008ca7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:39.970213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8cce1-b873-4e76-8f25-3d16008ca7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:39.970488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8cce1-b873-4e76-8f25-3d16008ca7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:39.979222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8cce1-b873-4e76-8f25-3d16008ca7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:39.980630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8cce1-b873-4e76-8f25-3d16008ca7e2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:39.989187 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4303/8680] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:44.238844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:44.303382 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5b09-dae0-48c0-bf63-320fcc1dd771 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:44.308415 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:44.309057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:44.309341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:44.309618 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] PATH_INFO: `/v3/users/2588984d36a14fc98c14f4ba8b998752` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:44.310839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2588984d36a14fc98c14f4ba8b998752)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:44.312776 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:44.337053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:44.361881 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2588984d36a14fc98c14f4ba8b998752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.375101 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2588984d36a14fc98c14f4ba8b998752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.375769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2588984d36a14fc98c14f4ba8b998752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.376381 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2588984d36a14fc98c14f4ba8b998752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.383920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2588984d36a14fc98c14f4ba8b998752'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.396939 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4378/8681] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:18:44 2022] DELETE /identity/v3/users/2588984d36a14fc98c14f4ba8b998752 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:44.401604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:44.402114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:44.402114 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:44.425050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:44.426307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:44.486172 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4304/8682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:44.496864 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:44.498276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:44.556390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f899944-bcd0-410a-84c9-e91d26117588 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:44.560061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd23a6-d729-49e7-94ac-30071f9aa4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:44.560672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd23a6-d729-49e7-94ac-30071f9aa4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:44.560954 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd23a6-d729-49e7-94ac-30071f9aa4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:44.561235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd23a6-d729-49e7-94ac-30071f9aa4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:44.570155 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd23a6-d729-49e7-94ac-30071f9aa4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:44.571844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd23a6-d729-49e7-94ac-30071f9aa4b5 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:44.581206 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4379/8683] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:44.751750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:44.753165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:44.766739 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbdc30-2e1e-409c-a174-0d6add6cb32a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:44.771801 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:44.772450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:44.772721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:44.772993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] PATH_INFO: `/v3/projects/317eecc7b0ec4b93819b7411c8557879` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:44.774790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317eecc7b0ec4b93819b7411c8557879)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:44.776731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:44.824637 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317eecc7b0ec4b93819b7411c8557879', 'request_id': 'req-a0cb930a-4c37-44da-a350-efd70d3879f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.830241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317eecc7b0ec4b93819b7411c8557879', 'request_id': 'req-a0cb930a-4c37-44da-a350-efd70d3879f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.838450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317eecc7b0ec4b93819b7411c8557879', 'request_id': 'req-a0cb930a-4c37-44da-a350-efd70d3879f5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.849656 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] The token cache is being invalidate because project 317eecc7b0ec4b93819b7411c8557879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:18:44.849951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.850622 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a0cb930a-4c37-44da-a350-efd70d3879f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:18:44.852665 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4305/8684] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:18:44 2022] DELETE /identity/v3/projects/317eecc7b0ec4b93819b7411c8557879 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:44.857903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:44.858227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:44.858512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:44.878981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:44.880181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:44.939962 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4380/8685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:44.948832 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06105-c095-454a-a441-6e83298bb341 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:44.949158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06105-c095-454a-a441-6e83298bb341 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:44.949443 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06105-c095-454a-a441-6e83298bb341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:44.960316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:44.974604 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-01f06105-c095-454a-a441-6e83298bb341 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:44.976515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-01f06105-c095-454a-a441-6e83298bb341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:44.985193 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4306/8686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:18:44.989406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:44.999957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525823f-1508-49bf-b5bc-0f6c41a2c05e None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.004573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.005180 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.005462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.005739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.006421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:18:45.006728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.008365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.020095 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4381/8687] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:18:45.024422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06105-c095-454a-a441-6e83298bb341 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:45.033643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06105-c095-454a-a441-6e83298bb341 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.038339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.038942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.039226 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.040144 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.040828 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.042748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.072031 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4307/8688] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:18:45 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:45.076255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:45.086489 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44daca-7b4d-4ae8-aa83-e1a8ad5aa204 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.116383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:45.146467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.147077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.147352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.147619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.148249 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.151278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.172884 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4382/8689] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:18:45 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:18:45.177054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:45.188005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d303f6-fc75-4785-8b14-73e788d9b935 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.192530 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.193126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.193401 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.193670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.194342 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.196888 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.206832 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4308/8690] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 06:18:45.210778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:45.221425 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0ccf-03d4-4c4d-b801-18c6a8b95f89 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.226050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461fb9b-f3ea-41fb-a65c-7d4af477f733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.226678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461fb9b-f3ea-41fb-a65c-7d4af477f733 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.227034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461fb9b-f3ea-41fb-a65c-7d4af477f733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.227283 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461fb9b-f3ea-41fb-a65c-7d4af477f733 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.228012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461fb9b-f3ea-41fb-a65c-7d4af477f733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.229588 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461fb9b-f3ea-41fb-a65c-7d4af477f733 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.240474 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4383/8691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:18:45.245109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:45.255995 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbce6-6ae0-4893-83d1-e982106beaab admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.268494 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.269186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.269470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.269747 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] PATH_INFO: `/v3/projects/6b4c6692e6714685ba30efbddaf4b87d/users/667622e7240b4241aa76bdcf7b41fce6/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.286689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4c6692e6714685ba30efbddaf4b87d, user_id=667622e7240b4241aa76bdcf7b41fce6, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.289682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.305896 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4309/8692] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:18:45 2022] PUT /identity/v3/projects/6b4c6692e6714685ba30efbddaf4b87d/users/667622e7240b4241aa76bdcf7b41fce6/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:45.311061 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e7c7-e3d5-49f6-8fc2-4b6cefd58063 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.311350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e7c7-e3d5-49f6-8fc2-4b6cefd58063 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.311628 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e7c7-e3d5-49f6-8fc2-4b6cefd58063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.331413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-0713e7c7-e3d5-49f6-8fc2-4b6cefd58063 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:45.332630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0713e7c7-e3d5-49f6-8fc2-4b6cefd58063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:45.393511 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4384/8693] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:45.403455 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:45.405235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:45.462544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0d3b7-12bd-470c-a564-f97f86c86de2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:45.466518 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:45.467132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:45.467417 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:45.467692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:45.476682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:45.478137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:45.487604 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4310/8694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:49.609920 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:49.610476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:49.610587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:49.640322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] MFA Rules not processed for user `667622e7240b4241aa76bdcf7b41fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:49.641540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:49.721512 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4385/8695] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:49.722827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:49.733899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960127a-35af-49a2-979a-9dc839e4cbd6 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:49.738549 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:49.739308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:49.739591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:49.739866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:49.740502 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:49.742551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:49.773379 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4311/8696] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:49.780020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:49.797099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160e86-2882-4b61-9bd9-d89c6359e87a None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:49.838086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:49.859468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:49.860110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:49.860392 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:49.860671 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:49.861348 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:49.863439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:49.889808 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4386/8697] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:18:49 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:18:49.891266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:49.903161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12d836-3a6b-43c5-b4f3-0d0ca9d1f116 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:49.907831 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:49.908365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:49.908643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:49.908916 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:49.909556 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:49.911180 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:49.923569 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4312/8698] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:18:49.927587 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:49.938803 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125aa67-f476-40b7-8db6-99d02b3ca743 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:49.943778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:49.944451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:49.944732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:49.945007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] PATH_INFO: `/v3/projects/102afdd7ec8c42a9ad0297081c9bbd35/users/422d747b86324902af01ab47479b124a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:49.962002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102afdd7ec8c42a9ad0297081c9bbd35, user_id=422d747b86324902af01ab47479b124a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:49.964745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:49.978498 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4387/8699] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:18:49 2022] PUT /identity/v3/projects/102afdd7ec8c42a9ad0297081c9bbd35/users/422d747b86324902af01ab47479b124a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:49.982515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:49.993521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d810-bd09-49dc-9191-2a011bacd99d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:50.057155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579e6d7-022f-49d9-b93e-9ad9254b4cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:50.057795 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579e6d7-022f-49d9-b93e-9ad9254b4cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:50.058580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579e6d7-022f-49d9-b93e-9ad9254b4cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:50.058867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579e6d7-022f-49d9-b93e-9ad9254b4cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:50.059548 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579e6d7-022f-49d9-b93e-9ad9254b4cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:50.061155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579e6d7-022f-49d9-b93e-9ad9254b4cf9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:50.072695 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4313/8700] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:18:50.077060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:50.088169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5db412-bfd0-4b21-b0cc-ef7b03672228 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:50.092817 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:50.093468 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:50.093745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:50.094014 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] PATH_INFO: `/v3/projects/102afdd7ec8c42a9ad0297081c9bbd35/users/422d747b86324902af01ab47479b124a/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:50.095966 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102afdd7ec8c42a9ad0297081c9bbd35, user_id=422d747b86324902af01ab47479b124a, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:50.098627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:50.109341 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4388/8701] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:18:50 2022] PUT /identity/v3/projects/102afdd7ec8c42a9ad0297081c9bbd35/users/422d747b86324902af01ab47479b124a/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:18:54.685183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3704ec-f0ea-451e-9d0d-099173f4e330 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:54.685646 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3704ec-f0ea-451e-9d0d-099173f4e330 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:54.685743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3704ec-f0ea-451e-9d0d-099173f4e330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:54.706836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:54.745486 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5f3704ec-f0ea-451e-9d0d-099173f4e330 None None] MFA Rules not processed for user `422d747b86324902af01ab47479b124a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:54.746833 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f3704ec-f0ea-451e-9d0d-099173f4e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:54.848223 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4314/8702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:54.869728 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:54.872112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:54.970646 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa447-0403-495f-8ff7-3187f9307613 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:54.977075 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:54.977802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:54.978093 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:54.978409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:55.042948 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:55.044570 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:55.054531 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4389/8703] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:18:55.122939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601b228-8cc0-4820-bd12-fab2414b322c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:55.123223 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601b228-8cc0-4820-bd12-fab2414b322c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:55.123495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601b228-8cc0-4820-bd12-fab2414b322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:55.143805 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a601b228-8cc0-4820-bd12-fab2414b322c None None] MFA Rules not processed for user `667622e7240b4241aa76bdcf7b41fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:18:55.145030 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a601b228-8cc0-4820-bd12-fab2414b322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:55.153971 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4315/8704] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:18:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:18:55.457308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:18:55.458912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:55.492791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:18:55.532000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f35bf-f76e-447e-a2c7-609898084efc service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:18:55.535783 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:18:55.536396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:18:55.536682 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:18:55.536961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:18:55.538839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:18:55.549458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:18:55.550913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:18:55.559558 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4390/8705] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:18:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:19:05.137397 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=35 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:19:05.555695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=17 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:19:08.147660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab269bf0-2b53-43de-99c7-1818746efc19 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:19:08.148111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab269bf0-2b53-43de-99c7-1818746efc19 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:19:08.148294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab269bf0-2b53-43de-99c7-1818746efc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:19:08.199049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ab269bf0-2b53-43de-99c7-1818746efc19 None None] MFA Rules not processed for user `b46b252d8cc1405896f3f9b22531c08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:19:08.200266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab269bf0-2b53-43de-99c7-1818746efc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:19:08.259859 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4316/8706] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 31 06:19:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:19:08.266426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:19:08.276336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33b949-02c2-4fe6-a16e-515f539160da service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:19:08.279970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:19:08.280573 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:19:08.280857 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:19:08.281137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:19:08.290506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:19:08.291943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:19:08.301585 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4391/8707] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:19:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:19:18.256336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=38 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:19:18.297242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:19:33.539246 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:19:33.539770 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:19:33.539960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:19:33.568913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] MFA Rules not processed for user `667622e7240b4241aa76bdcf7b41fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:19:33.570109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:19:33.594093 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4317/8708] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:19:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:19:34.153593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:19:34.155225 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:19:34.267501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eab91-a4f6-4f7c-8c7d-f1e7662652a0 service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:19:34.272524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:19:34.273136 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:19:34.273413 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:19:34.273685 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:19:34.275915 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:19:34.287398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:19:34.289012 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:19:34.300050 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4392/8709] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:19:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:19:43.592359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=15 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:19:44.295806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=50 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:19:57.428087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:19:57.438437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441dc9-4b0f-44d5-9dc5-152a7d2f12bc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:19:57.441990 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:19:57.442633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:19:57.442920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:19:57.443197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:19:57.444931 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:19:57.458733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:19:57.460147 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0161d4-3168-4962-ae4a-cbe2bef3f6ed service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:19:57.470796 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4318/8710] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:19:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:20:02.999505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:03.008739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ff1a-d8ea-48a8-84f6-7a227042a6ab service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:03.012897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46b252d8cc1405896f3f9b22531c08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:03.013496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:03.013778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:03.014053 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:03.016052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:03.029738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:03.031201 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:03.041831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4393/8711] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:20:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:20:07.466255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:10.186692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:10.187292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:10.187292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:10.208257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] MFA Rules not processed for user `667622e7240b4241aa76bdcf7b41fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:20:10.209485 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:10.216359 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4319/8712] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:20:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:20:13.037248 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:13.328422 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:13.338566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bcb3-2045-4015-93e7-1c95dfca247e service cinder] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:13.342339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:13.342953 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:13.343236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:13.343512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:13.345239 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:13.355052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:13.357050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:13.368245 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4394/8713] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:20:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:20:20.203228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:23.361635 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:44.100381 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:44.117946 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16932a-f527-4836-ace3-aee9309c6ba6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:44.124523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:44.125529 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:44.125824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:44.126110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:44.128007 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:44.143275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:44.145177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:44.157514 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4320/8714] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:20:52.021373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:52.085017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca630d-3d14-4ad7-a5e1-5f371e326fea service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:52.089596 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:52.090262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:52.090543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:52.090819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] PATH_INFO: `/v3/users/667622e7240b4241aa76bdcf7b41fce6` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:52.092451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=667622e7240b4241aa76bdcf7b41fce6)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:52.094404 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:52.141978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667622e7240b4241aa76bdcf7b41fce6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.153914 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667622e7240b4241aa76bdcf7b41fce6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.155130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667622e7240b4241aa76bdcf7b41fce6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.155775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667622e7240b4241aa76bdcf7b41fce6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.162900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667622e7240b4241aa76bdcf7b41fce6'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.176397 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4395/8715] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:20:52 2022] DELETE /identity/v3/users/667622e7240b4241aa76bdcf7b41fce6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:20:52.348719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:52.364023 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7bc1-d10e-4e13-bc5a-054e946a9879 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:52.421928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:52.422598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:52.422875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:52.423146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] PATH_INFO: `/v3/projects/6b4c6692e6714685ba30efbddaf4b87d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:52.424278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4c6692e6714685ba30efbddaf4b87d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:52.426169 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:52.471842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4c6692e6714685ba30efbddaf4b87d', 'request_id': 'req-3594d61f-299a-451f-bae0-6642e5cdf741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.477524 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4c6692e6714685ba30efbddaf4b87d', 'request_id': 'req-3594d61f-299a-451f-bae0-6642e5cdf741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.484882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4c6692e6714685ba30efbddaf4b87d', 'request_id': 'req-3594d61f-299a-451f-bae0-6642e5cdf741'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.496005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] The token cache is being invalidate because project 6b4c6692e6714685ba30efbddaf4b87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:20:52.496287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.496909 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.498493 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4321/8716] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:20:52 2022] DELETE /identity/v3/projects/6b4c6692e6714685ba30efbddaf4b87d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:20:52.502497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:52.503930 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:52.517882 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835f24-9e61-4751-b386-1735dd97f24f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:52.573665 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:52.574340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:52.574624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:52.574900 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] PATH_INFO: `/v3/users/422d747b86324902af01ab47479b124a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:52.576026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422d747b86324902af01ab47479b124a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:52.578717 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:52.600261 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:52.628144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422d747b86324902af01ab47479b124a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.641287 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422d747b86324902af01ab47479b124a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.642090 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422d747b86324902af01ab47479b124a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.642769 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422d747b86324902af01ab47479b124a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.649699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-b633fa10-0df4-4197-adcf-eb81fd7fa9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422d747b86324902af01ab47479b124a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.662358 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4396/8717] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:20:52 2022] DELETE /identity/v3/users/422d747b86324902af01ab47479b124a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:20:52.842939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:52.844469 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:52.857535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594d61f-299a-451f-bae0-6642e5cdf741 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:52.916634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:52.917279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:52.917562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:52.917843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] PATH_INFO: `/v3/projects/102afdd7ec8c42a9ad0297081c9bbd35` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:52.919008 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102afdd7ec8c42a9ad0297081c9bbd35)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:52.920935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:52.941904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:52.967906 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102afdd7ec8c42a9ad0297081c9bbd35', 'request_id': 'req-b3a4a0e6-00f3-4c35-b674-597409112263'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.973352 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102afdd7ec8c42a9ad0297081c9bbd35', 'request_id': 'req-b3a4a0e6-00f3-4c35-b674-597409112263'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.980829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102afdd7ec8c42a9ad0297081c9bbd35', 'request_id': 'req-b3a4a0e6-00f3-4c35-b674-597409112263'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.992487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] The token cache is being invalidate because project 102afdd7ec8c42a9ad0297081c9bbd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:20:52.992775 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.993406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3a4a0e6-00f3-4c35-b674-597409112263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:20:52.994903 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4322/8718] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:20:52 2022] DELETE /identity/v3/projects/102afdd7ec8c42a9ad0297081c9bbd35 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:20:53.000124 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.000445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.000729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.021440 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:20:53.022668 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:53.081313 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4397/8719] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:20:53.089951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.090271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.090551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.111307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:20:53.112497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:53.120245 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4323/8720] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:20:53.125216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.134903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fd952-e97e-4455-8b32-c11860b1a165 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.139525 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.140128 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.140664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.140937 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.141585 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:20:53.141884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.143519 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.155063 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4398/8721] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:20:53.159300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.168348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800762a-5584-4866-bdd7-c8e6779c628e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.173670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.174297 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.174577 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.174847 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.175474 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.177354 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.205196 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4324/8722] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:20:53 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:20:53.209699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.219904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230546f-4770-460a-ba30-af585932a175 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.277273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.277806 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.278086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.278401 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.279035 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.281877 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.306125 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4399/8723] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:20:53 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:20:53.307348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.318557 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9b31-b3ca-4149-8475-e7fa2fb68c39 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.323437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.324056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.324336 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.324609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.325294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.327436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.338789 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4325/8724] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:20:53.343535 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.353763 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3739-0887-4f05-8758-4a1e6e904a81 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.359376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c35ff1-8850-4089-87a7-81c28cfe8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.360409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c35ff1-8850-4089-87a7-81c28cfe8ade admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.360679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c35ff1-8850-4089-87a7-81c28cfe8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.360952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c35ff1-8850-4089-87a7-81c28cfe8ade admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.361629 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c35ff1-8850-4089-87a7-81c28cfe8ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.363699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c35ff1-8850-4089-87a7-81c28cfe8ade admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.376966 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4400/8725] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:20:53.381197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.392853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51726e-a843-4d7c-bbb9-12463d0f4126 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.397683 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.398398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.398685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.398956 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] PATH_INFO: `/v3/projects/e7506d976bca4432a99d2ee45559b389/users/5b4c3555ca1b49068295701b14a668de/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.414380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7506d976bca4432a99d2ee45559b389, user_id=5b4c3555ca1b49068295701b14a668de, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.417460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.430200 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4326/8726] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:20:53 2022] PUT /identity/v3/projects/e7506d976bca4432a99d2ee45559b389/users/5b4c3555ca1b49068295701b14a668de/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:20:53.435358 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c393e-584c-45b4-88df-a68c96f8341f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.436376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c393e-584c-45b4-88df-a68c96f8341f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.436654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c393e-584c-45b4-88df-a68c96f8341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.444931 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:53.459197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-e96c393e-584c-45b4-88df-a68c96f8341f None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:20:53.460603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e96c393e-584c-45b4-88df-a68c96f8341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:53.526829 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4401/8727] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:20:53.537184 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:53.538882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:53.595610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f5234-8d8f-4923-8bc6-4c79abf080ef admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:53.599343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:53.599957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:53.600289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:53.600566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:53.609686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:53.611158 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:53.620545 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4327/8728] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:20:57.896411 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:57.896957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:57.896957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:57.927496 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] MFA Rules not processed for user `5b4c3555ca1b49068295701b14a668de`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:20:57.928732 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:20:57.997374 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4402/8729] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:20:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:20:58.002662 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:58.012531 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f65089-a0fb-447b-a263-c38c6dfd4342 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:58.018452 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:58.019088 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:58.019390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:58.019669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:58.020331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:58.022418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:58.051171 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4328/8730] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:20:58 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:20:58.055359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:58.067212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80f931-2e12-406a-808c-41854df4e2ae None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:58.123735 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:58.124344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:58.124624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:58.124898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:58.125531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:58.127540 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:58.149815 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4403/8731] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:20:58 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:20:58.153799 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:58.164610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f2f26-a340-4005-846f-f0cdee280fa3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:58.169188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:58.169817 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:58.170101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:58.170411 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:58.171059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:58.172765 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:58.183256 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4329/8732] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:20:58.187934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:58.198108 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c50c-3f3b-4a9e-92ce-115f21ce395f admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:58.203737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:58.204403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:58.204687 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:58.205100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] PATH_INFO: `/v3/projects/875aff62553246fab6a2af26f694f79e/users/50b58342768348b592a4f18a760ed435/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:58.220100 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875aff62553246fab6a2af26f694f79e, user_id=50b58342768348b592a4f18a760ed435, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:58.223057 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:58.231556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:58.240822 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4404/8733] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:20:58 2022] PUT /identity/v3/projects/875aff62553246fab6a2af26f694f79e/users/50b58342768348b592a4f18a760ed435/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:20:58.242076 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:58.252896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67cbfd-e42e-4cd2-8f88-a1155819a65c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:58.266737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:20:58.318936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7686ee-a77e-4e36-833e-d8499f76f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:58.319551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7686ee-a77e-4e36-833e-d8499f76f178 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:58.319835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7686ee-a77e-4e36-833e-d8499f76f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:58.320109 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7686ee-a77e-4e36-833e-d8499f76f178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:58.320745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7686ee-a77e-4e36-833e-d8499f76f178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:58.322373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7686ee-a77e-4e36-833e-d8499f76f178 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:58.332478 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4330/8734] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:20:58.336751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:20:58.347727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5d53b-6bd8-4338-b43d-527624d8a768 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:20:58.352250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f775e4b-9bcc-486e-b104-526f1d1c27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:20:58.352896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f775e4b-9bcc-486e-b104-526f1d1c27e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:20:58.353174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f775e4b-9bcc-486e-b104-526f1d1c27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:20:58.353446 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f775e4b-9bcc-486e-b104-526f1d1c27e0 admin admin] PATH_INFO: `/v3/projects/875aff62553246fab6a2af26f694f79e/users/50b58342768348b592a4f18a760ed435/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:20:58.355409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f775e4b-9bcc-486e-b104-526f1d1c27e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875aff62553246fab6a2af26f694f79e, user_id=50b58342768348b592a4f18a760ed435, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:20:58.358327 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f775e4b-9bcc-486e-b104-526f1d1c27e0 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:20:58.368320 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4405/8735] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:20:58 2022] PUT /identity/v3/projects/875aff62553246fab6a2af26f694f79e/users/50b58342768348b592a4f18a760ed435/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:21:02.743879 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:02.744409 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:02.744501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:02.803244 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] MFA Rules not processed for user `50b58342768348b592a4f18a760ed435`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:21:02.804659 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:02.909226 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4331/8736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:21:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:21:02.940608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5154b-8be0-4e36-93a3-a943a8aec130 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:02.941164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5154b-8be0-4e36-93a3-a943a8aec130 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:02.941164 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5154b-8be0-4e36-93a3-a943a8aec130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:03.003608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-41a5154b-8be0-4e36-93a3-a943a8aec130 None None] MFA Rules not processed for user `d1a59dbd84f94e99ad696d60c25082c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:21:03.004902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-41a5154b-8be0-4e36-93a3-a943a8aec130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:03.075817 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4406/8737] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 31 06:21:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:21:03.083471 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:21:03.094221 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83f958-0c1e-4e57-a0f7-30e93486cbf3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:21:03.097883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede15eb4-3a2e-4dec-b3d0-009a8a1f0bab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:21:03.098476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15eb4-3a2e-4dec-b3d0-009a8a1f0bab service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:03.098762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15eb4-3a2e-4dec-b3d0-009a8a1f0bab service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:03.099065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15eb4-3a2e-4dec-b3d0-009a8a1f0bab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:03.171516 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede15eb4-3a2e-4dec-b3d0-009a8a1f0bab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:21:03.173355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede15eb4-3a2e-4dec-b3d0-009a8a1f0bab service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:21:03.198303 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4332/8738] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:21:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:21:03.387815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:03.388107 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:03.388459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:03.446092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:21:03.447328 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:03.519061 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4407/8739] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:21:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:21:03.577866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6c97-8912-4bb2-a4e7-cb4b9654eff6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:03.578259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6c97-8912-4bb2-a4e7-cb4b9654eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:03.578603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e6c97-8912-4bb2-a4e7-cb4b9654eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:03.634046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-734e6c97-8912-4bb2-a4e7-cb4b9654eff6 None None] MFA Rules not processed for user `d29fb54e4c484f94a012b821cdb5ae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:21:03.635522 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-734e6c97-8912-4bb2-a4e7-cb4b9654eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:03.640804 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:21:03.714518 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4333/8740] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Oct 31 06:21:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:21:03.721217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:21:03.735060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c74aa-eb11-48b6-ad2f-987743c13d0f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:21:03.740317 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28faddb-da58-46e1-a9bc-48069822197a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:21:03.741067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28faddb-da58-46e1-a9bc-48069822197a service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:03.741347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28faddb-da58-46e1-a9bc-48069822197a service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:03.741619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28faddb-da58-46e1-a9bc-48069822197a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:03.751467 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28faddb-da58-46e1-a9bc-48069822197a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:21:03.753329 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28faddb-da58-46e1-a9bc-48069822197a service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:21:03.762700 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4408/8741] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:21:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:21:12.880716 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:12.881262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:12.881262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:12.901459 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] MFA Rules not processed for user `5b4c3555ca1b49068295701b14a668de`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:21:12.902704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:12.911022 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4334/8742] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:21:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:21:13.758965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:21:14.897571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:14.898193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:14.898424 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:14.918390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:21:14.919714 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:14.927789 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4409/8743] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:21:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:21:14.940961 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:21:14.953164 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab5aee-9c1a-4e28-acba-70973d1f546f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:21:14.958289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:21:14.958933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:14.959212 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:14.959484 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:14.968161 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:21:14.969878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:21:14.978476 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4335/8744] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 06:21:24.913058 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:21:24.975011 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=38 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:21:28.934331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:21:28.936166 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:29.018780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e45e6a-1285-4a26-a8ec-d09e24da7d5b None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:21:29.024645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:21:29.025272 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:29.025552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:29.025825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:29.027624 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:29.041063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:21:29.042678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:21:29.053416 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4410/8745] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:21:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:21:39.048916 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=34 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:21:46.767033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:21:46.819951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588d517-a7db-4677-a4d9-830cd3ac6425 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:21:46.823694 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:21:46.824312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:46.824593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:46.824867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:46.834810 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:21:46.836232 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:21:46.845716 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4336/8746] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:21:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:21:48.707636 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:21:48.721652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a6c6b-7bb0-4115-bb11-c6dfde1b9f78 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:21:48.728054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:21:48.728779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:21:48.729135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:21:48.729486 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:21:48.731475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:21:48.746730 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:21:48.748242 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:21:48.762183 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4411/8747] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:21:56.841489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=26 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:21:58.755897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:22:19.467380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:22:19.469347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:22:19.559676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a78d-d378-4935-bb46-a39b3393fc40 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:22:19.564687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:22:19.565292 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:22:19.565571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:22:19.565842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:22:19.567596 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:22:19.578496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:22:19.580046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:22:19.589735 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4337/8748] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:22:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:22:29.585508 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=41 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:22:30.053759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:22:30.055252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:22:30.071103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785f05-bb73-4924-adc3-22ccb440b2fe service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:22:30.076041 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:22:30.076641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:22:30.076924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:22:30.077200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:22:30.078901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:22:30.090991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:22:30.092810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81d943-3e60-48a8-89d5-22c32c578823 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:22:30.102890 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4412/8749] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:22:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:22:40.098748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:24:58.551051 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:24:58.561119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b266-6ebe-405f-b6c2-236756423140 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:24:58.565185 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:24:58.565780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:24:58.566056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:24:58.566369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:24:58.569249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:24:58.602964 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:24:58.604315 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:24:58.624610 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4338/8750] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:24:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:24:59.789654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019589-2daa-4b5a-b845-74c4e3bc7248 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:24:59.790118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019589-2daa-4b5a-b845-74c4e3bc7248 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:24:59.790258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019589-2daa-4b5a-b845-74c4e3bc7248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:24:59.810845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-61019589-2daa-4b5a-b845-74c4e3bc7248 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:24:59.812050 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-61019589-2daa-4b5a-b845-74c4e3bc7248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:24:59.820007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4413/8751] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 06:24:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:24:59.858976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:24:59.870081 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281c434-e3a3-4ada-abf8-d810c879a179 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:24:59.875084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:24:59.875690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:24:59.875999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:24:59.876273 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:24:59.885407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:24:59.887059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:24:59.896099 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4339/8752] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:24:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:25:00.377162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ebf72-9c0c-4a90-a2aa-b18bdf960d84 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:00.377452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ebf72-9c0c-4a90-a2aa-b18bdf960d84 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:00.377727 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ebf72-9c0c-4a90-a2aa-b18bdf960d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:00.397961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-3e4ebf72-9c0c-4a90-a2aa-b18bdf960d84 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:25:00.399207 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-3e4ebf72-9c0c-4a90-a2aa-b18bdf960d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:00.406280 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4414/8753] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:25:00.418266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:00.429750 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1cd13-e4a5-4d89-80db-cf422b3b43c5 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:00.434853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:00.435449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:00.435731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:00.436002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:00.444802 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:00.446379 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:00.454709 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4340/8754] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:25:10.018907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:10.019377 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:10.019473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:10.039503 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] MFA Rules not processed for user `5b4c3555ca1b49068295701b14a668de`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:25:10.040697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:10.047487 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4415/8755] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:25:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:25:10.311540 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:10.321148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6c9a-7d9d-40ab-be08-4c3ef2d3db22 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:10.324704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:10.325300 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:10.325581 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:10.325884 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:10.327636 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:10.350130 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:10.351602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:10.361395 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4341/8756] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:25:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:25:10.684405 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:10.694021 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:10.695580 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:10.697555 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ed9b-8f31-46d5-b240-cb150c411782 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:10.702652 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:10.703276 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:10.703559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:10.703837 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:10.705575 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:10.706224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3051b9-7da3-487a-ad86-2e75d5bc37d5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:10.709841 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:10.710552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:10.710904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:10.711249 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:10.712970 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:10.717577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:10.719205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fe4b5-b73d-4552-b572-1babe9ec1a72 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:10.726505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:10.727951 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:10.729361 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4416/8757] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:25:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:25:10.741272 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4342/8758] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:25:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:25:12.041210 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:12.041696 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:12.041792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:12.061674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:25:12.062848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:12.070603 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4417/8759] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:25:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:25:12.082978 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:12.094287 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04dce-d07b-4ad1-8e72-cd1484f74b68 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:12.099980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:12.100554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:12.100837 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:12.101112 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:12.109826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:12.111442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:12.120595 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4343/8760] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:25:21.708990 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:21.713564 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=19 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:25:21.719798 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6d0c-7a04-4432-a04a-148d2a99377c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:21.723409 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:21.724562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:21.724860 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:21.725142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:21.727016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:21.739497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:21.741557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:21.749825 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4418/8761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:25:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:25:22.117101 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=53 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:25:31.746202 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:25:48.007704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:25:48.022520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101842c4-378c-45e6-91f9-39a29ba9b433 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:25:48.030713 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:25:48.031566 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:25:48.032013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:25:48.032454 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:25:48.035517 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:25:48.051843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:25:48.053840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:25:48.066447 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4344/8762] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:25:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:25:58.061878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:26:45.919055 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:26:45.932453 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5a2d-3e53-4947-bc63-d9f941a2900b service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:26:45.937872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:26:45.938497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:26:45.938781 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:26:45.939054 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:26:45.947565 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:26:45.949152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:26:45.957877 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4419/8763] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:26:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:26:55.953965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:27:25.492363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:27:25.504191 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c95e29-8c52-413a-a44a-870dcd6f769d service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:27:25.509255 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:27:25.509864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:27:25.510159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:27:25.510447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:27:25.519769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:27:25.521396 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:27:25.531764 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4345/8764] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:27:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:27:35.527156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:27:37.069580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:27:37.081700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dce35-6fa7-4be6-a665-2489b6291953 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:27:37.086622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c77d7-4817-45d6-98a7-767749755100 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:27:37.087221 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c77d7-4817-45d6-98a7-767749755100 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:27:37.087498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c77d7-4817-45d6-98a7-767749755100 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:27:37.087765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c77d7-4817-45d6-98a7-767749755100 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:27:37.096670 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c77d7-4817-45d6-98a7-767749755100 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:27:37.098271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c77d7-4817-45d6-98a7-767749755100 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:27:37.107840 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4420/8765] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:27:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:27:47.103752 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:01.749040 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:01.750554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:01.770880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d5845-c894-4c8d-a1ce-33129b20d3f4 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:01.776536 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:01.777821 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:01.778117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:01.778424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:01.789912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:01.791981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:01.805265 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4346/8766] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:11.800058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:16.384498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:16.385052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:16.385052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:16.414473 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:28:16.415669 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:16.422760 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4421/8767] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 06:28:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:28:16.467178 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:16.478972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175e2f-ceac-4633-9b71-306cdb862975 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:16.483983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:16.485156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:16.485450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:16.485727 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:16.494865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:16.496499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:16.506114 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4347/8768] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:28:16.891552 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:16.901586 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954365c6-64d0-435d-8900-dca878b16e04 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:16.905115 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:16.905718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:16.905996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:16.906303 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:16.977359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:16.978853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:17.003873 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4422/8769] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:20.220289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:20.233908 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271c7d-4d30-4805-8fbc-ccfbb9bfe06e service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:20.240189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:20.240960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:20.241762 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:20.246009 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:20.247925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:20.261613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:20.263129 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:20.274499 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4348/8770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:28:23.426534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:23.439794 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ceee1-046e-4099-9a13-9b8c42c5b3a2 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:23.450395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:23.451037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:23.451325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:23.451601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:23.454548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:23.467000 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:23.468597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:23.481175 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4423/8771] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:23.498173 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:23.525298 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01076d-e63d-40eb-81af-f003f8de6648 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:23.530838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:23.531997 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:23.532558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:23.532824 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] PATH_INFO: `/v3/users/5b4c3555ca1b49068295701b14a668de` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:23.534110 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4c3555ca1b49068295701b14a668de)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:23.536560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:23.596348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4c3555ca1b49068295701b14a668de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.604602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4c3555ca1b49068295701b14a668de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.605337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4c3555ca1b49068295701b14a668de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.606013 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4c3555ca1b49068295701b14a668de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.614437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4c3555ca1b49068295701b14a668de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.635666 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4349/8772] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:28:23 2022] DELETE /identity/v3/users/5b4c3555ca1b49068295701b14a668de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:23.823515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:23.834819 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465ec2-6123-413c-ae1d-d96e74013147 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:23.893951 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:23.894879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:23.895162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:23.895444 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] PATH_INFO: `/v3/projects/e7506d976bca4432a99d2ee45559b389` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:23.896556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7506d976bca4432a99d2ee45559b389)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:23.898546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:23.944888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7506d976bca4432a99d2ee45559b389', 'request_id': 'req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.946028 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:23.952762 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7506d976bca4432a99d2ee45559b389', 'request_id': 'req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.958844 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7506d976bca4432a99d2ee45559b389', 'request_id': 'req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.983500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] The token cache is being invalidate because project e7506d976bca4432a99d2ee45559b389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:28:23.983724 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.984964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:23.986846 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4424/8773] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:28:23 2022] DELETE /identity/v3/projects/e7506d976bca4432a99d2ee45559b389 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:23.990875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:23.992329 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:24.006667 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610fa3-c8b3-4502-9161-ea9659b30176 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.063707 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.064346 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.064633 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.064910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] PATH_INFO: `/v3/users/50b58342768348b592a4f18a760ed435` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.066091 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b58342768348b592a4f18a760ed435)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.068054 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.115197 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b58342768348b592a4f18a760ed435'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.116923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:24.124337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b58342768348b592a4f18a760ed435'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.125290 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b58342768348b592a4f18a760ed435'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.126426 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b58342768348b592a4f18a760ed435'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.134935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67e7e5da-c1ca-4f13-b514-fc4339aaa65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b58342768348b592a4f18a760ed435'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.152783 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4350/8774] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:28:23 2022] DELETE /identity/v3/users/50b58342768348b592a4f18a760ed435 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:24.329004 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.330561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:24.344360 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34632a80-bb44-40ff-bfb5-1a1253a8b3c8 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.403039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.403678 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.403961 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.404237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] PATH_INFO: `/v3/projects/875aff62553246fab6a2af26f694f79e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.405353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] RBAC: Authorizing `identity:delete_project(project_id=875aff62553246fab6a2af26f694f79e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.407913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.452802 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875aff62553246fab6a2af26f694f79e', 'request_id': 'req-8dfe97f9-4ee6-48b8-8590-138ddc57395a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.459441 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875aff62553246fab6a2af26f694f79e', 'request_id': 'req-8dfe97f9-4ee6-48b8-8590-138ddc57395a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.465016 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875aff62553246fab6a2af26f694f79e', 'request_id': 'req-8dfe97f9-4ee6-48b8-8590-138ddc57395a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.477024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] The token cache is being invalidate because project 875aff62553246fab6a2af26f694f79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:28:24.477318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.477955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-8dfe97f9-4ee6-48b8-8590-138ddc57395a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:28:24.479459 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4425/8775] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:28:24 2022] DELETE /identity/v3/projects/875aff62553246fab6a2af26f694f79e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:24.485306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.485601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.485873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.543156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:28:24.544291 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:24.605040 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4351/8776] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:28:24.614371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.614660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.614950 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.635436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:28:24.636637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:24.644918 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4426/8777] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:28:24.649162 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.659050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398f7f4-5267-4c90-9eba-4001179d0fab None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.663583 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.664179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.664462 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.664737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.665382 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:28:24.665686 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.667313 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.679872 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4352/8778] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:28:24.684509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.696870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c0c89-4363-4567-90c6-15ed30214153 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.701792 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.702443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.702734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.703043 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.703848 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.705775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.743295 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4427/8779] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:28:24 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:28:24.747697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.758424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d4a2-c038-4fdb-bbff-90ed4d75495b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.814521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.815057 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.815339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.815614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.816240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.818159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.838449 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4353/8780] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:28:24 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:28:24.842553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.854240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39217-1acd-44a0-a664-b1690e947f47 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.858926 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.860226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.860582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.860866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.861512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.863147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.873079 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4428/8781] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:28:24.877026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.887055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b37e6e-1a09-4094-bc53-0a3a4aba85d6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.892082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb07536-d5c0-4534-95a4-e5f5af738b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.892690 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07536-d5c0-4534-95a4-e5f5af738b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.892973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07536-d5c0-4534-95a4-e5f5af738b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.893253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07536-d5c0-4534-95a4-e5f5af738b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.893928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07536-d5c0-4534-95a4-e5f5af738b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.895809 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07536-d5c0-4534-95a4-e5f5af738b92 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.900980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:24.907577 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4354/8782] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:28:24.911706 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:24.922443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695da7c-ce24-42d2-96b8-46e3e32332d1 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:24.927254 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:24.927904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.928193 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.928477 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] PATH_INFO: `/v3/projects/d07a95b6f273428983bb71a36cbd84be/users/7a59a44dc68149a1992f433b403fe115/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:24.931526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:24.945520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07a95b6f273428983bb71a36cbd84be, user_id=7a59a44dc68149a1992f433b403fe115, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:24.948241 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:24.960947 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4429/8783] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:28:24 2022] PUT /identity/v3/projects/d07a95b6f273428983bb71a36cbd84be/users/7a59a44dc68149a1992f433b403fe115/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:24.972082 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:24.972456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:24.972740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.000645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] MFA Rules not processed for user `7a59a44dc68149a1992f433b403fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:28:25.001867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:25.070442 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4355/8784] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:28:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:28:25.075020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.137896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef7c41-3606-4422-94d6-5713894ba994 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.142640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.143256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.143530 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.143811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.144693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.146641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.176675 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4430/8785] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:28:25 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:28:25.179279 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.191066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aff4d6-56af-4a21-9472-eedce3114c6a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.246721 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.247337 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.247621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.247896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.248535 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.251058 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.273115 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4356/8786] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:28:25 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:28:25.277138 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.287805 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff364c6-e79e-4704-b438-172963c69573 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.292439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.293048 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.293324 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.293595 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.294337 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.295934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.307084 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4431/8787] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:28:25.311266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.322316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe040da-bd02-422e-a86c-d252c5c95a59 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.326936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.327594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.327878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.328199 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] PATH_INFO: `/v3/projects/8a27ab92925b406eb378065c601998c0/users/7caf9e53afc6402dac0bfb60dde1207d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.343066 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a27ab92925b406eb378065c601998c0, user_id=7caf9e53afc6402dac0bfb60dde1207d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.345774 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.358834 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4357/8788] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:28:25 2022] PUT /identity/v3/projects/8a27ab92925b406eb378065c601998c0/users/7caf9e53afc6402dac0bfb60dde1207d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:25.363267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.373579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206e230-2746-4153-ba9c-19270df00e02 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.431700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf78d7-addd-4c58-b1b9-c941b58cf031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.432352 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf78d7-addd-4c58-b1b9-c941b58cf031 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.432639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf78d7-addd-4c58-b1b9-c941b58cf031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.432918 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf78d7-addd-4c58-b1b9-c941b58cf031 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.433568 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf78d7-addd-4c58-b1b9-c941b58cf031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.435198 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf78d7-addd-4c58-b1b9-c941b58cf031 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.445375 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4432/8789] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:28:25.450435 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.461743 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fac7a-94e0-4d83-9d05-993dc684b3e3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.466431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.467089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.467393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.467652 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] PATH_INFO: `/v3/projects/8a27ab92925b406eb378065c601998c0/users/7caf9e53afc6402dac0bfb60dde1207d/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.470544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a27ab92925b406eb378065c601998c0, user_id=7caf9e53afc6402dac0bfb60dde1207d, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.472845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.483146 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4358/8790] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:28:25 2022] PUT /identity/v3/projects/8a27ab92925b406eb378065c601998c0/users/7caf9e53afc6402dac0bfb60dde1207d/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:28:25.494321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3caa-7547-4260-b481-919042d64b2f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.494791 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3caa-7547-4260-b481-919042d64b2f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.494901 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3caa-7547-4260-b481-919042d64b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.523608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-378e3caa-7547-4260-b481-919042d64b2f None None] MFA Rules not processed for user `7caf9e53afc6402dac0bfb60dde1207d`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:28:25.524818 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-378e3caa-7547-4260-b481-919042d64b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:25.571120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:25.596353 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4433/8791] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:28:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:28:25.611735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:25.613526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:25.660593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:25.690330 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5342c-5b6f-4101-9f44-af0f72c5269e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:25.695897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3f50-a45e-46ac-ac08-d7754fcb6f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:25.696511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3f50-a45e-46ac-ac08-d7754fcb6f9e service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:25.696796 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3f50-a45e-46ac-ac08-d7754fcb6f9e service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:25.697073 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3f50-a45e-46ac-ac08-d7754fcb6f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:25.754939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3f50-a45e-46ac-ac08-d7754fcb6f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:25.756523 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3f50-a45e-46ac-ac08-d7754fcb6f9e service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:25.765454 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4359/8792] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:28.738379 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3caa-7547-4260-b481-919042d64b2f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:28.739801 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-378e3caa-7547-4260-b481-919042d64b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:28.800865 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3caa-7547-4260-b481-919042d64b2f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:28.804490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:28.805112 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:28.805394 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:28.805675 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:28.815498 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:28.816968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:28.826807 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4434/8793] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:31.408892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:31.409373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:31.409674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:31.433304 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] MFA Rules not processed for user `7a59a44dc68149a1992f433b403fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:28:31.434704 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:31.443269 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4360/8794] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:28:31.850336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:31.853132 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:31.873341 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6d1e6-4341-4677-8b12-3c107b2fe009 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:31.878965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:31.879704 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:31.880114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:31.880484 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:31.882410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:31.895870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:31.897666 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:31.912445 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4435/8795] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:28:32.291936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:32.294043 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:32.377498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93134969-5cb0-447d-8c0f-d7b890be8bb5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:32.382627 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:32.383248 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:32.383532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:32.383808 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:32.385574 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:32.397737 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:32.399406 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:32.411358 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4361/8796] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:34.625641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:34.636218 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8247508-9f88-4a74-b81c-45e39335f82d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:34.640417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:34.641350 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:34.645518 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:34.645873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:34.648357 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:34.661698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:34.663434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c61cb-4981-4122-81fb-5342ef94f00a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:34.682229 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4436/8797] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:42.406749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=72 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:42.669610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:28:42.683117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff85260-ac68-4bef-b65a-77d237de7b49 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:28:42.689152 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:28:42.689850 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:28:42.690133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:28:42.690437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:28:42.692160 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:28:42.704890 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:28:42.706543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:28:42.717352 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4362/8798] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:28:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:28:44.670176 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=47 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:28:52.712917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:29:40.828313 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:29:40.829373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:29:40.829754 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:29:40.865479 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] MFA Rules not processed for user `7a59a44dc68149a1992f433b403fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:29:40.866734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:29:40.895968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4437/8799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:29:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:29:50.893683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=15 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:30:22.760917 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:30:22.798447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621efc-8b47-4289-9624-b2968990f041 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:30:22.802742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:30:22.803414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:30:22.803700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:30:22.803983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:30:22.805984 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:30:22.817037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:30:22.818561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:30:22.826403 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4363/8800] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:30:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:30:32.822933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=18 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:30:57.739396 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:30:57.749247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e5497-d620-42f5-aa53-681c9238b17c None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:30:57.752822 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:30:57.753576 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:30:57.754373 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:30:57.755688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:30:57.758037 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:30:57.781978 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:30:57.783733 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:30:57.796396 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4438/8801] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:30:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:30:59.062405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:30:59.071954 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd651-37f6-4c12-84f6-35cb3dfe6151 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:30:59.075503 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:30:59.076094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:30:59.076370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:30:59.076640 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:30:59.078331 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:30:59.091864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:30:59.093261 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efb79a-a7f2-4c1e-9b26-490b86ea5b97 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:30:59.103949 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4364/8802] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:30:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:31:07.791322 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=9 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:31:09.099533 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:32:01.491247 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:32:01.492815 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:01.508045 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47c3dc-f52d-4a34-847e-7e4af0a79781 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:32:01.514318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:32:01.514968 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:01.515298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:01.515581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:01.517368 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:01.531599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:32:01.533196 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:32:01.544158 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4439/8803] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:32:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:32:11.539420 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:32:12.136551 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:12.137771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:12.138334 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:12.165776 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] MFA Rules not processed for user `7a59a44dc68149a1992f433b403fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:32:12.167047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:12.177371 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4365/8804] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:32:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:32:12.567899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:32:12.577701 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823124a-ab14-45da-b483-68866bfb9850 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:32:12.581293 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:32:12.581906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:12.582220 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:12.582516 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:12.584266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:12.594256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:32:12.595699 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:32:12.603870 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4440/8805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:32:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:32:22.157498 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:32:22.600212 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:32:29.428192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:32:29.429559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:29.466125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cf527-5c5e-4ea3-8f94-549a33e370ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:32:29.471083 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:32:29.471684 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:29.471962 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:29.472233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:29.473932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:29.485293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:32:29.486913 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527bf52-1539-4a1d-8827-0e92ef7537cf service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:32:29.497485 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4366/8806] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:32:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:32:39.492631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=15 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:32:39.998423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:32:40.010343 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3289fb-aad5-4b45-a654-60e66441645c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:32:40.016231 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:32:40.016867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:40.017147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:40.017416 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:40.019431 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:40.031039 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:32:40.032617 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:32:40.042528 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4441/8807] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:32:50.038457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:32:59.879050 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e14f-ee0a-429e-8562-bff01f088ee5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:59.879626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e14f-ee0a-429e-8562-bff01f088ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:59.879626 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0e14f-ee0a-429e-8562-bff01f088ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:59.919059 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-abf0e14f-ee0a-429e-8562-bff01f088ee5 None None] MFA Rules not processed for user `0a0be2f91dce4a62aa9d25e95a45925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:32:59.920339 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-abf0e14f-ee0a-429e-8562-bff01f088ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:32:59.927173 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4367/8808] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:32:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:32:59.939559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:32:59.949505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2ae4-a651-4610-a4a6-0da8f0bf057a service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:32:59.953264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:32:59.953878 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:32:59.954178 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:32:59.954470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:32:59.961924 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:32:59.963383 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:32:59.972635 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4442/8809] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:32:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:33:00.056293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8334d5-ed84-4893-9153-25ec8bfff592 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:33:00.056579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8334d5-ed84-4893-9153-25ec8bfff592 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:33:00.056858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8334d5-ed84-4893-9153-25ec8bfff592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:33:00.095897 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fd8334d5-ed84-4893-9153-25ec8bfff592 None None] MFA Rules not processed for user `02161ca0b0614648b54e7047d767328d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:33:00.097090 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd8334d5-ed84-4893-9153-25ec8bfff592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:33:00.106107 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4368/8810] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:33:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:33:00.117906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:33:00.130839 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc6c3d-86b8-4ba9-9665-9caa5e270378 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:33:00.136816 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:33:00.137572 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:33:00.137859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:33:00.138135 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:33:00.146949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:33:00.148522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:33:00.158487 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4443/8811] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:33:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:33:01.338341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:33:01.338783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:33:01.338924 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:33:01.376641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:33:01.377891 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:33:01.389449 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4369/8812] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:33:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:33:01.400270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:33:01.410237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955aed6-ca72-41e6-b397-af97687bb60d service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:33:01.413722 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:33:01.414351 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:33:01.414631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:33:01.414898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:33:01.425237 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:33:01.426711 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:33:01.437679 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4444/8813] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:33:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:33:01.498791 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:33:01.510153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c02d-2a50-489b-a478-fbc240ba0d50 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:33:01.515276 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:33:01.515882 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:33:01.516166 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:33:01.516442 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:33:01.518136 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:33:01.530039 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:33:01.531665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:33:01.541596 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4370/8814] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:33:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:33:11.434268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=18 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:33:11.537284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=33 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:33:25.798686 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:33:25.810015 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc5c7-c030-4051-8a85-3e41218ab65d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:33:25.816601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:33:25.817222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:33:25.817506 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:33:25.817779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:33:25.825897 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:33:25.827537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:33:25.836680 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4445/8815] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:33:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:33:35.832490 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:34:17.418771 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:34:17.431177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3020c-a469-41db-8f1b-54727293d05b service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:34:17.436595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:34:17.437203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:17.437511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:17.437785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:17.439673 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:34:17.452149 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:34:17.453711 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:34:17.465492 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4371/8816] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:34:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:34:21.882546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:34:21.895026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947772a9-2db7-49f1-85bc-cf9e8f150af8 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:34:21.900626 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:34:21.901251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:21.901536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:21.901811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:21.908745 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:34:21.921517 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:34:21.923264 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cd46-7325-4ce3-a889-c8eee36edef9 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:34:21.934212 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4446/8817] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:34:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:34:26.043460 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:34:26.054140 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3338cc-fa7b-4409-9b27-757fd75eef76 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:34:26.057944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:34:26.058611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:26.058893 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:26.059194 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:26.068567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:34:26.069996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:34:26.079806 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4372/8818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:34:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:34:29.222705 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:29.223601 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:29.223879 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:29.244475 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] MFA Rules not processed for user `7a59a44dc68149a1992f433b403fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:34:29.245925 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:34:29.255025 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4447/8819] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:34:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:34:31.046048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:34:31.059446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb891e-866b-4e82-8ad6-42310e72671e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:34:31.066262 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:34:31.066985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:31.067332 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:31.067670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:31.077055 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:34:31.078705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:34:31.090127 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4373/8820] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:34:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:34:35.935996 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:34:35.946940 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96234938-ffc6-4ac9-9081-5831831aeaad None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:34:35.950559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:34:35.951173 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:35.951448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:35.951716 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:35.960780 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:34:35.962255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:34:35.973392 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4448/8821] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:34:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:34:41.085519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=18 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:34:42.291539 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:34:42.305910 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136a24-4437-48b3-876c-6a08b58a3f99 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:34:42.311630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:34:42.312245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:34:42.312526 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:34:42.312807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:34:42.322849 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:34:42.324410 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:34:42.335028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4374/8822] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:34:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:34:45.967072 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=15 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:34:52.330499 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:36:07.545896 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:36:07.556285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25058d2a-4f1a-471b-a953-51cd010c08c8 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:36:07.561001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:36:07.561698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:36:07.561984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:36:07.562302 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:36:07.582571 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:36:07.584010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:36:07.605181 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4449/8823] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:36:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:36:08.796904 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:36:08.806986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3a8e-d465-4eb7-afbb-fd22aee535ce service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:36:08.810559 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e01d0e-4303-4863-add6-61f58131b9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:36:08.811153 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e01d0e-4303-4863-add6-61f58131b9bc service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:36:08.811436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e01d0e-4303-4863-add6-61f58131b9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:36:08.811712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e01d0e-4303-4863-add6-61f58131b9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:36:08.821925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e01d0e-4303-4863-add6-61f58131b9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:36:08.823363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e01d0e-4303-4863-add6-61f58131b9bc service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:36:08.833884 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4375/8824] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:36:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:36:14.472744 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:36:14.484375 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529b6c-fce3-4537-a5fe-f9881dab5ebd service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:36:14.489590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:36:14.490295 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:36:14.490642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:36:14.490981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:36:14.492858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:36:14.506244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:36:14.508683 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:36:14.525487 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4450/8825] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:36:18.830001 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:36:19.989470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:36:19.990432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:36:19.990724 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:36:20.014668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] MFA Rules not processed for user `7a59a44dc68149a1992f433b403fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:36:20.015935 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:36:20.024106 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4376/8826] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:36:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:36:20.400946 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:36:20.413681 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7546681-a478-4a55-9d1d-806097630665 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:36:20.418622 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:36:20.419203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:36:20.419499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:36:20.419771 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:36:20.430612 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:36:20.432071 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:36:20.443677 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4451/8827] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:36:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:36:24.080415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:36:24.091826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12545d-de7e-4609-b7ef-d50e01099072 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:36:24.096270 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:36:24.097078 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:36:24.097402 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:36:24.097692 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:36:24.105985 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:36:24.107468 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:36:24.117076 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4377/8828] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:36:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:36:30.438861 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=25 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:36:34.112274 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:33.457834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:33.470047 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4b4a1-83a9-49d3-871f-c1e546bf6e91 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:33.475602 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:33.476203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:33.476488 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:33.476764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:33.485403 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:33.487117 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:33.498197 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4452/8829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:37:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:37:43.494011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:45.069203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:45.081415 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c6a3c-6799-45a5-84ef-b744f5ed352a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:45.087143 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:45.087766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:45.088046 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:45.088318 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:45.096634 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:45.099005 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:45.108676 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4378/8830] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:37:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:37:48.475208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:48.487943 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dfbab-a450-4fe4-a024-c163d1d8255f service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:48.494042 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5473b-07aa-443e-b94e-3f50db1bbf73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:48.494698 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5473b-07aa-443e-b94e-3f50db1bbf73 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:48.494983 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5473b-07aa-443e-b94e-3f50db1bbf73 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:48.495256 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5473b-07aa-443e-b94e-3f50db1bbf73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:48.507020 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5473b-07aa-443e-b94e-3f50db1bbf73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:48.508557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5473b-07aa-443e-b94e-3f50db1bbf73 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:48.519280 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4453/8831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:37:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:37:53.380369 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:53.445658 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71275-30bc-490d-9715-26c7045d3a6f service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:53.450316 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:53.450952 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:53.451236 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:53.451513 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] PATH_INFO: `/v3/users/7a59a44dc68149a1992f433b403fe115` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:53.452635 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a59a44dc68149a1992f433b403fe115)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:53.454595 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:53.501235 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a59a44dc68149a1992f433b403fe115'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.508496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a59a44dc68149a1992f433b403fe115'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.509155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a59a44dc68149a1992f433b403fe115'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.509766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a59a44dc68149a1992f433b403fe115'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.517749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a59a44dc68149a1992f433b403fe115'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.535592 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4379/8832] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:37:53 2022] DELETE /identity/v3/users/7a59a44dc68149a1992f433b403fe115 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:37:53.541099 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:53.541606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:53.541723 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:53.561606 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:37:53.562778 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:53.624200 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4454/8833] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:37:53.634532 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:53.635957 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:53.705493 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419c274-76a9-46cf-b52b-e42eb8eec258 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:53.710480 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:53.711092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:53.711373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:53.711645 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:53.720554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:53.721971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:53.726309 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:53.733638 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4380/8834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:37:53.908494 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:53.910114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:53.923509 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94839-84f0-4f09-a5fb-aaecacdd92ec None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:53.928866 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:53.929529 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:53.929808 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:53.930076 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] PATH_INFO: `/v3/projects/d07a95b6f273428983bb71a36cbd84be` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:53.931227 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07a95b6f273428983bb71a36cbd84be)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:53.933120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:53.983197 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07a95b6f273428983bb71a36cbd84be', 'request_id': 'req-c277448d-e10a-43db-9ba9-894599829157'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.989319 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07a95b6f273428983bb71a36cbd84be', 'request_id': 'req-c277448d-e10a-43db-9ba9-894599829157'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:53.995868 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07a95b6f273428983bb71a36cbd84be', 'request_id': 'req-c277448d-e10a-43db-9ba9-894599829157'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.009720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] The token cache is being invalidate because project d07a95b6f273428983bb71a36cbd84be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:37:54.010010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.010689 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.012161 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4455/8835] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:37:53 2022] DELETE /identity/v3/projects/d07a95b6f273428983bb71a36cbd84be => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:37:54.016196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.026561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1a94-5d23-45e6-ae68-24a82b63bb5a service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.084702 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.085250 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.085528 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.085800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] PATH_INFO: `/v3/users/7caf9e53afc6402dac0bfb60dde1207d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.086939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caf9e53afc6402dac0bfb60dde1207d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.088830 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.134572 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caf9e53afc6402dac0bfb60dde1207d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.141668 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caf9e53afc6402dac0bfb60dde1207d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.142322 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caf9e53afc6402dac0bfb60dde1207d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.142933 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caf9e53afc6402dac0bfb60dde1207d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.150230 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-84b49f82-4552-439b-a094-5f237f5f0596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caf9e53afc6402dac0bfb60dde1207d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.167140 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4381/8836] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:37:54 2022] DELETE /identity/v3/users/7caf9e53afc6402dac0bfb60dde1207d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:37:54.451032 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.452497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:54.465524 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277448d-e10a-43db-9ba9-894599829157 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.523645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.524298 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.524584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.524903 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] PATH_INFO: `/v3/projects/8a27ab92925b406eb378065c601998c0` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.526078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a27ab92925b406eb378065c601998c0)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.528089 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.539551 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:54.574905 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a27ab92925b406eb378065c601998c0', 'request_id': 'req-4ea1b50f-d38d-4923-a276-0236c7b7612b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.581187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a27ab92925b406eb378065c601998c0', 'request_id': 'req-4ea1b50f-d38d-4923-a276-0236c7b7612b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.587436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a27ab92925b406eb378065c601998c0', 'request_id': 'req-4ea1b50f-d38d-4923-a276-0236c7b7612b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.600436 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] The token cache is being invalidate because project 8a27ab92925b406eb378065c601998c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:37:54.600720 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.601344 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-4ea1b50f-d38d-4923-a276-0236c7b7612b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:37:54.602946 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4456/8837] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:37:54 2022] DELETE /identity/v3/projects/8a27ab92925b406eb378065c601998c0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:37:54.608450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.608932 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.609052 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.628835 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:37:54.630004 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:54.690042 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4382/8838] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:37:54.699209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.699500 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.699779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.720398 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:37:54.721598 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:54.729632 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4457/8839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:37:54.733785 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.744142 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e5c6d-12f7-41f6-894d-a468b1c5073d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.748725 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.749326 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.749607 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.749880 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.750567 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:37:54.750875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.752456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.764645 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4383/8840] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:37:54.768922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.778906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7acde4-dd27-40d4-babd-13514c596353 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.783566 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.784165 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.784443 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.784746 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.785406 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.787731 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.815859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4458/8841] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:37:54 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:37:54.820740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.827070 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:54.831240 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c410-1831-457e-a5f9-4a451a86c205 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.890430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.890972 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.891258 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.891537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.892192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.894405 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.916192 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4384/8842] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:37:54 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:37:54.920577 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.931584 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c486-4963-49ef-b555-f00f994d62d2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.936257 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.936872 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.937159 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.937470 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.938114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.939756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.951276 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4459/8843] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:37:54.955569 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:54.966615 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f08d5-2059-463a-8a33-2d9161def9a5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:54.971254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb832bc-ad42-4a2a-8168-3102444935a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:54.971862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb832bc-ad42-4a2a-8168-3102444935a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:54.972145 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb832bc-ad42-4a2a-8168-3102444935a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:54.972425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb832bc-ad42-4a2a-8168-3102444935a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:54.973065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb832bc-ad42-4a2a-8168-3102444935a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:54.974736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb832bc-ad42-4a2a-8168-3102444935a5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:54.985268 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4385/8844] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:37:54.989543 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:55.000385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be772c-d170-4b21-bc23-f0fa1016a1a2 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:55.005078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:55.006574 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:55.006863 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:55.007141 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] PATH_INFO: `/v3/projects/2a449fb364824a6b8605df40b6bd94c7/users/c0de9cffed134ed488d9430059f2669a/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:55.022314 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a449fb364824a6b8605df40b6bd94c7, user_id=c0de9cffed134ed488d9430059f2669a, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:55.024984 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:55.037663 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4460/8845] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:37:54 2022] PUT /identity/v3/projects/2a449fb364824a6b8605df40b6bd94c7/users/c0de9cffed134ed488d9430059f2669a/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:37:55.042818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5061c0b-2b18-4aaf-99e3-081483e61a27 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:55.043116 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5061c0b-2b18-4aaf-99e3-081483e61a27 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:55.043398 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5061c0b-2b18-4aaf-99e3-081483e61a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:55.063042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b5061c0b-2b18-4aaf-99e3-081483e61a27 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:37:55.064256 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b5061c0b-2b18-4aaf-99e3-081483e61a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:55.123888 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4386/8846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:37:55.133766 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:55.135504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:55.191811 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c6c6-6cdc-4052-bddd-a4171be17dda admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:55.199764 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:55.200380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:55.200662 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:55.200936 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:55.210262 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:55.211695 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:55.221060 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4461/8847] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:37:59.186541 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.187418 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.187844 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.220282 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] MFA Rules not processed for user `c0de9cffed134ed488d9430059f2669a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:37:59.221519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:37:59.292994 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4387/8848] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:37:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:37:59.297688 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:59.308447 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2206f6-085e-4105-97d2-107ad7084609 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:59.313167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:59.313789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.314068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.314388 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.315024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:59.316989 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:59.366036 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4462/8849] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:37:59 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:37:59.369186 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:59.380591 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e19fcf-5b37-49ee-be48-38aa81d25599 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:59.394744 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:59.451370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:59.452006 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.452293 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.452579 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.453228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:59.455253 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:59.479631 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4388/8850] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:37:59 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:37:59.483773 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:59.494594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08a5e-a9c2-421c-b176-6ffd5c19fbb9 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:59.499331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:59.499964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.500253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.500557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.501184 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:59.502911 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:59.514470 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4463/8851] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 06:37:59.518829 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:59.530271 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c5ed-29ca-4b1b-8796-2f7a3862750b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:59.535268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:59.535953 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.536241 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.536525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] PATH_INFO: `/v3/projects/1b6d6580e8004e3b86177dd9c66df209/users/8c79c76915b840368d33daff71d41f8e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.553712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6d6580e8004e3b86177dd9c66df209, user_id=8c79c76915b840368d33daff71d41f8e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:59.556391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:59.572299 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4389/8852] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:37:59 2022] PUT /identity/v3/projects/1b6d6580e8004e3b86177dd9c66df209/users/8c79c76915b840368d33daff71d41f8e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:37:59.576560 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:59.587810 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345bf69-f0be-42e6-8778-919da19882ce admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:59.592144 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:37:59.653316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7dc0c-e7e8-4e1e-99a3-96ec736189e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:59.653952 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7dc0c-e7e8-4e1e-99a3-96ec736189e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.654421 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7dc0c-e7e8-4e1e-99a3-96ec736189e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.654546 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7dc0c-e7e8-4e1e-99a3-96ec736189e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.655169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7dc0c-e7e8-4e1e-99a3-96ec736189e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:59.656786 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7dc0c-e7e8-4e1e-99a3-96ec736189e2 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:59.668708 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4464/8853] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:37:59.672641 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:37:59.684047 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f358b6c-d34c-4fbe-83c9-6ef30901d507 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:37:59.688948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:37:59.689660 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:37:59.689945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:37:59.690266 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] PATH_INFO: `/v3/projects/1b6d6580e8004e3b86177dd9c66df209/users/8c79c76915b840368d33daff71d41f8e/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:37:59.692233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6d6580e8004e3b86177dd9c66df209, user_id=8c79c76915b840368d33daff71d41f8e, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:37:59.695564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:37:59.706954 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4390/8854] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:37:59 2022] PUT /identity/v3/projects/1b6d6580e8004e3b86177dd9c66df209/users/8c79c76915b840368d33daff71d41f8e/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:38:04.015365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0745ee-b088-44c0-9fee-93fdb9a56f28 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:38:04.015964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0745ee-b088-44c0-9fee-93fdb9a56f28 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:38:04.015964 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0745ee-b088-44c0-9fee-93fdb9a56f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:38:04.047182 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-dc0745ee-b088-44c0-9fee-93fdb9a56f28 None None] MFA Rules not processed for user `8c79c76915b840368d33daff71d41f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:38:04.048423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-dc0745ee-b088-44c0-9fee-93fdb9a56f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:38:04.124570 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4465/8855] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:38:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:38:04.141424 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:38:04.143511 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:38:04.241056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04644-652c-4282-9ea8-a23d46dce3d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:38:04.246571 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:38:04.247172 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:38:04.247450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:38:04.247719 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:38:04.318111 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:38:04.330705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:38:04.332671 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:38:04.343495 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4391/8856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:38:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:38:05.411250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:38:05.412263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:38:05.412263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:38:05.432268 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] MFA Rules not processed for user `c0de9cffed134ed488d9430059f2669a`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:38:05.433569 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:38:05.440600 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4466/8857] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:38:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:38:05.772067 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:38:05.834254 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080528b-6cb8-4a36-9308-1658a803f014 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:38:05.838525 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:38:05.839363 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:38:05.839505 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:38:05.840159 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:38:05.843554 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:38:05.856447 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:38:05.858137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce5a07-f29f-4001-827f-9451032466aa service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:38:05.868541 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4392/8858] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:38:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:38:15.425408 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=63 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:38:15.863473 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=30 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:38:16.041604 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:38:16.043140 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:38:16.055321 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e824f-1b4d-4d24-92d8-de9fc37f195f None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:38:16.058949 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:38:16.059562 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:38:16.059845 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:38:16.060120 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:38:16.070647 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:38:16.072181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:38:16.082404 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4467/8859] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:38:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:38:26.078371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:40:26.725170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:26.725651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:26.725757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:26.797325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:40:26.798552 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:26.882090 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4393/8860] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:40:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:40:26.927907 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:26.929316 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:27.042315 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafed62a-024e-496f-90d4-cf564739831c service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:27.047399 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:27.048007 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:27.048285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:27.048558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:27.056471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:27.058547 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:27.066478 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4468/8861] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:40:29.737148 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:29.739319 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:29.758878 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3ea2-cfde-4a6e-93c4-59b123b33f3f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:29.765380 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:29.766294 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:29.766582 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:29.766862 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:29.768696 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:29.782284 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:29.783923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524b0d7-66e2-4751-a0bd-e8cf91e9a9d4 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:29.797077 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4394/8862] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:40:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:40:36.405884 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:36.426010 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bf57e-3fa9-4fec-b0a3-f34eba3ddd7b service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:36.429674 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:36.430312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:36.430593 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:36.430867 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:36.432734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:36.442077 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:36.443537 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:36.455013 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4469/8863] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:40:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:40:39.792340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=63 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:40:41.007975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:41.008670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:41.008670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:41.039858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] MFA Rules not processed for user `c82a0f508316483c92cc7872c1be0ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:40:41.041213 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:41.050935 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4395/8864] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 06:40:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:40:41.062371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:41.064068 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:41.144751 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef870e24-d938-42d1-ba57-32aa975c0421 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:41.151252 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113aef-2495-4e13-8231-52474c701893 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:41.151871 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113aef-2495-4e13-8231-52474c701893 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:41.152152 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113aef-2495-4e13-8231-52474c701893 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:41.152426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113aef-2495-4e13-8231-52474c701893 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:41.162779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08113aef-2495-4e13-8231-52474c701893 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:41.164233 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08113aef-2495-4e13-8231-52474c701893 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:41.175518 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4470/8865] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:40:41.240594 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:41.251026 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9aeb1-617a-4e06-9abb-f2ef21ab4622 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:41.254665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:41.255278 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:41.255563 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:41.255840 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:41.257631 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:41.267948 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:41.269436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:41.277718 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4396/8866] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:40:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:40:41.353277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113aef-2495-4e13-8231-52474c701893 service glance] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:41.363147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113aef-2495-4e13-8231-52474c701893 service glance] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:41.366748 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:41.367347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:41.367632 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:41.367913 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:41.370339 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:41.380481 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=100 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:40:41.385131 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:41.386640 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b3c6b-59a3-4bc0-8b06-d165883d93ba service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:41.398096 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4471/8867] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:40:41.458476 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:41.459869 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:41.529609 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280837-8d45-4e67-8e8d-30b3286513ce service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:41.534687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:41.535301 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:41.535586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:41.535866 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:41.537624 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:41.549044 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:41.550715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:41.561307 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4397/8868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:40:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:40:43.931679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975390-f3ef-4fb4-9e18-59a15e6c56a0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:43.932715 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975390-f3ef-4fb4-9e18-59a15e6c56a0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:43.932997 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975390-f3ef-4fb4-9e18-59a15e6c56a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:43.953181 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-44975390-f3ef-4fb4-9e18-59a15e6c56a0 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:40:43.954502 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-44975390-f3ef-4fb4-9e18-59a15e6c56a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:40:43.961863 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4472/8869] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:40:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:40:43.973705 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:40:43.985735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b78fe-06e1-495c-91c3-fe9f70ee145d service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:40:43.990867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:40:43.991470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:40:43.991780 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:40:43.992064 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:40:44.000811 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:40:44.002414 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:40:44.011229 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4398/8870] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:40:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:40:53.947457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:40:54.007227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=51 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:41:03.725244 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:41:03.725738 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:41:03.725852 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:41:03.749838 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:41:03.751102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:41:03.758407 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4473/8871] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 06:41:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:41:03.772927 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:41:03.795383 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ce30-ff05-4833-b4b2-e6a7322e62a9 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:41:03.802123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:41:03.803037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:41:03.803488 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:41:03.803950 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:41:03.816430 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:41:03.818015 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:41:03.828582 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4399/8872] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:41:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 06:41:13.743326 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:41:13.822936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:41:36.745890 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:41:36.755765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd31475-6c83-487a-baf6-e413a0f6ce89 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:41:36.759445 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:41:36.760056 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:41:36.760336 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:41:36.760639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:41:36.763142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:41:36.773067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:41:36.774531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:41:36.783153 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4474/8873] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:41:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:41:46.779597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:42:38.467993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:42:38.489613 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa9bf-38af-4f20-a6e7-12d433145ab7 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:42:38.494602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:42:38.495217 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:42:38.495497 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:42:38.495773 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:42:38.497472 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:38.522867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:42:38.524432 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:42:38.534783 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4400/8874] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:42:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:42:40.819205 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:42:40.836190 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb9ab-112f-4158-a7f5-f3f87fc44f6e service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:42:40.841955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:42:40.843523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:42:40.843807 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:42:40.844081 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:42:40.845833 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:40.859661 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:42:40.861250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:42:40.872335 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4475/8875] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:42:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:42:41.010761 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:42:41.020875 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56633d6-9cab-4f0d-a86c-81af64ca844f service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:42:41.024487 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:42:41.025098 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:42:41.025407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:42:41.025682 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:42:41.027407 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:41.040781 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:42:41.042238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657f373-db1a-4787-bdbb-3c231ce22f75 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:42:41.053686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4401/8876] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:42:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:42:42.526417 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:42:42.536419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18995c5-2371-4bb0-9220-a446724a5538 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:42:42.540267 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:42:42.540880 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:42:42.541194 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:42:42.541426 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:42:42.543209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:42.557995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:42:42.559499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:42:42.571509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4476/8877] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:42:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:42:44.881239 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:42:44.881734 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:42:44.881860 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:42:44.902170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] MFA Rules not processed for user `c0de9cffed134ed488d9430059f2669a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:42:44.903371 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:44.911158 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4402/8878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:42:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:42:49.990737 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:42:49.992226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:50.006605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca34979-65d8-4942-a1be-f224d840a0c6 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:42:50.011664 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:42:50.012273 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:42:50.012559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:42:50.012832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:42:50.014630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:42:50.027251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:42:50.028862 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:42:50.040186 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4477/8879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:42:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:42:54.896788 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=24 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:43:00.035657 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=18 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:43:00.448146 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:43:00.457921 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd63a-8d59-4f5d-9750-240465cde41a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:43:00.461449 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:43:00.462048 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:43:00.462422 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:43:00.462693 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:43:00.464391 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:43:00.474437 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:43:00.475894 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:43:00.483805 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4403/8880] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:43:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:43:00.952067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:43:00.963187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b877fa-e285-4104-9155-6d6349e46ac2 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:43:00.968258 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:43:00.968873 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:43:00.969163 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:43:00.969439 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:43:00.971853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:43:00.983672 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:43:00.985366 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:43:00.996420 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4478/8881] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:43:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:43:03.544605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:43:03.565644 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbb7d9-c599-4360-a3b0-e79f9a5a3e4e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:43:03.580138 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:43:03.581365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:43:03.582113 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:43:03.582593 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:43:03.584614 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:43:03.599157 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:43:03.600896 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:43:03.622791 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4404/8882] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:43:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:43:04.366365 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:43:04.380270 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ebdb8-9506-4d31-b42a-40dd59705e2d service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:43:04.385988 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:43:04.386765 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:43:04.387172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:43:04.387548 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:43:04.398213 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:43:04.400002 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:43:04.413055 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4479/8883] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:43:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:43:13.607742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=12 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:43:14.405611 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=12 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:43:20.154031 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:43:20.163428 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc295-8086-4344-8e61-a9ad4d4684dd service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:43:20.167071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:43:20.167700 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:43:20.167976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:43:20.168245 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:43:20.177094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:43:20.178544 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:43:20.187736 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4405/8884] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:43:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:43:30.183749 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:45:37.072113 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:45:37.084734 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847ecf3-fe34-473f-a7d9-e6ca4863aebf service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:45:37.090594 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:45:37.091235 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:45:37.091512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:45:37.091789 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:45:37.101590 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:45:37.103842 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:45:37.115450 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4480/8885] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:45:47.110434 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=6 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:46:41.752826 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:46:41.762063 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a3c52-1544-458b-80ab-57a6dc58fde5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:46:41.765887 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:46:41.766555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:46:41.766842 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:46:41.767118 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:46:41.774955 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:46:41.776372 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:46:41.784190 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4406/8886] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:46:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:46:51.780678 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:22.990832 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:23.001476 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af26b-8ccf-4d7e-81d8-b53fdd792e9a service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:23.005086 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:23.005679 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:23.005955 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:23.006255 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:23.079608 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:23.080970 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:23.099544 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4481/8887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:47:26.352537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:26.366094 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283eea7-c4b3-4652-a0f5-7b6cb795e0ad service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:26.372176 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:26.373024 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:26.373489 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:26.373928 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:26.376182 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:26.391495 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:26.393748 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:26.410049 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4407/8888] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:29.689278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:29.702209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b41bea-b207-46b8-9335-43d7dc30f6ed service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:29.708558 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:29.709209 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:29.709497 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:29.709774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] PATH_INFO: `/v3/users/c0de9cffed134ed488d9430059f2669a` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:29.710998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0de9cffed134ed488d9430059f2669a)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:29.713753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:29.768110 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0de9cffed134ed488d9430059f2669a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:29.781092 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0de9cffed134ed488d9430059f2669a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:29.781775 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0de9cffed134ed488d9430059f2669a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:29.782423 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0de9cffed134ed488d9430059f2669a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:29.789616 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0de9cffed134ed488d9430059f2669a'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:29.815407 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4482/8889] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:47:29 2022] DELETE /identity/v3/users/c0de9cffed134ed488d9430059f2669a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:47:29.991403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:30.002661 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd81cb5-4fc8-496a-94ce-3f0f73a70dd9 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:30.068348 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:30.069002 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.069285 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.069560 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] PATH_INFO: `/v3/projects/2a449fb364824a6b8605df40b6bd94c7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.071355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a449fb364824a6b8605df40b6bd94c7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:30.073257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:30.124034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a449fb364824a6b8605df40b6bd94c7', 'request_id': 'req-b7029649-8027-402d-a7fa-7b7052b0dcb5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.130108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a449fb364824a6b8605df40b6bd94c7', 'request_id': 'req-b7029649-8027-402d-a7fa-7b7052b0dcb5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.138605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a449fb364824a6b8605df40b6bd94c7', 'request_id': 'req-b7029649-8027-402d-a7fa-7b7052b0dcb5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.164385 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] The token cache is being invalidate because project 2a449fb364824a6b8605df40b6bd94c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:47:30.164864 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.165527 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.167092 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4408/8890] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:47:29 2022] DELETE /identity/v3/projects/2a449fb364824a6b8605df40b6bd94c7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:47:30.171208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:30.173111 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:30.186843 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7f94-7290-4046-96f9-9f9926fb20ed admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:30.236482 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:30.248026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:30.248759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.249044 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.249325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] PATH_INFO: `/v3/users/8c79c76915b840368d33daff71d41f8e` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.250534 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c79c76915b840368d33daff71d41f8e)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:30.252505 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:30.301526 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c79c76915b840368d33daff71d41f8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.313390 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c79c76915b840368d33daff71d41f8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.314083 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c79c76915b840368d33daff71d41f8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.314725 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c79c76915b840368d33daff71d41f8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.321779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-ec1f048c-1c85-4e3f-8b0a-3206d7177005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c79c76915b840368d33daff71d41f8e'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.334521 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4483/8891] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:47:30 2022] DELETE /identity/v3/users/8c79c76915b840368d33daff71d41f8e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:47:30.509222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:30.510619 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:30.526715 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7029649-8027-402d-a7fa-7b7052b0dcb5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:30.586017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:30.586685 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.586969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.587237 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] PATH_INFO: `/v3/projects/1b6d6580e8004e3b86177dd9c66df209` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.588349 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6d6580e8004e3b86177dd9c66df209)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:30.590257 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:30.598071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:30.639874 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6d6580e8004e3b86177dd9c66df209', 'request_id': 'req-efe2fa22-b92c-43ed-90d5-c72f3cf897be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.645537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6d6580e8004e3b86177dd9c66df209', 'request_id': 'req-efe2fa22-b92c-43ed-90d5-c72f3cf897be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.653674 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6d6580e8004e3b86177dd9c66df209', 'request_id': 'req-efe2fa22-b92c-43ed-90d5-c72f3cf897be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.665436 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] The token cache is being invalidate because project 1b6d6580e8004e3b86177dd9c66df209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:47:30.665722 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.666378 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-efe2fa22-b92c-43ed-90d5-c72f3cf897be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:47:30.667847 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4409/8892] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:47:30 2022] DELETE /identity/v3/projects/1b6d6580e8004e3b86177dd9c66df209 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:47:30.672922 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.673222 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.673501 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.719318 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:47:30.720430 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:30.779879 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4484/8893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:47:30.787602 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.787889 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.788165 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.808936 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:47:30.810227 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:30.818028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4410/8894] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:47:30.822469 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:30.832557 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad718a7-c64a-4891-9fa5-eba516dbc7e4 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:30.837232 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:30.837840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.838130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.838448 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] PATH_INFO: `/v3/domains` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.839102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 06:47:30.839410 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:30.841017 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:30.852990 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4485/8895] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 06:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 06:47:30.857192 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:30.866370 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc840-0d0c-4df8-8151-06fde32396e4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:30.872056 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:30.872650 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.872925 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.873196 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.873853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:30.875755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:30.913809 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4411/8896] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:47:30 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:47:30.918697 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:30.928729 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b1928-4a8f-4faa-835e-07f53d194580 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:30.958371 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:30.987463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:30.987999 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:30.988285 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:30.988581 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:30.989208 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:30.991148 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:31.015623 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4486/8897] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:47:30 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:47:31.019883 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:31.031170 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99430-5fd2-4aa9-a14b-bab324cafdff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:31.035701 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:31.036306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:31.036612 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:31.036892 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:31.037537 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:31.039198 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:31.049559 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4412/8898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:47:31.053549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:31.063795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ddb9-ffd7-4724-9e57-8a46693b8370 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:31.068432 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5c843-d202-4861-a495-832ff8da4c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:31.069026 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5c843-d202-4861-a495-832ff8da4c84 admin admin] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:31.069309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5c843-d202-4861-a495-832ff8da4c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:31.069580 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5c843-d202-4861-a495-832ff8da4c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:31.070251 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5c843-d202-4861-a495-832ff8da4c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:31.072078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5c843-d202-4861-a495-832ff8da4c84 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:31.082781 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4487/8899] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:47:31.087320 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:31.097621 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4a93-15f9-48b3-90f1-79c7d85832c3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:31.102999 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:31.103651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:31.103930 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:31.104206 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] PATH_INFO: `/v3/projects/dc23fd90bfa34b1db7b1422ef22060e7/users/3ac47b7b3e4f4d57bc718d53027b47db/roles/09d7d7b078e14ccfafcd918e3a06fe8a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:31.118926 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc23fd90bfa34b1db7b1422ef22060e7, user_id=3ac47b7b3e4f4d57bc718d53027b47db, role_id=09d7d7b078e14ccfafcd918e3a06fe8a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:31.121543 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:31.133958 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4413/8900] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:47:31 2022] PUT /identity/v3/projects/dc23fd90bfa34b1db7b1422ef22060e7/users/3ac47b7b3e4f4d57bc718d53027b47db/roles/09d7d7b078e14ccfafcd918e3a06fe8a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:47:31.140091 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1ade7-b787-48cd-a26d-a18c61835cd9 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:31.140374 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1ade7-b787-48cd-a26d-a18c61835cd9 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:31.140648 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1ade7-b787-48cd-a26d-a18c61835cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:31.160376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-f7e1ade7-b787-48cd-a26d-a18c61835cd9 None None] MFA Rules not processed for user `f880513b9a944eaeb8e9a0b21dc38a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:47:31.161603 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f7e1ade7-b787-48cd-a26d-a18c61835cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:31.219859 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4488/8901] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:47:31.230225 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:31.231937 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:31.290670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8855-3626-4af5-b977-98ae68be60b9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:31.294470 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:31.295089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:31.295373 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:31.295651 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:31.305092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:31.306601 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:31.316047 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4414/8902] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:35.295253 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.295768 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.295870 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.326823 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] MFA Rules not processed for user `3ac47b7b3e4f4d57bc718d53027b47db`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:47:35.328146 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:35.400952 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4489/8903] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:47:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:47:35.402085 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:35.412195 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4ae3b-617a-4258-97ab-bbdc60a70af2 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:35.418224 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:35.418843 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.419125 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.419403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.420065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:35.421969 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:35.453543 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4415/8904] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 06:47:35 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 06:47:35.455096 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:35.469707 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55663f-06a7-4ada-b289-e97d5b36abb0 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:35.521118 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:35.540278 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:35.540906 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.541185 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.541455 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] PATH_INFO: `/v3/users` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.542103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:35.544119 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:35.566744 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4490/8905] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 06:47:35 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 06:47:35.571836 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:35.578689 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:35.582735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d151e38-6d05-4556-a54f-775dbafcc708 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:35.589307 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:35.590034 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.590429 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.590971 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.592188 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:35.593980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:35.605686 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4416/8906] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:47:35.610127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:35.621279 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ca74-8746-4e1e-93ec-ca6f49f6140d admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:35.625921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:35.626619 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.626899 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.627172 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] PATH_INFO: `/v3/projects/23ab86754e934542b090d6af319003f1/users/f1e99d47a3c541af986ed2e48733c55b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.644073 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ab86754e934542b090d6af319003f1, user_id=f1e99d47a3c541af986ed2e48733c55b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:35.646869 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:35.678998 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4491/8907] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:47:35 2022] PUT /identity/v3/projects/23ab86754e934542b090d6af319003f1/users/f1e99d47a3c541af986ed2e48733c55b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:47:35.685798 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:35.697189 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b908c4-a115-46ef-83c9-3ace5a122dcf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:35.759390 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea8bc-fa5d-4132-8baf-fe67ea4f4676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:35.760022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea8bc-fa5d-4132-8baf-fe67ea4f4676 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.760308 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea8bc-fa5d-4132-8baf-fe67ea4f4676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.760586 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea8bc-fa5d-4132-8baf-fe67ea4f4676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.761238 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea8bc-fa5d-4132-8baf-fe67ea4f4676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:35.762905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea8bc-fa5d-4132-8baf-fe67ea4f4676 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:35.778697 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4417/8908] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 06:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 06:47:35.781522 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:35.794325 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4fcff-858b-4b0e-8a00-160d81ff1393 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:35.800098 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:35.800795 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] REQUEST_METHOD: `PUT` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:35.801104 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:35.801347 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] PATH_INFO: `/v3/projects/23ab86754e934542b090d6af319003f1/users/f1e99d47a3c541af986ed2e48733c55b/roles/14e4a1b541b244baaac32fd3e27cd6d1` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:35.803457 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ab86754e934542b090d6af319003f1, user_id=f1e99d47a3c541af986ed2e48733c55b, role_id=14e4a1b541b244baaac32fd3e27cd6d1)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:35.807142 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:35.823524 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4492/8909] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 06:47:35 2022] PUT /identity/v3/projects/23ab86754e934542b090d6af319003f1/users/f1e99d47a3c541af986ed2e48733c55b/roles/14e4a1b541b244baaac32fd3e27cd6d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:47:40.159519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa657b58-95a9-470b-9a1d-9eb4c742d662 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:40.159988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa657b58-95a9-470b-9a1d-9eb4c742d662 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:40.160092 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa657b58-95a9-470b-9a1d-9eb4c742d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:40.213481 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aa657b58-95a9-470b-9a1d-9eb4c742d662 None None] MFA Rules not processed for user `f1e99d47a3c541af986ed2e48733c55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:47:40.215731 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa657b58-95a9-470b-9a1d-9eb4c742d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:40.317862 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4418/8910] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:47:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:47:40.328266 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:40.331011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:40.475463 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61cf4-07fc-457f-bcd6-a43775f9811c admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:40.495759 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:40.496985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:40.496985 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:40.497217 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:40.563259 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:40.567009 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:40.580530 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4493/8911] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:47:41.651259 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180873-add5-4027-b435-d3176a35849f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:41.651766 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180873-add5-4027-b435-d3176a35849f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:41.651873 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180873-add5-4027-b435-d3176a35849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:41.671900 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2f180873-add5-4027-b435-d3176a35849f None None] MFA Rules not processed for user `3ac47b7b3e4f4d57bc718d53027b47db`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:47:41.673268 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f180873-add5-4027-b435-d3176a35849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:41.681059 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4419/8912] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:47:41.921709 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:41.940361 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:47:41.980001 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c722d-8faf-4da5-9c50-69bce4a24865 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:41.983607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:41.984216 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:41.984499 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:41.984777 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:41.986563 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:42.000454 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:42.001888 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:42.012921 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4494/8913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:42.094710 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180873-add5-4027-b435-d3176a35849f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:42.104643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180873-add5-4027-b435-d3176a35849f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:42.108155 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:42.108757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:42.109037 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:42.109312 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:42.111022 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:42.121519 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:42.123119 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:42.131703 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4420/8914] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:42.458977 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:42.460712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:42.515712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:42.517229 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:42.535133 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3510-71e7-4811-b772-d5d0c7c25b3d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:42.543966 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:42.545003 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:42.545980 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:42.546506 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:42.553769 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:42.578017 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:42.579665 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:42.589052 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd85f45-77f6-49e3-b7e9-8ab0e13a8317 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:42.595024 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:42.595653 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:42.595939 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:42.596395 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:42.596891 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4421/8915] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:47:42.609891 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:42.641289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:42.642840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:42.663679 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4495/8916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:44.581905 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:44.599049 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248373-35d7-48a6-810a-627f875d9ffa service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:44.605126 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:44.606181 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:44.606688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:44.607177 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:44.609265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:44.624688 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:44.626806 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:44.638648 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4422/8917] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:52.327959 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:52.337559 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632feea2-7ebf-4033-acc9-480f70a5d76e service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:52.341114 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:52.341712 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:52.341991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:52.342309 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:52.351034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:52.352965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:52.362279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4496/8918] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:54.219605 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:54.221087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:54.237827 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0bb3-5669-4585-8a09-2e6025aea528 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:54.243564 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:54.244179 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:54.244463 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:54.244733 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:54.246855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:54.259520 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:54.261647 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ed97-1d2a-4637-9f84-a7cdd2a3ad83 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:54.272028 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4423/8919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:47:58.027853 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:47:58.039650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71515-6f8b-457e-ba05-aaf279081f3d service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:47:58.044645 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:47:58.045250 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:47:58.045531 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:47:58.045800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:47:58.047554 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:47:58.059549 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:47:58.061129 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:47:58.071470 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4497/8920] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:47:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:48:04.267501 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:48:08.066904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=63 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:49:55.570421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c845494-0187-494b-bc60-de31085fb903 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:49:55.570989 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c845494-0187-494b-bc60-de31085fb903 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:49:55.571134 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c845494-0187-494b-bc60-de31085fb903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:49:55.591156 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9c845494-0187-494b-bc60-de31085fb903 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:49:55.592374 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9c845494-0187-494b-bc60-de31085fb903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:49:55.652934 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4424/8921] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:49:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:49:55.719380 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:49:55.720859 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:49:55.791512 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f840e80-42e2-4cee-9e7d-aa521680a006 service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:49:55.797246 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:49:55.797921 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:49:55.798236 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:49:55.798515 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:49:55.807474 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:49:55.809102 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:49:55.817662 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4498/8922] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 06:50:05.356065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:50:05.356598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:50:05.356598 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:50:05.378347 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] MFA Rules not processed for user `3ac47b7b3e4f4d57bc718d53027b47db`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:50:05.379845 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:50:05.388290 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4425/8923] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 06:50:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:50:05.813971 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=32 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:50:06.023385 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:50:06.033097 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20be45-2484-4144-aa16-2ac8df253fdc service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:50:06.036774 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:50:06.037376 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:50:06.037659 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:50:06.037934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:50:06.039693 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:50:06.062582 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:50:06.064103 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1ced-27f3-4235-a1b1-1139b5fb0e4a service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:50:06.072007 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4499/8924] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:50:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:50:06.396994 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:50:06.411960 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b49a-bbd5-43f4-8358-01a485cd8e8a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:50:06.420546 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:50:06.421263 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:50:06.421630 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:50:06.421976 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:50:06.423848 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:50:06.438975 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:50:06.441450 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:50:06.460647 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4426/8925] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:50:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:50:07.818637 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:50:07.819137 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:50:07.819331 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:50:07.840858 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:50:07.842289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:50:07.851869 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4500/8926] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:50:07.865446 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:50:07.877617 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f119921-438e-4689-ae1a-695f109aadd9 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:50:07.882818 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:50:07.883515 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:50:07.883868 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:50:07.884220 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:50:07.894137 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:50:07.895838 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:50:07.905055 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4427/8927] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:50:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:50:10.084579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:50:10.107036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fabf2-51b5-412a-822e-447386a863a7 None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:50:10.129034 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:50:10.131583 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:50:10.133995 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:50:10.134320 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:50:10.139157 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:50:10.178187 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:50:10.180067 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:50:10.195305 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4501/8928] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:50:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:50:17.901745 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=40 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:50:20.188941 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=25 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:51:45.740107 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:51:45.778233 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffdc8c-4f54-489b-a67b-df77c76f1fda service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:51:45.781912 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:51:45.783141 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:51:45.783425 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:51:45.783697 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:51:45.785934 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:51:45.805365 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:51:45.806929 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa4ca8-44b0-4dc8-8cec-a9cd68ceefa1 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:51:45.814945 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4428/8929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:51:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:51:55.811359 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=22 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:52:37.461528 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:37.523458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465f22c-6086-49a5-b95c-73dc1782fa34 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:37.529372 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:37.529981 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:37.530289 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:37.530561 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:37.532271 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:52:37.544452 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:37.545944 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:37.556509 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4502/8930] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:52:38.208423 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a740e-5a0c-4c99-8c38-b5176ffce7ba None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:38.208899 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a740e-5a0c-4c99-8c38-b5176ffce7ba None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:38.209065 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a740e-5a0c-4c99-8c38-b5176ffce7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:38.271341 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f44a740e-5a0c-4c99-8c38-b5176ffce7ba None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:52:38.272687 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f44a740e-5a0c-4c99-8c38-b5176ffce7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:52:38.292214 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4429/8931] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 06:52:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:52:38.334965 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:38.356458 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c19e0-ccda-4dc1-8033-56c61e25d8e1 service nova] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:38.361934 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:38.362579 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:38.362856 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:38.363130 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:38.371654 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:38.373240 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:38.382968 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4503/8932] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:52:40.568865 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:40.569944 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:40.570456 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:40.647736 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] MFA Rules not processed for user `d1a59dbd84f94e99ad696d60c25082c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:52:40.648996 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:52:40.741536 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:40.742453 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4430/8933] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 31 06:52:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 06:52:40.756308 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b134d-b3ab-4d70-a074-947f2a552feb service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:40.760615 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928afc18-20b6-4ca2-8411-e6fe1fb756b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1a59dbd84f94e99ad696d60c25082c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:40.761471 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928afc18-20b6-4ca2-8411-e6fe1fb756b3 service glance] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:40.762036 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928afc18-20b6-4ca2-8411-e6fe1fb756b3 service glance] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:40.762599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928afc18-20b6-4ca2-8411-e6fe1fb756b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:40.778063 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928afc18-20b6-4ca2-8411-e6fe1fb756b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:40.779553 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928afc18-20b6-4ca2-8411-e6fe1fb756b3 service glance] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:40.795831 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4504/8934] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:52:47.497670 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:47.524603 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d563f-c26a-4ede-a0e2-f1ad79c17d71 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:47.531421 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:47.532919 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:47.533431 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:47.534228 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:47.544939 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:47.546825 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:47.560113 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4431/8935] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:52:48.105226 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] REQUEST_METHOD: `POST` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:48.105700 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:48.105898 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:48.127334 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.auth.core [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:52:48.128605 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:52:48.135763 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4505/8936] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 06:52:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:52:48.149117 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:48.160923 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed3bc1-b623-4123-837f-716267d28c8c service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:48.165949 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:48.166599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:48.166886 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:48.167183 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:48.176074 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:48.177639 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:48.185736 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4432/8937] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:52:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:52:49.033060 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:49.043340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb91d3-0f5f-4839-9610-5e5898f3d9bf None None] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:49.047200 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:49.048599 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:49.048836 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:49.049168 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:49.056998 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:49.058556 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:49.068434 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4506/8938] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:52:49.935521 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:49.955025 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cae622-fdb5-4ab2-a124-8efbe1d78735 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:49.960858 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f375509-9796-427d-bb89-f7d1d1f34991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:49.962123 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f375509-9796-427d-bb89-f7d1d1f34991 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:49.962610 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f375509-9796-427d-bb89-f7d1d1f34991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:49.963343 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f375509-9796-427d-bb89-f7d1d1f34991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:49.977306 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f375509-9796-427d-bb89-f7d1d1f34991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:49.979071 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f375509-9796-427d-bb89-f7d1d1f34991 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:50.005895 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4433/8939] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:52:51.215834 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:51.225082 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19eb0-239d-4abc-a551-c0a4fd434b19 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:51.228756 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:51.229359 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:51.229642 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:51.229912 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:51.241630 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:51.243105 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:51.255134 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4507/8940] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 06:52:53.689299 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:53.689755 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:53.689853 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:53.725042 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] MFA Rules not processed for user `dac7255e7a4c40ff8be7f90f56aa6f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 06:52:53.726325 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:52:53.733986 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4434/8941] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 06:52:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 06:52:53.747419 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:53.760203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d86e0-3b13-4857-9304-0c909e594926 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:53.765639 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd29fb54e4c484f94a012b821cdb5ae64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:53.766825 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:53.767433 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:53.767847 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:53.778702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:53.780312 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:53.790017 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4508/8942] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 06:52:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 06:52:56.470087 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:56.484355 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bb0b9-61ab-4ee5-93e0-a9ee23eeec01 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:56.491790 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82a0f508316483c92cc7872c1be0ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:56.494362 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:56.494807 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:56.495089 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:56.505855 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:56.507920 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:56.521155 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4435/8943] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:52:57.875753 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:52:57.889702 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172f82-9e33-40a8-a30a-a62f37220af9 service swift] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:52:57.896902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a0be2f91dce4a62aa9d25e95a45925c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:52:57.897620 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:52:57.897904 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:52:57.898451 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:52:57.967908 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:52:57.969491 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:52:57.979256 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4509/8944] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:53:01.032496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:01.032496 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:53:01.044222 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:53:01.067800 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8146fe-5bdf-47cb-a8fc-88f589e5e85f service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:01.074108 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:01.074783 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:01.075104 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:01.075555 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:01.087361 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:01.095289 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:01.104083 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4436/8945] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:53:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:53:01.548011 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:01.554174 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=88 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:53:01.562307 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2d81-ffda-4fe5-8f9f-0f5cdfbeaef9 service neutron] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:01.570139 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:01.571902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:01.571902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:01.571902 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:01.575980 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:53:01.598127 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:01.600597 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:01.612646 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4510/8946] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:53:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:53:05.149676 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:05.166945 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fbe1-f9c3-4892-8bb4-37beb6d7e17c service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:05.174740 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:05.175388 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:05.175669 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:05.175942 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:05.178216 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:53:05.200115 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:05.201973 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:05.216852 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4437/8947] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:53:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:53:05.227840 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:05.283957 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c3513-a8e1-4e7d-b291-da73f1370a6e service placement] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:05.289153 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:05.290038 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:05.290660 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:05.291147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] PATH_INFO: `/v3/users/3ac47b7b3e4f4d57bc718d53027b47db` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:05.293779 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac47b7b3e4f4d57bc718d53027b47db)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:05.296162 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:05.359627 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac47b7b3e4f4d57bc718d53027b47db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.372625 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac47b7b3e4f4d57bc718d53027b47db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.373353 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac47b7b3e4f4d57bc718d53027b47db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.373967 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac47b7b3e4f4d57bc718d53027b47db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.382286 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac47b7b3e4f4d57bc718d53027b47db'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.413096 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4511/8948] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:53:05 2022] DELETE /identity/v3/users/3ac47b7b3e4f4d57bc718d53027b47db => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:53:05.615553 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:05.627742 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc7e8-3eeb-40ae-80d3-147e29e0c66b service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:05.696358 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:05.696993 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:05.697288 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:05.697562 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] PATH_INFO: `/v3/projects/dc23fd90bfa34b1db7b1422ef22060e7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:05.698757 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc23fd90bfa34b1db7b1422ef22060e7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:05.700712 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:05.751867 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc23fd90bfa34b1db7b1422ef22060e7', 'request_id': 'req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.758033 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc23fd90bfa34b1db7b1422ef22060e7', 'request_id': 'req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.767028 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc23fd90bfa34b1db7b1422ef22060e7', 'request_id': 'req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.779440 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] The token cache is being invalidate because project dc23fd90bfa34b1db7b1422ef22060e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:53:05.779735 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.780393 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.782507 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4438/8949] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:53:05 2022] DELETE /identity/v3/projects/dc23fd90bfa34b1db7b1422ef22060e7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:53:05.786800 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:05.788214 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:53:05.801650 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9930be2-8207-4e65-b4cf-73c856000c98 admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:05.863739 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:05.864520 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:05.864804 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:05.865079 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] PATH_INFO: `/v3/users/f1e99d47a3c541af986ed2e48733c55b` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:05.866263 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e99d47a3c541af986ed2e48733c55b)` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:05.868203 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:05.919718 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e99d47a3c541af986ed2e48733c55b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.931167 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:53:05.932504 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e99d47a3c541af986ed2e48733c55b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.933277 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e99d47a3c541af986ed2e48733c55b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.934169 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e99d47a3c541af986ed2e48733c55b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.943835 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.notifications [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e99d47a3c541af986ed2e48733c55b'} {{(pid=82000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:05.960648 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4512/8950] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 06:53:05 2022] DELETE /identity/v3/users/f1e99d47a3c541af986ed2e48733c55b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 06:53:06.139451 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:53:06.141097 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:53:06.154741 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac35a-5ce0-4ffc-bee9-764f6d3e3711 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:53:06.222643 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880513b9a944eaeb8e9a0b21dc38a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f366121cda9844abacd920de806ce5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:53:06.223275 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:53:06.223558 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:53:06.223981 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] PATH_INFO: `/v3/projects/23ab86754e934542b090d6af319003f1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:53:06.225132 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ab86754e934542b090d6af319003f1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:53:06.227084 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:53:06.234340 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:53:06.283983 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ab86754e934542b090d6af319003f1', 'request_id': 'req-93c53842-095a-4416-8881-2ae665d04ccd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:06.292403 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ab86754e934542b090d6af319003f1', 'request_id': 'req-93c53842-095a-4416-8881-2ae665d04ccd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:06.302302 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ab86754e934542b090d6af319003f1', 'request_id': 'req-93c53842-095a-4416-8881-2ae665d04ccd'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:06.326321 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] The token cache is being invalidate because project 23ab86754e934542b090d6af319003f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 06:53:06.326717 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:06.327465 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 06:53:06.329389 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4439/8951] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 06:53:06 2022] DELETE /identity/v3/projects/23ab86754e934542b090d6af319003f1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 06:53:15.953147 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:53:16.319203 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:57:51.408641 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Authenticating user token {{(pid=82000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:57:51.410078 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:57:51.495991 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24a3f-8362-441a-ad48-34de8368a13e admin admin] Validating token access rules against request {{(pid=82000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:57:51.561462 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:57:51.562019 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] REQUEST_METHOD: `GET` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:57:51.562332 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] SCRIPT_NAME: `/identity` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:57:51.562607 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:57:51.564459 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.fernet_utils [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:57:51.576631 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:57:51.578340 n-d-862355-5 devstack@keystone.service[82000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ea01-f5bb-488c-b0dc-5ef1fb0d0a3d service placement] RBAC: Authorization granted {{(pid=82000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:57:51.590279 n-d-862355-5 devstack@keystone.service[82000]: [pid: 82000|app: 0|req: 4513/8952] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:57:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:58:01.585523 n-d-862355-5 devstack@keystone.service[82000]: DEBUG dbcounter [-] [82000] Writing DB stats keystone:SELECT=58 {{(pid=82000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 06:58:07.020120 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 06:58:07.021561 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:58:07.037265 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c53842-095a-4416-8881-2ae665d04ccd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 06:58:07.042986 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02161ca0b0614648b54e7047d767328d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0792e9c5f1dd4b8da9ed5e65fd5b1bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 06:58:07.043611 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 06:58:07.043922 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 06:58:07.044202 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 06:58:07.045988 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 06:58:07.060834 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 06:58:07.062453 n-d-862355-5 devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faff430-cae3-4e01-a888-e94cccb51a79 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 06:58:07.073486 n-d-862355-5 devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4440/8953] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 06:58:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 06:58:17.069599 n-d-862355-5 devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}